Some bikes and wheels claim a forward lift from side wind, even wind coming more from the front. Probably minuscule compared to the total.
Riding with a group means you loose draft in a side wind. Definitely slows you down.
Solo it seems to wear on me psychologically more, which in turn cuts into my speed. I encounter side wind enough that it affects my equipment choice; no aero-profile wheels, low-trail steering geometry.