Aerospoke wheels are known for being heavy, and I've heard and read several times times that they're not particularly aerodynamic. I've only heard this from people who dislike fixies, so there could be more going on than meets the eye. But I've never been passed by anyone riding an aerospoke.
Also, for the type of riding you do, it sounds like aero wheels probably aren't worth your money.