when I sit down next to a friend of mine who's about 5', my head ends up lower than theirs. at meals I'm always feel like a child because I'm always having to look up at other people

That said, I rode the CAAD5 once in a 52cm as well, with the stem up, and it fitted like a dream!