Which tyre is faster depends on your average speed.
Is your average speed around 20 mph -> go for 23's.
Is your average speed around 15 mph -> stick with 28's.
Is your average speed around 10 mph -> go for 35's.

A 23 will not make you faster if you do not go fast enough and it will be less comfortable and less grippy in turns.