my recommendation would depend on how fast your group rides and the ferry schedule (and which ones you wanted to catch)
from my place in saanich, north sidney (the marinas) is about 30km...the ferry terminals are about 5-7km. so it's pretty doable....