It won't matter, they probably just want you to be in a group with swimmers you are equal with. That way you won't hold up faster swimmers behind you, and you won't get kicked in the face by slower swimmers in front of you.

But, you are right. It's a time trial, your time starts when you do.