I think it depends on your priorities.

If you can enjoy riding, knowing you will get dropped with the current group just find a different group to ride with.

If it is very important, you should train harder and smarter, get a power meter, do intervals (which I think are torture btw) and maybe even a coach.