I prefer having them to not having them. Keep tweaking them until they feel right.
If I had it to do again, I'd get some like
these:
They look as if they'd be comfortable, and I've read good reviews. My bar ends are aluminum and much longer, and I don't use all that length.