Ok... let's take that argument even further: What if what I consider desirable is to spend all my time and money hunting exotic endangered animals?

Or even more extreme: What if someone desires to spend all their time/money/energy killing people.

They should be free to do that?

At some point, morality HAS to come into the picture, and you have to do what's right. The only real argument seems to be where to draw that line.