Another option is to use a corkscrew in one of the holes in the cap, to pull the cap off. It won't go in very far, but it just needs to be far enough that the corkscrew won't immediately pull out of the hole. Take care not to mar the plastic cap, if possible, although that's just a cosmetic issue.