I'll throw in my 2 cents. First off it's still a bad move riding brakeless when you're not used to it at all, things happen and just cause you can skid doesn't mean that much. Though you didn't tackle things (aka decents) that you knew you couldn't so you don't seem like that much of an "idiot".
As far as the question at hand, I've always thought of it as this way. If you want the maximum results from your effort go clipless (training etc.), if you're using it more to get around & have a good time get clips.