I hate riding without a brake. I feel like I have to ride much slower and worry about skidding, which I don't like to do. I ride a track specific bike but I bought a fork for it that is drilled for a brake. If you are building up the bike from scratch this might be the best way to go. While I agree that brakeless riders are usually perfectly capable of riding safely, I wouldn't ever want to give up my comfort of riding for the sake of either being cool or riding a particular kind of bike. When I ride brakeless I feel much happier with a lower gear (< 65 gear inches) and this also contributes to me going slower. What is the point of going slow on a fast bike?