I frequently cycle over the border, either way. Just have your passport.
However, I usually cross at a small border crossing without a large bridge, etc.
The only problem might be if you have any food, like lunch. They probably won't
let you cross with a sandwich or a sub, pizza etc.