With folding bikes, you could hop on Amtrak's Capitol Limited. If you plan it right, you could have time to explore Harper's Ferry and then catch a train to spend the night in Cumberland. Probably other options, as well.

Wouldn't skip the beginning part out of DC, because of the interesting sights along the way, like downtown DC and Great Falls.