A lot of long stuff can be safely strapped to the top tube of the bike, and isn't much of a bother. Especially if you have a vintage bike with a level top tube

If you're doing it a lot, you might also be able to find a gun case the sword would fit inside of, and lash the gun case to the bike. Thus, all you would have to do is unzip and remove the sword.