Most Japanese swords should be slingable so you can carry it across your back, even if the sheath was not designed for such use. I would check with local ordinances concerning things like this as in some places edged weapons of this length are prohibited weapons.

Now...if you were carrying a claymore (Scottish broadsword) it might be a little more difficult...