I'd get a
Primus Classic canister stove. Cheap, lightweight, sturdy, reliable and works with canisters from other brands except Bleuet. You don't need to leave the canister on when not in use. I believe Primus sells an optional stand/hose to put the canister off to the side so you can use a wind breaker.