It's not something I would do, but I see no real problem with it. As long as you're just using the bike to cruise around at low speeds. Having the bars that far back might make your handling odd.
I think the real question is: do you want them further back, or do you just want them higher?