No problem at all. I routinely go out for 30+ milers (even did a century last summer) on the fixed. The areas also can be very remote. It is afterall still just a bike. Get a good overall use gear installed and hills will not be an issue.

Go for it.