I hope you do go off the beaten path, although there are some places on the beaten path worth going to. Museo Nacional Reina Sofía in Madrid is worth going to and it is free on certain days/hours. I am currently living not far from it and enjoy going there from time to time. The best time to visit is 2:00pm or so, Spanish standard lunch hour. It's got a great bookstore too.