If you ride on sand or gravel, the tires may pick up debris that will scrape on the fork crown or brake bridge. Other than that, if the tires don't otherwise drag on the frame anywhere it shouldn't be a problem.