I started modifying my eating slightly, mostly portion control (I am a boring eater) but I also cut out sugars and most bread products.
You're much farther along than most dieters. Ultimately, successfully losing weight is a lifestyle change; the choices on what to eat and how much to eat (as well as when to exercise) come from a lifestyle choice. A paleo diet doesn't hurt either.