The first thing I gave up was fried foods, fast food and soda. I have not eaten a fast food cheeseburger or had a coke in a couple of years. I don't miss the soda's, but crave a cheeseburger every once in a while - and will grill one on occasion -but the convenience of a drive through double cheeseburger is out of the equation.
I did not give up grains completely - just refined grains. I will still eat whole grains on occasion - oatmeal, wild rice, quinoa...
However, the best thing I did for weight loss, was keeping a food log. I used the "lose-it" app as well, and liked it. It takes very little time, and gives you a budget of calories for the day and adjusts that with exercise. Just seeing the food on paper that have eaten throughout the day, helps keep you driven towards you goal, and helps keep you honest as well.