Yes, fixed gear isn't for everyone. But for many of us it is a blast - once we get past the reflex to coast. And that can be a challenge. I learned fast. The hard way. At 20 mph. I locked my knee as I waited for several cars to pass so I could take a left turn. Got shot several feet into the air and collapsed onto the road at close to zero speed with a left leg that felt like raw hamburger. Now I tell fixed gear newbies to start out with their seat lowered most of 1/2"; low enough that you cannot possibly lock your knee. Now when you try to coast, you do no real damage. Some muscle tear but no long term damage and no crash, just a painful reminder. Do this a couple or few times and your body learns. At that point you can bring your seat back up to normal.
Consider giving it another go.
Ben