If the chainrings are riveted on, it is a cheap bike and not worth buying parts for. lock the derailer in the middle chain ring and leave it. Once you have done that, you can shorten the chain slightly to reduce chain slap. If you want to remove the derailer completely, you will want a new unramped or narrow/wide chainring to prevent dropping the chain on the extreme ends of the cassette.