Well, last time I went riding, I almost bit it because my rear wheel turned out to be loose when I was going off of a jump

So after that, I decided to check my wheels each time I went out riding (which I should've done in the first place).
My question is, how tight is tight? It's not a quick-release. What would happen if I tightened it too much?