If that piece does have something to do with the suspension (if it somehow controls the cushiness of it, I mean), wouldn't tightening it be a bad idea (given that I am very happy with the ride of the bike)?

I think I am going to have to take it into the shop b/c I honestly can't tell what is loose/spinning.