Spoke tension should hold it in place.

As long as there aren't any cracks in the aluminum around it, you should be fine.