It probably just needs to be tightened down. Don't overdo it but it looks like you underdid it. I ran into a bike mechanic on a tour who told me that square taper cranksets are prone to failure. I don't think that's true but it's clear that a lot of people tighten them down properly.

Be careful; if you run that crank arm loose, you're likely to ruin it.