+1 with @noglider, I ended up changing the chain which had stretched and everything's working smoothly now. But if you do have to change the crankset, change the chain and cassette as well since anything that's worn out will seriously decrease the life of the other components.