Keep in mind USB was never intended to be power outlet. It contained a power line in order to power small peripherals; not to recharge stuff. The USB chip on the computer is usually not capable of supplying much current.

If you want to charge faster get a powered USB hub; or, even better, use a USB wall charger (just remember to unplug it when you are not using it, otherwise it will waste energy as a phantom load).