What size of li-ion battery? If these are AA size such as Energizer E2 then you can swap them in but you may not see a huge benefit from using them other than that the lithium batteries weigh about half as much as similar size NiMH.
The li-ion and lipo batteries I usually see are 3.6V or a multiple of that if this is the case, it is a bad idea.