You can just take a taxi.

Just be aware that when you want to go back into town, it could be that some taxi drivers will try to rip you off. That is especially the case with ethnic Indian drivers.
Insist that they use the meter. Sometimes even that will not help, since some taxi drivers will fake their meters. Perhaps compare what you paid to go to the Batu caves with what you paid to get back to town.

Just arrange with a cab driver to take you and wait. We agreed a return price with our guy before we even went to the Batu caves. Took a bit of haggling but got an ok price in the end.

We visited the caves by bus. Cheaper than a taxi and just as quick. The buses were frequent and stop just outside the entrance to the caves. BTW, I have used taxis many times in KL and can't say I have ever had the same experience as Amin with taxi drivers, whether the drivers were " ethnic Indian" or any other ethnicity. Having said that, with only three days in KL, I don't think I would bother with the caves.

It's a well known problem in KL, that ethnic Indian taxi drivers are less honest than other drivers. Everybody in KL knows it.