Second Crellston--collectivos are very inexpensive and fun to ride. Even tours and taxis are--or were--inexpensive. I hired a taxi to take me to a couple of archaeological sites that are not on the standard SV tours and it was around US$30 for the day.

It's at least double nowadays, dwdvagamundo! Still better than hiring a car.

Any hotel can help you with taxis if you don't want to negotiate on your own.

sottovoce is headed for Huaraz, apparently..in a rental car!