I'm with RidgeShark...I think you're working backwards. By trying to use filters to get rid of the "big" damage first, it's eliminating the subtle detail like rock textures, thinking that that stuff is damage as well.
By going through and getting rid of major issues manually, you're starting out with a better base image for the filters to work on, so they won't have to be set to such extreme levels to do their job.