Harmy said:
...it doesn't really matter, if it mistakenly erases other details, like stars and stuff like that, since I would then only utilize the cleaned up version for manual cleanup in After Effects.
Ah, sorry. My reading comprehension is pretty bad at times. RemoveDirt might be the way-to-go then.
Try it with its default values on a dirty sample clip you have. Post here and I can more-or-less help you in real time.