Hi Harmy:
Are you using After Effects CS5 or later? If so, have you played with the Roto-brush tool? It can do a pretty good job of taking some of tedium out of roto work. You can find tutorials and demos of how to use it all over the web. Most of the stuff I do is shot greenscreen, but for what you're doing the roto brush could be a timesaver.
In what color space are you working? HDTV (Rec. 709)?
Keep up the good work.
Shawn