I have always made it a rule for me if I am going to sit down and watch a DVD, I will never fast forward through any scene.
Although when I watch the Prequels, I do start fast forwarding once the opening crawl appears on screen, and continue fast forwarding until the ending credits come up. :)