I guess it's only natural that most people wants this pass by shot to have the same grain quality and sharpness as the surrounding footage. That's why most optical effects were digitally recomposited for the SE in the first place. But the extra layer of grain is part of the effects technology of the time, many optical effects were even done to look as good as possible with this extra layer of grain in mind. If you remove it you're just doing the effect a disservice, removing the environment this effect were meant to occupy, the softer and grainier look helps mask any shortcomings. If you're ok with that, why not remove the matte-lines as well?