That's the thing, J, it does it very randomly. Sometimes it doesn't happen for a few seconds and then it happens 3 times in one second and it is different with each encode. I'm pretty sure this is not a framerate problem.
And yes, whichever way you look at it, this is indeed a team effort.