I think it won't be as bad as you think.
Keep in mind that moving objects always pull your focus. So even though the still might seem 'cluttered' or whatever, in motion that will diminish.
The overall background replacements have been great improvements, and this will be as well.