Man, thank you very much for the tip!
I didn’t know about optical flow. Now, even the ties coming around the castle are smoother!
For those interested, here’s a new link.
https://drive.google.com/file/d/1rlq4IBxaaX6cWvdPlPQttfvaKCIdYtwS/view?usp=sharing