Oh totally. I've since edited my last post to make it clear I'm not downplaying how difficult it would be. I just think that with all ady has planned such as new mattes and backgrounds, zooming in shots to tighten the focus, I think it would be very possible to remove Yoda for much of the film.
Of course, ady probably won't even go for the idea, but I think he definitely should consider it if it's possible.