It would make it so that Finn wanted to join the First Order, which in and of itself wouldn’t make sense.
And brainwashing can happen at any age, either way there would be a level of brainwashing happening. I feel like we’re just looking for excuses to not care about people dying, which… I dunno. Kinda goes against the “empathy” argument to me.