That's why I think you should go with my idea about having them around in their own story but never having them with the main characters but as outside observers to the main events of the movies. Therefore, they serve the same function you want, but it gets rid of the plausibility of them always being connected to the same group of people.