Fallout 4 is definitely the way to go. The amount of stuff you can do in that game is mind-boggling and mods are now available on the console versions.
I agree that Fallout 3 sets a way better atmosphere and I think it also has a better story. Fallout: New Vegas has a nice blue sky and everything has colour rather than a green tint. It shouldn’t even be a debate though because they’re all great.
I tried playing the original fallout games because I got them on the cheap on steam but I didn’t really get into them.