The closest I ever came was with Erasure. I had every album from the beginning up to Union Street, minus The Two Ring Circus, on CD. After that, I just stopped collecting albums of anything and periodically downloaded individual songs.
I’m in the same boat except I have The Two Ring Circus and I stopped at Chorus.
Their next album, the eponymous Erasure, is so different from all others, yet remains my favorite to this day. You shoulda gotten one more before quitting. 😉