The closest I ever came was with Erasure. I had every album from the beginning up to Union Street, minus The Two Ring Circus, on CD. After that, I just stopped collecting albums of anything and periodically downloaded individual songs.
I’m in the same boat except I have The Two Ring Circus and I stopped at Chorus.