Just to clarify, I don’t mean just physical media, I also mean digital media that you own. Bandcamp is awesome in this regard. I can see why The Caretaker has refused to release his albums on Spotify or Apple Music.
I don’t consider digital media to be something that you ever really own, but if it works for you, it works for you. I just bought Quincy Jones’ “The Dude” off of eBay even though most of my listening will come from the rips for my iPod. I’ll mostly use the CD when I’m driving around in my Toyota, but at least I’ll have the disc in case Apple declares my tech “obsolete” with a simple update. That’s what works for me.