I didn't care until i got my Walkman A35 and Grado Labs SR80e.
While growing up i hated digital files because they sounded like crap, all i could get my hands on were 128kbps with limewire. When i started working as a live audio tech for my schools occupational program I got tired of carrying my 64 disc folder and the damn thing scratching the CDs. I decided to get a Creative labs Zen Jukebox that started my downward spiral of music hoarding. After a few years I discovered lossless and started filling up ipod after ipod, I blame having studio equipment readily available for me wanting better quality audio.
Fast forward to '13 and I am discovering 24bit and DSD. By '15 my ipod's battery was shot from having it plugged into my gf's car stereos usb all the time, so i had to look for a replacement. I found out about sony's Walkman coming back as a digital player and I decided to look into it. When I got it right away I could hear a difference in the internet's album Ego Death. The difference between the 16bit my ipod could play and the 24bit my walkman could play was like night and day.
Now a days I usually go for the highest quality I can get especially, vinyl rips in 192khz or DSD. I do agreee that cd quality and AAC 320kbps is good enough on the go, thats why i have my LG V60 filled with 40k AAC files. But when I plan to just relax at home that's when i'll bust out the Walkman and my Grado Labs, or sometimes I'll hook up my 2tb music collection to my LG V30. But thats what I feel Hi-Res is for, when you want to sit down and listen to your music. If you never plan to do that then yeah higher quality music wont make a difference to your ears.
So yeah for me, the higher the better please.
The I missed one song on that NPR audio quality test, that Jay Z song. No surprise since that song only used digital samples.