Yeah you're right; PNG is a good example, but it's got ubiquitous support in comparison to .flac, so I wasn't sure if it was a perfect fit.

Ogg is actually an interesting one. It's a container not a codec. This is kind of getting into the weeds here, so I hope it's not TMI. It can contain multiple video and audio streams including flac data inside it. Kind of like mp4 container files in that way.

However, most people usually mean "ogg vorbis" or "ogg opus" when they say ogg, which are lossy formats. It's very comparable to mp3, but higher quality and generally better than mp3. You still sacrifice some compatibility though. Opus' main strength is that it's open licence and very low latency and medium-high quality. Ideal for streaming, video games, and music performances. Vorbis is just the older version of Opus, so it's a bit worse but more widely supported.

Aac is another popular codec, you'll see it commonly in m4a files from iTunes. It's again lossy, but higher quality than mp3. Extremely good support, almost as good as mp3.

You might also find ALAC from iTunes which is Apple's own lossless thing, basically only runs on Apple devices with some limited support outside the ecosystem.

In my humble opinion, mp3 is actually the worst codec for a personal music library, unless compatibility is your #1 priority. Most websites you buy music from let you choose other formats as well, like Bandcamp. Apple music does not, but their files always have a very high bitrate so it's ok. I always recommend flac if you can get it / run it, then wav, then ogg opus/vorbis, then aac, and finally high bitrate mp3. Low bitrate mp3 is a last resort 😂

Those are the main ones you're likely to encounter, unless I'm forgetting something. If you're interested in reading more, there's a good comparison on Wikipedia between different audio formats.

I'm not an "audiophile", but I do video and audio editing stuff as a hobby and some musician stuff too, so I probably notice these things more than others. It might be a fun idea if you're keen to download ffmpeg or Audacity and just mess around with different codecs and bitrates to experience the differences first hand.