Edit: I decided to use the internal speakers of the TV, as they are not as bad as I remembered them. So this is no longer an issue for me.

I connected the Series S console to my secondary display, a bigger and old TV from 2010 via HDMI. I use the TVs audio output to connect it with my speakers AUX input, so I can use the same speakers used by my PC. Everything is fine, besides the console is a bit too loud. It always outputs at 100% volume and I have to volume down my speakers with the knob. Sounds reasonable, but then my PC gets too much muted, even on 100% output from PC. Changing the volume on the TV just changes the output for its own internal speakers.

Ideally I would like to control the volume for audio output from XBOX. But it seems not to have any such settings. Any idea what I can do?

Background: I got the console from my brother and played a bit around with it back then. It's been 3 years since I used the console last. As a Linux PC Gamer, there are times when I can't play certain games. In such cases a console could help, because I do not want to install Windows. I have an old account and it was painful to get it all running again, with back and forth of accounts, emails and pins and passwords. Modern gaming.