I am so glad I read this! All these years I have assumed that the Siri volume was the same as the media playback volume, but they are separate.
Now I need to figure out how to make Siri speak quieter on my HomePod.
Edit: it works. Thanks! In fact, you could start using Siri right now.