tl;dr Turn your computer volume down, you're fine.
Here's how digital volume control (like the one your computer uses) works:
Digital resolution is limited by the bit depth. As the volume increases or decreases, the digital signal has to round it to fit one of the values the bit depth can resolve, and this rounding creates noise (called "quantization noise"). The more bits, the smaller the volume steps and the less rounding, so less noise. It turns out that each bit lowers the noise floor by -6 dB. 16-bit signals have a quantization noise floor of -96 dB, and 24-bit signals have -144 dB.
The problem is, since this noise floor is determined by the bit depth, it will not go down when you turn the digital volume down, like the noise introduced by an amp will. So if you have a 16-bit file and turn the volume down by -10 dB (1/2 the volume), the peak signal that was 96 dB above the digital noise floor is now only 86 dB above it. The signal-to-noise ratio was reduced by -10 dB as well. This is why people recommend using the analog volume control.
This is made moot by the fact you're probably not listening much louder than 80 dB, and your room's ambient volume is likely around 30 to 50 dB, and you're probably not even getting 96 dB of signal-to-noise ratio from your gear anyway.
Plus, if you're using your DAC in 24-bit mode, you have 8 extra bits to use for volume control. Meaning you could lower the volume by 48 dB (that's about 1/28 the volume) in the digital realm without reaching the noise floor of the 16-bit file you're playing, or the noise floor of your equipment. Digital volume control will only matter if you're raising the noise floor above the rest of your noise, and you're not realistically going to do that.
So turn down your computer volume, you're fine.