Yes. If your devices have balanced interfaces, then it will run quite nicely
https://www.epanorama.net/blog/2021/04/17/xlr-over-cat-567/

If interfaces are unbalanced then you need audio balun on both ends. Audio isolation transformers work quite ok for this as passive circuit.

For digital SPDIF signal video baluns will usually work OK.

“▶️Interfacing with cat6 – it’s just a 100Ohm Transmission line, right? I’m guessing if I want isolation, Ethernet transformers won’t work?)”

Ethernet transformers work well only for signals at frequency range used for Ethernet, typically starts from 100 kHz and goes up to 10-100 MHz or more.

For analog audio you want audio transformers that can handle audio frequencies. 600:600 ohm transformers work OK.

But it is not nowadays always better to use coax. For example typical high quality baluns connected to CAT5/CAT6 UTP can outperform coax on longer runs on signal details compared to cheap RG59 coax. Good UTP + balun can provide lower high frequency attenuation and be less susceptible to many noise sources for example for composite video signal.

It depends on the video signal type and coaxial cable properties when coax or UTP would perform better.
There is place for both coax and UTP solutions in video systems.