Is it possible to install and run chrome headless on a headless Linux box without installing the audio and xorg dependencies?
If not, then is there a special headless build of chrome/chromium which doesn't pull xorg and audio libs?
This troubleshooting doc on puppeteer should be of some help (https://github.com/GoogleChrome/puppeteer/blob/master/docs/troubleshooting.md), it oultlines all the package necessary for running Chrome on a linux machine (more specifically for web servers).
Depending on your end-goal, I wrote a service that provides access to headless Chrome at https://browserless.io. More or less treats Chrome in hosted fashion, so you don't have to try and get it running yourself, which is a time consuming process.
In any case, hope one of those helps!