OK I dug into this. It appears this is most easily accomplished with Matrix, as it allows many-to-many audio chats. I asked for a quote. ;P