For me, speakerphone goes on temporarily if I need multiple people to be able to both listen and speak to an existing conversation.

Otherwise, they join the call on their own devices.

I find holding a phone up to my cheek really annoying though; I could see secondary exceptions for people with wireless headphones whose batteries had just died.