Only one active speaker when in-call on speakerphone

I notice that when I use speakerphone when in a call, only the bottom speaker is active, the top doesn't have any sound at all? Anyone else notice this?