Because if the speaker wasn't on you couldn't yell out to hang up the phone when your modem starting saying "Hello? Hello?"

There was also a sense of relief when the handshake went well & the white noise took over.