Is it actually fast over a long distance if you're dependent on the wind going the right direction that day?

Has me wondering how far a person could fly if dropped from the highest height possible without being in orbit.