Airspace is primarily a matter of zoning law.

In crowded, urban areas and areas close to major airports; or can be lower.

Rule of thumb has been 500 feet but that's up for a lot of debate.