A pawpaw should be comparable is size to the crab apple. Much smaller than any oak that I know of.

I bet there's a woodworker near you that would love to have oak logs and especially the trunk so they can make beautiful things out of it.