I moved to the Japanese country side about 18 years ago for the same reason of it's a beautiful place to raise a family. At work I earn probably as much as I did in high school and I feel fortunate that the land is so cheap. When I went to nostrasia the people I met were not privileged but highly skilled individuals from all races.
Sorry to hear about your experience, maybe the barrier to get to Japan keeps many out or they are all located in Tokyo where it is expensive.