I actually heard a Q&A podcast of Neil Tyson where he actually touches this and what you say actually is on point.
Discussion
Interesting never heard him say anything on this.
https://open.spotify.com/episode/6JfcVV6c3G5j0PCkAo5yGU?si=5UhNozcLSlStSDDB9ZVPIQ&t=2345
Check out this question. His comment in it is very interesting. Not 100% the same but some concepts play in with what you said, imo.