I don’t care who’s smarter, nor am I certain that my understanding is correct. Spark’s documentation doesn’t reveal much about the technical details, so I can only arrive at a conclusion that makes sense to me based on the information I’ve read. Perhaps I’m wrong, and I welcome anyone to point out my mistakes.

However, if the assumption is that I’m simply biased or haven’t made the effort to understand, then there’s nothing more for me to say. After all, I’m under no obligation to investigate this, and I’ve already done more than I needed to.