Spark 4.0 is official! 🎉 Scala 2.13 and JDK 17 are the new defaults! It also supports the SQL pipe syntax, so you can do e.g. 'FROM customer |> JOIN orders ON ... |> AGGREGATE COUNT ...' #scala #spark #sql https://spark.apache.org/releases/spark-release-4-0-0.html