The work commenced in 2020 around Project Zen with the goal of providing a more, ah, soothing and copasetic experience for Python coders writing Spark jobs. Project Zen has already resulted in better ...

Apache Spark 3.0 is now here, and it’s bringing a host of enhancements across its diverse range of capabilities. The headliner is an big bump in performance for the SQL engine and better coverage of ...