It adds a cluster manager, notebooks, dashboards, jobs, and integration with third-party apps, to the free open source Spark distribution. Databricks provides several sample notebooks for ML problems.

With the new partnership with RStudio, Databricks is acknowledging that data scientists want to work in their own environments. It follows on earlier work to support SparklyR in Databricks notebooks.