With Apache Spark Declarative Pipelines, engineers describe what their pipeline should do using SQL or Python, and Apache Spark handles the execution.

Databricks One was launched on a hectic day for the company, which also debuted a new agentic AI platform called Mosaic Agent ...