Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Databricks and Hugging Face have collaborated to introduce a new feature ...

What I'd like to cover here goes beyond those AI headlines, however, and involves a special nugget just for folks doing data engineering, analytics and machine learning work with Apache Spark.

At its Data + AI Summit, Databricks today made the requisite number of announcements one would expect from a company’s flagship developer event. Among those are the launch of Delta Lake 2.0, the next ...

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More The summer has barely started, but MongoDB World and Snowflake Summit are ...

AI data engineering startup acquisition brings ETL and Spark automation in-house Microsoft has bought Osmos, an AI-assisted ...

Two years in the making, Apache Spark 2.0 will officially debut in a few weeks from Databricks Inc., which just released a technical preview so Big Data developers could get their hands on the "shiny ...

SAN FRANCISCO, June 11, 2025 /PRNewswire/ --Data + AI Summit -- Databricks, the Data and AI company, today announced it is open-sourcing the company's core declarative ETL framework as Apache Spark™ ...