Hydrolix, the company transforming the economics of log data with its streaming data lake platform, is unveiling a new Apache Spark connector that democratizes the power of Databricks to customers’ ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Databricks has announced that, in collaboration with industry partners, it has broken the world record in the CloudSort Benchmark, a third-party industry benchmarking competition for processing large ...

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Databricks and Hugging Face have collaborated to introduce a new feature ...

There is no shortage of big data sets in the healthcare world, encompassing everything from chest X-rays to drug research. Startups and established companies alike are both using artificial ...

What I'd like to cover here goes beyond those AI headlines, however, and involves a special nugget just for folks doing data engineering, analytics and machine learning work with Apache Spark.

Databricks Inc. today agreed to acquire Tabular Technologies Inc., developer of a universal storage platform based on the Apache Iceberg standard. The move signals stepped-up efforts by Databricks to ...

At its Data + AI Summit, Databricks today made the requisite number of announcements one would expect from a company’s flagship developer event. Among those are the launch of Delta Lake 2.0, the next ...