Beyond the Lakehouse

Why Organizational Evolution is Key to Data Success Why Data Projects Fail: A Call for Change in Organizational and Process Thinking In the race to solve data challenges, many companies rush to adopt new technologies such as Lakehouse architectures, believing they are the magic bullet. However, the frequent failure of data projects shows that technology alone cannot fix organizational and process issues that are deeply entrenched in outdated, centralized structures. While enterprises often focus on the latest tools and platforms, they overlook the importance of evolving their organizational culture and processes to be agile and distributed—essential traits for thriving in today’s data-driven landscape. ...

October 17, 2024

Iceberg Catalog

The TIP of your Lakehouse TL;DR The Iceberg Catalog landscape is evolving rapidly with significant announcements from Snowflake and Databricks. Adding to this vibrant ecosystem, HANSETAG introduces TIP, a Rust-native Iceberg REST Catalog that prioritizes data quality, governance, and flexibility. It innovates with change events, contract validation, and multi-tenancy — all in a lightweight, customizable solution. In recent days, seismic shifts have reverberated through the data landscape. Notably, Snowflake announced their open-source Iceberg REST catalog, Polaris , while Databricks acquired , Tabular.io - the pioneering company behind Apache Iceberg. Not stopping there, Databricks also open-sourced Unity Catalog – with Iceberg REST (read) support. It seems that these days, to be taken seriously as a Data Company, you need to open-source your Iceberg Catalog implementation. ...

June 18, 2024