Move data modeling upstream

We will see a lot of data modeling move upstream away from batch modeling in a cloud data warehouse (Modern Data Stack) to the producer continuously generating domain events instead. Why? “Source-aligned business events are not modeled or structured like the source application’s transactional database; an anti-pattern is often observed, particularly when events are sourced through Change Data Capture tooling or Data Virtualization on top of the application’s database.” Zhamak Dehghani describes this very well in the fourth chapter of Data Mesh (great read, recommend it) and it resonates very well with me....

August 13, 2021 · 1 min · Robert Sahlin

Is data mesh only for large organisations?

Is data mesh only for large organisations? Many data mesh authorities argue that is the case. But I disagree, it isn’t primarily about company size at all, in fact a data mesh can be even more suitable in a scale up than an enterprise. Why? IMO the maturity for a data mesh is rather based on: Pace of change in the analytical system. Degree of decentralization of the operational system....

August 13, 2021 · 2 min · Robert Sahlin