Uma análise de implementações de arquitetura orientada a domínios de dados (data mesh): casos, fatos e desafios

Abstract

The Domain-Driven Data Architecture, or Data Mesh, was formalized a few years ago in the heart of a large technology consultancy group and is currently getting increasing interest in the industry. Nevertheless, there is a lack implementation cases review focusing on challenges in order to determine for which corporate scale and business scenarios it fits better. That is precisely the main goal of this work. Thus, a systematic review of the theoretical concepts of Data Mesh Architecture was sought, as well as elements that integrate it with the fundamental concepts of Information Management and Data Governance. For the empirical part, we interviewed technology professionals who implement or are implementing it in Brazil and abroad for organizations from different industrial and service sectors. It was realized a best fit for larger organizations where there is a multiplicity of data sources and data use cases. Data-driven companies, where the organizational culture is horizontal, where more business process owners, managers and their delivery teams feel empowered to lead business processes and innovation by their own, tend to suffer less difficulties. Although a shallow reading may lead to conclusion that Data Mesh arises in contrast to traditional data architecture patterns such as Data Warehouses and Data Lakes, in fact the pattern proves to be flexible in integrating these pieces of architecture in the Mesh, if necessary, in order to enable the democratization of data for business processes and corporate innovation.