Building Medallion Architectures : Designing With Delta Lake and Spark

To deliver the insights that give them a competitive advantage, organizations increasingly turn to the proven Medallion architecture. Yet implementing a robust data architecture can be difficult, particularly when it comes to using the Medallion architecture's Bronze, Silver, and Gold layers—done wrong, it can hamper your ability to make data-driven decisions. This practical guide helps you build a Medallion architecture the right way with Azure Databricks and Microsoft Fabric.

Drawing on hands-on experience from the field, Piethein Strengholt demystifies common assumptions and complex problems you'll face when embarking on a new data architecture. Architects and engineers of all stripes will find answers to the most typical questions along with insights from real organizations about what's worked, what hasn't, and why.

You'll learn:

• Learn how to build a Medallion architecture with Azure Databricks and Microsoft Fabric
• Gain insights from three real case studies that illustrate practical field experience and lessons learned
• Explore scaling considerations, including governance, security, generative AI, and more
• Make informed decisions when designing or implementing new data architectures
• Get proven patterns for success that align with broader organizational objectives

Piethein Strengholt is the chief data officer for Microsoft Netherlands. He acts as a counterpart to CDOs and is a driving force in the community and the product group. Piethein is also a prolific blogger and regularly speaks about the latest trends in data management, including the data mesh concept, data governance, and strategy at scale.