Kołczan KsiążekStrona głównaZałóż konto Zaloguj się

Data Engineering with Azure Databricks. Design, build, and optimize scalable data pipelines and analytics solutions with Azure Databricks Dmitry Foshin, Dmitry Anoshin, Tonya Chernyshova - Wydania

1 wydanie

Data Engineering with Azure Databricks. Design, build, and optimize scalable data pipelines and analytics solutions with Azure Databricks Dmitry Foshin, Dmitry Anoshin, Tonya Chernyshova

Wydawnictwo: Packt Publishing (Z chęcią przeczytam książkę w języku polskim)

ISBN: 978-18-0610-636-3

ISBN bez myślników: 9781806106363

Typ okładki: Softcover

Liczba stron: 1

Język: polski (Polska)

Dostępne w innych językach

Profil książkipolski

Data Engineering with Azure Databricks. Design, build, and optimize scalable data pipelines and analytics solutions with Azure Databricks Dmitry Foshin, Dmitry Anoshin, Tonya Chernyshova

Dmitrij Foshin

Data Engineering with Azure Databricks is your essential guide to building scalable, secure, and high-performing data pipelines using the powerful Databricks platform on Azure. Designed for data engineers, architects, and developers, this book demystifies the complexities of Spark-based workloads, Delta Lake, Unity Catalog, and real-time data processing. Beginning with the foundational role of Azure Databricks in modern data engineering, you’ll explore how to set up robust environments, manage data ingestion with Auto Loader, optimize Spark performance, and orchestrate complex workflows using tools like Azure Data Factory and Airflow. The book offers deep dives into structured streaming, Delta Live Tables, and Delta Lake’s ACID features for data reliability and schema evolution. You’ll also learn how to manage security, compliance, and access controls using Unity Catalog, and gain insights into managing CI/CD pipelines with Azure DevOps and Terraform. With a special focus on machine learning and generative AI, the final chapters guide you in automating model workflows, leveraging MLflow, and fine-tuning large language models on Databricks. Whether you're building a modern data lakehouse or operationalizing analytics at scale, this book provides the tools and insights you need.