Data Engineering with Apache Spark, Delta Lake, and Lakehouse: Create scalable pipelines that ingest, curate, and aggregate complex data in a timely and secure way
Language: English
Published by Packt Publishing, 2021
- Softcover
- Used
Condition: Used - Very good
US$ 35.68
Quantity: 1 available
Add to basketItem description from seller
Gut/Very good: Buch bzw. Schutzumschlag mit wenigen Gebrauchsspuren an Einband, Schutzumschlag oder Seiten. / Describes a book or dust jacket that does show some signs of wear on either the binding, dust jacket or pages.
Seller Inventory # M01801077746-V
- Title
- Data Engineering with Apache Spark, Delta Lake, and Lakehouse: Create scalable pipelines that ingest, curate, and aggregate complex data in a timely and secure way
- Author
- Manoj Kukreja
- Publisher
- Packt Publishing
- Publication year
- 2021
- Condition
- very good
- Binding
- Soft cover
- Language
- English
- ISBN 10
- 1801077746
- ISBN 13
- 9781801077743
Understand the complexities of modern-day data engineering platforms and explore strategies to deal with them with the help of use case scenarios led by an industry expert in big data
Key Features
- Become well-versed with the core concepts of Apache Spark and Delta Lake for building data platforms
- Learn how to ingest, process, and analyze data that can be later used for training machine learning models
- Understand how to operationalize data models in production using curated data
Book Description
In the world of ever-changing data and schemas, it is important to build data pipelines that can auto-adjust to changes. This book will help you build scalable data platforms that managers, data scientists, and data analysts can rely on.
Starting with an introduction to data engineering, along with its key concepts and architectures, this book will show you how to use Microsoft Azure Cloud services effectively for data engineering. You'll cover data lake design patterns and the different stages through which the data needs to flow in a typical data lake. Once you've explored the main features of Delta Lake to build data lakes with fast performance and governance in mind, you'll advance to implementing the lambda architecture using Delta Lake. Packed with practical examples and code snippets, this book takes you through real-world examples based on production scenarios faced by the author in his 10 years of experience working with big data. Finally, you'll cover data lake deployment strategies that play an important role in provisioning the cloud resources and deploying the data pipelines in a repeatable and continuous way.
By the end of this data engineering book, you'll know how to effectively deal with ever-changing data and create scalable data pipelines to streamline data science, ML, and artificial intelligence (AI) tasks.
What you will learn
- Discover the challenges you may face in the data engineering world
- Add ACID transactions to Apache Spark using Delta Lake
- Understand effective design strategies to build enterprise-grade data lakes
- Explore architectural and design patterns for building efficient data ingestion pipelines
- Orchestrate a data pipeline for preprocessing data using Apache Spark and Delta Lake APIs
- Automate deployment and monitoring of data pipelines in production
- Get to grips with securing, monitoring, and managing data pipelines models efficiently
Who this book is for
This book is for aspiring data engineers and data analysts who are new to the world of data engineering and are looking for a practical guide to building scalable data platforms. If you already work with PySpark and want to use Delta Lake for data engineering, you'll find this book useful. Basic knowledge of Python, Spark, and SQL is expected.
Table of Contents
- The Story of Data Engineering and Analytics
- Discovering Storage and Compute Data Lakes
- Data Engineering on Microsoft Azure
- Understanding Data Pipelines
- Data Collection Stage - The Bronze Layer
- Understanding Delta Lake
- Data Curation Stage - The Silver Layer
- Data Aggregation Stage - The Gold Layer
- Deploying and Monitoring Pipelines in Production
- Solving Data Engineering Challenges
- Infrastructure Provisioning
- Continuous Integration and Deployment (CI/CD) of Data Pipelines
"Synopsis" may belong to another edition of this title.
About the Author
"About the title" may belong to another edition of this title.
Shipping rates from Germany to U.S.A.
| Item | 10 to 20 business days | 10 to 20 business days |
|---|---|---|
| First item | US$ 11.22 | US$ 22.44 |
Payment methods
Store description
**WILLKOMMEN** im AbeBooks Shop von medimops - dein Onlineshop mit der größten Auswahl an Second Hand Büchern. Stöber dich durch über 4 Millionen Artikel und spare bis zu 70 % im Vergleich zum Neupreis. Wir prüfen alle Artikel sorgfältig auf Qualität und Funktionalität. **WELCOME** to the medimop's AbeBooks shop, the online shop with a large range of second-hand books. Browse more than 4 million articles and save up to 70% on the new price. All our articles are quality checked. ** BIENVENUE ** dans la boutique AbeBooks de momox shop! Spécialiste des articles culturels d'occasion, nous vous offrons une gamme diversifiée de livres d'occasion. Découvrez nos offres et économisez jusqu'à 70% du prix neuf! Nous grarantissons tous nos articles en bon état. ** BENVENUTI ** nello shop medimops di AbeBooks, lo shop online per i libri usati. Abbiamo piu´di 4 milioni di articoli e potete risparmiare fino al 70% rispetto al nuovo. Tutti i nostri prodotti sono controllati a mano per garantire la massima qualità. ** BIENVENIDO ** a la tienda de medimops en AbeBooks, la tienda online con una gran oferta de libros de segunda mano. Navegue por más de 4 millones de artículos y ahorre hasta un 70% sobre el precio nuevo. Todos nuestros artículos son de calidad comprobada. …
Seller's business information
momox SE
Schreiberhauer Straße 30
Berlin, Germany 10317
Terms of sale
1. Scope
For all orders via our store on the AbeBooks Marketplace, the following terms and conditions apply. Unless otherwise agreed, the inclusion of any terms and conditions of your own used by you is contradicted.
2. contracting party, conclusion of contract, correction options
The purchase contract is concluded with momox SE.
The subject of the contract is the sale of goods.
If an article is posted by us on AbeBooks, the activation of the offer page on AbeBooks is the binding offer to conclude a contract under the conditions contained in the article page.
The presentation of the products in the online store does not constitute a legally binding offer, but a non-binding online catalog. You have the option to complete the ordering process via the shopping cart system or the buy now function. You can initially place our products in the shopping cart without obligation and correct your entries at any time before submitting your binding order by using the correction tools provided and explained for this purpose in the order process. By clicking the order button you make a binding offer for the goods contained in the shopping cart. By pressing the button "Buy now" an order is automatically created, which will be sent to the delivery address you have provided and for which a payment is made with the specified payment method.
The confirmation of receipt of your order will be sent by e-mail immediately after sending the order. We accept your order within 2 days by us or AbeBooks on our behalf submitting/issuing a declaration of acceptance or shipping confirmation in a separate email or, if applicable, the payment transaction is carried out by the service provider or the selected payment service provider. The time of execution of the payment transaction depends on the respective selected payment method (see under "Payment"). The relevant alternative for you depends on which of the listed events occurs first.
3. contract language, contract text storage
The language(s) available for the conclusion of the contract: German
We store the text of the contract on our systems, which, however, are not accessible to you.
However, you have the possibility to view your last orders via your AbeBooks account. The full text of the contract is not accessible there.
4. delivery conditions
Shipping costs will be added to the indicated product prices. You can find out more about the amount of the shipping costs at the offers.
5. payment
The payment processing is done by AbeBooks. You can pay the invoice amount by credit card.
6. retention of title
The goods remain our property until full payment.
7. transport damage
If goods are delivered with obvious transport damage, please complain about such defects to the deliverer as soon as possible and contact us immediately. Failure to make a complaint or contact us has no consequences for your legal claims and their enforcement, especially your warranty rights. However, they help us to be able to assert our own claims against the carrier or the transport insurance.
8. warranty
The statutory liability for defects shall apply.
Customer service: Phone number: 0049 (0) 30/488288200
9 a.m. to 6 p.m., e-mail: service@momox-shop.uk
9. liability
For claims based on damage caused by us, our legal representatives or vicarious agents, we shall always be liable without limitation - in the event of injury to life, limb or health - in the event of intentional or grossly negligent breach of duty - in the event of warranty promises, insofar as agreed, or - insofar as the scope of application of the Product Liability Act is opened. In the event of a breach of essential contractual obligations, the fulfillment of which is a prerequisite for the proper execution of the contract and the observance of which the contractual partner may regularly rely on (cardinal obligations) due to slight negligence on our part, on the part of our legal representatives or vicarious agents, liability shall be limited to the amount of the damage foreseeable at the time of the conclusion of the contract, the occurrence of which must typically be expected. Otherwise, claims for damages are excluded.
10. dispute resolution
The European Commission provides a platform for online dispute resolution (ODR), which can be found here: https://ec.europa.eu/consumers/odr/. Consumers have the possibility to use this platform for the settlement of their disputes.
To settle disputes arising from a contractual relationship with a consumer or whether such a contractual relationship exists at all, we are obliged to participate in dispute resolution proceedings before a consumer arbitration board. The responsible body is the Universalschlichtungsstelle des Bundes am Zentrum für Schlichtung e.V., Straßburger Straße 8, 77694 Kehl am Rhein, www.verbraucher-schlichter.de. We will participate in a dispute resolution procedure before this body.
11. protection of minors
If your order includes goods whose sale is subject to age restrictions, we ensure that the customer has reached the required minimum age by using a reliable procedure involving a personal identity and age check. The delivery person will hand over the goods only after the age check has been carried out and only to the customer in person.
Delivery to packing stations is not possible in this case.