Kafka Connect: Build and Run Data Pipelines - Softcover

Maison, Mickael; Stanley, Kate

Softcover

ISBN 10: 109812653X ISBN 13: 9781098126537

Publisher: O'Reilly Media, 2023

Synopsis

Used by more than 80% of Fortune 100 companies, Apache Kafka has become the de facto event streaming platform. Kafka Connect is a key component of Kafka that lets you flow data between your existing systems and Kafka to process data in real time.

With this practical guide, authors Mickael Maison and Kate Stanley show data engineers, site reliability engineers, and application developers how to build data pipelines between Kafka clusters and a variety of data sources and sinks. Kafka Connect allows you to quickly adopt Kafka by tapping into existing data and enabling many advanced use cases. No matter where you are in your event streaming journey, Kafka Connect is the ideal tool for building a modern data pipeline.

• Learn Kafka Connect's capabilities, main concepts, and terminology
• Design data and event streaming pipelines that use Kafka Connect
• Configure and operate Kafka Connect environments at scale
• Deploy secured and highly available Kafka Connect clusters
• Build sink and source connectors and single message transforms and converters

About this title

About the Author

Mickael Maison is a principal software engineer at Red Hat, a committer and chair of the project management committee (PMC) for Apache Kafka.
 
Kate Stanley is a principal software engineer at Red Hat, a technical speaker, and a Java Champion.

From the Back Cover

Kafka Connect is an awesome tool for building reliable and scalable data pipelines. As part of the Apache Kafka streaming platform, Kafka Connect allows you to easily get data into and out of your Kafka clusters and even mirror data between clusters. With this practical guide, you'll learn how to build powerful pipelines without writing a single line of code.

Authors Mickael Maison and Kate Stanley show data engineers, site reliability engineers, and application developers how to build pipelines between Kafka clusters and a variety of data sources and sinks. Kafka Connect allows you to quickly adopt Kafka by tapping into existing data and enabling many advanced use cases. No matter where you are in your event streaming journey, Kafka Connect is the ideal tool for building modern data pipelines.

This book shows you how to:

• Design resilient and efficient data pipelines by combining core Kafka Connect components
• Capture database changes, build data lakes, and mirror Kafka clusters using existing connectors
• Deploy, configure, and operate Kafka Connect clusters in production environments
• Use logs and metrics to continually monitor Kafka Connect clusters
• Run Kafka Connect clusters on Kubernetes
• Write your own connectors and plug-ins

Edition details

• Publisher: O'Reilly Media
• Publication date: 2023
• Language: English
• ISBN 10: 109812653X
• ISBN 13: 9781098126537
• Binding: Paperback
• Edition number: 1
• Number of pages: 400