Storm Applied: Strategies for Real-Time Event Processing

Summary

Storm Applied is a practical guide to using Apache Storm for the real-world tasks associated with processing and analyzing real-time data streams. This immediately useful book starts by building a solid foundation of Storm essentials so that you learn how to think about designing Storm solutions the right way from day one. But it quickly dives into real-world case studies that will bring the novice up to speed with productionizing Storm.

Summary

Storm Applied is a practical guide to using Apache Storm for the real-world tasks associated with processing and analyzing real-time data streams. This immediately useful book starts by building a solid foundation of Storm essentials so that you learn how to think about designing Storm solutions the right way from day one. But it quickly dives into real-world case studies that will bring the novice up to speed with productionizing Storm.

About the Technology

It's hard to make sense out of data when it's coming at you fast. Like Hadoop, Storm processes large amounts of data but it does it reliably and in real time, guaranteeing that every message will be processed. Storm allows you to scale with your data as it grows, making it an excellent platform to solve your big data problems.

About the Book

Storm Applied is an example-driven guide to processing and analyzing real-time data streams. This immediately useful book starts by teaching you how to design Storm solutions the right way. Then, it quickly dives into real-world case studies that show you how to scale a high-throughput stream processor, ensure smooth operation within a production cluster, and more. Along the way, you'll learn to use Trident for stateful stream processing, along with other tools from the Storm ecosystem.

This book moves through the basics quickly. While prior experience with Storm is not assumed, some experience with big data and real-time systems is helpful.

What's Inside

• Mapping real problems to Storm components
• Performance tuning and scaling
• Practical troubleshooting and debugging
• Exactly-once processing with Trident

About the Authors

Sean Allen, Matthew Jankowski, and Peter Pathirana lead the development team for a high-volume, search-intensive commercial web application at TheLadders.

Table of Contents

1. Introducing Storm
2. Core Storm concepts
3. Topology design
4. Creating robust topologies
5. Moving from local to remote topologies
6. Tuning in Storm
7. Resource contention
8. Storm internals
9. Trident

Sean T. Allen has worked in software for over 20 years. He works as Principal Architect for TheLadders. He is one of the developers of Redline Smalltalk; an implementation of the Smalltalk programming language that runs on the JVM. You can often follow Sean on Twitter at @SeanTAllen.

Matthew Jankowski has been involved in the development of software systems for over 10 years. Throughout his career, he has participated in a wide variety of projects, with a majority of the focus on the development of RESTful web services. He has spent the last two years integrating Storm into TheLadders and continues to search for new use cases for Storm within the company.

Peter Pathirana is a Lead Software Engineer at TheLadders.com at the vanguard of the Recommendations platform architecture. He has over 10 years of experience in designing comprehensive solutions for hard problems and he enjoys tinkering with Storm, Elastic Search, Solr, and RabbitMQ for starters.