Real-World Hadoop by Dunning, Ted -- Read -- Imperial Library of Trantor

Index

Real-World Hadoop Dedication Preface

How to Use This Book

1. Turning to Apache Hadoop and NoSQL Solutions

A Day in the Life of a Big Data Project From Aadhaar to Your Own Big Data Project What Hadoop and NoSQL Do When Are Hadoop and NoSQL the Right Choice?

2. What the Hadoop Ecosystem Offers

Typical Functions Data Storage and Persistence Data Ingest

Apache Kafka Apache Sqoop Apache Flume

Data Extraction from Hadoop Processing, Transforming, Querying

Streaming Micro-batching Batch Processing Interactive Query

Impala Apache Drill Apache Spark

Search Abuse—Using Search and Indexing for Interactive Query Visualization Tools

Integration via ODBC and JDBC

3. Understanding the MapR Distribution for Apache Hadoop

Use of Existing Non-Hadoop Applications Making Use of a Realtime Distributed File System Meeting SLAs Deploying Data at Scale to Remote Locations Consistent Data Versioning Finding the Keys to Success

4. Decisions That Drive Successful Hadoop Projects

Tip #1: Pick One Thing to Do First Tip #2: Shift Your Thinking Tip #3: Start Conservatively But Plan to Expand Tip #4: Be Honest with Yourself Tip #5: Plan Ahead for Maintenance Tip #6: Think Big: Don’t Underestimate What You Can (and Will) Want to Do Tip #7: Explore New Data Formats Tip #8: Consider Data Placement When You Expand a Cluster Tip #9: Plot Your Expansion Tip #10: Form a Queue to the Right, Please Tip #11: Provide Reliable Primary Persistence When Using Search Tools Tip #12: Establish Remote Clusters for Disaster Recovery Tip #13: Take a Complete View of Performance Tip #14: Read Our Other Books (Really!) Tip # 15: Just Do It

5. Prototypical Hadoop Use Cases

Data Warehouse Optimization Data Hub Customer 360 Recommendation Engine Marketing Optimization Large Object Store Log Processing Realtime Analytics Time Series Database

6. Customer Stories

Telecoms What Customers Want Working with Money Sensor Data, Predictive Maintenance, and a “Time Machine”

A Time Machine

Manufacturing

Extending Quality Assurance

7. What’s Next? A. Additional Resources

Additional Publications

About the Authors Colophon Copyright