Enterprise Data Workflows with Cascading
O'Reilly Media, Inc, USA (Verlag)
9781449358723 (ISBN)
Working with sample apps based on Java and other JVM languages, you’ll quickly learn Cascading’s streamlined approach to data processing, data filtering, and workflow optimization. This book demonstrates how this framework can help your business extract meaningful information from large amounts of distributed data.
- Start working on Cascading example projects right away
- Model and analyze unstructured data in any format, from any source
- Build and test applications with familiar constructs and reusable components
- Work with the Scalding and Cascalog Domain-Specific Languages
- Easily deploy applications to Hadoop, regardless of cluster location or data size
- Build workflows that integrate several big data frameworks and processes
- Explore common use cases for Cascading, including features and tools that support them
- Examine a case study that uses a dataset from the Open Data Initiative
Paco Nathan is a Data Scientist at Concurrent, Inc., and heads up the developer outreach program there. He has a dual background from Stanford in math/stats and distributed computing, with 25+ years experience in the tech industry. As an expert in Hadoop, R, predictive analytics, machine learning, natural language processing, Paco has built and led several expert Data Science teams, with data infrastructure based on large-scale cloud deployments. He has presented twice on the AWS Start-Up Tour, and gives talks often about Hadoop, Data Science, and Cloud Computing.
Chapter 1 Getting Started
Programming Environment Setup
Example 1: Simplest Possible App in Cascading
Build and Run
Cascading Taxonomy
Example 2: The Ubiquitous Word Count
Flow Diagrams
Predictability at Scale
Chapter 2 Extending Pipe Assemblies
Example 3: Customized Operations
Scrubbing Tokens
Example 4: Replicated Joins
Stop Words and Replicated Joins
Comparing with Apache Pig
Comparing with Apache Hive
Chapter 3 Test-Driven Development
Example 5: TF-IDF Implementation
Example 6: TF-IDF with Testing
A Word or Two About Testing
Chapter 4 Scalding—A Scala DSL for Cascading
Why Use Scalding?
Getting Started with Scalding
Example 3 in Scalding: Word Count with Customized Operations
A Word or Two about Functional Programming
Example 4 in Scalding: Replicated Joins
Build Scalding Apps with Gradle
Running on Amazon AWS
Chapter 5 Cascalog—A Clojure DSL for Cascading
Why Use Cascalog?
Getting Started with Cascalog
Example 1 in Cascalog: Simplest Possible App
Example 4 in Cascalog: Replicated Joins
Example 6 in Cascalog: TF-IDF with Testing
Cascalog Technology and Uses
Chapter 6 Beyond MapReduce
Applications and Organizations
Lingual, a DSL for ANSI SQL
Pattern, a DSL for Predictive Model Markup Language
Chapter 7 The Workflow Abstraction
Key Insights
Pattern Language
Literate Programming
Separation of Concerns
Functional Relational Programming
Enterprise vs. Start-Ups
Chapter 8 Case Study: City of Palo Alto Open Data
Why Open Data?
City of Palo Alto
Moving from Raw Sources to Data Products
Calibrating Metrics for the Recommender
Spatial Indexing
Personalization
Recommendations
Build and Run
Key Points of the Recommender Workflow
Appendix Troubleshooting Workflows
Build and Runtime Problems
Anti-Patterns
Workflow Bottlenecks
Other Resources
Index
Colophon
| Erscheint lt. Verlag | 27.8.2013 |
|---|---|
| Zusatzinfo | black & white illustrations, black & white line drawings, black & white tables, figures |
| Verlagsort | Sebastopol |
| Sprache | englisch |
| Maße | 178 x 233 mm |
| Gewicht | 295 g |
| Einbandart | kartoniert |
| Themenwelt | Mathematik / Informatik ► Informatik ► Datenbanken |
| ISBN-13 | 9781449358723 / 9781449358723 |
| Zustand | Neuware |
| Informationen gemäß Produktsicherheitsverordnung (GPSR) | |
| Haben Sie eine Frage zum Produkt? |
aus dem Bereich
