Index

A note on the digital index

A link in an index entry is displayed as the section title in which that entry appears. Because some sections have multiple index markers, it is not unusual for an entry to have several links to the same section. Clicking on any link will take you directly to the place in the text in which the marker appears.

A

accidental complexity, Complexity, More So Than Bigness, Comparing with Apache Hive, Functional Relational Programming

actors, Why Use Scalding?

actual parameters, Comparing with Apache Pig

ad hoc queries, Complexity, More So Than Bigness, Comparing with Apache Hive, Cascalog Technology and Uses

Alex Guazzelli, Technology Roadmap for Pattern

Alex Payne, A Word or Two about Functional Programming

Algebird, A Word or Two about Functional Programming

Amazon, Enterprise Data Workflows, A Word or Two About Testing

Anand Rajaraman, Technology Roadmap for Pattern

Ant, Example 1 in Cascalog: Simplest Possible App

anti-pattern, Scrubbing Tokens, Functional Relational Programming, Anti-Patterns

Apache Hadoop, Programming Environment Setup

Apache Hive, Complexity, More So Than Bigness, Comparing with Apache Hive, Cascalog Technology and Uses

Apache Pig, Complexity, More So Than Bigness, Comparing with Apache Pig, A Word or Two about Functional Programming

assembly language, Why Use Scalding?

Avi Bryant, A Word or Two about Functional Programming

Avro, Flow Diagrams

AWS, Running on Amazon AWS, Build and Run

B

BackType, Why Use Cascalog?, Cascalog Technology and Uses

BaseOperation, Example 3: Customized Operations

Bash, Predictability at Scale

behavioral targeting, Personalization

best practices, Complexity, More So Than Bigness, Origins of the Cascading API, Predictability at Scale, Scrubbing Tokens, Example 6: TF-IDF with Testing, Example 6 in Cascalog: TF-IDF with Testing

Boris Chen, Kudos

Bossie 2012 Award, A Word or Two about Functional Programming

branch, Example 5: TF-IDF Implementation, Example 6 in Cascalog: TF-IDF with Testing

Brian Carper, Cascalog Technology and Uses

C

Cascading email list, Build and Run, Getting Started with Scalding, Literate Programming, Other Resources

Cascading user group, Build and Run

Cascalog, Enterprise Data Workflows, Origins of the Cascading API, Getting Started with Cascalog

Cascalog email list, Getting Started with Cascalog

Cassandra, Flow Diagrams

Cay Horstmann, A Word or Two about Functional Programming

Chas Emerick, Cascalog Technology and Uses

checkpoints, Example 6: TF-IDF with Testing, Example 6: TF-IDF with Testing, A Word or Two About Testing, Example 6 in Cascalog: TF-IDF with Testing

Chris Reade, Separation of Concerns

Chris Severs, Kudos, Example 3 in Scalding: Word Count with Customized Operations

Chris Wensel, Origins of the Cascading API

Christophe Grand, Cascalog Technology and Uses

Christopher Alexander, Pattern Language

ClassNotFoundException, Example 3 in Scalding: Word Count with Customized Operations

Clojure, Origins of the Cascading API, Why Use Cascalog?, Getting Started with Cascalog

closures, Example 6 in Cascalog: TF-IDF with Testing

Conjars, Programming Environment Setup, Build and Run

conservatism, Complexity, More So Than Bigness, Cascading Taxonomy, Comparing with Apache Pig

continuous integration, Build and Run

Costin Leau, Kudos, A Word or Two about Functional Programming

Cygwin, Programming Environment Setup, Build and Runtime Problems

D

DAG, Cascading Taxonomy, Flow Diagrams, Flow Diagrams, Example 3 in Scalding: Word Count with Customized Operations, Functional Relational Programming

data provenance, Flow Diagrams

data serialization, Flow Diagrams

Datalog, Cascalog Technology and Uses

Dave Astels, A Word or Two About Testing

DB2, Cascalog Technology and Uses

Dean Wampler, Kudos, A Word or Two about Functional Programming, A Word or Two about Functional Programming

Debasish Ghosh, A Word or Two about Functional Programming

declarative programming, Cascalog Technology and Uses

developer community, Build and Run, Getting Started with Scalding, Getting Started with Cascalog

distributed cache, Stop Words and Replicated Joins

DJ Patil, A Word or Two About Testing

DMG, Pattern, a DSL for Predictive Model Markup Language

DML, Origins of the Cascading API, Comparing with Apache Pig

Donald Knuth, Separation of Concerns

Donna Kidwell, Kudos

DOT file, Example 2: The Ubiquitous Word Count, Flow Diagrams

DSL, Origins of the Cascading API, Why Use Scalding?, A Word or Two about Functional Programming, Why Use Cascalog?, Why Use Cascalog?, Lingual, a DSL for ANSI SQL

E

Each, Example 2: The Ubiquitous Word Count

eBay, Enterprise Data Workflows, A Word or Two About Testing, Example 3 in Scalding: Word Count with Customized Operations, A Word or Two about Functional Programming

Edgar Codd, Why Use Cascalog?, Functional Relational Programming

Elastic MapReduce, Running on Amazon AWS

elision, Literate Programming

EMR, Build and Run

EMR Ruby client, Running on Amazon AWS

Eric Ries, Complexity, More So Than Bigness

ETL, Flow Diagrams, Predictability at Scale, Comparing with Apache Hive, Example 6 in Cascalog: TF-IDF with Testing

Etsy, A Word or Two about Functional Programming

F

Facebook, Complexity, More So Than Bigness, A Word or Two About Testing

Factual, Cascalog Technology and Uses

fat jar, Getting Started with Scalding, Example 3 in Scalding: Word Count with Customized Operations, Build Scalding Apps with Gradle, Example 1 in Cascalog: Simplest Possible App, Build and Run

Filter, Stop Words and Replicated Joins

flow diagram, Flow Diagrams, Example 3 in Scalding: Word Count with Customized Operations

FlowDef, Example 1: Simplest Possible App in Cascading

Frank Buschmann, Pattern Language

FRP, Functional Relational Programming

Function, Example 3: Customized Operations

functional programming, Why Use Scalding?, A Word or Two about Functional Programming, Why Use Cascalog?

G

geohash, Moving from Raw Sources to Data Products

Gephi, Cascalog Technology and Uses

Girish Kathalagiri, Kudos

Git, Programming Environment Setup, Getting Started with Scalding, Getting Started with Cascalog, Example 1 in Cascalog: Simplest Possible App, City of Palo Alto

GitHub, Programming Environment Setup

Google, A Word or Two About Testing, Why Use Scalding?, Key Insights

Gradle, Programming Environment Setup, Build and Run, Build and Run, Example 6: TF-IDF with Testing, Getting Started with Scalding, Example 3 in Scalding: Word Count with Customized Operations, Build Scalding Apps with Gradle, Example 1 in Cascalog: Simplest Possible App, Cascalog Technology and Uses

GroupBy, Example 2: The Ubiquitous Word Count, Example 3 in Scalding: Word Count with Customized Operations

Grunt, Comparing with Apache Pig

H

Hadoop client, Example 1: Simplest Possible App in Cascading

Hans Dockter, Kudos

Hans Peter Luhn, Stop Words and Replicated Joins

Hans Rohnert, Pattern Language

Harvard, Cascalog Technology and Uses

HBase, Flow Diagrams

Homebrew, Build and Runtime Problems

I

Impatient series, Kudos, Programming Environment Setup, Example 6: TF-IDF with Testing, Example 3 in Scalding: Word Count with Customized Operations, A Word or Two about Functional Programming, Example 1 in Cascalog: Simplest Possible App

imperative programming, Example 4 in Cascalog: Replicated Joins

InfoWorld, A Word or Two about Functional Programming

Ivy, Example 1 in Cascalog: Simplest Possible App

J

J2EE, Complexity, More So Than Bigness, Comparing with Apache Pig

Jack Olson, Integrating with Desktop Tools

James Warren, Cascalog Technology and Uses

Jason Levitt, Kudos

Java, Enterprise Data Workflows, Programming Environment Setup

JavaDoc, Example 1: Simplest Possible App in Cascading, Example 5: TF-IDF Implementation

Jeffrey Dean, Key Insights

Jeffrey Ullman, Technology Roadmap for Pattern

Joiner, Stop Words and Replicated Joins

JRuby, A Word or Two about Functional Programming

Julian Hyde, Kudos, Lingual, a DSL for ANSI SQL, Integrating with Desktop Tools

JUnit, Example 6: TF-IDF with Testing

JVM, Complexity, More So Than Bigness

K

Kent Beck, A Word or Two About Testing, A Word or Two About Testing

Kyro, Flow Diagrams

L

left outer join, Stop Words and Replicated Joins, Example 4 in Scalding: Replicated Joins, Example 4 in Cascalog: Replicated Joins

Leiningen, Why Use Cascalog?, Getting Started with Cascalog, Example 1 in Cascalog: Simplest Possible App, Build and Run

levels of detail, Origins of the Cascading API

liberalism, Complexity, More So Than Bigness

Lingual, Enterprise Data Workflows, Lingual, a DSL for ANSI SQL

LinkedIn, A Word or Two About Testing

Linkfluence, Cascalog Technology and Uses

Lisp, Why Use Cascalog?

logic programming, Cascalog Technology and Uses

logical plan, Comparing with Apache Pig

Lucene, Origins of the Cascading API, Example 5: TF-IDF Implementation

Luke VanderHart, Cascalog Technology and Uses

Lumosity, Cascalog Technology and Uses

M

machine data, Enterprise Data Workflows

machine learning, Comparing with Apache Hive

Martin Fowler, Pattern Language

Matrix API, Origins of the Cascading API, A Word or Two about Functional Programming

Matthew McCullough, Build and Run

Maven, Build and Run, Build and Run, Example 3 in Scalding: Word Count with Customized Operations, Build Scalding Apps with Gradle, Getting Started with Cascalog, Example 1 in Cascalog: Simplest Possible App

Memcached, Enterprise Data Workflows, Flow Diagrams

Michael Stal, Pattern Language

Midje, Example 6 in Cascalog: TF-IDF with Testing

Mondrian, Lingual, a DSL for ANSI SQL

Murray Silverstein, Pattern Language

N

Nathan Marz, Getting Started with Cascalog, Cascalog Technology and Uses, Functional Relational Programming

natural language, Stop Words and Replicated Joins

Neo4j, Cascalog Technology and Uses

Nicholas Goodman, Integrating with Desktop Tools

Nokia, Cascalog Technology and Uses

Nutch, Origins of the Cascading API

O

OOP, Functional Relational Programming

Operations, Example 3: Customized Operations, Scrubbing Tokens

Optiq, Lingual, a DSL for ANSI SQL

Oracle, Cascalog Technology and Uses

Oscar Boykin, A Word or Two about Functional Programming

P

PageRank, Why Use Scalding?

partition file, Build and Run

Pattern, Enterprise Data Workflows, Kudos, Pattern, a DSL for Predictive Model Markup Language

pattern language, Origins of the Cascading API, Example 2: The Ubiquitous Word Count, Flow Diagrams

Paul Lam, Example 1 in Cascalog: Simplest Possible App

Peter Sommerlad, Pattern Language

physical plan, Complexity, More So Than Bigness, Cascading Taxonomy, Comparing with Apache Pig

plumbing, Origins of the Cascading API, Example 1: Simplest Possible App in Cascading, Example 2: The Ubiquitous Word Count, Why Use Scalding?

PMML, Enterprise Data Workflows, Pattern, a DSL for Predictive Model Markup Language

principle: fail the same way twice, Cascading Taxonomy

principle: plan far ahead, Origins of the Cascading API

principle: same JAR, any scale, Build and Run

principle: specify what you require, not how it must be achieved, Getting Started with Cascalog, Functional Relational Programming

principle: wants no surprises, Complexity, More So Than Bigness, Comparing with Apache Hive, Example 1 in Cascalog: Simplest Possible App

probabilistic data structures, A Word or Two about Functional Programming

Prolog, Cascalog Technology and Uses

Python, Complexity, More So Than Bigness, Predictability at Scale, Comparing with Apache Hive

R

RegexSplitGenerator, Scrubbing Tokens

Regine Meunier, Pattern Language

regular expression, Example 2: The Ubiquitous Word Count, Scrubbing Tokens, Comparing with Apache Pig, Example 6: TF-IDF with Testing, Example 4 in Cascalog: Replicated Joins

relational model, Flow Diagrams, Stop Words and Replicated Joins, Comparing with Apache Hive, Why Use Cascalog?, Functional Relational Programming

REPL, Why Use Cascalog?, Getting Started with Cascalog

replicated join, Stop Words and Replicated Joins, Example 4 in Scalding: Replicated Joins, Recommendations

Retain, Example 3: Customized Operations

Ruby, Complexity, More So Than Bigness, Getting Started with Scalding

S

S3, Running on Amazon AWS, Build and Run

s3cmd, Running on Amazon AWS

s3n protocol, Running on Amazon AWS

Sam Ritchie, Example 6 in Cascalog: TF-IDF with Testing

Sanjay Ghemawat, Key Insights

Sara Ishikawa, Pattern Language

SBT, Getting Started with Scalding, Example 1 in Cascalog: Simplest Possible App

Scala, Origins of the Cascading API, Why Use Scalding?, Getting Started with Scalding

Scalding, Enterprise Data Workflows, Origins of the Cascading API, Getting Started with Scalding

separation of concerns, Separation of Concerns

Serguey Boldyrev, Kudos

SimpleDB, Running on Amazon AWS

simplest possible app, Example 1: Simplest Possible App in Cascading, Getting Started with Scalding, Example 1 in Cascalog: Simplest Possible App

sketches, Why Use Scalding?

software development lifecycle, Complexity, More So Than Bigness

Sonatype, Build and Run

sparse data, Stop Words and Replicated Joins

spatial indexing, Spatial Indexing

Spring-Hadoop, A Word or Two about Functional Programming

SQL, Enterprise Data Workflows, Enterprise Data Workflows, Complexity, More So Than Bigness, Complexity, More So Than Bigness, Example 1: Simplest Possible App in Cascading, Comparing with Apache Hive, Why Use Cascalog?, Cascalog Technology and Uses

staffing costs, Enterprise Data Workflows, Complexity, More So Than Bigness

staging cluster, Build and Run

Steve Yegge, Complexity, More So Than Bigness

stream assertions, Example 6: TF-IDF with Testing, A Word or Two About Testing, Example 6 in Cascalog: TF-IDF with Testing

streaming algorithms, A Word or Two about Functional Programming

Stuart Evans, Kudos

Stuart Sierra, Cascalog Technology and Uses

Sujit Pal, A Word or Two about Functional Programming

system integration, Enterprise Data Workflows

T

tap identifier, Flow Diagrams, Example 3 in Scalding: Word Count with Customized Operations

test-driven development, Enterprise Data Workflows, Comparing with Apache Pig, Example 6: TF-IDF with Testing, A Word or Two About Testing, A Word or Two About Testing, Example 6 in Cascalog: TF-IDF with Testing

text analytics, Scrubbing Tokens

TextDelimited, Example 1: Simplest Possible App in Cascading, Example 3 in Scalding: Word Count with Customized Operations, Example 1 in Cascalog: Simplest Possible App

TF-IDF, Example 5: TF-IDF Implementation, Example 6 in Cascalog: TF-IDF with Testing

The Climate Corporation, Complexity, More So Than Bigness, Cascalog Technology and Uses

Think Big Analytics, A Word or Two about Functional Programming

Thor Olavsrud, Enterprise Data Workflows

Thrift, Flow Diagrams

Tim Berglund, Build and Run

Tom White, Programming Environment Setup

topology, Example 1: Simplest Possible App in Cascading, Cascalog Technology and Uses

traps, Example 6: TF-IDF with Testing, A Word or Two About Testing, Example 6 in Cascalog: TF-IDF with Testing

Tridivesh Jena, Technology Roadmap for Pattern

TSV, Example 1: Simplest Possible App in Cascading, Example 3 in Scalding: Word Count with Customized Operations, Example 3 in Scalding: Word Count with Customized Operations, Example 1 in Cascalog: Simplest Possible App

tuple schema, Example 1: Simplest Possible App in Cascading, Flow Diagrams, Example 3: Customized Operations, Example 3 in Scalding: Word Count with Customized Operations, Getting Started with Cascalog

Twitter, Origins of the Cascading API, A Word or Two About Testing, Getting Started with Scalding, Example 3 in Scalding: Word Count with Customized Operations, Why Use Cascalog?, Getting Started with Cascalog, Cascalog Technology and Uses

type-safe API, A Word or Two about Functional Programming

U

UDFs, Scrubbing Tokens, Comparing with Apache Pig, Comparing with Apache Hive, A Word or Two about Functional Programming, Cascalog Technology and Uses

unit tests, Scrubbing Tokens, Example 6: TF-IDF with Testing, A Word or Two About Testing, Example 6 in Cascalog: TF-IDF with Testing

user-defined functions, Scrubbing Tokens

uSwitch, Example 1 in Cascalog: Simplest Possible App, Cascalog Technology and Uses

V

Vijay Srinivas Agneeswaran, Kudos

Viswa Sharma, Kudos

W

Wen-Ching Lin, Technology Roadmap for Pattern

William Back, Integrating with Desktop Tools

Word Count, Example 2: The Ubiquitous Word Count, Example 3: Customized Operations, Comparing with Apache Pig, Example 6 in Cascalog: TF-IDF with Testing

workflow, Example 1: Simplest Possible App in Cascading, Example 4 in Cascalog: Replicated Joins, Example 6 in Cascalog: TF-IDF with Testing

Y

Yahoo!, Origins of the Cascading API, Comparing with Apache Pig

Yieldbot, Cascalog Technology and Uses