Home | Amazing | Today | Tags | Publishers | Years | Account | Search 
Fast Data Processing with Spark (Community Experience Distilled)


High-speed distributed computing made easy with Spark


  • Implement Spark's interactive shell to prototype distributed applications
  • Deploy Spark jobs to various clusters such as Mesos, EC2, Chef, YARN, EMR, and so on
  • Use Shark's SQL query-like syntax with Spark

In Detail

Spark is a framework for writing fast, distributed programs. Spark solves similar problems as Hadoop MapReduce does but with a fast in-memory approach and a clean functional style API. With its ability to integrate with Hadoop and inbuilt tools for interactive query analysis (Shark), large-scale graph processing and analysis (Bagel), and real-time analysis (Spark Streaming), it can be interactively used to quickly process and query big data sets.

Fast Data Processing with Spark covers how to write distributed map reduce style programs with Spark. The book will guide you through every step required to write effective distributed programs from setting up your cluster and interactively exploring the API, to deploying your job to the cluster, and tuning it for your purposes.

Fast Data Processing with Spark covers everything from setting up your Spark cluster in a variety of situations (stand-alone, EC2, and so on), to how to use the interactive shell to write distributed code interactively. From there, we move on to cover how to write and deploy distributed jobs in Java, Scala, and Python.

We then examine how to use the interactive shell to quickly prototype distributed programs and explore the Spark API. We also look at how to use Hive with Spark to use a SQL-like query syntax with Shark, as well as manipulating resilient distributed datasets (RDDs).

What you will learn from this book

  • Prototype distributed applications with Spark's interactive shell
  • Learn different ways to interact with Spark's distributed representation of data (RDDs)
  • Load data from the various data sources
  • Query Spark with a SQL-like query syntax
  • Integrate Shark queries with Spark programs
  • Effectively test your distributed software
  • Tune a Spark installation
  • Install and set up Spark on your cluster
  • Work effectively with large data sets


This book will be a basic, step-by-step tutorial, which will help readers take advantage of all that Spark has to offer.

Who this book is written for

Fast Data Processing with Spark is for software developers who want to learn how to write distributed programs with Spark. It will help developers who have had problems that were too much to be dealt with on a single computer. No previous experience with distributed programming is necessary. This book assumes knowledge of either Java, Scala, or Python.

(HTML tags aren't allowed.)

The Extreme Searcher's Internet Handbook: A Guide for the Serious Searcher
The Extreme Searcher's Internet Handbook: A Guide for the Serious Searcher
Several years ago, Thomas’s English Muffins had an ad that proclaimed that the tastiness of their muffins was due to the presence of myriad “nooks and crannies.” The same may be said of the Internet. It is in the Internet’s nooks and crannies that the true “tastiness” often lies. Almost every...
Youth in Saudi Arabia
Youth in Saudi Arabia

This book uses the youth life stage as a window through which to view all domains of life in present-day Saudi Arabia: family life, education, the impact of new media, the labour market, religion and politics. The authors draw extensively on their interviews with 25-35 year olds, selected so as to represent the life...

PostgreSQL for Data Architects
PostgreSQL for Data Architects

Discover how to design, develop, and maintain your database application effectively with PostgreSQL

About This Book

  • Understand how to utilize the most frequently used PostgreSQL ecosystem-related tools and technologies
  • A hands-on guide focused primarily on providing a practical approach...

Integrated Model of Distributed Systems (Studies in Computational Intelligence)
Integrated Model of Distributed Systems (Studies in Computational Intelligence)
In modern distributed systems, such as the Internet of Things or cloud computing, verifying their correctness is an essential aspect. This requires modeling approaches that reflect the natural characteristics of such systems: the locality of their components, autonomy of their decisions, and their asynchronous communication. However, most of the...
Expert Android
Expert Android

From the leading publisher of Android books, Apress’ Expert Android gives you advanced techniques for customizing views, controls, and layouts. You’ll learn to develop apps in record time using JSON, Advanced Form Processing, and the BaaS (Backend As A Service) platform Parse. The book also includes extensive coverage on...

100 Greatest Science Discoveries of All Time
100 Greatest Science Discoveries of All Time
Throughout history, science has changed lives and dramatically altered the way in which the universe is perceived. Focusing on the 100 most significant scientific events of all time--from Archimedes' discovery of the two fundamental principles underlying physics and engineering (levers and buoyancy) in 260 B.C.E. to human anatomy, Jupiter's moons,...
©2019 LearnIT (support@pdfchm.net) - Privacy Policy