Home | Amazing | Today | Tags | Publishers | Years | Account | Search 
Fast Data Processing with Spark (Community Experience Distilled)

Buy

High-speed distributed computing made easy with Spark

Overview

  • Implement Spark's interactive shell to prototype distributed applications
  • Deploy Spark jobs to various clusters such as Mesos, EC2, Chef, YARN, EMR, and so on
  • Use Shark's SQL query-like syntax with Spark

In Detail

Spark is a framework for writing fast, distributed programs. Spark solves similar problems as Hadoop MapReduce does but with a fast in-memory approach and a clean functional style API. With its ability to integrate with Hadoop and inbuilt tools for interactive query analysis (Shark), large-scale graph processing and analysis (Bagel), and real-time analysis (Spark Streaming), it can be interactively used to quickly process and query big data sets.

Fast Data Processing with Spark covers how to write distributed map reduce style programs with Spark. The book will guide you through every step required to write effective distributed programs from setting up your cluster and interactively exploring the API, to deploying your job to the cluster, and tuning it for your purposes.

Fast Data Processing with Spark covers everything from setting up your Spark cluster in a variety of situations (stand-alone, EC2, and so on), to how to use the interactive shell to write distributed code interactively. From there, we move on to cover how to write and deploy distributed jobs in Java, Scala, and Python.

We then examine how to use the interactive shell to quickly prototype distributed programs and explore the Spark API. We also look at how to use Hive with Spark to use a SQL-like query syntax with Shark, as well as manipulating resilient distributed datasets (RDDs).

What you will learn from this book

  • Prototype distributed applications with Spark's interactive shell
  • Learn different ways to interact with Spark's distributed representation of data (RDDs)
  • Load data from the various data sources
  • Query Spark with a SQL-like query syntax
  • Integrate Shark queries with Spark programs
  • Effectively test your distributed software
  • Tune a Spark installation
  • Install and set up Spark on your cluster
  • Work effectively with large data sets

Approach

This book will be a basic, step-by-step tutorial, which will help readers take advantage of all that Spark has to offer.

Who this book is written for

Fast Data Processing with Spark is for software developers who want to learn how to write distributed programs with Spark. It will help developers who have had problems that were too much to be dealt with on a single computer. No previous experience with distributed programming is necessary. This book assumes knowledge of either Java, Scala, or Python.

(HTML tags aren't allowed.)

America's Corner Store: Walgreen's Prescription for Success
America's Corner Store: Walgreen's Prescription for Success
Praise for America’s Corner Store

"Who would have thought the story of a drugstore chain could encompass so much vital and fascinating American history? With superb storytelling skills, John Bacon gives us a vivid and insightful chronicle of matters both large and small, from the birth of the milkshake to the rise of America’s...

Living Well in a Down Economy For Dummies
Living Well in a Down Economy For Dummies

Get smart about spending and saving -- and ride out a recession!

Looking for practical ways to make every dollar count? This savvy guide gives you expert tips for tightening your belt and saving cash in every area of your life -- from your house and car to dining and entertaining to banking and managing debt. You get...

Trust and Security in Collaborative Computing (Computer and Network Security)
Trust and Security in Collaborative Computing (Computer and Network Security)
Computer networks are compromised by various unpredictable factors, such as hackers, viruses, spam, faults, and system failures, hindering the full utilization of computer systems for collaborative computing one of the objectives for the next generation of the Internet. It includes the functions of data communication, resource sharing, group...

VMware vSphere 6.5 Cookbook - Third Edition: Over 140 task-oriented recipes to install, configure, manage, and orchestrate various VMware vSphere 6.5 components
VMware vSphere 6.5 Cookbook - Third Edition: Over 140 task-oriented recipes to install, configure, manage, and orchestrate various VMware vSphere 6.5 components

Deploy and manage VMware vSphere 6.5 components with ease

Key Features

  • Simplified and to-the-point theory and practical recipes to deploy and manage vSphere 6.5
  • Discover the best ways to deploy stateless and stateful ESXi hosts and upgrade them
  • Storage and...
3ds Max 2009 Bible
3ds Max 2009 Bible
The only comprehensive reference-tutorial on 3ds Max available, this book is everyone's favorite. Whether you're a beginner looking for 3D basics or a full-fledged animator seeking new ways to dazzle viewers with your creations, it's all here. You'll find pages of professional tips, loads of advice, and more than 150 step-by-step tutorials...
Real World Aperture
Real World Aperture
Released to near universal acclaim, Apple's Aperture is an all-in-one post-production tool for professional photographers. Featuring a RAW-focused workflow, Aperture lets photographers import, edit, catalog, organize, retouch, publish, and archive images more effectively and efficiently than ever before. In this guide, best-selling author Ben Long...
©2021 LearnIT (support@pdfchm.net) - Privacy Policy