PySpark SQL Recipes: With HiveQL, Dataframe and Graphframes

PySpark SQL Recipes: With HiveQL, Dataframe and Graphframes, 9781484243343 (148424334X), Apress, 2019

Carry out data analysis with PySpark SQL, graphframes, and graph data processing using a problem-solution approach. This book provides solutions to problems related to dataframes, data manipulation summarization, and exploratory analysis. You will improve your skills in graph data analysis using graphframes and see how to optimize your PySpark SQL code.

PySpark SQL Recipes starts with recipes on creating dataframes from different types of data source, data aggregation and summarization, and exploratory data analysis using PySpark SQL. You’ll also discover how to solve problems in graph analysis using graphframes.

On completing this book, you’ll have ready-made code for all your PySpark SQL tasks, including creating dataframes using data from different file formats as well as from SQL or NoSQL databases.

What You Will Learn

Understand PySpark SQL and its advanced features
Use SQL and HiveQL with PySpark SQL
Work with structured streaming
Optimize PySpark SQL
Master graphframes and graph processing

Who This Book Is For

Data scientists, Python programmers, and SQL programmers.

Comments

Amazing Books

The Rough Guide to Barcelona 8 (Rough Guide Travel Guides)

Rough Guides, 2009

The Rough Guide to Barcelona is the ultimate guide to this intoxicating Spanish city, whether you are backpacking on a budget, or city-breaking in luxury. This up-to-date guide has a full-colour introduction that showcases the colourful streets and astonishing architecture, and there are new full-colour sections exploring Antoni Gaudi and...

Digital Design and Implementation with Field Programmable Devices

Springer, 2004

The focus of Digital Design and Implementation with Field Programmable Devices is on a practical knowledge of digital system design for programmable devices. The book covers all necessary topics under one cover, and covers each topic just enough that is actually used by an advanced digital designer. The book is broken into three...

VMware vSphere 5.5 Cookbook

Packt Publishing, 2015

A task-oriented guide with over 150 practical recipes to install, configure, and manage VMware vSphere components

About This Book

Explore the use of command line interface (CLI) to consistently configure the environment and automate it reasonably

Discover the best practices to deploy...

Microsoft Internet Explorer 6 Resource Kit (Pro-Resource Kit)

Microsoft Press, 2001

Internet Explorer 6.0 offers dramatic performance, reliability, and usability improvements, making it the fastest, easiest, most cost-effective Web browser for organizations to deploy, manage, and support. The MICROSOFT INTERNET EXPLORER 6.0 RESOURCE KIT provides comprehensive information and tools for this browser-straight from the Microsoft...

MP3: The Definitive Guide

O'Reilly, 2000

MP3, standing for MPEG-1, Layer 3, is a codec for compressing the size of audio files for digital distribution. Much more than a definition, MP3 is nothing less than a cultural and economic revolution on the Internet. Every day, hundreds of thousands of MP3 music files are searched for, shared, recorded and listened to by computer and Internet...

Machine Learning for Multimedia Content Analysis (Multimedia Systems and Applications)

Springer, 2007

Challenges in complexity and variability of multimedia data have led to revolutions in machine learning techniques. Multimedia data, such as digital images, audio streams and motion video programs, exhibit richer structures than simple, isolated data items. A number of pixels in a digital image collectively conveys certain visual content to...