Big Data Hadoop and Spark Developer Training

Big Data & Spark OverviewHadoop Internals

• Overview of Big data and its challenges
• Spark Architecture Overview
• Installing and Configuring Spark

Hadoop Ecosystem Deep Dive

Quick Overview of SCALA Language

Spark Architecture – Deep Dive

• Using Spark Shell
• Understanding Resilient Distributed Datasets (RDDs), Types of RDDs
• Working with RDD Actions & Transformations
• Complete Flow of a spark program
• Deploying to Spark Standalone & Hadoop Cluster
• Using Web UI for monitoring & managing Spark Applications
• Hands On

Spark APIs & Usages

• Working with Key-value pairs using Spark APIs
• Overview of RDD lineage, Caching and Persistence
• Track Spark jobs stages for Investigation and Troubleshooting
• Hands On

Working with Advanced Spark Features

• Working with DataFrames & Spark SQLs
• Hive & RDD Integrations
• Working with different data formats: Structured and Unstructured
• Hands On

Writing Spark Streaming Applications

• Spark Streaming Overview

• Understanding Streaming Operations

• Developing Spark Streaming Applications