Monday, April 28, 2014
08:30 AM - 11:45 AM
This course is designed to provide a rapid immersion into Big Data with Hadoop. We start with an introduction to the Hadoop cluster and teach the ways to interact with the Hadoop file system and the cluster. We introduce Hive and Pig popular higher level interfaces to managing data in the Hadoop system. Upon completion, attendees will understand:
- Big Data concepts and technologies
- Map Reduce concepts
- The Hadoop file system
- Hive and Pig for productive data management and development
Big Data and Hadoop: A quick dive
- Big Data
- Problems with conventional systems
- Map Reduce algorithm
- Traditional Database Applications
- What is MapReduce?
- Relevance of MapReduce to Big Data
- Map operation
- Reduce operation
- What is Hadoop?
- The Hadoop architecture
- Hadoop Distributed File System
Hadoop Distributed File System (HDFS)
- HDFS Architecture
- HDFS API
- Data replication
- Typical Hadoop algorithms
- Best practices for Hadoop
Working with Hive
- What is Hive?
- Hive architecture
- Data warehouse using Hive
Working with Pig
- What is Pig?
- Analyzing data using Pig
- Using Pig Latin to build data analysis programs
Dr. Vladimir Bacvanski has over two decades of engineering experience with mission critical and distributed enterprise systems and data technologies. Vladimir has helped a number of companies including the US Treasury, the Federal Reserve Bank, the US Navy, IBM, Dell, Hewlett Packard, JP Morgan Chase, General Electric, BAE Systems, AMD, and others to select, transition to, and apply new software and data technologies.
Vladimir is published worldwide and is a keynote speaker, session chair, and workshop organizer at leading industry events. As a founder of SciSpike, Vladimir is focusing on Big Data technologies and highly scalable reactive software architectures with node.js and Scala. Vladimir is the author of the O'Reilly course on Big Data and NoSQL.