Performing Data Engineering on Microsoft HD Insight
Online Training by
NetCom Learning
Inquire Now
Online
/ Training
Details
The main purpose of the Performing Data Engineering on Microsoft HD Insight course is to give students the ability plan and implement big data workflows on HDInsight.
This course is based on the objectives of the course version 20775A.
Note: eLearning module (Microsoft On Demand, MOD) is also available for this course
This course is based on the objectives of the course version 20775A.
Note: eLearning module (Microsoft On Demand, MOD) is also available for this course
Outline
- Getting Started with HDInsight
- What is Big Data?
- Introduction to Hadoop
- Working with MapReduce Function
- Introducing HDInsight
- Lab : Working with HDInsight
- Provision an HDInsight cluster and run MapReduce jobs
- Deploying HDInsight Clusters
- Identifying HDInsight cluster types
- Managing HDInsight clusters by using the Azure portal
- Managing HDInsight Clusters by using Azure PowerShell
- Lab : Managing HDInsight clusters with the Azure Portal
- Create an HDInsight cluster that uses Data Lake Store storage
- Customize HDInsight by using script actions
- Delete an HDInsight cluster
- Authorizing Users to Access Resources
- Non-domain Joined clusters
- Configuring domain-joined HDInsight clusters
- Manage domain-joined HDInsight clusters
- Lab : Authorizing Users to Access Resources
- Prepare the Lab Environment
- Manage a non-domain joined cluster
- Loading data into HDInsight
- Storing data for HDInsight processing
- Using data loading tools
- Maximising value from stored data
- Lab : Loading Data into your Azure account
- Load data for use with HDInsight
- Troubleshooting HDInsight
- Analyze HDInsight logs
- YARN logs
- Heap dumps
- Operations management suite
- Lab : Troubleshooting HDInsight
- Analyze HDInsight logs
- Analyze YARN logs
- Monitor resources with Operations Management Suite
- Implementing Batch Solutions
- Apache Hive storage
- HDInsight data queries using Hive and Pig
- Operationalize HDInsight
- Lab : Implement Batch Solutions
- Deploy HDInsight cluster and data storage
- Use data transfers with HDInsight clusters
- Query HDInsight cluster data
- Design Batch ETL solutions for big data with Spark
- What is Spark?
- ETL with Spark
- Spark performance
- Lab : Design Batch ETL solutions for big data with Spark.
- Create a HDInsight Cluster with access to Data Lake Store
- Use HDInsight Spark cluster to analyze data in Data Lake Store
- Analyzing website logs using a custom library with Apache Spark cluster on HDInsight
- Managing resources for Apache Spark cluster on Azure HDInsight
- Analyze Data with Spark SQL
- Implementing iterative and interactive queries
- Perform exploratory data analysis
- Lab : Performing exploratory data analysis by using iterative and interactive queries
- Build a machine learning application
- Use zeppelin for interactive data analysis
- View and manage Spark sessions by using Livy
- Analyze Data with Hive and Phoenix
- Implement interactive queries for big data with interactive hive.
- Perform exploratory data analysis by using Hive
- Perform interactive processing by using Apache Phoenix
- Lab : Analyze data with Hive and Phoenix
- Implement interactive queries for big data with interactive Hive
- Perform exploratory data analysis by using Hive
- Perform interactive processing by using Apache Phoenix
- Stream Analytics
- Stream analytics
- Process streaming data from stream analytics
- Managing stream analytics jobs
- Lab : Implement Stream Analytics
- Process streaming data with stream analytics
- Managing stream analytics jobs
- Implementing Streaming Solutions with Kafka and HBase
- Building and Deploying a Kafka Cluster
- Publishing, Consuming, and Processing data using the Kafka Cluster
- Using HBase to store and Query Data
- Lab : Implementing Streaming Solutions with Kafka and HBase
- Create a virtual network and gateway
- Create a storm cluster for Kafka
- Create a Kafka producer
- Create a streaming processor client topology
- Create a Power BI dashboard and streaming dataset
- Create an HBase cluster
- Create a streaming processor to write to HBase
- Develop big data real-time processing solutions with Apache Storm
- Persist long term data
- Stream data with Storm
- Create Storm topologies
- Configure Apache Storm
- Lab : Developing big data real-time processing solutions with Apache Storm
- Stream data with Storm
- Create Storm Topologies
- Create Spark Streaming Applications
- Working with Spark Streaming
- Creating Spark Structured Streaming Applications
- Persistence and Visualization
- Lab : Building a Spark Streaming Application
- Installing Required Software
- Building the Azure Infrastructure
- Building a Spark Streaming Pipeline
Reviews
Be the first to write a review about this course.
Write a Review
NetCom Learning helps build innovative learning organizations in the workplace by structuring a smarter workforce, supporting learning changes, and driving learning growth. Since 1998 we have been empowering organizations to reach optimal performance results and address challenges by managing all aspects of organizational learning.
With a team of dedicated and knowledgeable learning professionals having deep subject-matter expertise, NetCom Learning has serviced over 80% of Fortune 100 companies. We've helped over 10,000 organizations achieve their business goals by offering a full complement of Managed Learning Services, including IT and business training, curriculum design and content development, learning delivery and administration, consulting and advisory services, and management of learning technology.
NetCom Learning is honored to be recognized as Microsoft's Worldwide Training Partner of the Year by Microsoft and as a Top 20 IT Training Company by TrainingIndustry.com for three years. We offer over 1,500 courses available to organizations around the world, encompassing all your technology and business training needs. From authorized or foundational training to specialized certifications, we empower organizations to achieve a competitive advantage. In addition, we provide customers with a choice of customized private programs, convenient scheduling options, flexible delivery formats, and continuous learning support, all tailored towards minimizing the skills gap and gaining maximum business impact for your organization. ...
Related Courses
NetCom Learning
