Apache kafka Training

Apache Kafka Certification Training

OL Tech Edu's Apache Kafka Certification Training helps you in learning the concepts about Kafka Architecture, Configuring Kafka Cluster, Kafka Producer, Kafka Consumer, Kafka Monitoring. Apache Kafka Certification Training is designed to provide insights into Integration of Kafka with Hadoop, Storm and Spark, understand Kafka Stream APIs, implement Twitter Streaming with Kafka, Flume through real life cases studies.

Kafka is used in the Big Data space as reliable way to ingest and move large amounts of data very quickly.

LinkedIn, Yahoo, Twitter, Netflix, Uber, Goldman ,PayPal, Airbnb​ ​​& other fortune companies use Kafka.

Be future ready. Start learning
Structure your learning and get a certificate to prove it.
Start Learning

Apache Kafka UpComing Batches

Nov-17 - Dec-29

Weekend
SOLD OUT

Timings: 07:00 AM To 10:00 AM (IST)

350.00     Enroll Now

Nov-10 - Dec-22

Weekday
SOLD OUT

Timings: 20:30 PM To 23:30 PM (IST)

350.00     Enroll Now

Nov-23 - Jan-04

Weekend
FILLING FAST

Timings: 07:00 AM To 10:00 AM (IST)

350.00     Enroll Now

Nov-30 - Jan-11

Weekday
FILLING FAST

Timings: 20:30 PM To 23:30 PM (IST)

350.00     Enroll Now

Dec-07 - Jan-18

Weekend

Timings: 07:00 AM To 10:00 AM (IST)

350.00     Enroll Now

Dec-14 - Jan-25

Weekday

Timings: 20:30 PM To 23:30 PM (IST)

350.00     Enroll Now
Be future ready. Start learning
Structure your learning and get a certificate to prove it.
Start Learning

Course Curriculum

DOWNLOAD BROCHURE

Apache Kafka Certification Training

SELF PACED

OL Tech Edu's Apache Kafka Certification Training helps you in learning the concepts about Kafka Architecture, Configuring Kafka Cluster, Kafka Producer, Kafka Consumer, Kafka Monitoring. Apache Kafka Certification Training is designed to provide insights into Integration of Kafka with Hadoop, Storm and Spark, understand Kafka Stream APIs, implement Twitter Streaming with Kafka, Flume through real life cases studies.

  • WEEK 5-6
  • 10 Modules
  • 6 Hours
Kafka Architecture
Goal:  In this module, you will understand where Kafka fits in the Big Data space, and Kafka Architecture. In addition, you will learn about Kafka Cluster, its Components, and how to Configure a Cluster.
Skills:
  • Kafka Concepts.
  • Kafka Installation.
  • Configuring Kafka Cluster.
Objectives: 

At the end of this module, you should be able to: 

  • Explain what is Big Data.
  • Understand why Big Data Analytics is important.
  • Describe the need of Kafka.
  • Know the role of each Kafka Components.
  • Understand the role of ZooKeeper.
  • Install ZooKeeper and Kafka. 
  • Classify different type of Kafka Clusters.
  • Work with Single Node-Single Broker Cluster.
Topics:
  • Introduction to Big Data.
  • Big Data Analytics.
  • Need for Kafka.
  • What is Kafka? 
  • Kafka Features.
  • Kafka Concepts.
  • Kafka Architecture.
  • Kafka Components. 
  • ZooKeeper.
  • Where is Kafka Used?
  • Kafka Installation.
  • Kafka Cluster. 
  • Types of Kafka Clusters.
  • Configuring Single Node Single Broker Cluster.
Hands on:
  • Kafka Installation.
  • Implementing Single Node-Single Broker Cluster.
Goal:  Kafka Producers send records to topics. The records are sometimes referred to as Messages. In this Module, you will work with different Kafka Producer APIs.
Skills:
  • Configure Kafka Producer.
  • Constructing Kafka Producer.
  • Kafka Producer APIs.
  • Handling Partitions.
Objectives:

At the end of this module, you should be able to:

  • Construct a Kafka Producer.
  • Send messages to Kafka.
  • Send messages Synchronously & Asynchronously.
  • Configure Producersl.
  • Serialize Using Apache Avro.
  • Create & handle Partitions.
Topics:
  • Configuring Single Node Multi Broker Cluster.
  • Constructing a Kafka Producer.
  • Sending a Message to Kafka.
  • Producing Keyed and Non-Keyed Messages. 
  • Sending a Message Synchronously & Asynchronously.
  • Configuring Producers.
  • Serializers.
  • Serializing Using Apache Avro.
  • Partitions.
Hands On:
  • Working with Single Node Multi Broker Cluster.
  • Creating a Kafka Producer.
  • Configuring a Kafka Producer.
  • Sending a Message Synchronously & Asynchronously.
Goal: Applications that need to read data from Kafka use a Kafka Consumer to subscribe to Kafka topics and receive messages from these topics. In this module, you will learn to construct Kafka Consumer, process messages from Kafka with Consumer, run Kafka Consumer and subscribe to Topics.
Skills:
  • Configure Kafka Consumer.
  • Kafka Consumer API.
  • Constructing Kafka Consumer.
Objectives: 

At the end of this module, you should be able to:

  • Perform Operations on Kafka.
  • Define Kafka Consumer and Consumer Groups.
  • Explain how Partition Rebalance occurs. 
  • Describe how Partitions are assigned to Kafka Broker.
  • Configure Kafka Consumer.
  • Create a Kafka consumer and subscribe to Topics.
  • Describe & implement different Types of Commit.
  • Deserialize the received messages.
Topics:
  • Consumers and Consumer Groups.
  • Standalone Consumer.
  • Consumer Groups and Partition Rebalance.
  • Creating a Kafka Consumer.
  • Subscribing to Topics.
  • The Poll Loop.
  • Configuring Consumers.
  • Commits and Offsets.
  • Rebalance Listeners.
  • Consuming Records with Specific Offsets.
  • Deserializers.
Hands On:
  • Creating a Kafka Consumer.
  • Configuring a Kafka Consumer.
  • Working with Offsets.
Goal: Apache Kafka provides a unified, high-throughput, low-latency platform for handling real-time data feeds. Learn more about tuning Kafka to meet your high-performance needs.
Skills:
  • Kafka APIs.
  • Kafka Storage. 
  • Configure Broker.
Objectives: 

At the end of this module, you should be able to:

  • Understand Kafka Internals.
  • Explain how Replication works in Kafka.
  • Differentiate between In-sync and Out-off-sync Replicas.
  • Understand the Partition Allocation.
  • Classify and Describe Requests in Kafka.
  • Configure Broker, Producer, and Consumer for a Reliable System.
  • Validate System Reliabilities.
  • Configure Kafka for Performance Tuning.
 
Topics:
  • Cluster Membership.
  • The Controller.
  • Replication.
  • Request Processing.
  • Physical Storage.
  • Reliability. 
  • Broker Configuration.
  • Using Producers in a Reliable System.
  • Using Consumers in a Reliable System.
  • Validating System Reliability.
  • Performance Tuning in Kafka.
Hands On:
  • Create topic with partition & replication factor 3 and execute it on multi-broker cluster.
  • Show fault tolerance by shutting down 1 Broker and serving its partition from another broker.
Goal:  
  • Kafka Cluster typically consists of multiple brokers to maintain load balance.
  • ZooKeeper is used for managing and coordinating Kafka broker.
  • Learn about Kafka Multi-Cluster Architectures, Kafka Brokers, Topic, Partitions, Consumer Group, Mirroring, and ZooKeeper Coordination in this module.
Skills: 
  • Administer Kafka.
Objectives:

At the end of this module, you should be able to:

  • Understand Use Cases of Cross-Cluster Mirroring.
  • Learn Multi-cluster Architectures.
  • Explain Apache Kafka’s MirrorMaker.
  • Perform Topic Operations.
  • Understand Consumer Groups.
  • Describe Dynamic Configuration Changes.
  • Learn Partition Management.
  • Understand Consuming and Producing.
  • Explain Unsafe Operations.
Topics:
  • Use Cases - Cross-Cluster Mirroring.
  • Multi-Cluster Architectures.
  • Apache Kafka’s MirrorMaker.
  • Other Cross-Cluster Mirroring Solutions.
  • Topic Operations.
  • Consumer Groups.
  • Dynamic Configuration Changes.
  • Partition Management.
  • Consuming and Producing.
  • Unsafe Operations.
Hands on:
  • Topic Operations.
  • Consumer Group Operations.
  • Partition Operations.
  • Consumer and Producer Operations.
Goal:
  • Learn about the Kafka Connect API and Kafka Monitoring.
  • Kafka Connect is a scalable tool for reliably streaming data between Apache Kafka and other systems.
Skills: 
  • Kafka Connect.
  • Metrics Concepts.
  • Monitoring Kafka.
Objectives: 

At the end of this module, you should be able to:

  • Explain the Metrics of Kafka Monitoring.
  • Understand Kafka Connect.
  • Build Data pipelines using Kafka Connect.
  • Understand when to use Kafka Connect vs Producer/Consumer API. 
  • Perform File source and sink using Kafka Connect.
Topics:
  • Considerations When Building Data Pipelines.
  • Metric Basics.
  • Kafka Broker Metrics.
  • Client Monitoring.
  • Lag Monitoring.
  • End-to-End Monitoring.
  • Kafka Connect.
  • When to Use Kafka Connect?
  • Kafka Connect Properties.
Hands on:
  • Kafka Connect.
Goal:
  • Learn about the Kafka Streams API in this module.
  • Kafka Streams is a client library for building mission-critical real-time applications and microservices, where the input and/or output data is stored in Kafka Clusters.
Skills: 
  • Stream Processing using Kafka.
Objectives:

At the end of this module, you should be able to:

  • Describe What is Stream Processing.
  • Learn Different types of Programming Paradigm.
  • Describe Stream Processing Design Patterns.
  • Explain Kafka Streams & Kafka Streams API.
Topics:
  • Stream Processing.
  • Stream-Processing Concepts.
  • Stream-Processing Design Patterns.
  • Kafka Streams by Example.
  • Kafka Streams: Architecture Overview.
Hands on:
  • Kafka Streams.
  • Word Count Stream Processing.
Goal:
  • In this module, you will learn about Apache Hadoop, Hadoop Architecture, Apache Storm, Storm Configuration, and Spark Ecosystem.
  • In addition, you will configure Spark Cluster, Integrate Kafka with Hadoop, Storm, and Spark.
Skills: 
  • Kafka Integration with Hadoop.
  • Kafka Integration with Storm.
  • Kafka Integration with Spark.
Objectives:

At the end of this module, you will be able to:

  • Understand What is Hadoop.
  • Explain Hadoop 2.x Core Components.
  • Integrate Kafka with Hadoop.
  • Understand What is Apache Storm.
  • Explain Storm Components.
  • Integrate Kafka with Storm.
  • Understand What is Spark.
  • Describe RDDs.
  • Explain Spark Components.
  • Integrate Kafka with Spark.
 
 Topics:
  • Apache Hadoop Basics.
  • Hadoop Configuration.
  • Kafka Integration with Hadoop.
  • Apache Storm Basics.
  • Configuration of Storm. 
  • Integration of Kafka with Storm.
  • Apache Spark Basics.
  • Spark Configuration.
  • Kafka Integration with Spark.
Hands On:
  • Kafka integration with Hadoop.
  • Kafka integration with Storm.
  • Kafka integration with Spark.
Goal:
  • Learn how to integrate Kafka with Flume, Cassandra and Talend.
Skills:
  • Kafka Integration with Flume.
  • Kafka Integration with Cassandra.
  • Kafka Integration with Talend.
 
 Objectives:

At the end of this module, you should be able to:

  • Understand Flume.
  • Explain Flume Architecture and its Components.
  • Setup a Flume Agent.
  • Integrate Kafka with Flume.
  • Understand Cassandra.
  • Learn Cassandra Database Elements.
  • Create a Keyspace in Cassandra.
  • Integrate Kafka with Cassandra.
  • Understand Talend.
  • Create Talend Jobs.
  • Integrate Kafka with Talend.
Topics:
  • Flume Basics.
  • Integration of Kafka with Flume.
  • Cassandra Basics such as and KeySpace and Table Creation.
  • Integration of Kafka with Cassandra.
  • Talend Basics.
  • Integration of Kafka with Talend.
Hands On:
  • Kafka demo with Flume.
  • Kafka demo with Cassandra.
  • Kafka demo with Talend.
Goal: In this module, you will work on a project, which will be gathering messages from multiple sources.
Scenario:
  • In E-commerce industry, you must have seen how catalog changes frequently. Most deadly problem they face is “How to make their inventory and price consistent?”.
  • There are various places where price reflects on Amazon, Flipkart or Snapdeal. If you will visit Search page, Product Description page or any ads on Facebook/google. You will find there are some mismatch in price and availability. If we see user point of view that’s very disappointing because he spends more time to find better products and at last if he doesn’t purchase just because of consistency.
  • Here you have to build a system which should be consistent in nature. For example, if you are getting product feeds either through flat file or any event
  • Stream you have to make sure you don’t lose any events related to product specially inventory and price.
  • If we talk about price and availability it should always be consistent because there might be possibility that the product is sold or the seller doesn’t want to sell it anymore or any other reason. However, attributes like Name, description doesn’t make that much noise if not updated on time.
Problem Statement.
  • You have given set of sample products.
  • You have to consume and push products to Cassandra/MySQL once we get products in the consumer.
  • You have to save below-mentioned fields in Cassandra.
      1. PogId.
      2. Supc.
      3. Brand.
      4. Description.
      5. Size.
      6. Category.
      7. Sub Category.
      8. Country.
      9. Seller Code.
  • In MySQL, you have to store:
      1. PogId.
      2. Supc.
      3. Price.
      4. Quantity.

This Project enables you to gain Hands On experience on the concepts that you have learned as part of this Course. 

You can email the solution to our Support team within 2 weeks from the Course Completion Date. OL Tech Edu will evaluate the solution and award a Certificate with a Performance-based Grading.

Problem Statement:

You are working for a website techreview.com that provides reviews for different technologies. The company has decided to include a new feature in the website which will allow users to compare the popularity or trend of multiple technologies based on twitter feeds. They want this comparison to happen in real time. So, as a big data developer of the company, you have been task to implement following things:

  • Near Real Time Streaming of the data from Twitter for displaying last minute's count of people tweeting about a particular technology.
  • Store the twitter count data into Cassandra.

Program Syllabus

Curriculum

You can also view the program syllabus by downloading this program Curriculum.

Curriculum

Projects

What are the system requirements for this course?

Minimum RAM required:- 4GB (Suggested: 8GB), Minimum Free Disk Space:- 25GB, Minimum Processor i3 or above Operating System of 64bit, Participant’s machines must support a 64-bit VirtualBox guest image.

How will I execute the practicals?

We will help you to setup OLTechEdu s Virtual Machine in your System with local access. The detailed installation guides are provided in the LMS for setting up the environment. For any doubt, the 24*7 support team will promptly assist you. OLTechEdu Virtual Machine can be installed on Mac or Windows machine.

Which case studies will be a part of the course?

Stock Profit Ltd, India s first discount broker, Design a system to capture real-time stocks data from source. and calculate the Profit and loss for customers who are subscribed to the tool.

Course Description

About The Apache Kafka Online Course
About the Apache Kafka Online Course
  • This Training would help you to clear the CCA Spark and Hadoop Developer (CCA175) Examination.
  • PySpark Certification Training Course is designed to provide you with the knowledge and skills to become a successful Big Data & Spark Developer.
  • Apache Kafka Certification Training is designed to provide you with the knowledge and skills to become a successful Kafka Big Data Developer.
  • The training encompasses the fundamental concepts (such as Kafka Cluster and Kafka API) of Kafka and covers the advanced topics (such as Kafka Connect, Kafka streams, Kafka Integration with Hadoop, Storm and Spark) thereby enabling you to gain expertise in Apache Kafka.
Course Objectives
Course ObjectivesAfter the completion of Real-Time Analytics with Apache Kafka course at OL Tech Edu, you should be able to:
  • Learn Kafka and its components.
  • Set up an end to end Kafka cluster along with Hadoop and YARN cluster.
  • Integrate Kafka with real time streaming systems like Spark & Storm.
  • Describe the basic and advanced features involved in designing and developing a high throughput messaging system.
  • Use Kafka to produce and consume messages from various sources including real time streaming sources like Twitter.
  • Get an insight of Kafka API.
  • Understand Kafka Stream APIs.
  • Work on a real-life project, Implementing Twitter Streaming with Kafka, Flume, Hadoop & Storm.
Why Learn Apache Kafka
Why learn Apache Kafka ? Kafka training helps you gain expertise in Kafka Architecture, Installation, Configuration, Performance Tuning, Kafka Client APIs like Producer, Consumer and Stream APIs, Kafka Administration, Kafka Connect API and Kafka Integration with Hadoop, Storm and Spark using Twitter Streaming use case.
Who Should Go For This Course
Who should go for this Course?
This course is designed for professionals who want to learn Kafka techniques and wish to apply it on Big Data. It is highly recommended for:
  • Developers, who want to gain acceleration in their career as a "Kafka Big Data Developer".
  • Testing Professionals, who are currently involved in Queuing and Messaging Systems.
  • Big Data Architects, who like to include Kafka in their ecosystem.
  • Project Managers, who are working on projects related to Messaging Systems.
  • Admins, who want to gain acceleration in their careers as a "Apache Kafka Administrator".
Course Description
What are the Pre-requisites for this Course? Fundamental knowledge of Java concepts is mandatory. OL Tech Edu provides a complimentary course i.e., "Java Essentials" to all the participants, who enrolls for the Apache Kafka Certification Training.

Course Certification

OL Tech Edu’s Certificate Holders work at top 500s of companies like

certificate

Features

Explore step by step paths to get started on your journey to Jobs of Today and Tomorrow.

Instructor-led Sessions

30 Hours of Online Live Instructor-Led Classes.
Weekend Class : 10 sessions of 3 hours each.

Real Life Case Studies

Real-life Case Studies

Live project based on any of the selected use cases, involving implementation of the various real life solutions / services.

Assignments

Assignments

Each class will be followed by practical assignments.

24 x 7 Expert Support

24 x 7 Expert Support

We have 24x7 online support team to resolve all your technical queries, through ticket based tracking system, for the lifetime.

Certification

Certification

Towards the end of the course, OL Tech Edu certifies you for the course you had enrolled for based on the project you submit.

Course FAQ's

Enroll, Learn, Grow, Repeat! Get ready to achieve your learning goals with OL Tech Edu View All Courses
Top Courses
Stands by you all the way to ensure that you achieve your learning goals.

Top Courses

Partner Courses

Certifications

HELP & SUPPORT

Connect With Us

Get In Touch     Address: 5th Floor(Tower B), A-40, Ithum Tower Sector - 62, Noida Uttar Pradesh   Phone: +91-9654136060   Email: info@oltechedu.com  

© 2015 - 2024 OL Tech Edu. All Rights Reserved.
Designed, Developed & Powered by MNJ SOFTWARE

The website is best experienced on the following version (or higher) of Chrome 31, Firefox 26, Safari 6 and Internet Explorer 9 browsers