Elk Stack Training

ELK Stack Training

OL Tech Edu's ELK Stack course makes you an expert in ELK such that you can run and operate your own search cluster using Elasticsearch, Logstash, Kibana. You will gain proficiency to use Logstash to load data into Elasticsearch, run various search operation and do data visualization with the help of Kibana.

ELK stack makes it way easier -- and way faster -- to search and analyze large data sets.

ELK has been adopted by well-known organizations such as LinkedIn, Netflix, Stack Overflow​, Accenture.

Be future ready. Start learning
Structure your learning and get a certificate to prove it.
Start Learning

Elk Stack UpComing Batches

Nov-17 - Dec-29

Weekend
SOLD OUT

Timings: 07:00 AM To 10:00 AM (IST)

350.00     Enroll Now

Nov-10 - Dec-22

Weekday
SOLD OUT

Timings: 20:30 PM To 23:30 PM (IST)

350.00     Enroll Now

Nov-23 - Jan-04

Weekend
FILLING FAST

Timings: 07:00 AM To 10:00 AM (IST)

350.00     Enroll Now

Nov-30 - Jan-11

Weekday
FILLING FAST

Timings: 20:30 PM To 23:30 PM (IST)

350.00     Enroll Now

Dec-07 - Jan-18

Weekend

Timings: 07:00 AM To 10:00 AM (IST)

350.00     Enroll Now

Dec-14 - Jan-25

Weekday

Timings: 20:30 PM To 23:30 PM (IST)

350.00     Enroll Now
Be future ready. Start learning
Structure your learning and get a certificate to prove it.
Start Learning

Course Curriculum

ELK Stack Training and Certification

SELF PACED

OL Tech Edu's ELK Stack course makes you an expert in ELK such that you can run and operate your own search cluster using Elasticsearch, Logstash, Kibana. You will gain proficiency to use Logstash to load data into Elasticsearch, run various search operation and do data visualization with the help of Kibana.

  • WEEK 5-6
  • 10 Modules
  • 6 Hours
Safe Paced

Introduction:

Alice is a support engineer working in TS foundation, which is a software developing company. One of its feature is enabling single sign-on for its applications.


Alices’ Day To Day Challanges:

Her task is to help the customers, and troubleshoot issues when needed. Whenever there’s a ticket for an issue, the first place she checks in, is the logs in the designated servers. She keeps searching and searching for related words or keyword match. Meanwhile there is change in logs every minute, and this is making her search, more and more hectic.

How can we help her?


Solution:

Well this is where ELK stack comes into the picture.

ELK comes with elastic search, logstash and kibana stacked altogether to give her a full analytics system.


Elastic Search enables her to search logs easily and get to know the issue and resolve it in a faster manner; not only that she can get proactive by analyzing the logs, and see if any of those customers are facing any issues or failures.

Now she can log into Kibana and search for relevant keywords easily. She can even limit the research by using timestamp filter. Monitoring single sign-on activities can be easily done by using different visualization graphs on the dashboards.


Goal: Let’s help Alice by introducing ELK stack to her, and helping her in understanding the core concepts and the technology behind it. This will help her in learning ELK architecture and various implementation of ELK stack in companies. 


Objectives: Upon completing this lesson, you should be able to:


  • Introduce ELK Stack. 
  • Learn about Architecture of ELK stack. 
  • Understand various ELK terminology. 
  • Learn the basics of Elastic Search, Logstash and Kibana.
  • Understand ELK stack use case.

Topics:
  • Introduction to ELK Stack.
  • Why ELK?
  • Architecture of ELK.
  • High level Overview of. 
  • Elastic Search.
  • Logstash.
  • Kibana.

Goal: Alice has learnt to the basic concepts of ELK stack. Now what if she has to work with new sets of inputs, let’s help her with the another component of ELK stack, logstash. This module will give her a basic introduction to Logstash and guide through the process of installing Logstash and verifying that everything is running properly. After learning how to stash your first event, you can go on to create a more advanced pipeline that takes Apache web logs as input, parses the logs, and writes the parsed data to an Elasticsearch cluster. Then you learn how to stitch together multiple input and output plugins to unify data from a variety of disparate sources.

 

Objectives: At the end of this lesson, you should be able to:


  • Install and verify running of Logstash on your machine.
  • Learn to stash first event. 
  • Create a more advanced pipeline that takes Apache web logs as input, parses the logs, and writes the parsed data to an Elasticsearch cluster.
  • Learn how to stitch together multiple input and output plugins to unify data from a variety of disparate sources.

 Topics:

  • Introduction to Logstash.
  • Installing Logstash.
  • Configuring a log File.
  • Stashing your First Event.
  • Parsing Logs with Logstash.
  • Stitching together Multiple Input and Output.
  • Plugins. 
  • Execution Model.

Hands On: 

  • Step by step guide to install Logstash on your machine.
  • Configure the log file.
  • Stash your first event in Logstash.
  • Parsing Logs with Logstash.
  • Installing FileBeats and configuring it to work with Logstash.
  • Configuring Grok Plugin.

Goal: Alice got the overview of the ELK stack, now she wants a deep understanding of each component of the stack. Let’s help her in getting started, with a brief introduction to Elastic Search with a use-case. 

 

Objectives:  At the end of this module, you should be able to:


  • Enable Multi Value Tags, Numbers and Full text.
  • Retrieve the full Details of any Employee.
  • Perform Structured Search. 
  • Learn about full-text Search.
  • Return Highlighted Search Snippets.

Topics:

  • Elastic Search Overview.
  • Installing and Running Elastic Search.
  • Indexing Documents.
  • Retrieving a Document.
  • Searching a Document.

Hands On:

  • Installing and Running Elastic Search.
  • Indexing Documents.
  • Retrieving Full Document.
  • Retrieving a part of Document.
  • Checking Document Existence.
  • Updating a Document.
  • Deleting a Document.
  • Searching a Document (Overview).


Goal: Alice seemed excited and she is curious about learning searching in depth. She wants to explore more about Elastic Search. She understood its not just enough to use the match query. She needs to understand the data and run search query through it. This module explains her, how to index and query your data to allow her to take advantage of word proximity, partial matching, fuzzy matching, and language awareness.


Objectives: At the end of this module, you should be able to:


  • Perform Structured Search using Elastic Search.
  • Deploy and Understand full text Search Query.
  • Know your data with Multifield Search.
  • Find Associated Words.
  • Understand Partial Matching Query.

Topics:

  • Structured Search.
  • Full text Search.
  • Complicated Search. 
  • Phrase Search.
  • Highlighting our Search.
  • Multi-field Search.
  • Proximity Matching.
  • Partial Matching.

Hands On:

  • Above all topics are hands-on intensive.


Goal: Alice learned and performed various searching queries and was satisfied with it, when she suddenly realized a problem. Her query was not able to remove distinction between singular and plural words, or between tenses. She even faced problem with typos and various other problem. Let’s help Alice in solving her issues by training her on how to deal with human language for improving performance.

 

Objectives: At the end of this lesson, you should be able to:


  • Remove diacritics like and so that a search for rôle will also match role, and vice versa using Normalizing Tokens.
  • Remove the distinction between singular and plural—fox versus foxes—or between tenses—jumping versus jumped versus jumps—by stemming each word to its root form in Reducing Words to Their Root Form.
  • Remove commonly used words or stopwords like the, and, and or to improve search performance in Stopwords: Performance Versus Precision.
  • Including synonyms so that a query for quick could also match fast, or UK could match United Kingdom with the help of Synonyms.
  • Check for misspellings or alternate spellings, or match on homophones—words that sound the same, like their versus there, meat versus meet versus mete using Typos and Misspellings.

Topics:

  • Getting Started with Languages.
  • Identifying Words.
  • Normalizing Tokens.
  • Reducing Words to their Root Form.
  • Stopwords: Performance Versus Precision.
  • Synonyms.
  • Typos and Misspellings.

Hands On:

  • Above all topics are hands-on intensive.


Goal: Alice leaned all about how to search through her data, now once data is searched she needs to get a higher-level overview of the dataset and perform queries on it to get her answers in near-real time. This has made her task very tedious and tiring. Let’s ease her problem by training her with aggregation.

 

Aggregations will allow her to ask sophisticated questions of her data in near real time. With search, we have a query and we want to find a subset of documents that match the query. We are looking for the needle(s) in the haystack.

 

With aggregations, we zoom out to get an overview of our data. Instead of looking for individual documents, we want to analyze and summarize our complete set of data:


Objectives: At the end of this module you will be able to:

  • Understand the concepts of Buckets and Metrics.
  • Build bar chart with Buckets.
  • Look at the time using Date Histogram.
  • Filter Queries and Aggregation.
  • Sort Multivalue Bucket.

Topics:

  • High Level Concepts. 
  • Getting started with Aggregation.
  • Time Analysis.
  • Filtering Queries and Aggregations.
  • Sorting Multivalue Buckets.
  • Approximate Aggregation.
  • Doc Values and Field Data.

Hands On:

  • Above all topics are hands-on intensive.


Goal: Alice was well-versed in working with SQL she thought that for handling relationships, the golden rule of relational database- normalize your data will be applicable in Elastic Search too. But as a matter of fact, this golden rule does not apply to Elastic Search. Joining entities at query time is expensive—the more joins that are required, the more expensive the query. Performing joins between entities that live on different hardware is so expensive that it is just not practical. In this module let’s discover how data is modelled in Elastic Search. 

 

Objectives: 

At the end of this lesson, you should be able to:


  • Compare Elasticsearch with RDBMS.
  • Get the best search result by learning Denormalizing Data.
  • Perform action with Nested Objects.
  • Understand Parent-Child Relationship.
  • Finally conclude the module with concept of shards and replicas.

 Topics:

  • Elastic Search vs RDBMS.
  • Handling Relationships. 
  • Nested Objects.
  • Parent-Child Relationship.
  • Designing for Scale.

Hands On:

  • Above all topics are hands-on intensive.


Goal: The beauty of Elasticsearch is that it allows you to combine geolocation with full-text search, structured search, and analytics. 


For instance: show me restaurants that mention PIZZA, BURGER, and are within a 5-minute walk, and are open at 11 p.m., and then rank them by a combination of user rating, distance, and price.


Objectives: At the end of this module you will be able to:


  • Understand the concepts of Geo Points.
  • Aggregate Geo Distance.
  • Understand Geohash and Aggregate Geohash Grid.
  • Learn about different Geo Shapes.

Topics:

  • Geo Points.
  • Geo Hashes.
  • Geo Aggregations.
  • Geo Shapes.

Hands On:

  • Above all topics are hands-on intensive.


Goal: Learn to search, view, and interact with data stored in Elasticsearch indices. You can easily perform advanced data analysis and visualize your data in a variety of charts, tables, and maps.


Objectives: At the end of this lesson, you should be able to:


  • Install and Verify Kibana. 
  • Ingest .json files into Elasticsearch. 
  • Create different visualization.
  • Pie Chart.
  • Bar Chart.
  • Coordinate Map.
  • Summarize the Dashboard.

Topics:

  • Introduction to Kibana.
  • Installing Kibana.
  • Loading Sample Data.
  • Discovering your Data.
  • Visualizing your Data.
  • Working with Dashboard.

Hands On:

  • Using Kibana to create a Dashboard.


Goal: Learn to interact and explore your data from the Discover page. You have access to every document in every index that matches the selected index pattern. You can submit search queries, filter the search results, and view document data. You can also see the number of documents that match the search query and get field value statistics. If a time field is configured for the selected index pattern, the distribution of documents over time is displayed in a histogram at the top of the page.


Objectives:

  • Search your Data in Kibana.
  • Understanding Metric Beat.
  • Comparing CPU time spent in user space with offset by an hour.
  • Understand Timeline and Analyzing Earthquake with ELK. 
  • Extend what is possible with Elastic search using X-Pack.
  • Detect Fraud with X-Pack.

Topics:

  • Setting the Time Filter.
  • Searching your Data.
  • Filtering by Field.
  • Viewing Document Data.
  • Viewing Document Context.
  • Viewing Field Statistics.
  • Data Visualization.
  • Dashboard.
  • Analyzing live data with ELK Stack.

Hands On:

  • Time Filter.
  • Document Context.
  • Creating a Dashboard.

Program Syllabus

Curriculum

You can also view the program syllabus by downloading this program Curriculum.

Projects

What are the system requirements for this course?

The system requirements for ELK Stack course is Multicore Processor (i3-i7 series), 8GB of RAM is recommended and 20GB Hard Disck (SDD preferable). The operating system can be Windows.

How will I execute the practicals?

The practicals can be executed on your machine by installing all the three component of the stack. Detailed Installation Guide will be provided as part of the LMS.

Which case studies will be a part of the course?

Tech Analyst:- A 9.5 years young and energetic IT services company founded by IITian, providing a full 360 degree solution to the clients across the globe. One of the main task of the company involves analyzing huge amount of data Task. The task of the employee is to fetch the required data from the source to Logstash and run queries on elastic search and finally visualize the data.

Course Description


About The Course
About the courseThe ELK stack consists of Elasticsearch, Logstash, and Kibana. Although they've all been built to work exceptionally well together, each one is a separate tool that is driven by the open-source vendor Elastic. Elastic has created an end-to-end stack that delivers actionable insights in real time from almost any type of structured and unstructured data source. So the course can be summarized into:
  • An overview of the key features of Elasticsearch, Logstash & Kibana.
  • A deep dive on how their powers combine to deliver an end to end solution for analytics, logging, search & visualization.
  • Extensive hands-on demo of the Elastic Stack in action.

What Are The Objectives Of This Course
What are the objectives of this course ?After completing ELK Stack course, you should be able to:
  • Learn the fundamentals of ELK stack with different use-case.
  • Discuss about each component of ELK stack individually in depth.
  • Install the stack components in your system.
  • Use Logstash to load data into Elastic Search.
  • Create visualization with the loaded data with the help of Kibana.
  • Analyze real time data with ELK stack.
  • Compare CPU time spent in user space with offset by hour using Metric Beat.

Why Learn ELK Stack
Why learn ELK Stack?ELK Stack will help you find answers to the below questions that might be part of various Business Scenarios:
  • How many users have signed up this week?
  • When should we schedule the maintenance?
  • Why is the database slow?
  • How can i search in the Logs that are of different formats and have inconsistent data?
  • How to deal with different types of Time Formats?
  • How can I search logs that are spread across different locations?

Who Should Go For This Training
Who should go for this training?
  • Big Data Analytics Engineer – Elastic Search.
  • Web Administrator.
  • System Log Analyst.
  • Full Stack Technical Architect.
  • Web Analyst.
  • Technical Manager.
  • Business Analyst.

Pre Requisites For This Course
What are the pre-requisites for this course? To master the concept of ELK Stack, you need to have basic understanding of :​
  • ​JSON Data Format​.
  • ​SQL​.
  • ​Restful API.​

Course Certification

OL Tech Edu’s Certificate Holders work at top 500s of companies like

certificate

Features

Explore step by step paths to get started on your journey to Jobs of Today and Tomorrow.

Instructor-led Sessions

30 Hours of Online Live Instructor-Led Classes.
Weekend Class : 10 sessions of 3 hours each.

Real Life Case Studies

Real-life Case Studies

Live project based on any of the selected use cases, involving implementation of the various real life solutions / services.

Assignments

Assignments

Each class will be followed by practical assignments.

24 x 7 Expert Support

24 x 7 Expert Support

We have 24x7 online support team to resolve all your technical queries, through ticket based tracking system, for the lifetime.

Certification

Certification

Towards the end of the course, OL Tech Edu certifies you for the course you had enrolled for based on the project you submit.

Course FAQ's

Enroll, Learn, Grow, Repeat! Get ready to achieve your learning goals with OL Tech Edu View All Courses

© 2015 - 2024 OL Tech Edu. All Rights Reserved.
Designed, Developed & Powered by MNJ SOFTWARE

The website is best experienced on the following version (or higher) of Chrome 31, Firefox 26, Safari 6 and Internet Explorer 9 browsers