Use Code TRYNOW15 for a One-Time, Extra 15% OFF at KodeKloud
Monitoring
Kubernetes
Logging

EFK Stack: Enterprise-Grade Logging and Monitoring

Raghunandana Sanur
Staff Data Engineer & MLOps Engineer at Talabat
DevOps Pre-Requisite Course
Play Button
Fill this form to get a notification when course is released.
book
9
Lessons
book
Challenges
Article icon
70
Topics

What you’ll learn

Our students work at..

Description

Unlock the full potential of the EFK Stack (Elasticsearch, Fluent Bit, and Kibana) with this comprehensive course, designed for developers, system administrators, and DevOps professionals. Gain hands-on experience and deep knowledge to implement and optimize an end-to-end logging and monitoring solution. This course guides you through each component of the EFK stack and shows you how to deploy these technologies in a Kubernetes environment.

This course comes with detailed demonstrations, Quizes,  and hands-on labs.

Course Sections:

1. What Is Logging and Elasticsearch:

  • Introduction to Logging: Learn about the significance of logging, types of logs, and best practices for managing logs effectively.
  • Overview of Elasticsearch: Explore Elasticsearch's architecture, core concepts, and its capabilities as a powerful search engine and analytics tool for real-time data handling.

2. Mastering Elasticsearch Fundamentals:

  • Setup and Installation: Step-by-step guidance on installing and configuring Elasticsearch on various platforms.
  • Core Features: Understand indexing, querying, aggregation, and managing data within Elasticsearch.

3. Understanding Kibana:

  • Introduction to Kibana: Learn how to visualize data stored in Elasticsearch using Kibana's dashboards and visualization tools.

4. Fluent Bit:

  • Introduction to Fluent Bit: Discover how Fluent Bit collects, processes, and forwards logs to Elasticsearch, serving as the cornerstone of efficient log management.

5. Elasticsearch and Kibana Deployment on Kubernetes:

  • Kubernetes Integration: Master deployment techniques for Elasticsearch and Kibana within a Kubernetes cluster for scalable solutions.

6. Deploying Mock Ecommerce Application on Kubernetes:

  • Practical Application: Deploy and monitor a mock eCommerce application, applying your newly acquired skills in a real-world scenario.

7. Instrumenting a Simple Python Application for Logging:

  • Hands-On Logging: Learn how to instrument a Python application to generate logs, ensuring detailed visibility into application behavior.

8. Elastic Cloud:

  • Leverage Elastic Cloud services: Explore managed services for deploying and scaling Elasticsearch and Kibana effortlessly in the cloud.

Embark on this journey to become proficient in the EFK Stack and elevate your capability to maintain high-performing, reliable applications.

Read More

What our students say

About the instructor

Raghunandana Krishnamurthy is a seasoned Staff Data Engineer and MLOps expert, skilled in navigating both GCP and AWS cloud platforms to accelerate model development and deployment. His experience spans modernizing legacy data systems, architecting hybrid infrastructures, and ensuring data quality for diverse applications. He used to hold  Associate AWS Solution Architect certification, Cloudera Hadoop Admin certification, Airflow certification, and Databricks Lakehouse certification 

A technical leader and passionate trainer, Raghunandana excels at building and maintaining big data platforms, championing DevOps best practices, and fostering team alignment. With hands-on expertise in tools like SageMaker, VertexAI, Prometheus, Grafana, and extensive DevOps tools focusing on Data Engineering and MLOps.

No items found.

Introduction

lock
lock
3
Topics
Lesson Content

Module Content

Course Introduction
Join Our Community
Course GitHub URL

What Is Logging and Elasticsearch?

lock
lock
2
Topics
Lesson Content

Module Content

What is Logging, and Why Does it Matter?
Elasticsearch and its evolution

Mastering Elasticsearch Fundamentals

lock
lock
20
Topics
Lesson Content

Module Content

Mastering Fundamentals of Elasticsearch
Nodes and Cluster in Elasticsearch
Node Roles in Elasticsearch
Documents in Elasticsearch
Inverted Index in Elasticsearch
Index in Elasticsearch
Shards and Replicas in Elasticsearch
Mapping in Elasticsearch
Dynamic and Explicit Mapping in Elasticsearch
CRUD operations on Elasticsearch
Elasticsearch CRUD Commands
Elasticsearch CRUD Commands
Lab challange Elasticsearch CRUD Commands
Difference between POST and PUT operations
Difference between POST and PUT operations
Lab challange Difference between POST and PUT operations
Cluster Information - Elasticsearch CRUD Commands
Cluster Information - Elasticsearch CRUD Commands
Lab Challenge - Cluster Information - Elasticsearch CRUD Commands
MCQ: Elasticsearch

Understanding Kibana

lock
lock
10
Topics
Lesson Content

Module Content

Introduction to Kibana
Kibana visualizations and dashboards
Kibana Query Language (KQL): Understanding the syntax and capabilities of KQL for advanced data querying
KQL Demo
Building our first dashboard using Kibana
Building our first dashboard using Kibana
Interactive Dashboards with Drilldowns in Kibana
Building Dashboard Maps with Kibana
Building Dashboard Maps with Kibana
Kibana MCQ

Fluent Bit

lock
lock
7
Topics
Lesson Content

Module Content

Introduction to FluentBit
Logstash's Role within the ELK Stack
Logstash vs FluentD
FluentD vs FluentBit
Fluent Bit's Role as a Lightweight Log Shipper
Input, Filter, and Output Plugins in Fluent Bit
Fluent Bit MCQ

Elasticsearch and Kibana Deployment on Kubernetes

lock
lock
8
Topics
Lesson Content

Module Content

Deploying Elasticsearch as a Cluster within Kubernetes
Deploy Elasticsearch on Kubernetes
Deploy Elasticsearch on Kubernetes
Deployments for Kibana instances
Deploy Kibana on Kubernetes
Scaling Elasticsearch and Kibana
Security Considerations for Production Kubernetes Deployment
Scaling Elasticsearch Nodes

Deploying E-Commerce Application on K8s

lock
lock
7
Topics
Lesson Content

Module Content

Deploying Mock E-Commerce Application on K8s
Setting up Event Generator App
Setting up Fluentbit to Monitor Application Logs
Exploring Application Logs in Kibana
Dashboarding with KQL in Kibana
Conditional Appearance on Kibana Dashboards
Deploying mock ecommerce application on K8s

Instrumenting a Simple Python App for Logging

lock
lock
8
Topics
Lesson Content

Module Content

Instrumenting a Simple Python Application for Logging
Deploying and Validating the Login App on Kubernetes
Configuring Fluent Bit to Collect Python Application Logs
Deploying Login App application on K8s and Kibana on Kubernetes
Building Kibana Dashboards to Visualize Our Application - Part 1
Building Kibana Dashboards to Visualize Our Application - Part 2
Building Kibana Dashboards to Visualize Our Application - Part 3
Building Kibana Dashboards to Visualize Our Application - Part 4

Elastic Cloud

lock
lock
5
Topics
Lesson Content

Module Content

Elastic Cloud and its Offering
Elastic Cloud Quiz
Setting up Free Elastic Cloud Account
Monitoring Kubernetes Cluster using in Elastic Agent
Setting up Kubernetes monitoring in Elastic Cloud
Play Button
Fill this form to get a notification when course is released.
This course comes with hands-on cloud labs
book
9
Modules
book
Lessons
Article icon
70
Lessons
check mark
Course Certificate
Videos icon
04.10
Hours of Video
laptop
Hours of Labs
Story Format
Videos icon
Videos
Case Studies
ondemand_video icon
Demo
laptop
Labs
laptop
Cloud Labs
checklist
Mock exams
Quizzes
slack icon
Slack channel support
people icon
Community support
language icon
English
Closed Captions