Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Cluster Architecture and Configuration

  • The role of Kafka in modern data pipelines
  • Distinctions between Apache Kafka and Confluent Kafka
  • Essential components: producers, consumers, brokers, topics, and partitions
  • Deployment models and scaling factors for Kafka clusters

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining Zookeeper Quorum size
  • Setting up Zookeeper configurations
  • Establishing SSH on server infrastructure
  • Practical: Configuring Zookeeper (as a team and service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical: Setting up Zookeeper Quorums
  • Exploring the Zookeeper internal file system
  • Performance metrics impacting Zookeeper
  • Demo of management tools for Zookeeper and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Fundamental Kafka concepts
  • Basic Kafka setup
  • Practical: Configuring Kafka brokers
  • Practical: Running Kafka commands
  • Practical: Setting up a Kafka Multi-Broker Cluster
  • Practical: Testing the Kafka cluster
  • Verifying connectivity to the Kafka cluster
  • Advertised.listeners settings: a critical configuration parameter
  • Topic-level configurations
  • Settings for message ingestion and retrieval in topics
  • Practical: Demonstrating Kafka resilience
  • Kafka performance: I/O operations
  • Kafka performance: Network (RED)
  • Kafka performance: RAM usage
  • Kafka performance: CPU utilization
  • Kafka performance: Operating System (OS) interactions
  • Kafka performance: Other factors
  • Practical: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
  • Messaging via CLI, Java, and the Spring framework
  • Monitoring metrics and tools (Confluent Control Center, Elasticsearch, etc.)
  • Managing log files and offsets
  • High availability and disaster recovery strategies
  • Ensuring resilience through replication
  • Optimizing producer and consumer performance
  • Disaster recovery planning
  • Failover control and data restoration
  • Configuring connectors
  • Implementing Kafka Connect
  • Reviewing Kafka security features

Summary and Future Steps

Requirements

  • Knowledge of distributed systems and messaging principles
  • Proficiency with the Linux command line
  • Fundamental understanding of networking and system administration

Target Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure teams

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories