Get in Touch
 Duration 16 hours

Course Outline

Module 1: Fundamentals of Confluent Apache Kafka Architecture and Cluster Configuration

  • Overview of Apache Kafka and the Confluent Platform
  • Core concepts of Kafka brokers, producers, consumers, and topics
  • The function of Kafka in data streaming and messaging workflows
  • Confluent add-ons: REST Proxy, Schema Registry, and Control Center
  • Cluster architecture details: brokers, partitions, and replication

Module 2: Zookeeper Quorum Setup

  • Introduction to Zookeeper
  • Zookeeper's function within a Kafka cluster
  • Determining Zookeeper quorum size
  • Zookeeper configuration parameters
  • Implementing SSH on our servers
  • Practical Exercise: Configuring Zookeeper (as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical Exercise: Establishing Zookeeper quorum
  • Zookeeper's internal file system structure
  • Performance considerations impacting Zookeeper
  • Demonstration: Zookeeper management utilities and Zoonavigator

Module 3: Kafka Cluster Setup

  • Core Kafka concepts
  • Kafka configuration settings
  • Practical Exercise: Configuring Kafka on a single broker
  • Practical Exercise: Running Kafka commands
  • Practical Exercise: Setting up a Kafka multi-broker (cluster) environment
  • Practical Exercise: Testing the Kafka cluster
  • Verifying connectivity to your Kafka cluster
  • Configuring Advertised.listeners: essential settings
  • Topic configuration details
  • Establishing message ingestion and delivery within topics
  • Practical Exercise: Illustrating Kafka resilience
  • Kafka performance metrics: I/O, network, RAM, CPU, and OS
  • Kafka performance: additional influencing factors
  • Practical Exercise: Modifying broker configurations

Module 4: Advanced Kafka Configurations

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages via CLI, Java, and Spring Framework
  • Metrics and monitoring solutions (Confluent Control Center, Elasticsearch, and others)
  • Log file and offset management
  • High availability and disaster recovery planning
  • Achieving high availability through replication
  • Performance optimization for producers and consumers
  • Disaster recovery methodologies
  • Failover control and data restoration
  • Connector implementation
  • Deploying Kafka Connect
  • Kafka security features

Conclusion and Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Working knowledge of distributed systems principles
  • Foundational understanding of networking and system configuration

Target Audience

  • DevOps and SRE teams responsible for Kafka deployments
  • System administrators collaborating with Confluent and Zookeeper
  • Kafka developers and architects tasked with building scalable systems

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories