Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to the Architecture and Cluster Configuration of Confluent Apache Kafka

  • Overview of Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • The function of Kafka within data streaming and messaging pipelines
  • Key Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster architecture: understanding brokers, partitions, and replication

Module 2: Configuring the Zookeeper Quorum

  • Introduction to Zookeeper
  • The specific role Zookeeper plays in managing a Kafka cluster
  • Determining the appropriate Zookeeper quorum size
  • Configuring Zookeeper settings
  • Implementation of SSH on server infrastructure
  • Hands-on: Configuring Zookeeper both as a team and as a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Establishing the Zookeeper quorum setup
  • Exploring Zookeeper’s internal file system
  • Performance elements that impact Zookeeper operations
  • Demo: Overview of Zookeeper management tools and Zoonavigator

Module 3: Kafka Cluster Configuration

  • Fundamental Kafka concepts
  • General Kafka configuration processes
  • Hands-on: Setting up Kafka configuration on a single broker
  • Hands-on: Executing standard Kafka commands
  • Hands-on: Implementing a multi-broker (cluster) Kafka setup
  • Hands-on: Testing the Kafka cluster
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: a critical setting
  • Topic configuration details
  • Establishing message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka resilience
  • Kafka performance considerations: I/O, network, RAM, CPU, and OS
  • Additional factors influencing Kafka performance
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message sending and receiving methods (CLI, Java, Spring Framework)
  • Monitoring and metrics tools (Confluent Control Center, Elasticsearch, etc.)
  • Managing log files and offsets
  • Strategies for high availability and disaster recovery
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Formulating disaster recovery strategies
  • Controlling failover and recovering data
  • Setting up Connectors
  • Implementing Kafka Connect
  • Kafka security features and best practices

Summary and Next Steps

Requirements

  • Hands-on experience with Linux-based systems and command-line utilities
  • Knowledge of distributed systems principles
  • Foundational understanding of networking and system configuration

Target Audience

  • DevOps and SRE teams responsible for Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects focused on building scalable systems

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories