Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration
- Introduction to Apache Kafka and the Confluent Platform
- Core concepts: Kafka brokers, producers, consumers, and topics
- The role of Kafka in data streaming and messaging pipelines
- Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center
- Kafka cluster architecture: brokers, partitions, and replication mechanisms
Module 2: Configuring the Zookeeper Quorum
- Introduction to Zookeeper
- The function of Zookeeper within a Kafka cluster
- Determining appropriate Zookeeper quorum sizes
- Zookeeper configuration processes
- Implementing SSH on server infrastructure
- Hands-on: Configuring Zookeeper (both as a team member and as a service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Hands-on: Establishing a Zookeeper quorum
- Zookeeper’s internal file system structure
- Performance factors that impact Zookeeper
- Demo: Using Zookeeper management tools and Zoonavigator
Module 3: Configuring the Kafka Cluster
- Fundamentals of Kafka
- Core configuration settings
- Hands-on: Configuring Kafka on a single broker
- Hands-on: Executing standard Kafka commands
- Hands-on: Setting up a multi-broker Kafka cluster
- Hands-on: Testing the stability of the Kafka cluster
- Verifying connectivity to the Kafka cluster
- Configuring Advertised.listeners: a critical setting
- Topic configuration strategies
- Setting up message ingestion and delivery workflows
- Hands-on: Demonstrating Kafka’s resilience capabilities
- Kafka performance optimization: I/O, network, RAM, CPU, and OS considerations
- Kafka performance: additional influencing factors
- Hands-on: Modifying broker configurations effectively
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Message transmission and reception (via CLI, Java, and Spring Framework)
- Metrics and monitoring tools (including Confluent Control Center and Elasticsearch)
- Managing log files and offsets
- High availability and disaster recovery planning
- Ensuring high availability through replication
- Performance tuning for producers and consumers
- Developing disaster recovery strategies
- Controlling failover and managing data recovery
- Setting up connectors
- Implementing Kafka Connect
- Exploring Kafka security features
Summary and Next Steps
Requirements
- Practical experience with Linux-based operating systems and command-line utilities
- Working knowledge of distributed systems principles
- Foundational understanding of networking and system configuration
Target Audience
- DevOps and SRE teams responsible for managing Kafka deployments
- System administrators working with Confluent and Zookeeper ecosystems
- Kafka developers and architects tasked with building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)