Apache Kafka Complete Training - Streaming & Data Pipeline Mastery

Master Apache Kafka with our immersive course designed for real-time data enthusiasts! Dive into messaging systems, producers/consumers dynamics, reliable delivery mechanisms & build powerful data pipelines. Learn from experts to harness the full potential of streaming data for impactful insights & decision-making.

Face-to-Face May 20-21, 2026 9:00 AM - 5:00 PM Waqar Tariq
updated
beginner
Apache Kafka
We price match

Public Pricing

MYR 3500

Corporate Pricing

Pax:

Training Fees: MYR 6500/day
Total Fees: MYR 13000 ++

Training Provider Pricing

Pax:

Training Fees: MYR 2400/day
Material Fees: MYR 400
Total Fees: MYR 5200 ++

Features

2 days
16 modules
20 intakes
English
Technical: 25 pax

Target Audience

students
engineers

Methodologies

lecture
slides
labs
case studies
group discussion

Subsidies

HRDC Claimable logo

What you'll learn

  • Construct efficient Kafka producers and consumers for message handling
  • Comprehend the role of Zookeeper in Apache Kafka's ecosystem
  • Implement reliable data delivery systems using Apache Kafka
  • Administer a Kafka environment effectively through topic management and performance monitoring
  • Install and configure Apache Kafka brokers both locally and in cloud environments
  • Understand the fundamental concepts of messaging systems and Apache Kafka
  • Gain deep knowledge of Kafka internals such as cluster membership and replication
  • Build scalable data pipelines utilizing Kafka Connect and stream-processing frameworks

Why should you attend?

Apache Kafka is a robust, open-source stream processing platform that enables real-time data feeding, processing, and analytics. It's designed to handle high volumes of data and support high-throughput applications. This course begins with an introduction to messaging systems, focusing on Apache Kafka's role in the modern data ecosystem and its workflow. We'll cover installation procedures, including configuring Kafka brokers and deploying Kafka in cloud environments. The crucial role of Zookeeper in managing cluster state and basic operations is also discussed. Building on this foundation, we delve into Kafka producers and consumers—key components for writing and reading messages within Kafka. You'll learn how to construct producers, configure them for optimal performance, create consumers, and manage commits and offsets. Understanding Kafka's internals will provide insights into cluster membership, replication mechanisms, request processing, and physical storage considerations. The course emphasizes reliable data delivery by exploring system reliability validation techniques. We also tackle building resilient data pipelines with Kafka Connect and stream-processing frameworks while addressing critical factors like timeliness, throughput, and security. Cross-cluster data mirroring techniques are explained to ensure robust multicluster architectures. Finally, administering Kafka topics, consumer groups, dynamic configurations, along with monitoring using Kafka APIs and metrics are covered to equip you with comprehensive administration skills.

Course Syllabus

Day 1 - Kafka Fundamentals and Core Components
Module 1
Module 2
Short Break
15 mins
Module 3
Module 4
Recap and Q&A
15 mins
Lunch
1 hour
Module 5
Module 6
Short Break
15 mins
Module 7
Module 8
Recap and Q&A
15 mins
End of Day 1
Day 2 - Data Pipelines and Stream Processing
Module 9
Module 10
Short Break
15 mins
Module 11
Module 12
Recap and Q&A
15 mins
Lunch
1 hour
Module 13
Module 14
Short Break
15 mins
Module 15
Module 16
Recap and Q&A
15 mins
End of Day 2

Instructor

Loading...
Tasmeea Rahman Data Analytics & Engineering Training Specialist
Trainer Profile
Trainer Profile
TTT Certificate
TTT Certificate
TTT Accreditation
TTT Accreditation
Tasmeea Rahman is a highly accomplished corporate trainer and academic professional with a unique blend of technical expertise and pedagogical excellence. Currently pursuing her PhD in Project Management with a focus on Energy Management in the electrical power industry at Universiti Putra Malaysia, she maintains an exceptional 4.00/4.00 CGPA while actively contributing to the professional training landscape. With extensive experience as a Freelance Corporate Trainer since 2023, Tasmeea specializes in delivering comprehensive training programs across multiple domains. Her training portfolio encompasses advanced data analytics tools including Python, Power BI, Minitab, Jaspersoft, Apache Superset, and TIBCO Spotfire, as well as machine learning applications. She also excels in teaching engineering design software such as AutoCAD, Autodesk Fusion 360, Solid Edge, and Autodesk 3Ds Max for both 2D and 3D electrical and mechanical designs. Her project management training capabilities further complement her diverse skill set. Her academic credentials are impressive, holding a Master of Engineering Management from Universiti Putra Malaysia (CGPA: 3.713/4.00), an MBA in Marketing from the University of Dhaka (CGPA: 3.61/4.00), and a Bachelor's degree in Electrical and Electronics Engineering. This multidisciplinary educational background enables her to bridge technical concepts with business applications effectively. As an Adjunct Lecturer at Leading University, she demonstrated her ability to develop curricula and deliver engaging lectures on complex electrical and electronics subjects, including VLSI design, digital signal processing, and microprocessor systems. Tasmeea's research contributions are noteworthy, with publications in high-impact journals including a first-author paper in Renewable and Sustainable Energy Reviews (Q1, Impact Factor: 15.9) and co-authored works in IEEE Access. She holds a Train the Trainer Certification from HRD Corp Malaysia and is certified in Agile Project Management by Google. Her technical proficiency spans programming languages like Python and C++, engineering software including MATLAB and CISCO Packet Tracer, and various data analytics platforms. With her combination of industry experience, academic rigor, and certified training expertise, Tasmeea delivers practical, industry-relevant training that empowers professionals to excel in their respective fields.
8 Students
88 Courses
8 Years

Instructor

Loading...
Mohammad Mehdi Lotfinejad Chief Data Officer & Data Science Trainer
Trainer Profile
Trainer Profile
TTT Certificate
TTT Certificate
Mohammad Mehdi Lotfinejad is a distinguished Chief Data Officer and certified HRDF trainer with over 15 years of experience in computer science instruction and professional data science training. Currently serving as Chief Data and Knowledge Officer at Magna.ai, a Florida-based lawtech company, he leads the development of sophisticated graph databases, data warehouses, and API solutions that power AI-driven legal case analysis systems. His expertise spans the entire data ecosystem, from architecture design to workflow automation and team leadership. With a robust background encompassing more than a decade of hands-on experience in data engineering and data science, Mohammad has successfully implemented enterprise-scale data processing pipelines across multiple industries and geographies. His professional journey includes senior roles at Axiata Digital Advertising (ADA) in Malaysia, where he designed and deployed data pipelines using AWS Redshift, Snowflake, Apache Spark, and Apache Airflow, and at The Center of Applied Data Science, where he led teams delivering training solutions to major corporations including CIMB, PETRONAS, SHELL, and TNB. Mohammad's technical proficiency is comprehensive and current, encompassing cloud platforms (AWS, Google Cloud), data warehousing solutions (Redshift, Snowflake), big data technologies (Apache Spark, Hadoop, Hive), workflow orchestration (Apache Airflow), and multiple database systems (MySQL, PostgreSQL, MongoDB). He holds a Harvard Business School certification in Business Analytics and multiple AWS certifications, including specialized credentials in Big Data, Data Warehousing, and Practical Data Science with Amazon SageMaker. As an educator, Mohammad brings exceptional depth to his training delivery. His academic career includes faculty positions at Payame Noor University and Islamic Azad University, where he served in leadership roles including Chancellor and Department Head. He has authored three technical books and published numerous peer-reviewed papers in international journals. His teaching repertoire covers data engineering, data science, machine learning, software development, and computer architecture, delivered through engaging, hands-on methodologies that bridge theoretical concepts with practical industry applications. Mohammad's unique combination of executive leadership, technical expertise, and proven training capabilities makes him an invaluable resource for organizations seeking to develop their data science and engineering capabilities. His ability to translate complex technical concepts into actionable learning outcomes, coupled with his extensive real-world implementation experience, ensures that training participants gain immediately applicable skills that drive business value.
8 Students
101 Courses
18 Years

Instructor

Loading...
Waqar Tariq Project Management & Operations Excellence Trainer
Trainer Profile
Trainer Profile
TTT Certificate
TTT Certificate
TTT Accreditation
TTT Accreditation
Dr. Engr. Waqar Tariq is a certified Project Management Professional (PMP®) and HRDC Malaysia-accredited trainer who brings a unique blend of academic excellence and practical industry expertise to every training engagement. With a PhD in Project Management from University Putra Malaysia and professional engineering credentials, he has established himself as a leading authority in operations management, project delivery, corporate communication, and organizational leadership across multiple continents. Throughout his distinguished career, Dr. Tariq has trained and consulted with professionals and organizations across Southeast Asia, the Gulf region, Australia, and the United Kingdom. His expertise spans a comprehensive range of critical business domains including operations management with focus on process design, lean operations, and JIT systems; advanced project management incorporating CPM, PERT, agile methodologies, and risk management; and corporate communication encompassing executive communication, negotiation, presentation skills, and stakeholder engagement. He is particularly recognized for his work in data-backed decision making, digital transformation, AI integration in operations, and strategic leadership during organizational change. What distinguishes Dr. Tariq as a trainer is his commitment to bridging academic rigor with industry practice. He designs and delivers highly engaging, practical training programs built around real-world case studies, simulations, and applied exercises that ensure participants gain immediately implementable skills. His training portfolio includes modules on corporate communication and negotiation, executive presentation, stakeholder engagement, change management, digital transformation, risk management, business continuity planning, and both fundamental and advanced project management practices. Participants consistently praise Dr. Tariq's ability to deliver complex topics with clarity and structure, his use of relevant industry examples to connect theory with practice, and his mentorship approach that extends beyond the classroom. His training methodology focuses on building confidence through practical assignments while strengthening communication and decision-making capabilities that directly impact organizational performance. Dr. Tariq views himself as a partner in growth, dedicated to helping individuals and organizations transform challenges into opportunities through better operations, stronger leadership, and clearer communication, creating lasting impact with every program he delivers.
12 Courses
English, Urdu
15 Years

Instructor Reviews

TR

Tasmeea Rahman

Data Analytics & Engineering Training Specialist

"Tasmeea was an excellent teacher. Very pleasant, willing to assist and answer concerns, and continuously asked how she could assist more. She made the course enjoyable as well as informative."

"Thank you so much for your invaluable guidance. I really enjoyed it and appreciated how much fun you made it! I feel much more equipped to cope with difficult challenges."

"The training was both fascinating and beneficial. Many members of the staff commented on how useful it was. Tasmeea delivers the topic with authority, wit, and passion."

ML

Mohammad Mehdi Lotfinejad

Chief Data Officer & Data Science Trainer

"Mehdi and I worked on several projects with company such as Petronas , Shell and CIMB Regional ETC. I must say Mehdi's training was highly appreciated by our clients as he was able to exhibit in full display his vast knowledge as a Data professional. I would highly recommend him to anyone looking for a top tier training expert."

"Not only knowledgeable but also having hands dirty on what he knows Friendly and building networks quickly."

"I had the pleasure of working with Mehdi together on some high-level initiatives such as the Petronas data scientist program and Shell's project to become a data-driven organization. During these projects, Mehdi received numerous accolades for his ability to share his knowledge and mentor up-and-coming data scientists. Based on our shared experiences, I have no hesitation in recommending Mehdi for any project or position he may be considered for."

FAQ

Frequently Asked Questions About This Course

Why should you attend?

Apache Kafka is a robust, open-source stream processing platform that enables real-time data feeding, processing, and analytics. It's designed to handle high volumes of data and support high-throughput applications. This course begins with an introduction to messaging systems, focusing on Apache Kafka's role in the modern data ecosystem and its workflow. We'll cover installation procedures, including configuring Kafka brokers and deploying Kafka in cloud environments. The crucial role of Zookeeper in managing cluster state and basic operations is also discussed. Building on this foundation, we delve into Kafka producers and consumers—key components for writing and reading messages within Kafka. You'll learn how to construct producers, configure them for optimal performance, create consumers, and manage commits and offsets. Understanding Kafka's internals will provide insights into cluster membership, replication mechanisms, request processing, and physical storage considerations. The course emphasizes reliable data delivery by exploring system reliability validation techniques. We also tackle building resilient data pipelines with Kafka Connect and stream-processing frameworks while addressing critical factors like timeliness, throughput, and security. Cross-cluster data mirroring techniques are explained to ensure robust multicluster architectures. Finally, administering Kafka topics, consumer groups, dynamic configurations, along with monitoring using Kafka APIs and metrics are covered to equip you with comprehensive administration skills.


What you'll learn

  • Construct efficient Kafka producers and consumers for message handling
  • Comprehend the role of Zookeeper in Apache Kafka's ecosystem
  • Implement reliable data delivery systems using Apache Kafka
  • Administer a Kafka environment effectively through topic management and performance monitoring
  • Install and configure Apache Kafka brokers both locally and in cloud environments
  • Understand the fundamental concepts of messaging systems and Apache Kafka
  • Gain deep knowledge of Kafka internals such as cluster membership and replication
  • Build scalable data pipelines utilizing Kafka Connect and stream-processing frameworks

Course Syllabus

Day 1 - Kafka Fundamentals and Core Components
Module 1
Module 2
Short Break
15 mins
Module 3
Module 4
Recap and Q&A
15 mins
Lunch
1 hour
Module 5
Module 6
Short Break
15 mins
Module 7
Module 8
Recap and Q&A
15 mins
End of Day 1
Day 2 - Data Pipelines and Stream Processing
Module 9
Module 10
Short Break
15 mins
Module 11
Module 12
Recap and Q&A
15 mins
Lunch
1 hour
Module 13
Module 14
Short Break
15 mins
Module 15
Module 16
Recap and Q&A
15 mins
End of Day 2

Instructor Reviews

Tasmeea Rahman

Tasmeea Rahman

Data Analytics & Engineering Training Specialist

"Tasmeea was an excellent teacher. Very pleasant, willing to assist and answer concerns, and continuously asked how she could assist more. She made the course enjoyable as well as informative."

"Thank you so much for your invaluable guidance. I really enjoyed it and appreciated how much fun you made it! I feel much more equipped to cope with difficult challenges."

"The training was both fascinating and beneficial. Many members of the staff commented on how useful it was. Tasmeea delivers the topic with authority, wit, and passion."

Mohammad Mehdi Lotfinejad

Mohammad Mehdi Lotfinejad

Chief Data Officer & Data Science Trainer

"Mehdi and I worked on several projects with company such as Petronas , Shell and CIMB Regional ETC. I must say Mehdi's training was highly appreciated by our clients as he was able to exhibit in full display his vast knowledge as a Data professional. I would highly recommend him to anyone looking for a top tier training expert."

"Not only knowledgeable but also having hands dirty on what he knows Friendly and building networks quickly."

"I had the pleasure of working with Mehdi together on some high-level initiatives such as the Petronas data scientist program and Shell's project to become a data-driven organization. During these projects, Mehdi received numerous accolades for his ability to share his knowledge and mentor up-and-coming data scientists. Based on our shared experiences, I have no hesitation in recommending Mehdi for any project or position he may be considered for."

We price match

Public Pricing

MYR 3500

Corporate Pricing

Pax:

Training Fees: MYR 6500/day
Total Fees: MYR 13000 ++

Training Provider Pricing

Pax:

Training Fees: MYR 2400/day
Material Fees: MYR 400
Total Fees: MYR 5200 ++

Features

2 days
16 modules
20 intakes
English
Technical: 25 pax

Target Audience

students
engineers

Methodologies

lecture
slides
labs
case studies
group discussion

Subsidies

HRDC Claimable logo

Instructors

Loading...
Tasmeea Rahman Data Analytics & Engineering Training Specialist
Trainer Profile
Trainer Profile
TTT Certificate
TTT Certificate
TTT Accreditation
TTT Accreditation
Tasmeea Rahman is a highly accomplished corporate trainer and academic professional with a unique blend of technical expertise and pedagogical excellence. Currently pursuing her PhD in Project Management with a focus on Energy Management in the electrical power industry at Universiti Putra Malaysia, she maintains an exceptional 4.00/4.00 CGPA while actively contributing to the professional training landscape. With extensive experience as a Freelance Corporate Trainer since 2023, Tasmeea specializes in delivering comprehensive training programs across multiple domains. Her training portfolio encompasses advanced data analytics tools including Python, Power BI, Minitab, Jaspersoft, Apache Superset, and TIBCO Spotfire, as well as machine learning applications. She also excels in teaching engineering design software such as AutoCAD, Autodesk Fusion 360, Solid Edge, and Autodesk 3Ds Max for both 2D and 3D electrical and mechanical designs. Her project management training capabilities further complement her diverse skill set. Her academic credentials are impressive, holding a Master of Engineering Management from Universiti Putra Malaysia (CGPA: 3.713/4.00), an MBA in Marketing from the University of Dhaka (CGPA: 3.61/4.00), and a Bachelor's degree in Electrical and Electronics Engineering. This multidisciplinary educational background enables her to bridge technical concepts with business applications effectively. As an Adjunct Lecturer at Leading University, she demonstrated her ability to develop curricula and deliver engaging lectures on complex electrical and electronics subjects, including VLSI design, digital signal processing, and microprocessor systems. Tasmeea's research contributions are noteworthy, with publications in high-impact journals including a first-author paper in Renewable and Sustainable Energy Reviews (Q1, Impact Factor: 15.9) and co-authored works in IEEE Access. She holds a Train the Trainer Certification from HRD Corp Malaysia and is certified in Agile Project Management by Google. Her technical proficiency spans programming languages like Python and C++, engineering software including MATLAB and CISCO Packet Tracer, and various data analytics platforms. With her combination of industry experience, academic rigor, and certified training expertise, Tasmeea delivers practical, industry-relevant training that empowers professionals to excel in their respective fields.
8 Students
88 Courses
8 Years
Loading...
Mohammad Mehdi Lotfinejad Chief Data Officer & Data Science Trainer
Trainer Profile
Trainer Profile
TTT Certificate
TTT Certificate
Mohammad Mehdi Lotfinejad is a distinguished Chief Data Officer and certified HRDF trainer with over 15 years of experience in computer science instruction and professional data science training. Currently serving as Chief Data and Knowledge Officer at Magna.ai, a Florida-based lawtech company, he leads the development of sophisticated graph databases, data warehouses, and API solutions that power AI-driven legal case analysis systems. His expertise spans the entire data ecosystem, from architecture design to workflow automation and team leadership. With a robust background encompassing more than a decade of hands-on experience in data engineering and data science, Mohammad has successfully implemented enterprise-scale data processing pipelines across multiple industries and geographies. His professional journey includes senior roles at Axiata Digital Advertising (ADA) in Malaysia, where he designed and deployed data pipelines using AWS Redshift, Snowflake, Apache Spark, and Apache Airflow, and at The Center of Applied Data Science, where he led teams delivering training solutions to major corporations including CIMB, PETRONAS, SHELL, and TNB. Mohammad's technical proficiency is comprehensive and current, encompassing cloud platforms (AWS, Google Cloud), data warehousing solutions (Redshift, Snowflake), big data technologies (Apache Spark, Hadoop, Hive), workflow orchestration (Apache Airflow), and multiple database systems (MySQL, PostgreSQL, MongoDB). He holds a Harvard Business School certification in Business Analytics and multiple AWS certifications, including specialized credentials in Big Data, Data Warehousing, and Practical Data Science with Amazon SageMaker. As an educator, Mohammad brings exceptional depth to his training delivery. His academic career includes faculty positions at Payame Noor University and Islamic Azad University, where he served in leadership roles including Chancellor and Department Head. He has authored three technical books and published numerous peer-reviewed papers in international journals. His teaching repertoire covers data engineering, data science, machine learning, software development, and computer architecture, delivered through engaging, hands-on methodologies that bridge theoretical concepts with practical industry applications. Mohammad's unique combination of executive leadership, technical expertise, and proven training capabilities makes him an invaluable resource for organizations seeking to develop their data science and engineering capabilities. His ability to translate complex technical concepts into actionable learning outcomes, coupled with his extensive real-world implementation experience, ensures that training participants gain immediately applicable skills that drive business value.
8 Students
101 Courses
18 Years
Loading...
Waqar Tariq Project Management & Operations Excellence Trainer
Trainer Profile
Trainer Profile
TTT Certificate
TTT Certificate
TTT Accreditation
TTT Accreditation
Dr. Engr. Waqar Tariq is a certified Project Management Professional (PMP®) and HRDC Malaysia-accredited trainer who brings a unique blend of academic excellence and practical industry expertise to every training engagement. With a PhD in Project Management from University Putra Malaysia and professional engineering credentials, he has established himself as a leading authority in operations management, project delivery, corporate communication, and organizational leadership across multiple continents. Throughout his distinguished career, Dr. Tariq has trained and consulted with professionals and organizations across Southeast Asia, the Gulf region, Australia, and the United Kingdom. His expertise spans a comprehensive range of critical business domains including operations management with focus on process design, lean operations, and JIT systems; advanced project management incorporating CPM, PERT, agile methodologies, and risk management; and corporate communication encompassing executive communication, negotiation, presentation skills, and stakeholder engagement. He is particularly recognized for his work in data-backed decision making, digital transformation, AI integration in operations, and strategic leadership during organizational change. What distinguishes Dr. Tariq as a trainer is his commitment to bridging academic rigor with industry practice. He designs and delivers highly engaging, practical training programs built around real-world case studies, simulations, and applied exercises that ensure participants gain immediately implementable skills. His training portfolio includes modules on corporate communication and negotiation, executive presentation, stakeholder engagement, change management, digital transformation, risk management, business continuity planning, and both fundamental and advanced project management practices. Participants consistently praise Dr. Tariq's ability to deliver complex topics with clarity and structure, his use of relevant industry examples to connect theory with practice, and his mentorship approach that extends beyond the classroom. His training methodology focuses on building confidence through practical assignments while strengthening communication and decision-making capabilities that directly impact organizational performance. Dr. Tariq views himself as a partner in growth, dedicated to helping individuals and organizations transform challenges into opportunities through better operations, stronger leadership, and clearer communication, creating lasting impact with every program he delivers.
12 Courses
English, Urdu
15 Years

FAQ

Frequently Asked Questions About This Course

Close menu