He has 14 years of information technology experience covering all phases of the systems and software implementation. Over the period of last 13 years, he worked as Solution Architect, Platform Administrator for Hadoop clusters, Kafka, Informatica & Talend ETL tools, Oracle databases, and ETL consultant in Business Technology Solutions, Enterprise Application Integration, Data Migration and Data Integration domains. Apart from this long-standing experience, Lakshman loves reading technical books, listening to music, farming, and watching movies.
Now, Kafka provides an ideal mechanism for storing consumer offsets. Consumers can commit their offsets in Kafka by writing them to a durable (replicated) and highly available topic. This article covers some internals of Offset management in Apache Kafka. Offset in Kafka The offset is a unique ID assigned to the partitions, which contains messages. […]
Offset: Management and Role Read More »
Kafka is a distributed, partitioned, replicated, log service that is a massively scalable pub/sub message queue architected as a distributed transaction log. It provides a unified platform for handling all the real-time data feeds a large company might have. In our last article series of Kafka, we learned about its brief regarding introduction, function and
Optimizing Kafka: Architecture Insights and Performance Tips Read More »