This talk will introduce Apache Kafka - a modern platform for handling streaming data. This product is successfully used in industries for:
- consolidating multiple streams into single ingestion pipe into HDFS
- implementing Lambda architectures
- performing stream processing and analytics
In this session we will demonstrate what are the advantages and how to use Kafka in all mentioned scenarios. Also it will report about status of current Kafka deployment at CERN