Wednesday, Sep 11, 17.30:
Simplify log analytics with Kafka

We are seeing a rise in a new generation of logging solutions. Traditional approaches have been based on database indexes, but the next wave of log management platforms is a combination of techniques including streaming queries, in-memory processing, brute-force search, and filtering. We call this *Index-Free Logging*.

In this talk, we will provide an overview of the advantages of Index-Free Logging, and how we’re implementing it in Humio, a new log analytics system with a novel storage and query engine for events logs and traces. Humio was built from the ground up as a multi-tenant on-prem system so you can install it behind your own firewalls or in your own cloud infrastructure.

In a Humio setup, we then use Kafka for two things: buffering ingest and as a sequencer of events among the nodes of a Humio cluster. We love Kafka — it has made implementing a distributed system significantly easier than if we had to do the distributed queue from scratch. Using Kafka as a building block has allowed us to focus our attention on building a fast and easy search experience.

Join GOTO Night’s next meetup with Kresten Thorup, CTO and Co-founder of Humio. Kresten will provide an overview of the advantages of Index-Free Logging and how his company implements it. Expect an evening of learning and networking with fellow developers. 

Speaker 

Kresten Krab Thorup is CTO and Co-founder of Humio. He provides technical leadership and vision at Humio. In his previous role as CTO of Trifork, Kresten was responsible for technical strategy and has provided consulting advice to teams on a variety of technologies to include distributed systems and databases, Erlang, Java, and mobile application development. Kresten has been a contributor to several open source projects, including GCC, GNU Objective-C, GNU Compiled Java, Emacs, and Apache Geronimo/Yoko. Prior to Trifork, Kresten worked at NeXT Software (now acquired by Apple), where he was responsible for the development of the Objective-C tool chain, the debugger, and the runtime system. Kresten has a Ph.D. in computer science from University of Aarhus.

Agenda

17:30 – Meet & Greet

17.45 – Talk 1: Index-Free Log Aggregation With Kafka

18.30 – Break with something lighter to eat and drink

19.00 – Q&A

20.00 – The End