Application Logging in the 21st Century
Application Logging in the 21st Century
By Tim Bunce
Date: Friday, 10 October 2014 14:10
Duration: 40 minutes
Target audience: Any
Language: English
Tags: elasticsearch haproxy json kibana log4perl logstash rsyslog
You can find more information on the speaker's site:
We run lots of applications on lots of machines. Many written in Perl but many not.
In this talk I'll be exploring how we've evolved the logging step by step to the point where we now capture, forward, and store all log messages from all applications on all machines into an Elasticsearch cluster. The powerful Kibana GUI makes searching fast, simple and powerful.
And not just applications logs as we also log all TCP and HTTP traffic as well, via haproxy.
Along the way we've learned many useful lessons and a few tricks.
For Perl applications in particular I'll be showing how we generate logs in JSON and automatically include extra 'contextual data' that make log messages much more useful. Got an uninitialized variable warning? Now you can see what the code was working on when that happened.
Attended by: Markus Förster, Thomas Heine, David Schmidt (davewood), Stephen Riehm, Elizabeth Mattijsen (liz), Paul Cochrane (ptc), Patrick Michaud (Pm), Philipp Gortan (mephinet), Stefan Seifert (Nine), Johann Rolschewski (jorol), Peter Holzer (hjp), Nina Bieringer, Sebastian Hofer, steve mynott (itz), Roland Ortner, Timo Paulssen (timotimo), Wendy Van Dijk (woolfy), Sue Mynott (virtualsue),
