@@ -28,4 +28,31 @@ log data to Sentry for aggregation. Sentry provides a clean web application
2828interface for viewing the exceptions. Sentry can also be configured with a
2929mail plugin to send emails when exceptions occur.
3030
31+ ## Logging Aggregators
3132
33+ When you are running your application on several servers, it is helpful
34+ to have a monitoring tool called a "logging aggregator". You can configure your
35+ application to forward your system and application logs to one location that
36+ provides tools such as to viewing searching, and monitoring logging events across your cluster.
37+
38+ Another advantage of log aggregatortion tools is they allow you to set up custom alerts
39+ and alarms so you can get notified when error rates breach a certain threshold.
40+
41+ ### Log Aggregator Third Party Services
42+ * [ loggly] ( https://www.loggly.com/ ) Loggly is a third party cloud based application that
43+ aggregates logs. They have instructions for every major language, including python. It includes email
44+ alerting on custom searches.
45+ * [ papertrail] ( https://papertrailapp.com/ ) Paper trail is similar to both loggly and splunk and provides
46+ integration with S3 for
47+ * [ splunk] ( http://www.splunk.com/ ) Splunk offers third party cloud and self hosted solutions
48+ for event aggregation. It excells at searching and data mining any text based data.
49+
50+ ###Open Source Projects
51+ * [ Graylog2] ( http://graylog2.org/ ) Provides a central server for log aggregation as well as a GUI for
52+ browsing and searching through log events. There are libraries for most major languages, including python.
53+ Saves data in elasicache.
54+ * [ Logstash] ( http://logstash.net/ ) Similar to Graylog2, logstash offers features to programatically
55+ configure log data workflows.
56+ * [ Scribe] ( https://github.com/facebook/scribe ) A project written by facebook to aggregate logs. It's designed
57+ to run on multiple servers and scale with the rest of your cluster. Uses the Thrift messagaing format so it can
58+ be used with any language.
0 commit comments