Fluentd

Fluentd
Developer(s) Treasure Data
Initial release October 2011 (2011-10)
Stable release
v0.12.15
Written in C, Ruby
Operating system Linux (Amazon Linux, CentOS, RHEL), Mac OS X (10.9 and above), Ruby, Windows (7 and above)
Type Logging Tool
License opensource under Apache 2.0
Website fluentd.org

Fluentd is a cross platform open source data collection solution originally developed at Treasure Data. It is written primarily in Ruby.

Overview

Fluentd is a Big Data tool and deals with semi- or unstructured data sets in real time. Like Kafka, it analyzes event logs, application logs, and clickstreams.[1] According to Suonsyrjä and Mikkonen, the "core idea of Fluentd is to be the unifying layer between different types of log inputs and outputs."[2] According to its official website, Fluentd is available on Linux and Mac OSX and experimentally on Windows.[3]

History

Fluentd was created by Sadayuki Furuhashi as a project of the Mountain View-based firm Treasure Data. Written primarily in Ruby, its source code was released as open source in October 2011.[4][5]

Users

Fluentd is one of the data collection tools recommended by Amazon Web Services who noted in their 2013 white paper that while its architecture is very similar to Apache Flume or Scribe, Fluentd had better documentation and support and was easier to both install and maintain.[6] Google Cloud Platform's BigQuery recommends Fluentd as default real-time data-ingestion tool, and uses Google's customized version of Fluentd, called google-fluentd, as a default logging agent.[7][8]

References

  1. ↑ Pasupuleti, Pradeep and Purra, Beulah Salome (2015). Data Lake Development with Big Data. pp. 44–45; 48. Packt. ISBN 1785881663
  2. ↑ Suonsyrjä, Sampo and Mikkonen, Tommi "Designing an Unobtrusive Analytics Framework for Monitoring Java Applications", pp. 170–173 in Software Measurement. Springer. ISBN 3319242857
  3. ↑ Fluentd.org. "Download Fluentd". Retrieved 10 March 2016.
  4. ↑ Mayer, Chris (30 October 2013). "Treasure Data: Breaking down the Hadoop barrier". JAXenter
  5. ↑ Fluentd.org. "What is Fluentd?". Retrieved 10 March 2016.
  6. ↑ Deyhim, Parviz (August 2013). "Best Practices for Amazon EMR", p. 12. Amazon Web Services. Retrieved 10 March 2016.
  7. ↑ Google Cloud Platform (2016). "Real-time logs analysis using Fluentd and BigQuery". Retrieved 10 March 2016.
  8. ↑ Google Cloud Platform (2016). "The Logging Agent". Retrieved 10 March 2016.

Further reading

External links

This article is issued from Wikipedia - version of the 10/22/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.