Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms.
The system is centrally managed and allows for intelligent dynamic management. It uses a simple extensible data model that allows for online analytic applications.
Get Flume and give it a try to fully assess its capabilities!
What's New in This Release: [ read full changelog ]
Bug:
· [FLUME-48] - collectorSink writes files with .seq suffix even though text files are written out.
· [FLUME-129] - Find and fix bug/race that caused TestTailSourceCursor.testCursorRotatePrexistingSameSizeWithNewModtime to fail.
· [FLUME-203] - Fix TestDiskFailoverAgent flakiness
· [FLUME-265] - FanOut Collector does not support multiple collectorSink attributes
· [FLUME-305] - Fix code that causes TestCollectorSink to fail intermittently.
· [FLUME-474] - flume executable doesn't support extending java.library.path with flume-env.sh
· [FLUME-482] - Compression producing NullPointerException
· [FLUME-496] - Handle 64-bit vs 32-bit JVM during windows install.
· [FLUME-511] - Output format args can't be given via the configuration language
· [FLUME-513] - Typo fixes
· [FLUME-515] - Master Node does not bootstrap custom formats extending from AbstractOutputFormat
· [FLUME-516] - bin/flume script does not properly load pre-existing hadoop jars
· [FLUME-523] - Missing jar reference in h...