Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-410

Add ability to tail subdirs to tailDir sink

          Details

          • Type: New Feature
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: v0.9.3
          • Component/s: Sinks+Sources
          • Labels:
            None

            Description

            Add additional parameter to tailDir source to make it recurse into subdirectories for watching/tailing files. Ideally add parameter which defines max depth of recursing.

            Motivation:

            There are monitoring (and other type of tools) tools which write logs into multiple dirs, i.e. log files are not in a single dir but placed into multiple dirs with tree structure. E.g. collectd creates separate dir for each cpu and puts there logs.

              Attachments

                Issue Links

                blocks

                Improvement - An improvement or enhancement to an existing feature or task. FLUME-431 Add attribute with dir path to events produced by tailing sources

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Open

                Improvement - An improvement or enhancement to an existing feature or task. FLUME-432 Add ability to provide directory filter to tailDir sink in case of recursing into subdirs

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Open

                  Activity

                    People

                    • Assignee:
                      alex Alex Baranau
                      Reporter:
                      alex Alex Baranau
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      1 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: