Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-432

Add ability to provide directory filter to tailDir sink in case of recursing into subdirs

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      Currently tailDir accepts regex parameter that is used to filter files to be tailed. In case of recursing into subdirs (FLUME-410) filter is not applied to directories. Ability to filter directories to recurse into (i.e. the ones to tail) should be provided.

      Suggestions:

      • add extra param for filtering dirs on regex
      • filter files & dirs based on full path. E.g. user could use "subdir[12](/..log)?" to tail subdir1/.log and subdir2/*.log

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                alex Alex Baranau
                Reporter:
                alex Alex Baranau
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: