Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-258

TailDir should include source file name metadata for sink

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: v0.9.0, v0.9.1, v0.9.1u1
    • Fix Version/s: v0.9.2
    • Component/s: Node
    • Labels:
      None
    • Environment:
      Linux

      Description

      When a node use tailDir, and tails for more then one source file, I would like
      to recognize the source file name in the sink.

      for example:

      I have a dir with 3 files in it.
      /evia/flume/file1
      /evia/flume/file2
      /evia/flume/file3

      so I want that in the sink all events from file2 will be in a file that have prefix file2.....

      Maybe the way to do it is to add the filename as a field of the metadata??

      Thanks

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jon Jonathan Hsieh
                Reporter:
                eviatenne Eviatar Tenne
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: