Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-515

Master Node does not bootstrap custom formats extending from AbstractOutputFormat

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v0.9.3, v0.9.4
    • Component/s: None
    • Labels:
      None

      Description

      To use a custom output format the format need to be registered on both the master and nodes in you Flume cluster.

      Currently the Nodes register the custom output format by calling 'FlumeNode.loadOutputFormatPlugins' which registers the custom format in the 'FormatFactory'.
      The master does not make this call so only the core formats are loaded which results in you not being able to use your custom output format.

      You can see the custom format being loaded in the node logs by looking for the following line
      '2011-02-09 02:52:19,768 INFO com.cloudera.flume.agent.FlumeNode: Registered output format plugin x.y.z'

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gnoremac cameron gandevia
                Reporter:
                gnoremac cameron gandevia
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: