Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-250

Allow compression in Avro output formats

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: v0.9.4
          • Component/s: Sinks+Sources
          • Labels:
            None

            Description

            The current AvroDataFileOutputFormat and AvroJsonOutputFormat don't support compression of output. It'd be good to have a compression option, ideally with a configurable compression level.

            Indeed, per FLUME-97 the avrojson output format isn't an Avro file format at all yet, but when it is it'd be good to support this for it too.

              Attachments

                Issue Links

                depends on

                New Feature - A new feature of the product, which has yet to be developed. FLUME-133 Add support for Avro Native output files.

                • Critical - Crashes, loss of data, severe memory leak.
                • Closed

                  Activity

                    People

                    • Assignee:
                      bruce.mitchener Bruce Mitchener
                      Reporter:
                      rbodkin Ron Bodkin
                    • Votes:
                      1 Vote for this issue
                      Watchers:
                      3 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: