Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-299

Trying to utilize Flume Batching, do not see speed improvements over regular transfers, Is in implemented ?

          Details

          • Type: Task
          • Status: Resolved
          • Priority: Major
          • Resolution: Won't Fix
          • Affects Version/s: CDH3u1
          • Fix Version/s: None
          • Component/s: Flume
          • Labels:
          • Environment:
            Red Hat Enterprise Linux Server release 6.1 (Santiago) on the collector
            Red Hat Enterprise Linux Server release 5.4 (Tikanga) on the agent

            Description

            Trying to utilize batching on a 47MB text file, but see no speed improvements over a regular transfer, noted the comment on implemented the feature before documenting. Is this feature implemented?

            agentBESink( "xx.xx.xx.xx", 35853, batchN=100)

            and

            agentBESink( "xx.xx.xx.xx", 35853, batchN=100, batchLatency=10000, compression=true)

              Attachments

                Activity

                  People

                  • Assignee:
                    jon Jonathan Hsieh
                    Reporter:
                    jl121772 Jim Langston
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    0 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: