Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-416

CollectorSink hangs due to ConcurrentModificationException in RollSink

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: v0.9.0, v0.9.1, v0.9.1u1, v0.9.2
    • Fix Version/s: v0.9.3
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      Apparently, there can be a race on the collector ack manager's. It seems that the collector hangs after this happens.

      10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: initial checksum is 12ce79b3c59
      10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: Finishing checksum group called 'log.00001136.20101215-114127844-0500.6785369377806000.seq'
      10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: Checksum succeeded 12ceae86624
      Exception in thread "Roll-TriggerThread-1" java.util.ConcurrentModificationException
      at java.util.HashMap$HashIterator.nextEntry(HashMap.java:793)
      at java.util.HashMap$KeyIterator.next(HashMap.java:828)
      at com.google.common.collect.StandardMultimap$WrappedCollection$WrappedIterator.next(StandardMultimap.java:491)
      at com.cloudera.flume.collector.CollectorSink$RollDetectDeco.close(CollectorSink.java:154)
      at com.cloudera.flume.handlers.rolling.RollSink.rotate(RollSink.java:181)
      at com.cloudera.flume.handlers.rolling.RollSink$TriggerThread.run(RollSink.java:122)
      10/12/15 20:08:43 INFO endtoend.AckChecksumChecker: moved from partial to complete log.00001136.20101215-114127844-0500.6785369377806000.seq

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jon Jonathan Hsieh
                Reporter:
                jon Jonathan Hsieh
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: