Uploaded image for project: 'Flume (READ-ONLY)'
  1. Flume (READ-ONLY)
  2. FLUME-543

TailThread exits on repeated WAL failures

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: v0.9.3
    • Fix Version/s: v0.9.5
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Environment:
      Amazon EC2 Ubuntu 10.04 LTS

      Description

      On repeated failures:

      2011-02-28 23:37:26,908 ERROR com.cloudera.flume.core.connector.DirectDriver: Driving src/sink failed! LazyOpenSource | LazyOpenDecorator because java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
      java.io.IOException: java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
      	at com.cloudera.flume.agent.durability.NaiveFileWALDeco$1.fireError(NaiveFileWALDeco.java:254)
      	at com.cloudera.flume.core.connector.DirectDriver.fireError(DirectDriver.java:216)
      	at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:102)
      Caused by: java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
      	at com.cloudera.flume.agent.durability.NaiveFileWALManager.changeState(NaiveFileWALManager.java:410)
      	at com.cloudera.flume.agent.durability.NaiveFileWALManager.getUnackedSource(NaiveFileWALManager.java:557)
      	at com.cloudera.flume.agent.durability.WALSource.next(WALSource.java:104)
      	at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:89)
      

      The tailer exits and the master reports all nodes in ERROR state.

      2011-02-28 23:37:27,917 INFO com.cloudera.flume.handlers.text.TailSource: TailThread has exited
      

      Full log file attached.

      Rob

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jon Jonathan Hsieh
                Reporter:
                robert.slifka@gmail.com Robert Slifka
              • Votes:
                11 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: