Details
-
Type:
Bug
-
Status: Closed
-
Priority:
Major
-
Resolution: Duplicate
-
Affects Version/s: v0.9.0
-
Fix Version/s: v0.9.2
-
Component/s: Sinks+Sources
-
Labels:None
-
Environment:Redhat Enterprise 5
Description
Three node setup: 1 master, 1 collector, 1 node.
The node configuration is: Source: tail( "/var/log/httpd/access_log" ), Sink: agentE2ESink( "q1.local", 35853 )
The collector configuration is: Source: collectorSource(35853), Sink: collectorSink( "hdfs://hd.local:9000/flume/%Y-%m-%d/%H00/", "%
-" )
While running over the weekend the node ran out of filehandles. I gave it more handles with ulimit and then restarted both the node and the collector. After about ten minutes the collector crashed with this error.
2010-07-25 23:05:06,092 ERROR com.cloudera.flume.core.connector.DirectDriver: Stream source failed! LazyOpenSource | LazyOpenDecorator
java.lang.NullPointerException
at com.cloudera.flume.handlers.hdfs.CustomDfsSink.close(CustomDfsSink.java:76)
at com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink.close(EscapedCustomDfsSink.java:130)
at com.cloudera.flume.core.EventSinkDecorator.close(EventSinkDecorator.java:65)
at com.cloudera.flume.collector.CollectorSink$RollDetectDeco.close(CollectorSink.java:109)
at com.cloudera.flume.handlers.rolling.RollSink.rotate(RollSink.java:204)
at com.cloudera.flume.handlers.rolling.RollSink.append(RollSink.java:184)
at com.cloudera.flume.core.EventSinkDecorator.append(EventSinkDecorator.java:58)
at com.cloudera.flume.handlers.endtoend.AckChecksumChecker.append(AckChecksumChecker.java:178)
at com.cloudera.flume.collector.CollectorSink.append(CollectorSink.java:151)
at com.cloudera.flume.core.EventSinkDecorator.append(EventSinkDecorator.java:58)
at com.cloudera.flume.handlers.debug.LazyOpenDecorator.append(LazyOpenDecorator.java:57)
at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:92)
2010-07-25 23:05:06,098 INFO com.cloudera.flume.agent.LogicalNode: Connector q1.localexited with error
java.lang.NullPointerException
at com.cloudera.flume.handlers.hdfs.CustomDfsSink.close(CustomDfsSink.java:76)
at com.cloudera.flume.handlers.hdfs.EscapedCustomDfsSink.close(EscapedCustomDfsSink.java:130)
at com.cloudera.flume.core.EventSinkDecorator.close(EventSinkDecorator.java:65)
at com.cloudera.flume.collector.CollectorSink$RollDetectDeco.close(CollectorSink.java:109)
at com.cloudera.flume.handlers.rolling.RollSink.rotate(RollSink.java:204)
at com.cloudera.flume.handlers.rolling.RollSink.append(RollSink.java:184)
at com.cloudera.flume.core.EventSinkDecorator.append(EventSinkDecorator.java:58)
at com.cloudera.flume.handlers.endtoend.AckChecksumChecker.append(AckChecksumChecker.java:178)
at com.cloudera.flume.collector.CollectorSink.append(CollectorSink.java:151)
at com.cloudera.flume.core.EventSinkDecorator.append(EventSinkDecorator.java:58)
at com.cloudera.flume.handlers.debug.LazyOpenDecorator.append(LazyOpenDecorator.java:57)
at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:92)
2010-07-25 23:05:06,102 INFO com.cloudera.flume.collector.CollectorSource: closed
2010-07-25 23:05:06,109 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Closed server on port 35853...
2010-07-25 23:05:06,109 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Queue still has 999 elements ...
2010-07-25 23:05:16,208 WARN com.cloudera.flume.handlers.thrift.ThriftEventSource: Close timed out due to no progress. Closing despite having 999 values still enqued
2010-07-25 23:05:16,208 INFO com.cloudera.flume.handlers.rolling.RollSink: closing RollSink 'null'
