Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-598

Hue datanode plugin poorly handles retries when failing to register with the namenode

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 2.0.0-beta
    • Component/s: core.api
    • Labels:
      None

      Description

      The Hue datanode plugin doesn't seem to re-open its connection to the namenode if registration fails, thereby causing registration to fail and overwhelm the log messages with the following.

      2011-11-15 11:20:14,730 INFO org.apache.hadoop.thriftfs.DatanodePlugin: Datanode registration failed
      org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
              at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
              at org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:163)
              at org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:91)
              at org.apache.hadoop.thriftfs.api.Namenode$Client.send_datanodeUp(Namenode.java:1159)
              at org.apache.hadoop.thriftfs.api.Namenode$Client.datanodeUp(Namenode.java:1153)
              at org.apache.hadoop.thriftfs.DatanodePlugin$1.run(DatanodePlugin.java:198)
              at java.lang.Thread.run(Thread.java:619)
      Caused by: java.net.SocketException: Broken pipe
              at java.net.SocketOutputStream.socketWrite0(Native Method)
              at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
              at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
              at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
              at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
              at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
              ... 6 more
      

        Attachments

          Activity

            People

            • Assignee:
              philip Philip Zeyliger
              Reporter:
              philip Philip Zeyliger
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: