Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-377

The Datanode block scanner thread may fail on startup.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: CDH3u3
    • Fix Version/s: CDH3u3
    • Component/s: HDFS
    • Labels:
      None
    • Release Note:
      Hide
      In order to use this update all datanode and namenode packages in the cluster need to be updated to the new version. If you have pinned your repository to update 3, all server nodes in the cluster need to be updated. This change does not affect client / server compatibility.
      Show
      In order to use this update all datanode and namenode packages in the cluster need to be updated to the new version. If you have pinned your repository to update 3, all server nodes in the cluster need to be updated. This change does not affect client / server compatibility.

      Description

      The Datanode block scanner thread may fail on Datanode startup. This is indicated by the following warning in the Datanode log:

      Feb 9, 6:55:58 PM WARN org.apache.hadoop.hdfs.server.datanode.DataBlockScanner
      RuntimeException during DataBlockScanner.run() : null  java.util.concurrent.RejectedExecutionException
      

      The block scanner thread is a background thread that checks for silent corruption / bit rot of HDFS data blocks. Blocks are checked when they are accessed, so this functionality is useful for checking blocks that are not frequently accessed.

        Attachments

          Activity

            People

            • Assignee:
              eli Eli Collins
              Reporter:
              eli Eli Collins
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: