Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-510

[lily] lots of EOFException warnings in RS log when load data to HBase w/ indexing enabled

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: search-0.9.3
    • Fix Version/s: None
    • Component/s: Search
    • Labels:
      None

      Description

      Create a cluster via CM (CM4.7 + CDH4.4 + Solr 0.9.3) with HBase/Solr/KS Indexer services configured, load 1000+ records to HBase table. (indexing works fine.)
      I see lots of warnings in hbase region server log.
      1:23:00.649 PM WARN org.apache.hadoop.hbase.replication.regionserver.ReplicationSource
      Waited too long for this file, considering dumping
      1:23:10.655 PM WARN org.apache.hadoop.hbase.replication.regionserver.ReplicationSource
      Indexer_hbaseindexer Got:
      java.io.EOFException
      at java.io.DataInputStream.readFully(DataInputStream.java:180)
      at java.io.DataInputStream.readFully(DataInputStream.java:152)
      at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1800)
      at org.apache.hadoop.io.SequenceFile$Reader.initialize(SequenceFile.java:1765)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1714)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1728)
      at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:55)
      at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(SequenceFileLogReader.java:177)
      at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:713)
      at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:693)
      at org.apache.hadoop.hbase.replication.regionserver.ReplicationHLogReaderManager.openReader(ReplicationHLogReaderManager.java:67)
      at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.openReader(ReplicationSource.java:502)
      at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:313)

        Attachments

          Activity

            People

            • Assignee:
              greid Gabriel Reid
              Reporter:
              czhu Chunshi Zhu
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: