Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-365

Travis CI for hadoop-1 fails while initializing MiniDFSCluster

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 0.12.0
          • Fix Version/s: 0.12.1
          • Component/s: Data Module
          • Labels:
            None

            Description

            I can reproduce this on my local ubuntu machine. Tests in error: 

              TestCrunchDatasetsHCatalog>TestCrunchDatasets.data:62->MiniDFSTest.setupFS:51 » IO
  TestCrunchDatasetsFileSystem>TestCrunchDatasets.data:62->MiniDFSTest.setupFS:51 » IO

# Caused by:

java.io.IOException: Cannot lock storage /home/blue/workspace/kite/kite-data/kite-data-crunch/target/test-data/f24844ac-6198-4044-b6a5-27421cd5c363/dfscluster_fb1c29ce-bbad-4aa2-8716-b3a6228a1c48/dfs/name1. The directory is already locked.
  at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:599)
  at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:1338)
  at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:1356)
  at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1261)
  at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:193)
  at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:268)
  at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
  at org.kitesdk.data.MiniDFSTest.setupFS(MiniDFSTest.java:51)
  at org.kitesdk.data.crunch.TestCrunchDatasets.data(TestCrunchDatasets.java:62)

              Attachments

                Activity

                  People

                  • Assignee:
                    blue Ryan Blue
                    Reporter:
                    blue Ryan Blue
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    0 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: