Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-710

HBase example doesn't work after schema evolution

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.17.0
    • Fix Version/s: 0.17.0
    • Component/s: None
    • Labels:
      None

      Description

      mvn exec:java -Dexec.mainClass="org.kitesdk.examples.data.ReadUserDataset"[INFO] Scanning for projects...
      [INFO]                                                                         
      [INFO] ------------------------------------------------------------------------
      [INFO] Building Kite Dataset HBase Examples 0.16.1-SNAPSHOT
      [INFO] ------------------------------------------------------------------------
      [INFO] 
      [INFO] --- exec-maven-plugin:1.3.2:java (default-cli) @ dataset-hbase ---
      [WARNING] Warning: killAfter is now deprecated. Do you need it ? Please comment on MEXEC-6.
      2014-10-03 15:03:36 WARN  :: Not loading URI patterns in org.kitesdk.data.spi.hive.Loader
      2014-10-03 15:03:36 INFO  :: Client environment:zookeeper.version=3.4.5-cdh5.1.0--1, built on 07/12/2014 13:39 GMT
      2014-10-03 15:03:36 INFO  :: Client environment:host.name=172.19.1.88
      2014-10-03 15:03:36 INFO  :: Client environment:java.version=1.7.0_65
      2014-10-03 15:03:36 INFO  :: Client environment:java.vendor=Oracle Corporation
      2014-10-03 15:03:36 INFO  :: Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_65.jdk/Contents/Home/jre
      2014-10-03 15:03:36 INFO  :: Client environment:java.class.path=/opt/apache-maven/boot/plexus-classworlds-2.4.jar
      2014-10-03 15:03:36 INFO  :: Client environment:java.library.path=/Users/joey/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
      2014-10-03 15:03:36 INFO  :: Client environment:java.io.tmpdir=/var/folders/lk/qp1b1j_s6h78z5kt0n5gj65r0000gn/T/
      2014-10-03 15:03:36 INFO  :: Client environment:java.compiler=<NA>
      2014-10-03 15:03:36 INFO  :: Client environment:os.name=Mac OS X
      2014-10-03 15:03:36 INFO  :: Client environment:os.arch=x86_64
      2014-10-03 15:03:36 INFO  :: Client environment:os.version=10.9.4
      2014-10-03 15:03:36 INFO  :: Client environment:user.name=joey
      2014-10-03 15:03:36 INFO  :: Client environment:user.home=/Users/joey
      2014-10-03 15:03:36 INFO  :: Client environment:user.dir=/Users/joey/src/joey/kite-examples/dataset-hbase
      2014-10-03 15:03:36 INFO  :: Initiating client connection, connectString=quickstart.cloudera:2181 sessionTimeout=90000 watcher=hconnection-0x6419f098, quorum=quickstart.cloudera:2181, baseZNode=/hbase
      2014-10-03 15:03:37 INFO  :: Process identifier=hconnection-0x6419f098 connecting to ZooKeeper ensemble=quickstart.cloudera:2181
      2014-10-03 15:03:37 INFO  :: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
      2014-10-03 15:03:37 INFO  :: Socket connection established to localhost/127.0.0.1:2181, initiating session
      2014-10-03 15:03:37 INFO  :: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x148d730f7ee00c6, negotiated timeout = 40000
      2014-10-03 15:03:38 ERROR :: Could not find managed version for users, User that matches org.kitesdk.data.hbase.avro.AvroEntitySchema@b63bc2b6
      [WARNING] 
      java.lang.reflect.InvocationTargetException
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: org.kitesdk.data.SchemaNotFoundException: Could not find managed version for users, User that matches org.kitesdk.data.hbase.avro.AvroEntitySchema@b63bc2b6
      	at org.kitesdk.data.hbase.manager.DefaultSchemaManager.getEntityVersion(DefaultSchemaManager.java:193)
      	at org.kitesdk.data.hbase.avro.VersionedAvroEntityMapper.<init>(VersionedAvroEntityMapper.java:179)
      	at org.kitesdk.data.hbase.avro.VersionedAvroEntityMapper.<init>(VersionedAvroEntityMapper.java:57)
      	at org.kitesdk.data.hbase.avro.VersionedAvroEntityMapper$Builder.build(VersionedAvroEntityMapper.java:118)
      	at org.kitesdk.data.hbase.avro.SpecificAvroDao.<init>(SpecificAvroDao.java:124)
      	at org.kitesdk.data.hbase.HBaseDatasetRepository.newDataset(HBaseDatasetRepository.java:153)
      	at org.kitesdk.data.hbase.HBaseDatasetRepository.load(HBaseDatasetRepository.java:112)
      	at org.kitesdk.data.hbase.HBaseDatasetRepository.load(HBaseDatasetRepository.java:45)
      	at org.kitesdk.data.Datasets.load(Datasets.java:69)
      	at org.kitesdk.data.Datasets.load(Datasets.java:113)
      	at org.kitesdk.examples.data.ReadUserDataset.run(ReadUserDataset.java:35)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
      	at org.kitesdk.examples.data.ReadUserDataset.main(ReadUserDataset.java:60)
      	... 6 more
      2014-10-03 15:03:38 ERROR :: Event thread exiting due to interruption
      java.lang.InterruptedException
      	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
      	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
      	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
      2014-10-03 15:03:38 INFO  :: EventThread shut down
      2014-10-03 15:03:51 WARN  :: Session 0x148d730f7ee00c6 for server localhost/127.0.0.1:2181, unexpected error, closing socket connection and attempting reconnect
      java.nio.channels.ClosedByInterruptException
      	at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202)
      	at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:496)
      	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
      	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
      	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
      2014-10-03 15:03:53 INFO  :: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
      2014-10-03 15:03:53 INFO  :: Socket connection established to localhost/127.0.0.1:2181, initiating session
      2014-10-03 15:03:53 INFO  :: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x148d730f7ee00c6, negotiated timeout = 40000
      [WARNING] thread Thread[org.kitesdk.examples.data.ReadUserDataset.main(localhost:2181),5,org.kitesdk.examples.data.ReadUserDataset] was interrupted but is still alive after waiting at least 15000msecs
      [WARNING] thread Thread[org.kitesdk.examples.data.ReadUserDataset.main(localhost:2181),5,org.kitesdk.examples.data.ReadUserDataset] will linger despite being asked to die via interruption
      [WARNING] NOTE: 1 thread(s) did not finish despite being asked to  via interruption. This is not a problem with exec:java, it is a problem with the running code. Although not serious, it should be remedied.
      [WARNING] Couldn't destroy threadgroup org.codehaus.mojo.exec.ExecJavaMojo$IsolatedThreadGroup[name=org.kitesdk.examples.data.ReadUserDataset,maxpri=10]
      java.lang.IllegalThreadStateException
      	at java.lang.ThreadGroup.destroy(ThreadGroup.java:775)
      	at org.codehaus.mojo.exec.ExecJavaMojo.execute(ExecJavaMojo.java:328)
      	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
      	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
      	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
      	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
      	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
      	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
      	at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
      	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
      	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
      	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
      	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
      	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
      	at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
      	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
      	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
      	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 21.543s
      [INFO] Finished at: Fri Oct 03 15:03:53 CDT 2014
      [INFO] Final Memory: 25M/515M
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.2:java (default-cli) on project dataset-hbase: An exception occured while executing the Java class. null: InvocationTargetException: Could not find managed version for users, User that matches org.kitesdk.data.hbase.avro.AvroEntitySchema@b63bc2b6 -> [Help 1]
      [ERROR] 
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR] 
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
      

        Attachments

          Activity

            People

            • Assignee:
              joey Joey Echeverria
              Reporter:
              joey Joey Echeverria
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: