Uploaded image for project: 'RecordService'
  1. RecordService
  2. RS-121

Error creating zk znode path for planner / worker membership

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.3.0
    • Fix Version/s: None
    • Component/s: Server
    • Labels:
      None

      Description

      We have secured the zk znode path in master branch. But if we redeploy an old version, then it will has some problem accessing the zookeeper znode.
      We'd better fix this, eg. clean up all the zookeeper znodes for recordservice when stoping recordservice.

      Here is the error log in recordservice:

      I0301 08:52:10.100419  7468 jni-util.cc:177] com.cloudera.impala.common.InternalException: Could not start up zookeeper session.
      	at com.cloudera.impala.service.JniFrontend.initZooKeeper(JniFrontend.java:209)
      Caused by: java.io.IOException: Error creating path /recordservice/planners
      	at com.cloudera.impala.service.ZooKeeperSession.ensurePath(ZooKeeperSession.java:318)
      	at com.cloudera.impala.service.ZooKeeperSession.initMembershipPaths(ZooKeeperSession.java:492)
      	at com.cloudera.impala.service.ZooKeeperSession.<init>(ZooKeeperSession.java:196)
      	at com.cloudera.impala.service.JniFrontend.initZooKeeper(JniFrontend.java:207)
      Caused by: java.io.IOException: Could not watch worker membership.
      	at com.cloudera.impala.service.ZooKeeperSession.initMembership(ZooKeeperSession.java:450)
      	at com.cloudera.impala.service.ZooKeeperSession.registerMembership(ZooKeeperSession.java:409)
      	at com.cloudera.impala.service.ZooKeeperSession.getSession(ZooKeeperSession.java:256)
      	at com.cloudera.impala.service.ZooKeeperSession.ensurePath(ZooKeeperSession.java:310)
      	... 3 more
      Caused by: org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /recordservice/workers
      	at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
      	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
      	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1586)
      	at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214)
      	at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203)
      	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
      	at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:200)
      	at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191)
      	at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38)
      	at org.apache.curator.framework.recipes.cache.PathChildrenCache.rebuild(PathChildrenCache.java:327)
      	at org.apache.curator.framework.recipes.cache.PathChildrenCache.start(PathChildrenCache.java:300)
      	at com.cloudera.impala.service.ZooKeeperSession.initMembership(ZooKeeperSession.java:447)
      	... 6 more
      I0301 08:52:10.113358  7468 status.cc:112] InternalException: Could not start up zookeeper session.
      CAUSED BY: IOException: Error creating path /recordservice/planners
      CAUSED BY: IOException: Could not watch worker membership.
      CAUSED BY: NoAuthException: KeeperErrorCode = NoAuth for /recordservice/workers
          @           0x82a3d9  impala::Status::Status()
          @           0xb8dc30  impala::JniUtil::GetJniExceptionMsg()
          @           0xa72284  impala::Frontend::InitZooKeeper()
          @           0xa9b83f  impala::ImpalaServer::ImpalaServer()
          @           0xa9cecc  impala::CreateImpalaServer()
          @           0x80725b  main
          @       0x3efce1ecdd  (unknown)
          @           0x804479  (unknown)
      E0301 08:52:10.113386  7468 impala-server.cc:418] Could not initialize zookeeper. Exiting.
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lilicn Li Li
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: