Uploaded image for project: 'RecordService (READ-ONLY)'
  1. RecordService (READ-ONLY)
  2. RS-104

fix 'alter partitioned table set cached' failure caused by hive serde

          Details

          • Type: Bug
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: 0.2.0
          • Fix Version/s: None
          • Component/s: Server, Test
          • Labels:
            None

            Description

            Impala test failed when running 'alter partitioned table set cached' query, eg. alter table functional.alltypessmall set cached in 'testPool'

            Here is the error log:

            Query: alter table functional.alltypestiny set cached in 'testPool'
16:07:29 ERROR: 
16:07:29 ImpalaRuntimeException: Error making 'alter_partition' RPC to Hive Metastore: 
16:07:29 CAUSED BY: MetaException: Put request failed : INSERT INTO "PARTITION_PARAMS" ("PARAM_VALUE","PART_ID","PARAM_KEY") VALUES (?,?,?) 
16:07:29 org.datanucleus.exceptions.NucleusDataStoreException: Put request failed : INSERT INTO "PARTITION_PARAMS" ("PARAM_VALUE","PART_ID","PARAM_KEY") VALUES (?,?,?) 
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.putAll(JoinMapStore.java:230)
16:07:29 	at org.datanucleus.store.types.backed.HashMap.initialise(HashMap.java:203)
16:07:29 	at org.datanucleus.store.types.SCOUtils.createSCOWrapper(SCOUtils.java:247)
16:07:29 	at org.datanucleus.store.types.SCOUtils.newSCOInstance(SCOUtils.java:138)
16:07:29 	at org.datanucleus.state.JDOStateManager.wrapSCOField(JDOStateManager.java:3627)
16:07:29 	at org.datanucleus.state.JDOStateManager.setObjectField(JDOStateManager.java:1958)
16:07:29 	at org.apache.hadoop.hive.metastore.model.MPartition.jdoSetparameters(MPartition.java)
16:07:29 	at org.apache.hadoop.hive.metastore.model.MPartition.setParameters(MPartition.java:124)
16:07:29 	at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:2891)
16:07:29 	at org.apache.hadoop.hive.metastore.ObjectStore.alterPartition(ObjectStore.java:2910)
16:07:29 	at sun.reflect.GeneratedMethodAccessor80.invoke(Unknown Source)
16:07:29 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
16:07:29 	at java.lang.reflect.Method.invoke(Method.java:606)
16:07:29 	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98)
16:07:29 	at com.sun.proxy.$Proxy0.alterPartition(Unknown Source)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartition(HiveAlterHandler.java:350)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rename_partition(HiveMetaStore.java:3242)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rename_partition(HiveMetaStore.java:3215)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partition(HiveMetaStore.java:3198)
16:07:29 	at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source)
16:07:29 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
16:07:29 	at java.lang.reflect.Method.invoke(Method.java:606)
16:07:29 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:133)
16:07:29 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99)
16:07:29 	at com.sun.proxy.$Proxy3.alter_partition(Unknown Source)
16:07:29 	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_partition.getResult(ThriftHiveMetastore.java:10206)
16:07:29 	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_partition.getResult(ThriftHiveMetastore.java:10190)
16:07:29 	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
16:07:29 	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
16:07:29 	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)
16:07:29 	at java.security.AccessController.doPrivileged(Native Method)
16:07:29 	at javax.security.auth.Subject.doAs(Subject.java:415)
16:07:29 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
16:07:29 	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)
16:07:29 	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
16:07:29 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
16:07:29 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
16:07:29 	at java.lang.Thread.run(Thread.java:745)
16:07:29 Caused by: org.datanucleus.store.rdbms.exceptions.MappedDatastoreException: INSERT INTO "PARTITION_PARAMS" ("PARAM_VALUE","PART_ID","PARAM_KEY") VALUES (?,?,?) 
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.internalPut(JoinMapStore.java:1078)
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.putAll(JoinMapStore.java:220)
16:07:29 	... 37 more
16:07:29 Caused by: org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00
16:07:29   Hint: This error can also happen if the byte sequence does not match the encoding expected by the server, which is controlled by "client_encoding".
16:07:29 	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)
16:07:29 	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)
16:07:29 	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
16:07:29 	at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)
16:07:29 	at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
16:07:29 	at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)
16:07:29 	at com.jolbox.bonecp.PreparedStatementHandle.executeUpdate(PreparedStatementHandle.java:205)
16:07:29 	at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeUpdate(ParamLoggingPreparedStatement.java:399)
16:07:29 	at org.datanucleus.store.rdbms.SQLController.executeStatementUpdate(SQLController.java:439)
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.internalPut(JoinMapStore.java:1069)
16:07:29 	... 38 more
16:07:29 Nested Throwables StackTrace:
16:07:29 org.datanucleus.store.rdbms.exceptions.MappedDatastoreException: INSERT INTO "PARTITION_PARAMS" ("PARAM_VALUE","PART_ID","PARAM_KEY") VALUES (?,?,?) 
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.internalPut(JoinMapStore.java:1078)
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.putAll(JoinMapStore.java:220)
16:07:29 	at org.datanucleus.store.types.backed.HashMap.initialise(HashMap.java:203)
16:07:29 	at org.datanucleus.store.types.SCOUtils.createSCOWrapper(SCOUtils.java:247)
16:07:29 	at org.datanucleus.store.types.SCOUtils.newSCOInstance(SCOUtils.java:138)
16:07:29 	at org.datanucleus.state.JDOStateManager.wrapSCOField(JDOStateManager.java:3627)
16:07:29 	at org.datanucleus.state.JDOStateManager.setObjectField(JDOStateManager.java:1958)
16:07:29 	at org.apache.hadoop.hive.metastore.model.MPartition.jdoSetparameters(MPartition.java)
16:07:29 	at org.apache.hadoop.hive.metastore.model.MPartition.setParameters(MPartition.java:124)
16:07:29 	at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:2891)
16:07:29 	at org.apache.hadoop.hive.metastore.ObjectStore.alterPartition(ObjectStore.java:2910)
16:07:29 	at sun.reflect.GeneratedMethodAccessor80.invoke(Unknown Source)
16:07:29 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
16:07:29 	at java.lang.reflect.Method.invoke(Method.java:606)
16:07:29 	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98)
16:07:29 	at com.sun.proxy.$Proxy0.alterPartition(Unknown Source)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartition(HiveAlterHandler.java:350)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rename_partition(HiveMetaStore.java:3242)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rename_partition(HiveMetaStore.java:3215)
16:07:29 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partition(HiveMetaStore.java:3198)
16:07:29 	at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source)
16:07:29 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
16:07:29 	at java.lang.reflect.Method.invoke(Method.java:606)
16:07:29 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:133)
16:07:29 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99)
16:07:29 	at com.sun.proxy.$Proxy3.alter_partition(Unknown Source)
16:07:29 	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_partition.getResult(ThriftHiveMetastore.java:10206)
16:07:29 	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_partition.getResult(ThriftHiveMetastore.java:10190)
16:07:29 	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
16:07:29 	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
16:07:29 	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)
16:07:29 	at java.security.AccessController.doPrivileged(Native Method)
16:07:29 	at javax.security.auth.Subject.doAs(Subject.java:415)
16:07:29 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
16:07:29 	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)
16:07:29 	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
16:07:29 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
16:07:29 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
16:07:29 	at java.lang.Thread.run(Thread.java:745)
16:07:29 Caused by: org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00
16:07:29   Hint: This error can also happen if the byte sequence does not match the encoding expected by the server, which is controlled by "client_encoding".
16:07:29 	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)
16:07:29 	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)
16:07:29 	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
16:07:29 	at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)
16:07:29 	at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
16:07:29 	at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)
16:07:29 	at com.jolbox.bonecp.PreparedStatementHandle.executeUpdate(PreparedStatementHandle.java:205)
16:07:29 	at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeUpdate(ParamLoggingPreparedStatement.java:399)
16:07:29 	at org.datanucleus.store.rdbms.SQLController.executeStatementUpdate(SQLController.java:439)
16:07:29 	at org.datanucleus.store.rdbms.scostore.JoinMapStore.internalPut(JoinMapStore.java:1069)
16:07:29 	... 38 more
16:07:29

              Attachments

                Activity

                  People

                  • Assignee:
                    sunchao Chao Sun
                    Reporter:
                    lilicn Li Li
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    1 Start watching this issue

                    Dates

                    • Created:
                      Updated: