Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-771

Unable to use custom Hive Storage Handler in CDH 5.5.0

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: CDH 5.5.0
    • Fix Version/s: None
    • Component/s: Hive
    • Labels:
      None

      Description

      I'm unable to use a custom Hive Storage Handler in CDH 5.5.0. I get the following exception in Hive logs:

      java.lang.NoSuchMethodError: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.initSerdeParams
      

      This method does not appear to be exposed in hive-serde-1.1.0:

      javap -classpath hive-serde-1.1.0-cdh5.5.0.jar org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe | grep initSerdeParams
      

      However I see this method in hive-serde-0.13.1:

      javap -classpath hive-serde-0.13.1-cdh5.3.2.jar org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe | grep initSerdeParams
        public static org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe$SerDeParameters initSerdeParams(org.apache.hadoop.conf.Configuration, java.util.Properties, java.lang.String)       throws org.apache.hadoop.hive.serde2.SerDeException;
      

      This is a public method and has not been deprecated: https://hive.apache.org/javadocs/r1.1.1/api/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.html#initSerdeParams(org.apache.hadoop.conf.Configuration,%20java.util.Properties,%20java.lang.String)

      Or maybe I'm doing something wrong?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              andrewlam Andrew Lam
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: