Uploaded image for project: 'CDH (READ-ONLY)'
  1. CDH (READ-ONLY)
  2. DISTRO-835

sqoop command adds /usr/share/java to classpath

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: CDH 5.8.3
    • Fix Version/s: None
    • Component/s: Sqoop
    • Labels:
      None

      Description

      The CDH sqoop script adds the path /usr/share/java to HADOOP_CLASSPATH. This can cause serious issues as that path is where java libraries for the OS are installed which are always old and out of date. This is particularly a problem when the OS has a version of xerces installed.

      # sqoop jobs
      Warning: /opt/cloudera/parcels/CDH-5.9.0-1.cdh5.9.0.p0.23/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
      Please set $ACCUMULO_HOME to the root of your Accumulo installation.
      16/11/30 14:59:44 FATAL conf.Configuration: error parsing conf core-default.xml
      javax.xml.parsers.ParserConfigurationException: Feature 'http://apache.org/xml/features/xinclude' is not recognized.
              at org.apache.xerces.jaxp.DocumentBuilderFactoryImpl.newDocumentBuilder(Unknown Source)
              at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2541)
              at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2503)
              at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2409)
              at org.apache.hadoop.conf.Configuration.get(Configuration.java:982)
              at org.apache.sqoop.tool.SqoopTool.loadPluginsFromConfDir(SqoopTool.java:170)
              at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:140)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:208)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
              at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      Exception in thread "main" java.lang.RuntimeException: javax.xml.parsers.ParserConfigurationException: Feature 'http://apache.org/xml/features/xinclude' is not recognized.
              at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2659)
              at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2503)
              at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2409)
              at org.apache.hadoop.conf.Configuration.get(Configuration.java:982)
              at org.apache.sqoop.tool.SqoopTool.loadPluginsFromConfDir(SqoopTool.java:170)
              at org.apache.sqoop.tool.SqoopTool.loadPlugins(SqoopTool.java:140)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:208)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
              at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      Caused by: javax.xml.parsers.ParserConfigurationException: Feature 'http://apache.org/xml/features/xinclude' is not recognized.
              at org.apache.xerces.jaxp.DocumentBuilderFactoryImpl.newDocumentBuilder(Unknown Source)
              at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2541)
              ... 8 more
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              brock Brock Noland
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: