Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.2.0
    • Component/s: Data Module
    • Labels:

      Description

      Hi,

      I tried to run sqoop import parquet job from MySQL to maprfs on MapR environment with following command:

      sqoop import --connect jdbc:mysql://10.10.80.221:3306/hive --username root
      --password xxx --table TBLS  --target-dir /user/root/TBLS3 --as-parquetfile  -m
      

      And get the following error:

      15/07/24 15:02:01 ERROR sqoop.Sqoop: Got exception running Sqoop:
      org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern:
      dataset:maprfs:///user/root/TBLS3
      Check that JARs for maprfs datasets are on the classpath
      org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern:
      dataset:maprfs:///user/root/TBLS3
      Check that JARs for maprfs datasets are on the classpath
          at
      org.kitesdk.data.spi.Registration.lookupDatasetUri(Registration.java:128)
          at org.kitesdk.data.Datasets.create(Datasets.java:228)
          at org.kitesdk.data.Datasets.create(Datasets.java:307)
          at org.apache.sqoop.mapreduce.ParquetJob.createDataset(ParquetJob.java:107)
          at
      org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:89)
          at
      org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:108)
          at
      org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:260)
          at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
          at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
          at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
          at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
          at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
          at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
          at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
          at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
          at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
          at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      

      I investigated problem and make a temporary patch which fix my problem. Patch attached.

      Probably there should be more complex and consistent solution.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ScoRp Nikita Tarasenko
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: