Details
-
Type:
Bug
-
Status: Open
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: 1.0.0
-
Fix Version/s: 1.2.0
-
Component/s: Data Module
Description
Hi,
I tried to run sqoop import parquet job from MySQL to maprfs on MapR environment with following command:
sqoop import --connect jdbc:mysql://10.10.80.221:3306/hive --username root --password xxx --table TBLS --target-dir /user/root/TBLS3 --as-parquetfile -m
And get the following error:
15/07/24 15:02:01 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern: dataset:maprfs:///user/root/TBLS3 Check that JARs for maprfs datasets are on the classpath org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern: dataset:maprfs:///user/root/TBLS3 Check that JARs for maprfs datasets are on the classpath at org.kitesdk.data.spi.Registration.lookupDatasetUri(Registration.java:128) at org.kitesdk.data.Datasets.create(Datasets.java:228) at org.kitesdk.data.Datasets.create(Datasets.java:307) at org.apache.sqoop.mapreduce.ParquetJob.createDataset(ParquetJob.java:107) at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:89) at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:108) at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:260) at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673) at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
I investigated problem and make a temporary patch which fix my problem. Patch attached.
Probably there should be more complex and consistent solution.
Attachments
Issue Links
- blocks
-
KITE-951 Does KiteSDK support/works in MapR distribution
-
- Open
-