Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-6717

[editor] Support sqoop command with --query parameter

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Bug
    • Affects Version/s: 4.0.0
    • Fix Version/s: None
    • Component/s: app.editor
    • Labels:
      None

      Description

      We should split the command into <args> instead of a <command>:

      import --connect jdbc:mysql://prachi-1.vpc.cloudera.com:3306/test --username new_user --password cloudera --query 'SELECT * FROM employee' --target-dir /user/romain/employee4 --verbose 
      
              <sqoop xmlns="uri:oozie:sqoop-action:0.2">
                  <job-traker>foo:8021</job-tracker>
                  <name-node>bar:8020</name-node>
                  <prepare>
                      <delete path="${jobOutput}"/>
                  </prepare>
                  <configuration>
                      <property>
                          <name>mapred.compress.map.output</name>
                          <value>true</value>
                      </property>
                  </configuration>
                  <arg>import</arg>
                  <arg>--connect</arg>
                  <arg>jdbc:mysql://prachi-1.vpc.cloudera.com:3306/test</arg>
                  <arg>--username</arg>
                  <arg>new_user</arg>
                  <arg>--password</arg>
                  <arg>cloudera</arg>
                  <arg>--query</arg>
                  <arg>SELECT * FROM employee</arg>
                 ....
              </sqoop>
      
      1. Split by space but escape the spaces within quotes
      2. Add splits into an 'arguments' list https://github.com/cloudera/hue/blob/master/apps/oozie/src/oozie/models2.py#L827
      3. Update workflow-sqoop-document.xml.mako

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                prachi.poddar Prachi Poddar
                Reporter:
                romain Romain Rigaux
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: