Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-8646

Escaped CSV fields not honored on table creation and import of CSV file

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 4.3.0
    • Fix Version/s: None
    • Component/s: con.impala
    • Labels:
      None
    • Environment:

      On the internal Cloudera cluster.  5.15

      Description

      I've documented via screenshots an import of a CSV with escaped strings in a CSV to create a parquet file.  The import process does not handle escaped strings with commas in them.  I think maybe if the preview in Hue sees an escaped string in the first 5 rows, it might work, but I didn't test that. 

       

      The evidence is in the screenshots here.  I show a screenshot of an escaped field with a comma in it.  It has double quotes around the strings as exported from Excel.  

       

      I followed the import process in the screenshots and you can see that double quotes are selected, but querying the table after the import, you see that it treated the comma within the escaped field as a field separator instead of escaping it and throws all the remaining data off.

        Attachments

        1. Screen Shot 2018-10-26 at 3.12.31 PM.png
          133 kB
          Rob Johnson
        2. Screen Shot 2018-10-26 at 3.19.31 PM.png
          119 kB
          Rob Johnson
        3. Screen Shot 2018-10-26 at 3.13.21 PM.png
          445 kB
          Rob Johnson
        4. Screen Shot 2018-10-26 at 3.13.49 PM.png
          250 kB
          Rob Johnson
        5. Screen Shot 2018-10-26 at 3.14.10 PM.png
          337 kB
          Rob Johnson
        6. Screen Shot 2018-10-26 at 3.14.38 PM.png
          652 kB
          Rob Johnson
        7. HueCSVSample.csv
          0.0 kB
          Alan Jackoway

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              rj@cloudera.com Rob Johnson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: