Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-8646

Escaped CSV fields not honored on table creation and import of CSV file

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 4.3.0
    • Fix Version/s: None
    • Component/s: con.impala
    • Labels:
      None
    • Environment:

      On the internal Cloudera cluster.  5.15

      Description

      I've documented via screenshots an import of a CSV with escaped strings in a CSV to create a parquet file.  The import process does not handle escaped strings with commas in them.  I think maybe if the preview in Hue sees an escaped string in the first 5 rows, it might work, but I didn't test that. 

       

      The evidence is in the screenshots here.  I show a screenshot of an escaped field with a comma in it.  It has double quotes around the strings as exported from Excel.  

       

      I followed the import process in the screenshots and you can see that double quotes are selected, but querying the table after the import, you see that it treated the comma within the escaped field as a field separator instead of escaping it and throws all the remaining data off.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              rj@cloudera.com Rob Johnson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: