Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-7 [metastore] Redesign create table wizard
  3. HUE-4911

[metastore] Sample more rows for more precise types in create table from a file

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 3.11.0
    • Fix Version/s: None
    • Component/s: app.editor
    • Labels:
      None

      Description

      • Download all_month.csv from this JIRA
      • Go to the Metastore Manager
      • Click the default database
      • Click create table from file
      • Name table and open Input File or Directory (...)
      • Upload all_month.csv, select file
      • Click Next
      • Click Next
      • Deselect, Use first row as column names
      • Click Create Table
      • Go to Impala and Perform incremental metadata update

      Compare column col_17 (magError) with column col_15 (horizontalError). magError is set to string while horizontalError is set to float. If you look at the csv file itself, you can see that magError has a NULL in its first row while horizontalError does not.

      In 3.11, you see this same behavior when you create the table with column names. In 3.10, you only saw this behavior when you created with column names. When you removed column names, magError was also set to float.

        Attachments

        1. _310_with_col_names.png
          16 kB
          Gwendolynne Barr
        2. _310_wo_col_names.png
          16 kB
          Gwendolynne Barr
        3. _311_with_col_names.png
          17 kB
          Gwendolynne Barr
        4. _311_wo_col_names.png
          15 kB
          Gwendolynne Barr
        5. all_month.csv
          1.74 MB
          Gwendolynne Barr
        6. all_month_20.csv
          4 kB
          Gwendolynne Barr

          Activity

            People

            • Assignee:
              jennykim Jenny Kim
              Reporter:
              gbarr Gwendolynne Barr
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: