Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-2573

Import data from file truncates large files to 64MB

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 3.7.0
    • Fix Version/s: 3.8.0
    • Component/s: app.catalog
    • Labels:
      None

      Description

      When attempting to use the "Create a new table from a file" wizard, the process truncates the data to 64MB for large files, as described here:

      http://stackoverflow.com/questions/26414470/load-large-csv-in-hadoop-via-hue-would-only-store-a-64mb-block

      I've replicated this myself in Hue 3.7.0. The truncation appears to happen at the stage the data is copied over into /user/hive/warehouse. Using a two stage process where you untick "import data from file" and then later use "Import data" on the table works OK though.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              martinbenson Martin Benson
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: