Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.2.0
    • Fix Version/s: None
    • Component/s: Client, Server
    • Labels:
      None

      Description

      Nested type support is now in Impala 2.3, so now query such as:

           drop table if exists functional.complextypestbl;
           create external table functional.complextypestbl (
             id bigint,
             int_array array<int>,
             int_array_array array<array<int>>,
             int_map map<string, int>,
             int_map_array array<map<string, int>>,
             nested_struct struct<a: int, b: array<int>,
               c: struct<d: array<array<struct<e: int, f: string>>>>,
               g: map<string, struct<h: struct<i: array<float>>>>>)
             stored as parquet
             location '/test-warehouse/complextypestbl_parquet/';
      
             select id, a.item from functional.complextypestbl t, t.int_array a;
      

      works in Impala. However, Impala currently doesn't support directly selection nested data, such as:

           select int_array from functional.complextypestbl;
      

      For RecordService, for integration with SparkSQL/Hive/Impala, we need to support returning nested data.

        Attachments

          Activity

            People

            • Assignee:
              sunchao Chao Sun
              Reporter:
              sross Steve Ross
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: