Details
Description
Nested type support is now in Impala 2.3, so now query such as:
drop table if exists functional.complextypestbl; create external table functional.complextypestbl ( id bigint, int_array array<int>, int_array_array array<array<int>>, int_map map<string, int>, int_map_array array<map<string, int>>, nested_struct struct<a: int, b: array<int>, c: struct<d: array<array<struct<e: int, f: string>>>>, g: map<string, struct<h: struct<i: array<float>>>>>) stored as parquet location '/test-warehouse/complextypestbl_parquet/'; select id, a.item from functional.complextypestbl t, t.int_array a;
works in Impala. However, Impala currently doesn't support directly selection nested data, such as:
select int_array from functional.complextypestbl;
For RecordService, for integration with SparkSQL/Hive/Impala, we need to support returning nested data.