Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-322

Parquet readers and writers should use in-memory Configuration object

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 0.11.0
          • Fix Version/s: 0.14.0
          • Component/s: Data Module
          • Labels:
            None

            Description

            ParquetFileSystemDatasetReader and ParquetFileSystemDatasetWriter should use the constructors of AvroParquetReader and AvroParquetWriter that take a Configuration, rather than relying on the default.

            This relies on https://github.com/Parquet/parquet-mr/issues/295.

              Attachments

                Issue Links

                blocks

                Bug - A problem which impairs or prevents the functions of the product. KITE-380 Problem reading parquet file from Hive created with Kite

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved
                depends on

                Sub-task - The sub-task of the issue KITE-351 Add view support to DatasetInputFormat

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      tom Tom White
                      Reporter:
                      tom Tom White
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      0 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: