Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-976

DatasetKeyInputFormat/DatasetKeyOutputFormat not setting job configuration before loading dataset

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 1.0.0
          • Fix Version/s: 1.1.0
          • Component/s: None
          • Labels:
            None

            Description

            From this discussion on the mailing list[1], it was discovered that we are not setting the job configuration on the DefaultConfiguration before loading the dataset in DatasetKeyInputFormat/DatasetKeyOutputFormat. This can lead to issues like not being able to reference a name service in the dataset uri that isn't in the default hadoop configuration for that node.

            [1] https://groups.google.com/a/cloudera.org/forum/#!topic/cdk-dev/RofUdsSUx3M

              Attachments

                Issue Links

                blocks

                Bug - A problem which impairs or prevents the functions of the product. KITE-758 Hive MetaStore URI from HiveConf is not present for MR jobs

                • Major - Major loss of function.
                • Resolved
                relates to

                Bug - A problem which impairs or prevents the functions of the product. KITE-1090 DatasetKeyInputFormat not honoring job config regression

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      Unassigned
                      Reporter:
                      edward.skoviak Edward Skoviak
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      2 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: