Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-30

Support (programmatic) configuration of Flume logging by dataset

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 0.2.0
          • Fix Version/s: 0.3.0
          • Component/s: None
          • Labels:
            None

            Description

            There are a couple of places where we have to know about the dataset layout in HDFS:

            1. The Avro schema for the event objects being logged is configured in the log4j properties file.
            2. The HDFS path is configured in the Flume configuration file.

            Ideally we would configure these with datasets.

              Attachments

                Issue Links

                blocks

                Improvement - An improvement or enhancement to an existing feature or task. KITE-39 Update examples to configure Flume by dataset

                • Major - Major loss of function.
                • Resolved
                relates to

                Improvement - An improvement or enhancement to an existing feature or task. KITE-38 HCatalogMetadataProvider should store the Avro schema on the filesystem

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      tom Tom White
                      Reporter:
                      tom Tom White
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      0 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: