Uploaded image for project: 'Kite SDK'
  1. Kite SDK
  2. KITE-454

Add morphline command that removes all record fields for which the field name matches a blacklist but not a whitelist

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.15.0
    • Component/s: Morphlines Module
    • Labels:
      None

      Description

      We should add a command that takes a field name regex (or glob expression or literal string) as a whitelist and/or a blacklist and removes corresponding record fields, e.g. to support schemaless mode.

      For example:

      # remove all fields where the name matches at least one of foo.* or bar* or baz, but none of foobar or bazoo
      # blacklist defaults to match all, whereas whitelist defaults to match none
      removeFields {
       blacklist: [regex:foo.*, glob:bar*, literal:baz]
       whitelist: [literal:foobar, literal:bazoo]
      }
      

        Attachments

          Activity

            People

            • Assignee:
              whoschek Wolfgang Hoschek
              Reporter:
              whoschek Wolfgang Hoschek
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: