Details
-
Type:
New Feature
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.10.0
-
Fix Version/s: 0.15.0
-
Component/s: Morphlines Module
-
Labels:None
Description
We should add a command that takes a field name regex (or glob expression or literal string) as a whitelist and/or a blacklist and removes corresponding record fields, e.g. to support schemaless mode.
For example:
# remove all fields where the name matches at least one of foo.* or bar* or baz, but none of foobar or bazoo
# blacklist defaults to match all, whereas whitelist defaults to match none
removeFields {
blacklist: [regex:foo.*, glob:bar*, literal:baz]
whitelist: [literal:foobar, literal:bazoo]
}