Details
Description
The flume master keeps accumulating config information. This is especially bad in an auto scaled (EC2) environment where nodes go up and down every day.
We simply want to see all the active nodes on the master status page. We do not want to see anything that is decommissioned or lost.
There are multiple ways to handle this
One way is to have some sort of 'purge' commands that will clear out decommission or lost nodes.We can always set a cron to run the purge command every day. I would further suggest that the purge command should take a status so that you can delete bunch of nodes together. Otherwise in a bigger cluster, it will be a problem.
Another way is to add a filter to the master status page, that will only show all the active nodes. That way people can choose what they want to see.
Attachments
Issue Links
- blocks
-
FLUME-417 Add command to purge only DECOMMISSIONED or LOST node status.
-
- Patch Available
-