Details

    • Type: Epic
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Master
    • Labels:
      None

      Description

      Multi master configurations for high availability and node scalability suffers from several deficiencies. This jira will serve as a coordination point for another implementation of the master's configuration storage mechanism and or a possible re-architecting of is code.

      These are some of the core issues:

      1) Translations for logical nodes (auto*Chain, logicalSource/Sink) does not work in mutli-master.
      2) Flows abstraction is not scalable.
      3) ZK-backend needs to be revisited to be scalable (single znodes vs several znodes).
      4) OOME error occurs due to ack sharing mechanism.
      5) Each master maintains its own command history.

      Fundamentally, this is due to two core issues:

      1) Not all state information is shared.
      2) Current implementation does not have a leader

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jon Jonathan Hsieh
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: