Uploaded image for project: 'RecordService (READ-ONLY)'
  1. RecordService (READ-ONLY)
  2. RS-28

Investigate Spark w/ RS memory usage

          Details

          • Type: Task
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: 0.2.0
          • Fix Version/s: None
          • Component/s: Client, Server
          • Labels:

            Description

            We found out that Spark job w/ RS needs more memory than Spark w/o RS, and sometimes this will cause failures if executor memory is set too low. We should investigate why RS needs more memory to run.

              Attachments

                Activity

                  People

                  • Assignee:
                    sunchao Chao Sun
                    Reporter:
                    sunchao Chao Sun
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    1 Start watching this issue

                    Dates

                    • Created:
                      Updated: