Uploaded image for project: 'RecordService (READ-ONLY)'
  1. RecordService (READ-ONLY)
  2. RS-105

Set spark.task.fetch.size for spark job

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 0.2.0
          • Fix Version/s: 0.1.0, 0.2.0
          • Component/s: Client
          • Labels:
            None

            Description

            Currently, the task.fetch.size for spark job is using the default value (5000) in server side, and cannot be changed. We should make it changeable, and client can change it in spark.conf.

              Attachments

                Activity

                  People

                  • Assignee:
                    lilicn Li Li
                    Reporter:
                    lilicn Li Li
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    1 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: