Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-709

FileSystemWriter.write() doesn't handle RuntimeExceptions

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Duplicate
          • Affects Version/s: 0.16.0
          • Fix Version/s: None
          • Component/s: None
          • Labels:
            None

            Description

            FileSystemWriter.write() catches IOExceptions thrown by it's FileAppender, but it doesn't catch RuntimeExceptions. This can cause bad behavior. For example, if you were using the DurableParquetAppender and you close the FileSystemWriter after you failed a write(), you'd end up deleting the Avro file which may or may not cause data loss depending on where the RuntimeException was thrown and how the user application tried to handle individual write failures.

              Attachments

                Issue Links

                duplicates

                Improvement - An improvement or enhancement to an existing feature or task. KITE-885 Fix writer state machine for runtime exceptions and error handling

                • Major - Major loss of function.
                • Resolved
                relates to

                Bug - A problem which impairs or prevents the functions of the product. KITE-594 Document durability guarantees

                • Major - Major loss of function.
                • Resolved

                Task - A task that needs to be done. KITE-713 Don't use DurableParquetAppender by default

                • Blocker - Blocks development and/or testing work, production could not run.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      blue Ryan Blue
                      Reporter:
                      joey Joey Echeverria
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      3 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: