Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-1057

csv-import command breaks when pointed to single csv file on HDFS

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Minor
          • Resolution: Fixed
          • Affects Version/s: 1.1.0
          • Fix Version/s: 1.2.0
          • Component/s: Command-line Interface, Data Module
          • Labels:
            None
          • Environment:
            CDH 5.4.4

            Description

            The csv-import command will fail when pointed to a single csv file on HDFS, printing a message like "IO error: Could not access signal path: hdfs://10.0.0.0:8020/path/to/file.csv/.signals/unbounded".

            The problem is that org.kitesdk.data.spi.filesystem.SignalManager.java assumes it is dealing with a directory where it can create subdirectories.

            The exception is thrown from org.kitesdk.data.spi.filesystem.SignalManager.java:80 when it attempts to create an output stream in the signal directory. Prior to attempting to open the output stream in the signal directory, SignalManager attempts to create the signal directory which fails silently (HDFS does not allow it) but throws no exception.

              Attachments

                Issue Links

                links to

                Web Link PR #413

                  Activity

                    People

                    • Assignee:
                      blue Ryan Blue
                      Reporter:
                      jcooperellis Jonathan Cooper-Ellis
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      2 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: