Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-658

Decide between URI and URL for descriptors

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.17.0
    • Fix Version/s: 0.17.0
    • Component/s: Data Module
    • Labels:
      None

      Description

      We recently added DatasetDescriptor#getUri, but need to follow up and decide whether URI or URL is correct to expose through the API. URL is easier to open, but Java URLs have requires a hacky handler addition in Kite for hdfs URIs. This handler calls new Configuration() (which should be updated for DefaultConfiguration) and is used for any URI that had no handler. So while the API guarantees there is a handler, there is no guarantee that the URL's openStream method will work without throwing an exception from Hadoop's FileSystem.

        Attachments

          Activity

            People

            • Assignee:
              blue Ryan Blue
              Reporter:
              blue Ryan Blue
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: