Uploaded image for project: 'Kite SDK (READ-ONLY)'
  1. Kite SDK (READ-ONLY)
  2. KITE-689

Can't create an HBase dataset with an embedded mapping but external partition strategy

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.16.0
    • Fix Version/s: None
    • Component/s: HBase Module
    • Labels:
      None

      Description

      The following doesn't work:

          DatasetDescriptor.Builder builder = new DatasetDescriptor.Builder();
          builder.partitionStrategy(getClass().getClassLoader().
              getResourceAsStream("partition_strategy/MessagePartitionStrategy.json"));
          builder.schema(Message.getClassSchema());
       
          Dataset<Message> messages = Datasets.create(
              "dataset:hbase:" + zookeeperQuorum + "/messages", builder.build(),
              Message.class);
      

      it fails with an exception:

      org.kitesdk.data.ValidationException: Fields are key-mapped without identity partitioners: id
      

      This works if the mapping is embedded in the fields, but not if it's embedded in the top-level of the schema.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              joey Joey Echeverria
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: