Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-2208

explore service fails on wrapped indexedTable with Avro (specific record) contents

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 3.1.0
    • Component/s: Datasets, Explore
    • Labels:
      None
    • Rank:
      1|hzyrlr:

      Description

      Follow up from an issue posted on cdap-user:
      https://groups.google.com/forum/#!topic/cdap-user/eSKwvY2146Y
      (contains logs, and code excerpts)

      I'm using a custom dataset which wraps an IndexedTable and stores serialized Avro specific records. Everything works fine when storing and accessing the data through a service, and de-serialization methods also work fine in unit test.

      However, the explore service doesn't work for this dataset in standalone mod (haven't tried in unit-test.) I can see the schema on the web interface, but the queries fail (both with and without a WHERE clause.)

      The log shows where it's breaking- in the avro-generated deserialization code- it fails where it attempts to casts to the specific type of an enum used in the schema. If I remove the enum and change it for a string, it fails later, when trying to cast to the specific data type.

      This seems to indicate a problem in the environment rather than in the de-serialization code itself.

      Looking at the jar generated for the dataset, it seems to include everything needed..

      I'm not sure, but suspect I had the same issue when running on 2.7.1.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashau Albert Shau
                Reporter:
                ppsauve Pierre-Paul Sauve
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: