Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5012

Download Large Explore Query Fails

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.5.0, 3.4.0, 3.3.0
    • Fix Version/s: 4.0.0
    • Component/s: Explore
    • Release Notes:
      Support downloading of large (multiple GB+) explore queries.
    • Rank:
      1|hzz75r:

      Description

      Downloading large explore queries (tested using 50 million lines, 4.5 GB file) fails. UI getting INVALID_CHUNK_SIZE error. Tested using curl to download the query and it fails as well with error "curl: (56) Illegal or missing hexadecimal sequence in chunked-encoding"

      To reproduce:
      1. Create a stream
      2. Load large file
      3. Submit at least 3 queries with the following query string: SELECT * FROM <stream name>
      4. Download the query

      To generate random large file, in the terminal, do

      echo "This is a line of data that is 100 bytes long......................................................" > source.csv
      for i in {1..26}; do cat source.csv source.csv > source2.csv && mv source2.csv source.csv; done;
      

      This will generate a file of size 6.4GB, with ~67 million lines.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ali.anwar Ali Anwar
                Reporter:
                edwin Edwin Elia
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: