Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13447

Handle the case where there is no program run record file within the query time range

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0.0
    • Component/s: None
    • Labels:
      None
    • Rank:
      1|i00ctz:

      Description

      Currently if there is no program run record file within the query time range, there is such error: 

      2018-05-22 15:44:57,177 - ERROR [report-generation-1:c.c.c.r.ReportGenerationSpark$ReportSparkHandler@380] - Failed to generate report c07b2132-5e11-11e8-8395-000000564e43
      java.io.FileNotFoundException: No Avro files found. Hadoop option "avro.mapred.ignore.inputs.without.extension" is set to true. Do all input files have ".avro" extension?
              at com.databricks.spark.avro.DefaultSource$$anonfun$2.apply(DefaultSource.scala:65) ~[spark-avro_2.11-4.0.0.jar:4.0.0]
              at com.databricks.spark.avro.DefaultSource$$anonfun$2.apply(DefaultSource.scala:65) ~[spark-avro_2.11-4.0.0.jar:4.0.0]
              at scala.Option.getOrElse(Option.scala:121) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
              at com.databricks.spark.avro.DefaultSource.inferSchema(DefaultSource.scala:64) ~[spark-avro_2.11-4.0.0.jar:4.0.0]
              at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$7.apply(DataSource.scala:184) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
       ...

      This should have a better error message or not to fail the program report generation.

        Attachments

          Activity

            People

            • Assignee:
              shankar Shankar Selvam
              Reporter:
              mao Chengfeng Mao
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: