Our Vertica database sometimes throws insufficient resource ERRORs and provides no (or apparently sometimes partial) results to Hydrator Database Source plugins. I have four Hydrator Database Source plugins in my pipeline and they ignore the ERRORs and proceed. Therefore the results are invalid yet the batch pipeline run declares SUCCESS. I need CDAP to declare the batch pipeline run FAILED instead of SUCCEEDED when any one of the Database Source plugins receives an ERROR from the Vertica database. This way partial results will not be committed by the pipeline to the sink CDAP Table Datasets.
Logs are attached from one run of my pipeline in which all four database sources received ERRORs from Vertica, yet the pipeline declared the run SUCCEEDED.