Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-15737

Hadoop substitution depth errors

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: Parking Lot
    • Component/s: App Fabric
    • Labels:
      None
    • Rank:
      1|i00q7r:

      Description

      Seeing some failures like:

      java.lang.IllegalStateException: Variable substitution depth too large: 20 [...]
              at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:818)
              at org.apache.hadoop.conf.Configuration.get(Configuration.java:838)
              at io.cdap.cdap.internal.app.runtime.batch.MapReduceContextConfig.getOutputs(MapReduceContextConfig.java:126)
      

      Basically, any place CDAP is setting a property in a Hadoop conf, it should be using getRaw() instead of get() to retrieve that property back.

        Attachments

          Activity

            People

            • Assignee:
              bhooshan Bhooshan Mogal
              Reporter:
              ashau Albert Shau
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: