Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-9091

Revisit macro handling in pipelines

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.2.0
    • Component/s: UI
    • Labels:
    • Sprint:
      UP4 Sprint 1, UP4 Sprint 2, UP4 Sprint 3
    • Release Notes:
      Hide
      Users can now set both runtime arguments and other pipeline configurations through the new Configure modeless. If there are macro keys defined in the pipeline stages, their values will be derived from Preferences. Users can also mark a macro runtime argument as Provided if the value will be provided by a stage in the pipeline.
      Show
      Users can now set both runtime arguments and other pipeline configurations through the new Configure modeless. If there are macro keys defined in the pipeline stages, their values will be derived from Preferences. Users can also mark a macro runtime argument as Provided if the value will be provided by a stage in the pipeline.
    • Rank:
      1|hzy0v2:

      Description

      There are a few problems with handling of macros, runtime arguments and preferences in pipelines. To list a few:

      1. Every single time you run or schedule a pipeline, you have to click twice, even if your pipeline doesn't use macros
      2. The UI automatically populates the macro keys, but their values are not derived from preferences.
      3. UI expects every single macro key to be defined (unless of course you explicitly delete it)
      4. Macros are not available in preview mode

      Creating a top-level jira. Will add subtasks to address each of these issues.

        Attachments

        1. ALERTS - BATCH RUN  Copy 2.png
          ALERTS - BATCH RUN Copy 2.png
          116 kB
        2. ALERTS - BATCH STUDIO DATABASE QUERY.png
          ALERTS - BATCH STUDIO DATABASE QUERY.png
          223 kB
        3. ALERTS - BATCH STUDIO DATABASE QUERY Copy.png
          ALERTS - BATCH STUDIO DATABASE QUERY Copy.png
          214 kB
        4. ALERTS - BATCH STUDIO EMAIL.png
          ALERTS - BATCH STUDIO EMAIL.png
          218 kB
        5. ALERTS - BATCH STUDIO Email 1.png
          ALERTS - BATCH STUDIO Email 1.png
          219 kB
        6. ALERTS - BATCH STUDIO HTTP call.png
          ALERTS - BATCH STUDIO HTTP call.png
          229 kB
        7. ALERTS - BATCH STUDIO HTTP call Copy.png
          ALERTS - BATCH STUDIO HTTP call Copy.png
          214 kB
        8. CONFIRMATION MODAL.png
          CONFIRMATION MODAL.png
          94 kB
        9. ENGINE CONFIG - BATCH PREVIEW.png
          ENGINE CONFIG - BATCH PREVIEW.png
          287 kB
        10. ENGINE CONFIG - BATCH RUN .png
          ENGINE CONFIG - BATCH RUN .png
          116 kB
        11. ENGINE CONFIG - BATCH STUDIO.png
          ENGINE CONFIG - BATCH STUDIO.png
          264 kB
        12. ENGINE CONFIG - REALTIME PREVIEW.png
          ENGINE CONFIG - REALTIME PREVIEW.png
          257 kB
        13. ENGINE CONFIG - REALTIME PREVIEW Copy.png
          ENGINE CONFIG - REALTIME PREVIEW Copy.png
          271 kB
        14. ENGINE CONFIG - REALTIME PREVIEW Copy 2.png
          ENGINE CONFIG - REALTIME PREVIEW Copy 2.png
          260 kB
        15. ENGINE CONFIG - REALTIME RUN Copy.png
          ENGINE CONFIG - REALTIME RUN Copy.png
          114 kB
        16. ENGINE CONFIG - REALTIME RUN Copy 2.png
          ENGINE CONFIG - REALTIME RUN Copy 2.png
          109 kB
        17. ENGINE CONFIG - REALTIME STUDIO.png
          ENGINE CONFIG - REALTIME STUDIO.png
          257 kB
        18. ENGINE CONFIG - REALTIME STUDIO Copy.png
          ENGINE CONFIG - REALTIME STUDIO Copy.png
          250 kB
        19. ENGINE CONFIG - REALTIME STUDIO Copy 2.png
          ENGINE CONFIG - REALTIME STUDIO Copy 2.png
          248 kB
        20. PIPELINE CONFIG - BATCH PREVIEW Copy.png
          PIPELINE CONFIG - BATCH PREVIEW Copy.png
          285 kB
        21. PIPELINE CONFIG - BATCH STUDIO Copy.png
          PIPELINE CONFIG - BATCH STUDIO Copy.png
          264 kB
        22. PIPELINE CONFIG - BATCH STUDIO Copy 2.png
          PIPELINE CONFIG - BATCH STUDIO Copy 2.png
          267 kB
        23. PIPELINE CONFIGURE - BATCH PIPELINE .png
          PIPELINE CONFIGURE - BATCH PIPELINE .png
          108 kB
        24. Pipelines-Config-modeless---SPECS-.png
          Pipelines-Config-modeless---SPECS-.png
          242 kB
        25. PREVEIW CONFIG - BATCH PREVIEW Copy.png
          PREVEIW CONFIG - BATCH PREVIEW Copy.png
          283 kB
        26. RESOURCE - BATCH STUDIO Copy 2.png
          RESOURCE - BATCH STUDIO Copy 2.png
          264 kB
        27. RESOURCES - BATCH RUN  Copy.png
          RESOURCES - BATCH RUN Copy.png
          111 kB
        28. RESOURCES - REALTIME RUN .png
          RESOURCES - REALTIME RUN .png
          103 kB
        29. RESOURCES - REALTIME RUN Copy 2.png
          RESOURCES - REALTIME RUN Copy 2.png
          99 kB
        30. Runtime Arguments - Batch PREVIEW.png
          Runtime Arguments - Batch PREVIEW.png
          295 kB
        31. Runtime Arguments - Batch RUN.png
          Runtime Arguments - Batch RUN.png
          107 kB
        32. Runtime Arguments - Realtime PREVIEW.png
          Runtime Arguments - Realtime PREVIEW.png
          269 kB
        33. Runtime Arguments - Realtime RUN.png
          Runtime Arguments - Realtime RUN.png
          115 kB
        34. SCHEDULE.png
          SCHEDULE.png
          118 kB
        35. SCHEDULE Copy.png
          SCHEDULE Copy.png
          102 kB
        36. SCHEDULE Copy 2.png
          SCHEDULE Copy 2.png
          115 kB
        37. SCHEDULE Copy 3.png
          SCHEDULE Copy 3.png
          113 kB
        38. SCHEDULE Copy 4.png
          SCHEDULE Copy 4.png
          119 kB
        39. SCHEDULE Copy 5.png
          SCHEDULE Copy 5.png
          120 kB
        40. SCHEDULE Copy 6.png
          SCHEDULE Copy 6.png
          118 kB
        41. SCHEDULE Copy 7.png
          SCHEDULE Copy 7.png
          121 kB
        42. Screen Shot 2017-04-28 at 4.20.00 PM.png
          Screen Shot 2017-04-28 at 4.20.00 PM.png
          68 kB

          Issue Links

            Activity

              People

              • Assignee:
                tbach Tony Bach
                Reporter:
                bhooshan Bhooshan Mogal
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: