Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Pipelines
    • Labels:
      None
    • Release Notes:
      Added checkpointing to Hydrator realtime pipelines.
    • Rank:
      1|hzziu7:

      Description

      The data streams app needs to enable checkpointing in order to survive driver failures, and in order to pick up where it left off if it is restarted. See http://spark.apache.org/docs/latest/streaming-programming-guide.html#checkpointing

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashau Albert Shau
                Reporter:
                ashau Albert Shau
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: