A pipeline step that is used to manually get/set the checkpoint. Often, this pipeline step is used to get and store checkpoints and then at the very end of the pipeline, it will use the saved off data to manaully checkpoint using StreamUtil.stats.
StreamUtil.stats
Note, this is only rarely used in special cases.
Exposes a function to allow the developer to set the checkpoint.
Exposes a function to allow the developer to manually get the checkpoint.
Generated using TypeDoc
A pipeline step that is used to manually get/set the checkpoint. Often, this pipeline step is used to get and store checkpoints and then at the very end of the pipeline, it will use the saved off data to manaully checkpoint using
StreamUtil.stats.Note, this is only rarely used in special cases.