Action: stalled

Reports when a stream has stopped getting events for a given duration

NOTE the semi-colons - this is not a multi-line bash script

Example

Input:

input:
  exec:
    raw: true
    command: |
      echo '{"one":1}';
      echo '{"two":2}';
      sleep 2;
      echo '{"three":3}';

Pipe Language Snippet:

stalled:
  timeout: 1s
  marker:
    - stalled

Output:

{"_marker":"stalled","streaming":"yes"}
{"one":1}
{"two":2}
{"_marker":"stalled","streaming":"no"}
{"_marker":"stalled","streaming":"yes"}
{"three":3}

Field Summary

Field Name	Type	Description	Default
condition	expression	Only run this action if the condition the specified condition is met	-
timeout	duration	How long to wait before indicating that no data is flowing	1m
use-document-marker	bool	If specified we use end-of-document markers instead of the timeout	false
marker	array of strings	Field value to add for when the Pipe is stalled	-
warning	bool	Enable warnings	false
group-by	field	A field containing group values	-
time-field	field	A field containing time in millisecs since epoch	-
save-file	path	Optional file to save the state of this action to	-

Fields

condition

Type: expression

Only run this action if the condition the specified condition is met

timeout

Type: duration

Default: 1m

How long to wait before indicating that no data is flowing

use-document-marker

Type: bool

Default: false

If specified we use end-of-document markers instead of the timeout

marker

Type: array of strings

Field value to add for when the Pipe is stalled

warning

Type: bool

Default: false

Enable warnings

group-by

Type: field
Alias: group-by

A field containing group values

time-field

Type: field

A field containing time in millisecs since epoch

save-file

Type: path

Optional file to save the state of this action to