Baidu Stream Computing (BSC) Baidu Streaming Compute (BSC) includes 8 types of monitor objects: FLINK_STREAM:SQL, FLINK_STREAM:JAR, FLINK_BATCH:SQL, FLINK_BATCH:JAR, SPARK_STREAM:SQL, SPARK_STREAM:JAR, SPARK_BATCH:SQL, and SPARK_BATCH:JAR. The list of monitoring metrics for each type is as follows:
FLINK_STREAM:SQL
Metric name (English)
Metric name (Chinese)
Unit
Dimension
isBackPressured
Task backpressure status
1: Yes; 0: No
ApplicationId,SubTaskIndex,TaskName
lastCheckpointSize
Last checkpoint status
Bytes
ApplicationId
numberOfCompletedCheckpoints
checkpoint successes
Time
ApplicationId
numberOfFailedCheckpoints
checkpoint failures
Time
ApplicationId
numBytesInPerSecond
Task ingress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesInPerSecondPerJob
Job ingress traffic per second
Bytes/s
ApplicationId
numBytesOutPerSecond
Task egress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesOutPerSecondPerJob
Job egress traffic per second
Bytes/s
ApplicationId
numRecordsInPerSecond
Task records input per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsInPerSecondPerJob
Job records input per second
Entry/s
ApplicationId
numRecordsOutPerSecond
Task records output per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsOutPerSecondPerJob
Job records output per second
Entry/s
ApplicationId
numRestarts
Job restart operations
Time
ApplicationId
restartingTime
Job restart time
Second
ApplicationId
totalNumberOfCheckpoints
Total checkpoint count
Time
ApplicationId
FLINK_STREAM:JAR
Metric name (English)
Metric name (Chinese)
Unit
Dimension
isBackPressured
Task backpressure status
1: Yes; 0: No
ApplicationId,SubTaskIndex,TaskName
lastCheckpointSize
Last checkpoint status
Bytes
ApplicationId
numberOfCompletedCheckpoints
checkpoint successes
Time
ApplicationId
numberOfFailedCheckpoints
checkpoint failures
Time
ApplicationId
numBytesInPerSecond
Task ingress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesInPerSecondPerJob
Job ingress traffic per second
Bytes/s
ApplicationId
numBytesOutPerSecond
Task egress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesOutPerSecondPerJob
Job egress traffic per second
Bytes/s
ApplicationId
numRecordsInPerSecond
Task records input per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsInPerSecondPerJob
Job records input per second
Entry/s
ApplicationId
numRecordsOutPerSecond
Task records output per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsOutPerSecondPerJob
Job records output per second
Entry/s
ApplicationId
numRestarts
Job restart operations
Time
ApplicationId
restartingTime
Job restart time
Second
ApplicationId
totalNumberOfCheckpoints
Total checkpoint count
Time
ApplicationId
FLINK_BATCH:SQL
Metric name (English)
Metric name (Chinese)
Unit
Dimension
isBackPressured
Task backpressure status
1: Yes; 0: No
ApplicationId,SubTaskIndex,TaskName
lastCheckpointSize
Last checkpoint status
Bytes
ApplicationId
numberOfCompletedCheckpoints
checkpoint successes
Time
ApplicationId
numberOfFailedCheckpoints
checkpoint failures
Time
ApplicationId
numBytesInPerSecond
Task ingress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesInPerSecondPerJob
Job ingress traffic per second
Bytes/s
ApplicationId
numBytesOutPerSecond
Task egress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesOutPerSecondPerJob
Job egress traffic per second
Bytes/s
ApplicationId
numRecordsInPerSecond
Task records input per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsInPerSecondPerJob
Job records input per second
Entry/s
ApplicationId
numRecordsOutPerSecond
Task records output per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsOutPerSecondPerJob
Job records output per second
Entry/s
ApplicationId
numRestarts
Job restart operations
Time
ApplicationId
restartingTime
Job restart time
s
ApplicationId
totalNumberOfCheckpoints
Total checkpoint count
Time
ApplicationId
FLINK_BATCH:JAR
Metric name (English)
Metric name (Chinese)
Unit
Dimension
isBackPressured
Task backpressure status
1: Yes; 0: No
ApplicationId,SubTaskIndex,TaskName
lastCheckpointSize
Last checkpoint status
Bytes
ApplicationId
numberOfCompletedCheckpoints
checkpoint successes
Time
ApplicationId
numberOfFailedCheckpoints
checkpoint failures
Time
ApplicationId
numBytesInPerSecond
Task ingress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesInPerSecondPerJob
Job ingress traffic per second
Bytes/s
ApplicationId
numBytesOutPerSecond
Task egress traffic per second
Bytes/s
ApplicationId,SubTaskIndex,TaskName
numBytesOutPerSecondPerJob
Job egress traffic per second
Bytes/s
ApplicationId
numRecordsInPerSecond
Task records input per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsInPerSecondPerJob
Job records input per second
Entry/s
ApplicationId
numRecordsOutPerSecond
Task records output per second
Entry/s
ApplicationId,SubTaskIndex,TaskName
numRecordsOutPerSecondPerJob
Job records output per second
Entry/s
ApplicationId
numRestarts
Job restart operations
Time
ApplicationId
restartingTime
Job restart time
s
ApplicationId
totalNumberOfCheckpoints
Total checkpoint count
Time
ApplicationId
SPARK_STREAM:SQL
Metric name (English)
Metric name (Chinese)
Unit
Dimension
inputRowsPerSecond
Job records input per second
Entry/s
ApplicationId
latency
Job processing latency
s
ApplicationId
processedRowsPerSecond
Job records processed per second
Entry/s
ApplicationId
taskCompletedNums
Task successes in Executor
Time
ApplicationId,ExecutorId
taskCompletedNumsPerJob
Job task successes
Time
ApplicationId
taskFailedNums
Task failures in Executor
Time
ApplicationId,ExecutorId
taskFailedNumsPerJob
Job task failures
Time
ApplicationId
SPARK_STREAM:JAR
Metric name (English)
Metric name (Chinese)
Unit
Dimension
inputRowsPerSecond
Job records input per second
Entry/s
ApplicationId
latency
Job processing latency
s
ApplicationId
processedRowsPerSecond
Job records processed per second
Entry/s
ApplicationId
taskCompletedNums
Task successes in Executor
Time
ApplicationId,ExecutorId
taskCompletedNumsPerJob
Job task successes
Time
ApplicationId
taskFailedNums
Task failures in Executor
Time
ApplicationId,ExecutorId
taskFailedNumsPerJob
Job task failures
Time
ApplicationId
SPARK_BATCH:SQL
Metric name (English)
Metric name (Chinese)
Unit
Dimension
inputRowsPerSecond
Job records input per second
Entry/s
ApplicationId
latency
Job processing latency
s
ApplicationId
processedRowsPerSecond
Job records processed per second
Entry/s
ApplicationId
taskCompletedNums
Task successes in Executor
Time
ApplicationId,ExecutorId
taskCompletedNumsPerJob
Job task successes
Time
ApplicationId
taskFailedNums
Task failures in Executor
Time
ApplicationId,ExecutorId
taskFailedNumsPerJob
Job task failures
Time
ApplicationId
SPARK_BATCH:JAR
Metric name (English)
Metric name (Chinese)
Unit
Dimension
inputRowsPerSecond
Job records input per second
Entry/s
ApplicationId
latency
Job processing latency
s
ApplicationId
processedRowsPerSecond
Job records processed per second
Entry/s
ApplicationId
taskCompletedNums
Task successes in Executor
Time
ApplicationId,ExecutorId
taskCompletedNumsPerJob
Job task successes
Time
ApplicationId
taskFailedNums
Task failures in Executor
Time
ApplicationId,ExecutorId
taskFailedNumsPerJob
Job task failures
Time
ApplicationId