百度智能云

All Product Document

          Cloud Monitor

          Baidu Stream Computing (BSC)

          Baidu Streaming Compute (BSC) includes 8 types of monitor objects: FLINK_STREAM:SQL, FLINK_STREAM:JAR, FLINK_BATCH:SQL, FLINK_BATCH:JAR, SPARK_STREAM:SQL, SPARK_STREAM:JAR, SPARK_BATCH:SQL, and SPARK_BATCH:JAR. The list of monitoring metrics for each type is as follows:

          Metric name (English) Metric name (Chinese) Unit Dimension
          isBackPressured Task backpressure status 1: Yes; 0: No ApplicationId,SubTaskIndex,TaskName
          lastCheckpointSize Last checkpoint status Bytes ApplicationId
          numberOfCompletedCheckpoints checkpoint successes Time ApplicationId
          numberOfFailedCheckpoints checkpoint failures Time ApplicationId
          numBytesInPerSecond Task ingress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesInPerSecondPerJob Job ingress traffic per second Bytes/s ApplicationId
          numBytesOutPerSecond Task egress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesOutPerSecondPerJob Job egress traffic per second Bytes/s ApplicationId
          numRecordsInPerSecond Task records input per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsInPerSecondPerJob Job records input per second Entry/s ApplicationId
          numRecordsOutPerSecond Task records output per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsOutPerSecondPerJob Job records output per second Entry/s ApplicationId
          numRestarts Job restart operations Time ApplicationId
          restartingTime Job restart time Second ApplicationId
          totalNumberOfCheckpoints Total checkpoint count Time ApplicationId
          Metric name (English) Metric name (Chinese) Unit Dimension
          isBackPressured Task backpressure status 1: Yes; 0: No ApplicationId,SubTaskIndex,TaskName
          lastCheckpointSize Last checkpoint status Bytes ApplicationId
          numberOfCompletedCheckpoints checkpoint successes Time ApplicationId
          numberOfFailedCheckpoints checkpoint failures Time ApplicationId
          numBytesInPerSecond Task ingress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesInPerSecondPerJob Job ingress traffic per second Bytes/s ApplicationId
          numBytesOutPerSecond Task egress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesOutPerSecondPerJob Job egress traffic per second Bytes/s ApplicationId
          numRecordsInPerSecond Task records input per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsInPerSecondPerJob Job records input per second Entry/s ApplicationId
          numRecordsOutPerSecond Task records output per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsOutPerSecondPerJob Job records output per second Entry/s ApplicationId
          numRestarts Job restart operations Time ApplicationId
          restartingTime Job restart time Second ApplicationId
          totalNumberOfCheckpoints Total checkpoint count Time ApplicationId
          Metric name (English) Metric name (Chinese) Unit Dimension
          isBackPressured Task backpressure status 1: Yes; 0: No ApplicationId,SubTaskIndex,TaskName
          lastCheckpointSize Last checkpoint status Bytes ApplicationId
          numberOfCompletedCheckpoints checkpoint successes Time ApplicationId
          numberOfFailedCheckpoints checkpoint failures Time ApplicationId
          numBytesInPerSecond Task ingress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesInPerSecondPerJob Job ingress traffic per second Bytes/s ApplicationId
          numBytesOutPerSecond Task egress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesOutPerSecondPerJob Job egress traffic per second Bytes/s ApplicationId
          numRecordsInPerSecond Task records input per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsInPerSecondPerJob Job records input per second Entry/s ApplicationId
          numRecordsOutPerSecond Task records output per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsOutPerSecondPerJob Job records output per second Entry/s ApplicationId
          numRestarts Job restart operations Time ApplicationId
          restartingTime Job restart time s ApplicationId
          totalNumberOfCheckpoints Total checkpoint count Time ApplicationId
          Metric name (English) Metric name (Chinese) Unit Dimension
          isBackPressured Task backpressure status 1: Yes; 0: No ApplicationId,SubTaskIndex,TaskName
          lastCheckpointSize Last checkpoint status Bytes ApplicationId
          numberOfCompletedCheckpoints checkpoint successes Time ApplicationId
          numberOfFailedCheckpoints checkpoint failures Time ApplicationId
          numBytesInPerSecond Task ingress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesInPerSecondPerJob Job ingress traffic per second Bytes/s ApplicationId
          numBytesOutPerSecond Task egress traffic per second Bytes/s ApplicationId,SubTaskIndex,TaskName
          numBytesOutPerSecondPerJob Job egress traffic per second Bytes/s ApplicationId
          numRecordsInPerSecond Task records input per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsInPerSecondPerJob Job records input per second Entry/s ApplicationId
          numRecordsOutPerSecond Task records output per second Entry/s ApplicationId,SubTaskIndex,TaskName
          numRecordsOutPerSecondPerJob Job records output per second Entry/s ApplicationId
          numRestarts Job restart operations Time ApplicationId
          restartingTime Job restart time s ApplicationId
          totalNumberOfCheckpoints Total checkpoint count Time ApplicationId

          SPARK_STREAM:SQL

          Metric name (English) Metric name (Chinese) Unit Dimension
          inputRowsPerSecond Job records input per second Entry/s ApplicationId
          latency Job processing latency s ApplicationId
          processedRowsPerSecond Job records processed per second Entry/s ApplicationId
          taskCompletedNums Task successes in Executor Time ApplicationId,ExecutorId
          taskCompletedNumsPerJob Job task successes Time ApplicationId
          taskFailedNums Task failures in Executor Time ApplicationId,ExecutorId
          taskFailedNumsPerJob Job task failures Time ApplicationId

          SPARK_STREAM:JAR

          Metric name (English) Metric name (Chinese) Unit Dimension
          inputRowsPerSecond Job records input per second Entry/s ApplicationId
          latency Job processing latency s ApplicationId
          processedRowsPerSecond Job records processed per second Entry/s ApplicationId
          taskCompletedNums Task successes in Executor Time ApplicationId,ExecutorId
          taskCompletedNumsPerJob Job task successes Time ApplicationId
          taskFailedNums Task failures in Executor Time ApplicationId,ExecutorId
          taskFailedNumsPerJob Job task failures Time ApplicationId

          SPARK_BATCH:SQL

          Metric name (English) Metric name (Chinese) Unit Dimension
          inputRowsPerSecond Job records input per second Entry/s ApplicationId
          latency Job processing latency s ApplicationId
          processedRowsPerSecond Job records processed per second Entry/s ApplicationId
          taskCompletedNums Task successes in Executor Time ApplicationId,ExecutorId
          taskCompletedNumsPerJob Job task successes Time ApplicationId
          taskFailedNums Task failures in Executor Time ApplicationId,ExecutorId
          taskFailedNumsPerJob Job task failures Time ApplicationId

          SPARK_BATCH:JAR

          Metric name (English) Metric name (Chinese) Unit Dimension
          inputRowsPerSecond Job records input per second Entry/s ApplicationId
          latency Job processing latency s ApplicationId
          processedRowsPerSecond Job records processed per second Entry/s ApplicationId
          taskCompletedNums Task successes in Executor Time ApplicationId,ExecutorId
          taskCompletedNumsPerJob Job task successes Time ApplicationId
          taskFailedNums Task failures in Executor Time ApplicationId,ExecutorId
          taskFailedNumsPerJob Job task failures Time ApplicationId
          Previous
          Baidu Elasticsearch
          Next
          Data warehouse DORIS