千帆数据智能平台 DataBuilder
千帆数据智能平台 DataBuilder有8个子类型,源连接与集成实例(SeatunnelCompute)、源连接与集成节点(SeatunnelNode)、数据处理常驻Ray实例(RayCompute)、数据处理常驻Ray节点(RayNode)、数据处理常驻Spark实例(SparkCompute)、数据处理常驻Spark节点(SparkNode)、分析与AI搜索Doris实例(DorisCompute)、分析与AI搜索Doris节点(DorisNode),各个类型包含的监控指标列表如下:
源连接与集成实例(SeatunnelCompute)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| SeatunnelMasterCountRunning |
master节点正常运行数 |
个 |
SeatunnelCompute |
|
| SeatunnelWorkerCountRunning |
worker节点正常运行数 |
个 |
SeatunnelCompute |
|
| SeatunnelTotalSlot |
任务执行单元总数 |
个 |
SeatunnelCompute |
|
| SeatunnelUnassignedSlot |
任务执行单元空闲数 |
个 |
SeatunnelCompute |
|
| SeatunnelSlotUtilization |
任务执行单元利用率 |
% |
SeatunnelCompute |
|
| SeatunnelJobCountRunning |
运行中任务数 |
个 |
SeatunnelCompute,SeatunnelNode |
|
源连接与集成节点(SeatunnelNode)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| SeatunnelNodeTotalSlot |
节点任务执行单元总数 |
个 |
SeatunnelCompute,SeatunnelNode |
|
| SeatunnelNodeUnassignedSlot |
节点任务执行单元空闲数 |
个 |
SeatunnelCompute,SeatunnelNode |
|
| SeatunnelNodeSlotUtilization |
节点任务执行单元利用率 |
% |
SeatunnelCompute,SeatunnelNode |
|
| SeatunnelMemoryUtilization |
内存利用率 |
% |
SeatunnelCompute,SeatunnelNode |
|
| SeatunnelCpuUtilization |
CPU利用率 |
% |
SeatunnelCompute,SeatunnelNode |
|
| SeatunnelReceivedThroughNetwork |
Seatunnel Node网络接收量 |
Bytes/s |
SeatunnelCompute,SeatunnelNode |
|
| SeatunnelTransmittedThroughNetwork |
Seatunnel Node网络发送量 |
Bytes/s |
SeatunnelCompute,SeatunnelNode |
|
数据处理常驻Ray实例(RayCompute)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| RayNodeCount |
节点统计 |
个 |
RayCompute |
|
数据处理常驻Ray节点(RayNode)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| RayCpuUtilization |
CPU利用率 |
% |
RayCompute,RaylNode |
|
| RayMemoryUtilization |
内存利用率 |
% |
RayCompute,RaylNode |
|
| RayGpuUtilization |
GPU利用率 |
% |
RayCompute,RaylNode |
|
| RayGpuMemoryUtilization |
显存存利用率 |
% |
RayCompute,RaylNode |
|
| RayObjectStoreMemory |
对象存储内存 |
GB |
RayCompute,RaylNode |
|
| RaySchedulerPlacementGroups |
调度器放置组 |
个 |
RayCompute,RaylNode |
|
| RayCpuResourceUsed |
CPU逻辑资源使用量 |
个 |
RayCompute,RaylNode |
|
| RayCpuResourceTotal |
CPU逻辑资源使用总量 |
个 |
RayCompute,RaylNode |
|
| RayGpuResourceUsed |
GPU逻辑资源使用量 |
个 |
RayCompute,RaylNode |
|
| RayGpuResourceTota |
CPU逻辑资源使用总量 |
个 |
RayCompute,RaylNode |
|
| RaySchedulerTaskState |
调度器任务状态 |
- |
RayCompute,RaylNode |
|
| RaySchedulerActorState |
调度器Actor状态 |
- |
RayCompute,RaylNode |
|
| RaySchedulerTaskStateRate |
调度器任务状态变化率 |
个/秒 |
RayCompute,RaylNode |
|
| RaySchedulerActorStateRate |
调度器Actor状态变化率 |
个/秒 |
RayCompute,RaylNode |
|
数据处理常驻Spark实例(SparkCompute)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| SparkNodeCount |
节点统计 |
个 |
SparkCompute |
|
数据处理常驻Spark节点(SparkNode)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| SparkCpuUtilization |
CPU利用率 |
% |
SparkCompute,SparkNode |
|
| SparkMemoryUtilization |
内存利用率 |
% |
SparkCompute,SparkNode |
|
| SparkMemorySwapUtilization |
内存交换空间利用率 |
% |
SparkCompute,SparkNode |
|
| SparkReceivedThroughNetwork |
网络接收量 |
Bytes/s |
SparkCompute,SparkNode |
|
| SparkTransmittedThroughNetwork |
网络发送量 |
Bytes/s |
SparkCompute,SparkNode |
|
| SparkActiveTasks |
活跃任务 |
个 |
SparkCompute,SparkNode |
|
| SparkTotalFailedTasks |
失败任务总数 |
个 |
SparkCompute,SparkNode |
|
| SparkTotalFailedTasksRate |
失败任务总数变化率 |
个/s |
SparkCompute,SparkNode |
|
| SparkTotalCompletedTasks |
已完成任务总数 |
个 |
SparkCompute,SparkNode |
|
| SparkTotalCompletedTasksRate |
已完成任务总数变化率 |
个/s |
SparkCompute,SparkNode |
|
| SparkTotalNumberOfTasks |
任务总数 |
个 |
SparkCompute,SparkNode |
|
| SparkTotalCompletedTasksRate |
任务总数变化率 |
个/s |
SparkCompute,SparkNode |
|
| SparkTotalShuffleRead |
总Shuffle读取量 |
Bytes |
SparkCompute,SparkNode |
|
| SparkTotalShuffleWrite |
总Shuffle写入量 |
Bytes |
SparkCompute,SparkNode |
|
| SparkTotalShuffleRead |
总任务持续时间 |
s |
SparkCompute,SparkNode |
|
分析与AI搜索Doris实例(DorisCompute)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| DorisNodeCount |
节点统计 |
个 |
DorisCompute |
|
| DorisConnectionTotal |
当前总连接数 |
个 |
DorisCompute |
|
| DorisQueriesPerSecond |
每秒查询数 |
个 |
DorisCompute |
|
| DorisErrorQueriesPerSecond |
每秒查询错误数 |
个 |
DorisCompute |
|
| DorisAverageQueryLatency |
平均查询耗时 |
毫秒 |
DorisCompute |
|
| Doris99thPercentileQueryLatency |
99分位查询耗时 |
毫秒 |
DorisCompute |
|
| DorisCacheHitRatio |
查询缓存命中率 |
% |
DorisCompute |
|
| DorisJobAlterRunningRollup |
Running状态Rollup任务数 |
个 |
DorisCompute |
|
| DorisJobAlterRunningSchemaChange |
Running状态SchemaChange任务数 |
个 |
DorisCompute |
|
| DorisJobLoadPendingSpark |
Pending状态Spark导入任务数 |
个 |
DorisCompute |
|
| DorisJobLoadLoadingSpark |
Loading状态Spark导入任务数 |
个 |
DorisCompute |
|
| DorisJobLoadPendingInsert |
Pending状态Insert导入任务数 |
个 |
DorisCompute |
|
| DorisJobLoadLoadingInsert |
Loading状态Insert导入任务数 |
个 |
DorisCompute |
|
| DorisJobLoadFinishedInsert |
Finished状态Insert导入任务数 |
个 |
DorisCompute |
|
| DorisJobLoadCancelledInsert |
Cancelled状态Insert导入任务数 |
个 |
DorisCompute |
|
| DorisJobLoadPendingBroker |
Pending状态Broker导入个数 |
个 |
DorisCompute |
|
| DorisJobLoadFinishedBroker |
Finished状态Broker导入个数 |
个 |
DorisCompute |
|
| DorisJobLoadLoadingBroker |
Loading状态Broker导入个数 |
个 |
DorisCompute |
|
| DorisJobLoadCancelledBroker |
Cancelled状态Broker导入个数 |
个 |
DorisCompute |
|
| DorisMaxTabletCompactionScore |
数据分片合并情况 |
N/A |
DorisCompute |
|
| DorisBrokerDeadNum |
Broker异常个数 |
个 |
DorisCompute |
|
| DorisBackendDeadNum |
BE 异常个数 |
个 |
DorisCompute |
|
| DorisFrontendDeadNum |
FE 异常个数 |
个 |
DorisCompute |
|
| DorisS3FileReaderTotal |
远程存储读次数 (QPS) |
个/秒 |
DorisCompute |
|
| DorisS3FileWriterTotal |
远程存储写次数 (QPS) |
个/秒 |
DorisCompute |
|
| DorisSlowQueryRecordsCount |
慢查询数 |
个 |
DorisCompute |
|
| DorisQuerySuccRate |
查询成功率 |
% |
DorisCompute |
|
| DorisRequestTotalRate |
每秒请求数 |
个/秒 |
DorisCompute |
|
| DorisMaxJournalId |
当前元数据日志id |
N/A |
DorisCompute |
|
| DorisTxnCounterFailed |
失败的事务数量 |
个/秒 |
DorisCompute |
|
| DorisTxnCounterReject |
被拒绝的事务数量 |
个/秒 |
DorisCompute |
|
| DorisScheduledTabletNum |
Master节点正在调度的Tablet数量 |
个 |
DorisCompute |
|
| DorisTxnCounterBegin |
开始的事务数量 |
个/秒 |
DorisCompute |
|
| DorisTxnCounterSuccess |
成功的事务数量 |
个/秒 |
DorisCompute |
|
| DorisReportQueueSize |
ComputeNode(BE)定期汇报任务在LeaderNode(FE)端的队列长度 |
个 |
DorisCompute |
|
| DorisMaxTabletCompactionScore |
Tablet Compaction 最高分 |
个 |
DorisCompute |
|
| DorisTxnStatusUnknown |
处于Unknown状态的事务个数 |
个 |
DorisCompute |
|
| DorisTxnStatusPrepare |
处于Prepare状态的事务个数 |
个 |
DorisCompute |
|
| DorisTxnStatusCommitted |
处于Committed状态的事务个数 |
个 |
DorisCompute |
|
| DorisTxnStatusVisible |
处于Visible状态的事务个数 |
个 |
DorisCompute |
|
| DorisTxnStatusAborted |
处于Aborted状态的事务个数 |
个 |
DorisCompute |
|
| DorisTxnStatusPrecommitted |
处于Precommitted状态的事务个数 |
个 |
DorisCompute |
|
| DorisEditLogWrite |
元数据日志写入次数 |
个/秒 |
DorisCompute |
|
| DorisEditLogRead |
元数据日志读取次数 |
个/秒 |
DorisCompute |
|
| DorisEditLogCurrentBytes |
元数据日志当前大小 |
Byte/s |
DorisCompute |
|
| DorisEditlogWriteLatencyMs_0_99 |
元数据日志写入延迟的99分位统计 |
毫秒 |
DorisCompute |
|
| DorisEditLogCleanSuccess |
清理历史元数据日志成功次数 |
个 |
DorisCompute |
|
| DorisEditLogCleanFailed |
清理历史元数据日志失败次数 |
个 |
DorisCompute |
|
| DorisImageCleanSuccess |
清理历史元数据镜像文件成功次数 |
个 |
DorisCompute |
|
| DorisImageCleanFailed |
清理历史元数据镜像文件失败次数 |
个 |
DorisCompute |
|
| DorisImagePushSuccess |
将元数据镜像文件推送给其他FE节点的失败次数 |
个 |
DorisCompute |
|
| DorisImagePushFailed |
将元数据镜像文件推送给其他FE节点的成功次数 |
个 |
DorisCompute |
|
| DorisImageWriteSuccess |
生成元数据镜像文件成功次数 |
个 |
DorisCompute |
|
| DorisImageWriteFailed |
生成元数据镜像文件失败次数实例 |
个 |
DorisCompute |
|
分析与AI搜索Doris节点(DorisNode)
| 指标英文名称(metric name) |
指标中文名称 |
单位 |
维度 |
备注 |
| DorisCpuUtilization |
CPU利用率 |
% |
DorisCompute,DorisNode |
|
| DorisMemoryUtilization |
内存利用率 |
% |
DorisCompute,DorisNode |
|
| DorisReceivedThroughNetwork |
网络接收量 |
Bytes/s |
DorisCompute,DorisNode |
|
| DorisTransmittedThroughNetwork |
网络发送量 |
Bytes/s |
DorisCompute,DorisNode |
|
| DorisMaxDiskIOUtilPercent |
磁盘IO利用率 |
% |
DorisCompute,DorisNode |
|
| DorisLoadRowsPerSecond |
每秒导入行数 |
Rows/s |
DorisCompute,DorisNode |
|
| DorisLoadBytesPerSecond |
每秒导入字节数 |
Bytes/s |
DorisCompute,DorisNode |
|
| DorisRoutineLoadRows |
Routine Load 的行数 |
行 |
DorisCompute,DorisNode |
|
| DorisRoutineLoadErrorRows |
Routine Load 错误的行数 |
行 |
DorisCompute,DorisNode |
|
| DorisJobLoadNeedScheduleRoutineLoad |
NeedSchedule状态Routine导入个数 |
个 |
DorisCompute,DorisNode |
|
| DorisJobLoadRunningRoutineLoad |
Running 状态Routine导入个数 |
个 |
DorisCompute,DorisNode |
|
| DorisJobLoadStoppedRoutineLoad |
Stopped 状态Routine导入个数 |
个 |
DorisCompute,DorisNode |
|
| DorisJobLoadPausedRoutineLoad |
Paused 状态Routine导入个数 |
个 |
DorisCompute,DorisNode |
|
| DorisJobLoadCancelledRoutineLoad |
Cancelled 状态Routine导入个数 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalBaseCompaction |
BaseCompaction任务总累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalBaseCompactionRate |
BaseCompaction任务总累计值变化率 |
个/s |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedBaseCompaction |
BaseCompaction任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalCumulativeCompaction |
CumulativeCompaction任务总累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalCumulativeCompactionRate |
CumulativeCompaction任务总累计值变化率 |
个/s |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedCumulativeCompaction |
CumulativeCompaction任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisStreamLoadReceiveBytes |
Stream Load 接收的字节数累计值 |
Bytes |
DorisCompute,DorisNode |
|
| DorisStreamLoadReceiveBytesRate |
Stream Load 接收的字节数累计值变化率 |
Bytes/s |
DorisCompute,DorisNode |
|
| DorisStreamLoadLoadRows |
Stream Load 最终导入的行数累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisStreamLoadLoadRowsRate |
Stream Load 最终导入的行数累计值变化率 |
个/s |
DorisCompute,DorisNode |
|
| DorisStreamingLoadRequestsPerSecond |
Stream Load 作业导入频率 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisQueryScanRows |
读取行数的数量 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisQueryCacheMemoryTotalByte |
Query Cache 占用字节数 |
Byte |
DorisCompute,DorisNode |
|
| DorisQueryScanBytesPerSecond |
读取数据速率 |
Byte/s |
DorisCompute,DorisNode |
|
| DorisQueryCachePartitionTotalCount |
当前 Partition Cache 缓存个数 |
个 |
DorisCompute,DorisNode |
|
| DorisQueryCacheSqlTotalCount |
当前 SQL Cache 缓存个数 |
个 |
DorisCompute,DorisNode |
|
| DorisCpuStolenPercent |
CPU抢占率 |
% |
DorisCompute,DorisNode |
|
| DorisMemoryUsedGBytes |
内存使用量 |
Byte |
DorisCompute,DorisNode |
|
| DorisMemoryAllocatedBytes |
Memory Allocated 大小 |
Byte |
DorisCompute,DorisNode |
|
| DorisProcessFdNumLimitSoft |
内存使用量 |
Byte |
DorisCompute,DorisNode |
|
| DorisMemoryUsedGBytes |
进程文件句柄 Soft 限制数量 |
个 |
DorisCompute,DorisNode |
|
| DorisDisksAvailCapacity |
磁盘的剩余空间 |
Byte |
DorisCompute,DorisNode |
|
| DorisProcessFdNumUsed |
进程使用文件句柄数量 |
个 |
DorisCompute,DorisNode |
|
| DorisProcessThreadNum |
进程运行的线程个数 |
个 |
DorisCompute,DorisNode |
|
| DorisS3BytesReadTotal |
S3FileReader 读取字节数累计值 |
Byte/s |
DorisCompute,DorisNode |
|
| DorisQueryLatencyMs_0_99 |
查询延时99分位数 |
毫秒 |
DorisCompute,DorisNode |
|
| DorisRequestTotal |
累计操作请求数 |
个 |
DorisCompute,DorisNode |
|
| DorisQueryErrRate |
每秒查询错误数 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalPublish |
Publish任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedPublish |
Publish任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalFinishTask |
FinishTask任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedFinishTask |
FinishTask任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalDelete |
Delete任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedDelete |
Delete任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalClone |
Clone任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedClone |
Clone任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalCreateRollup |
CreateRollup任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedCreateRollup |
CreateRollup任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalSchemaChange |
SchemaChange任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedSchemaChange |
SchemaChange任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalTotalCreateTablet |
CreateTablet任务总累计值 |
个/秒 |
DorisCompute,DorisNode |
|
| DorisEngineRequestsTotalFailedCreateTablet |
CreateTablet任务失败累计值 |
个 |
DorisCompute,DorisNode |
|
| DorisCompactionBytesTotalBase |
Base compaction 的数据量 |
Byte/s |
DorisCompute,DorisNode |
|
| DorisCompactionBytesTotalCumulative |
Cumulative compaction 的数据量 |
Byte/s |
DorisCompute,DorisNode |
|
![]()