Redis容量型(PegaDB)本地盘性能白皮书
更新时间:2025-09-25
本文介绍Redis容量型(本地盘)性能测试的测试环境、测试工具、测试方法与测试结果。
云盘
环境 | 说明 |
---|---|
压测客户端机器 | 百度BCC, 规格bcc.c4.c64m128(计算型64C128G,参见BCC实例规格) |
测试集群架构 | 一主一从 |
压测工具 | YCSB |
实例规格 |
压测环境
压测工具:work@bjdd-online-scs-csmaster01.bjdd:~/caipengbo/ycsb-redis-binding-0.18.0-SNAPSHOT.tar.gz
Plain Text
1tar -xavf ycsb-redis-binding-0.18.0-SNAPSHOT.tar.gz
2cd ycsb-redis-binding-0.18.0-SNAPSHOT
3sh test.sh
4
5 #test.sh 脚本内容如下,需要根据场面的场景修改脚本中的 recordcount、run_operationcount 和 fieldlength
压测脚本
Plain Text
1#! /bin/bash
2
3ip=192.168.0.23
4port=3100
5timeout=3000000
6command_group=string
7recordcount=640000000
8run_operationcount=20000000
9fieldcount=1
10fieldlength=100
11threads=32
12load_sleep_time=600
13run_sleep_time=60
14
15echo "##################################### $command_group ############################################"
16#Load
17./bin/ycsb load redis -s -P workloads/workloada -p "redis.host=${ip}" -p "redis.port=${port}" -p "recordcount=${recordcount}" -p "operationcount=${recordcount}" -p "redis.timeout=${timeout}" -p "redis.command_group=${command_group}" -p "fieldcount=${fieldcount}" -p "fieldlength=${fieldlength}" -p "hdrhistogram.percentiles=95,99,99.9,99.99" -threads ${threads}
18sleep ${load_sleep_time}
19
20#Uniform-Read
21./bin/ycsb run redis -s -P workloads/workloadc -p "redis.host=${ip}" -p "redis.port=${port}" -p "recordcount=${recordcount}" -p "operationcount=${run_operationcount}" -p "redis.timeout=${timeout}" -p "redis.command_group=${command_group}" -p "fieldcount=${fieldcount}" -p "fieldlength=${fieldlength}" -p "requestdistribution=uniform" -p "hdrhistogram.percentiles=95,99,99.9,99.99" -threads ${threads}
22sleep ${run_sleep_time}
23
24#Zipfian-Read
25./bin/ycsb run redis -s -P workloads/workloadc -p "redis.host=${ip}" -p "redis.port=${port}" -p "recordcount=${recordcount}" -p "operationcount=${run_operationcount}" -p "redis.timeout=${timeout}" -p "redis.command_group=${command_group}" -p "fieldcount=${fieldcount}" -p "fieldlength=${fieldlength}" -p "requestdistribution=zipfian" -p "hdrhistogram.percentiles=95,99,99.9,99.99" -threads ${threads}
26sleep ${run_sleep_time}
27
28#Uniform-50%Read-50%Update
29./bin/ycsb run redis -s -P workloads/workloada -p "redis.host=${ip}" -p "redis.port=${port}" -p "recordcount=${recordcount}" -p "operationcount=${run_operationcount}" -p "redis.timeout=${timeout}" -p "redis.command_group=${command_group}" -p "fieldcount=${fieldcount}" -p "fieldlength=${fieldlength}" -p "requestdistribution=uniform" -p "readproportion=0.5" -p "updateproportion=0.5" -p "hdrhistogram.percentiles=95,99,99.9,99.99" -threads ${threads}
2 压测场景 和 数据
2.1 本地盘
2.1.1 数据量小于内存
2.1.1.1不限QPS
Pega规格 | Value大小 | 场景(16G数据) | YCSB配置 | 工作负载 | 压测开始时间 | 压测结束时间 | QPS(次/秒) | Average Latency(微秒) | 99th Percentile Latency(微秒) | 99.9th Percentile Latency(微秒) |
32G内存 | 128byte | 数据小于内存 | recordcount=125000000(约16G数据) run_operationcount=100000000 fieldlength=128 | Load | 2025-02-28 10:47:47:344 | 2025-02-28 11:26:51:046 | 53107.80502042951 | 549.99003404 | 1337 | 2901 |
Uniform-Read | 2025-02-28 11:37:01:197 | 2025-02-28 12:07:21:338 | 54640.59872982464 | 548.4716607 | 1236 | 2481 | ||||
Zipfian-Read | 2025-02-28 12:08:31:492 | 2025-02-28 12:37:58:461 | 56275.57021221518 | 528.77489758 | 1199 | 2305 | ||||
Uniform-50%Read-50%Update | 2025-02-28 12:39:08:613 | 2025-02-28 13:10:41:452 | 52553.0536214572 | Read:569.3336924588384 | Read:1203 | Read: 2557 | ||||
Update:532.5775312037339 | Update:1159 | Update: 2533 | ||||||||
1 KB | 数据小于内存 | recordcount=16000000(约16G) run_operationcount=16000000 fieldlength=1000 | Load | 2025-02-28 13:47:09:869 | 2025-02-28 13:52:44:106 | 46479.74064304721 | 640.234666875 | 2961 | 11879 | |
Uniform-Read | 2025-02-28 14:02:54:272 | 2025-02-28 14:08:01:592 | 50422.28665069961 | 578.940135625 | 1502 | 2859 | ||||
Zipfian-Read | 2025-02-28 14:09:11:759 | 2025-02-28 14:13:46:996 | 56093.704533423086 | 518.1126713125 | 1145 | 2439 | ||||
Uniform-50%Read-50%Update | 2025-02-28 14:14:57:157 | 2025-02-28 14:22:23:885 | 35031.79135065072 | Read: 760.0053056143888 | Read:3529 | Read:7515 | ||||
Update:967.5719033938068 | Update:4551 | Update: 8359 |
2.1.1.2 限QPS
Pega规格 | Value大小 | 场景(16G数据) | YCSB配置 | 工作负载 | 压测开始时间 | 压测结束时间 | QPS(次/秒) | Average Latency(微秒) | 99th Percentile Latency(微秒) | 99.9th Percentile Latency(微秒) |
32G内存 | 128byte | 数据小于内存 | recordcount=125000000(约16G数据) run_operationcount=100000000 fieldlength=128 | Load | 2025-02-28 14:23:34:057 | 2025-02-28 16:07:34:088 | 19999.897600524284 | 450.579659616 | 812 | 2061 |
Uniform-Read | 2025-02-28 16:17:44:240 | 2025-02-28 17:40:54:274 | 19999.864000924794 | 464.51162666 | 797 | 1979 | ||||
Zipfian-Read | 2025-02-28 17:42:04:428 | 2025-02-28 19:05:14:458 | 19999.880000719997 | 449.03101286 | 752 | 1923 | ||||
Uniform-50%Read-50%Update | 2025-02-28 19:06:24:609 | 2025-02-28 20:29:34:641 | 19999.872000819196 | Read:496.5908622345565 | Read:834 | Read: 2038 | ||||
Update:461.1727488960475 | Update:784 | Update: 2013 | ||||||||
1 KB | 数据小于内存 | recordcount=16000000(约16G) run_operationcount=16000000 fieldlength=1000 | Load | 2025-02-28 20:30:47:101 | 2025-02-28 20:43:57:133 | 19999.20003199872 | 461.58051825 | 951 | 2437 | |
Uniform-Read | 2025-02-28 20:54:07:290 | 2025-02-28 21:07:17:322 | 19999.175034029846 | 474.716823 | 888 | 2545 | ||||
Zipfian-Read | 2025-02-28 21:08:27:477 | 2025-02-28 21:21:37:509 | 19999.20003199872 | 443.775066875 | 786 | 2063 | ||||
Uniform-50%Read-50%Update | 2025-02-28 21:22:47:662 | 2025-02-28 21:35:57:693 | 19999.225030030088 | Read: 506.5914217688257 | Read:905 | Read:2199 | ||||
Update:471.7023783770679 | Update:868 | Update: 2287 |
2.1.2 数据量大于内存
2.1.2.1不限QPS
Pega规格 | Value大小 | 场景(160G数据) | YCSB配置 | 工作负载 | 压测开始时间 | 压测结束时间 | QPS(次/秒) | Average Latency(微秒) | 99th Percentile Latency(微秒) | 99.9th Percentile Latency(微秒) |
32G内存 | 128byte | 数据大于内存 | recordcount=1250000000(约160G数据) run_operationcount=100000000 fieldlength=128 | Load | 2025-02-28 21:37:09:781 | 2025-03-01 04:21:20:614 | 51523.37302171887 | 579.0055030792 | 1617 | 3477 |
Uniform-Read | 2025-03-01 04:31:30:770 | 2025-03-01 05:07:10:486 | 46517.750941170394 | 652.82563173 | 1409 | 2543 | ||||
Zipfian-Read | 2025-03-01 05:08:20:640 | 2025-03-01 05:39:11:801 | 53729.90300140611 | 564.02235816 | 1100 | 2319 | ||||
Uniform-50%Read-50%Update | 2025-03-01 05:40:21:966 | 2025-03-01 06:14:26:248 | 48678.68997856677 | Read:665.747763127304 | Read:1600 | Read:4643 | ||||
Update:549.1251631732381 | Update:1426 | Update: 4467 | ||||||||
1 KB | 数据大于内存 | recordcount=160000000(约160G) run_operationcount=16000000 fieldlength=1000 | Load | 2025-03-01 06:15:36:419 | 2025-03-01 08:13:25:908 | 22600.501250867117 | 1331.9619193875 | 13127 | 49151 | |
Uniform-Read | 2025-03-01 08:23:36:063 | 2025-03-01 08:29:18:463 | 45402.951191827466 | 655.589482125 | 1398 | 2909 | ||||
Zipfian-Read | 2025-03-01 08:30:28:620 | 2025-03-01 08:36:10:607 | 45456.35337769116 | 655.62419 | 1702 | 2855 | ||||
Uniform-50%Read-50%Update | 2025-03-01 08:37:20:771 | 2025-03-01 08:45:16:908 | 32912.60058913555 | Read: 1001.0874481750843 | Read:5307 | Read:62911 | ||||
Update:798.870791061788 | Update:3409 | Update: 53791 |
2.1.2.2 限QPS
Pega规格 | Value大小 | 场景(160G数据) | YCSB配置 | 工作负载 | 压测开始时间 | 压测结束时间 | QPS(次/秒) | Average Latency(微秒) | 99th Percentile Latency(微秒) | 99.9th Percentile Latency(微秒) |
32G内存 | 128byte | 数据大于内存 | recordcount=1250000000(约160G数据) run_operationcount=100000000 fieldlength=128 | Load | 2025-03-01 08:46:27:091 | 2025-03-02 02:07:57:122 | 19999.989760005243 | 436.5263386568 | 748 | 2055 |
Uniform-Read | 2025-03-02 02:18:07:276 | 2025-03-02 03:41:17:307 | 19999.876000768796 | 548.12705759 | 1079 | 2401 | ||||
Zipfian-Read | 2025-03-02 03:42:27:461 | 2025-03-02 05:05:37:491 | 19999.876000768796 | 482.07186666 | 816 | 2011 | ||||
Uniform-50%Read-50%Update | 2025-03-02 05:06:47:642 | 2025-03-02 06:29:57:674 | 19999.872000819196 | Read:561.5936741242456 | Read:953 | Read: 2213 | ||||
Update:455.183262961337 | Update:814 | Update: 2105 | ||||||||
1 KB | 数据大于内存 | recordcount=160000000(约160G) run_operationcount=16000000 fieldlength=1000 | Load | 2025-03-02 06:31:11:606 | 2025-03-02 08:46:18:497 | 19711.980855724192 | 785.0062321875 | 7091 | 41439 | |
Uniform-Read | 2025-03-02 08:56:28:659 | 2025-03-02 09:09:38:689 | 19999.250028123945 | 565.1696450625 | 963 | 2195 | ||||
Zipfian-Read | 2025-03-02 09:10:48:861 | 2025-03-02 09:23:58:892 | 19999.225030030088 | 517.0921109375 | 901 | 2113 | ||||
Uniform-50%Read-50%Update | 2025-03-02 09:25:09:047 | 2025-03-02 09:38:19:077 | 19999.225030030088 | Read: 561.6355125268964 | Read:1027 | Read:2297 | ||||
Update:456.8313022962669 | Update:852 | Update: 2317 |