Doc Menu

TiDB TPC-C Performance Test Report -- v5.2.0 vs. v5.1.1

Test overview

This test aims to compare the TPC-C performance of TiDB v5.2.0 and TiDB v5.1.1 in the online transactional processing (OLTP) scenario. The results show that compared with v5.1.1, the TPC-C performance of v5.2.0 is reduced by 4.22%.

Test environment (AWS EC2)

Hardware configuration

Service typeEC2 typeInstance count

Software version

Service typeSoftware version
PDv5.1.1 and v5.2.0
TiDBv5.1.1 and v5.2.0
TiKVv5.1.1 and v5.2.0

Parameter configuration

TiDB v5.2.0 and TiDB v5.1.1 use the same configuration.

TiDB parameter configuration

log.level: "error"
performance.max-procs: 20
prepared-plan-cache.enabled: true
tikv-client.max-batch-wait-time: 2000000

TiKV parameter configuration

pessimistic-txn.pipelined: true
raftdb.allow-concurrent-memtable-write: true
raftdb.max-background-jobs: 4
raftstore.apply-max-batch-size: 2048
raftstore.apply-pool-size: 3 2048 3 10
readpool.unified.max-thread-count: 20
readpool.unified.min-thread-count: 5
rocksdb.max-background-jobs: 8
server.grpc-concurrency: 6
storage.scheduler-worker-pool-size: 20
server.enable-request-batch: false

TiDB global variable configuration


set global tidb_hashagg_final_concurrency=1;
set global tidb_hashagg_partial_concurrency=1;
set global tidb_enable_async_commit = 1;
set global tidb_enable_1pc = 1;
set global tidb_guarantee_linearizability = 0;
set global tidb_enable_clustered_index = 1;

Test plan

  1. Deploy TiDB v5.2.0 and v5.1.1 using TiUP.
  2. Create a database named tpcc: create database tpcc;.
  3. Use BenchmarkSQL to import the TPC-C 5000 Warehouse data: tiup bench tpcc prepare --warehouse 5000 --db tpcc -H -p 4000.
  4. Execute the tiup bench tpcc run -U root --db tpcc --host --port 4000 --time 300s --warehouses 5000 --threads {{thread}} command to perform stress tests on TiDB via HAProxy.
  5. Extract the tpmC data of New Order from the result.

Test result

Compared with v5.1.1, the TPC-C performance of v5.2.0 is reduced by 4.22%.