TiDB TPC-C Performance Test Report -- v3.0 vs. v2.1
Test purpose
This test aims to compare the TPC-C performance of TiDB 3.0 and TiDB 2.1.
Test version, time, and place
TiDB version: v3.0.0 vs. v2.1.13
Time: June, 2019
Place: Beijing
Test environment
IDC machine:
| Type | Name |
|---|---|
| OS | Linux (CentOS 7.3.1611) |
| CPU | 40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz |
| RAM | 128GB |
| DISK | 1.5TB SSD * 2 |
This test uses the open-source BenchmarkSQL 5.0 as the TPC-C testing tool and adds the support for the MySQL protocol. You can download the testing program by using the following command:
git clone -b 5.0-mysql-support-opt https://github.com/pingcap/benchmarksql.git
Test plan
Use BenchmarkSQL to load the data of 1000 warehouses into the TiDB cluster. By using HAProxy, send concurrent requests to the cluster at an incremental number. A single concurrent test lasts 10 minutes.
TiDB version information
v3.0.0
| Component | GitHash |
|---|---|
| TiDB | 46c38e15eba43346fb3001280c5034385171ee20 |
| TiKV | a467f410d235fa9c5b3c355e3b620f81d3ac0e0c |
| PD | 70aaa5eee830e21068f1ba2d4c9bae59153e5ca3 |
v2.1.13
| Component | GitHash |
|---|---|
| TiDB | 6b5b1a6802f9b8f5a22d8aab24ac80729331e1bc |
| TiKV | b3cf3c8d642534ea6fa93d475a46da285cc6acbf |
| PD | 886362ebfb26ef0834935afc57bcee8a39c88e54 |
TiDB parameter configuration
[log]
level = "error"
[performance]
max-procs = 20
[prepared_plan_cache]
enabled = true
TiKV parameter configuration
The default TiKV configuration is used in both v2.1 and v3.0.
Cluster topology
| Machine IP | Deployment instance |
|---|---|
| 172.16.4.75 | 2*TiDB 2*TiKV 1*pd |
| 172.16.4.76 | 2*TiDB 2*TiKV 1*pd |
| 172.16.4.77 | 2*TiDB 2*TiKV 1*pd |
Test result
| Version | Threads | tpmC |
|---|---|---|
| v3.0 | 128 | 44068.55 |
| v3.0 | 256 | 47094.06 |
| v3.0 | 512 | 48808.65 |
| v2.1 | 128 | 10641.71 |
| v2.1 | 256 | 10861.62 |
| v2.1 | 512 | 10965.39 |
According to the testing statistics, the performance of TiDB 3.0 has increased by 450% than that of TiDB 2.1.