Important

You are viewing the documentation of an older version of the TiDB database (TiDB v4.0).

It is recommended that you use the latest LTS version of the TiDB database.

TiDB Sysbench Performance Test Report -- v2.0.0 vs. v1.0.0

Test purpose

This test aims to compare the performances of TiDB 1.0 and TiDB 2.0.

Test version, time, and place

TiDB version: v1.0.8 vs. v2.0.0-rc6

Time: April 2018

Place: Beijing, China

Test environment

IDC machine

TypeName
OSlinux (CentOS 7.3.1611)
CPU40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
RAM128GB
DISKOptane 500GB SSD * 1

Test plan

TiDB version information

v1.0.8

ComponentGitHash
TiDB571f0bbd28a0b8155a5ee831992c986b90d21ab7
TiKV4ef5889947019e3cb55cc744f487aa63b42540e7
PD776bcd940b71d295a2c7ed762582bc3aff7d3c0e

v2.0.0-rc6

ComponentGitHash
TiDB82d35f1b7f9047c478f4e1e82aa0002abc8107e7
TiKV7ed4f6a91f92cad5cd5323aaebe7d9f04b77cc79
PD2c8e7d7e33b38e457169ce5dfb2f461fced82d65

TiKV parameter configuration

  • v1.0.8

    sync-log = false
    grpc-concurrency = 8
    grpc-raft-conn-num = 24
    
  • v2.0.0-rc6

    sync-log = false
    grpc-concurrency = 8
    grpc-raft-conn-num = 24
    use-delete-range: false
    

Cluster topology

Machine IPDeployment instance
172.16.21.11tidb 1pd 1*sysbench
172.16.21.21tidb 1pd 1*sysbench
172.16.21.31tidb 1pd 1*sysbench
172.16.11.41*tikv
172.16.11.51*tikv
172.16.11.61*tikv
172.16.11.71*tikv
172.16.11.81*tikv
172.16.11.91*tikv

Test result

Standard Select test

VersionTable countTable sizeSysbench threadsQPSLatency (avg/.95)
v2.0.0-rc63210 million128 * 32019361.9033 ms/5.67667 ms
v2.0.0-rc63210 million256 * 32081303.69333 ms/8.90333 ms
v2.0.0-rc63210 million512 * 32117887.23333 ms/15.59 ms
v2.0.0-rc63210 million1024 * 321286814.5933 ms/43.2133 ms
v1.0.83210 million128 * 31886862.03667 ms/5.99 ms
v1.0.83210 million256 * 31950903.94 ms/9.12 ms
v1.0.83210 million512 * 32030127.57333 ms/15.3733 ms
v1.0.83210 million1024 * 320593214.9267 ms/40.7633 ms

According to the statistics above, the Select query performance of TiDB 2.0 GA has increased by about 10% at most than that of TiDB 1.0 GA.

Standard OLTP test

VersionTable countTable sizeSysbench threadsTPSQPSLatency (avg/.95)
v2.0.0-rc63210 million128 * 35404.22108084.487.2033 ms/110 ms
v2.0.0-rc63210 million256 * 35578.165111563.3167.673 ms/275.623 ms
v2.0.0-rc63210 million512 * 35874.045117480.9315.083 ms/674.017 ms
v2.0.0-rc63210 million1024 * 36290.7125814529.183 ms/857.007 ms
v1.0.83210 million128 * 35523.9111047869.53 ms/88.6333 ms
v1.0.83210 million256 * 35969.43119389128.63 ms/162.58 ms
v1.0.83210 million512 * 36308.93126179243.543 ms/310.913 ms
v1.0.83210 million1024 * 36444.25128885476.787ms/635.143 ms

According to the statistics above, the OLTP performance of TiDB 2.0 GA and TiDB 1.0 GA is almost the same.

Standard Insert test

VersionTable countTable sizeSysbench threadsQPSLatency (avg/.95)
v2.0.0-rc63210 million128 * 331707.512.11 ms/21.1167 ms
v2.0.0-rc63210 million256 * 338741.219.8233 ms/39.65 ms
v2.0.0-rc63210 million512 * 345136.834.0267 ms/66.84 ms
v2.0.0-rc63210 million1024 * 34866763.1167 ms/121.08 ms
v1.0.83210 million128 * 331125.712.3367 ms/19.89 ms
v1.0.83210 million256 * 33680020.8667 ms/35.3767 ms
v1.0.83210 million512 * 34412334.8067 ms/63.32 ms
v1.0.83210 million1024 * 34849663.3333 ms/118.92 ms

According to the statistics above, the Insert query performance of TiDB 2.0 GA has increased slightly than that of TiDB 1.0 GA.

Was this page helpful?