Doc Menu

TiDB TPC-H 50G Performance Test Report

Test purpose

This test aims to compare the performances of TiDB 1.0 and TiDB 2.0 in the OLAP scenario.

Note:

Different test environments might lead to different test results.

Test environment

Machine information

System information:

Machine IPOperation systemKernel versionFile system type
172.16.31.2Ubuntu 17.10 64bit4.13.0-16-genericext4
172.16.31.3Ubuntu 17.10 64bit4.13.0-16-genericext4
172.16.31.4Ubuntu 17.10 64bit4.13.0-16-genericext4
172.16.31.6CentOS 7.4.1708 64bit3.10.0-693.11.6.el7.x86_64ext4
172.16.31.8CentOS 7.4.1708 64bit3.10.0-693.11.6.el7.x86_64ext4
172.16.31.10CentOS 7.4.1708 64bit3.10.0-693.11.6.el7.x86_64ext4

Hardware information:

TypeName
CPU40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
RAM128GB, 16GB RDIMM * 8, 2400MT/s, dual channel, x8 bitwidth
DISKIntel P4500 4T SSD * 2
Network Card10 Gigabit Ethernet

TPC-H

tidb-bench/tpch

Cluster topology

Machine IPDeployment Instance
172.16.31.2TiKV * 2
172.16.31.3TiKV * 2
172.16.31.6TiKV * 2
172.16.31.8TiKV * 2
172.16.31.10TiKV * 2
172.16.31.10PD * 1
172.16.31.4TiDB * 1

Corresponding TiDB version information

TiDB 1.0:

ComponentVersionCommit Hash
TiDBv1.0.94c7ee3580cd0a69319b2c0c08abdc59900df7344
TiKVv1.0.82bb923a4cd23dbf68f0d16169fd526dc5c1a9f4a
PDv1.0.8137fa734472a76c509fbfd9cb9bc6d0dc804a3b7

TiDB 2.0:

ComponentVersionCommit Hash
TiDBv2.0.0-rc.682d35f1b7f9047c478f4e1e82aa0002abc8107e7
TiKVv2.0.0-rc.68bd5c54966c6ef42578a27519bce4915c5b0c81f
PDv2.0.0-rc.69b824d288126173a61ce7d51a71fc4cb12360201

Test result

Query IDTiDB 2.0TiDB 1.0
133.915s215.305s
225.575sNan
359.631s196.003s
430.234s249.919s
531.666sOOM
613.111s118.709s
731.710sOOM
831.734s800.546s
934.211s630.639s
1030.774s133.547s
1127.692s78.026s
1227.962s124.641s
1327.676s174.695s
1419.676s110.602s
15NaNNan
1624.890s40.529s
17245.796sNaN
1891.256sOOM
1937.615sNaN
2044.167s212.201s
2131.466sOOM
2231.539s125.471s

TPC-H Query Result

It should be noted that:

  • In the diagram above, the orange bars represent the query results of Release 1.0 and the blue bars represent the query results of Release 2.0. The y-axis represents the processing time of queries in seconds, the shorter the faster.
  • Query 15 is tagged with "NaN" because VIEW is currently not supported in either TiDB 1.0 or 2.0. We have plans to provide VIEW support in a future release.
  • Queries 2, 17, and 19 in the TiDB 1.0 column are tagged with "NaN" because TiDB 1.0 did not return results for these queries.
  • Queries 5, 7, 18, and 21 in the TiDB 1.0 column are tagged with "OOM" because the memory consumption was too high.