Optimizer Fix Controls
As the product evolves iteratively, the behavior of the TiDB optimizer changes, which in turn generates more reasonable execution plans. However, in some particular scenarios, the new behavior might lead to unexpected results. For example:
- The effect of some behaviors relies on a specific scenario. Changes that bring improvements to most scenarios might cause regressions to others.
- Sometimes, the relationship between changes in the behavior details and their consequences is very complicated. An improvement in a certain behavior might cause overall regression.
Therefore, TiDB provides the Optimizer Fix Controls feature that allows you to make fine-grained control of TiDB optimizer behaviors by setting values for a group of fixes. This document describes the Optimizer Fix Controls feature and how to use them, and lists all the fixes that TiDB currently supports for Optimizer Fix Controls.
Introduction to tidb_opt_fix_control
Starting from v6.5.3 and v7.1.0, TiDB provides the tidb_opt_fix_control system variable to control the behavior of the optimizer in a more fine-grained way.
Each fix is a control item used to adjust the behavior in the TiDB optimizer for one particular purpose. It is denoted by a number that corresponds to a GitHub Issue that contains the technical details of the behavior change. For example, for fix 44262, you can review what it controls in Issue 44262.
The tidb_opt_fix_control system variable accepts multiple fixes as one value, separated by commas (,). The format is "<#issue1>:<value1>,<#issue2>:<value2>,...,<#issueN>:<valueN>", where <#issueN> is the fix number. For example:
SET SESSION tidb_opt_fix_control = '44262:ON,44389:ON';
Optimizer Fix Controls reference
33031 New in v8.0.0
- Default value:
OFF - Possible values:
ON,OFF - This variable controls whether to allow plan cache for partitioned tables. If it is set to
ON, neither Prepared statement plan cache nor Non-prepared statement plan cache will be enabled for partitioned tables.
44262 New in v6.5.3 and v7.2.0
- Default value:
OFF - Possible values:
ON,OFF - This variable controls whether to allow the use of Dynamic pruning mode to access the partitioned table when the GlobalStats are missing.
44389 New in v6.5.3 and v7.2.0
- Default value:
OFF - Possible values:
ON,OFF - For filters such as
c = 10 and (a = 'xx' or (a = 'kk' and b = 1)), this variable controls whether to try to build more comprehensive scan ranges forIndexRangeScan.
44823 New in v7.3.0
- Default value:
200 - Possible values:
[0, 2147483647] - To save memory, Plan Cache does not cache queries with parameters exceeding the specified number of this variable.
0means no limit.
44830 New in v6.5.7 and v7.3.0
- Default value:
OFF - Possible values:
ON,OFF - This variable controls whether Plan Cache is allowed to cache execution plans with the
PointGetoperator generated during physical optimization.
44855 New in v6.5.4 and v7.3.0
- Default value:
OFF - Possible values:
ON,OFF - In some scenarios, when the
Probeside of anIndexJoinoperator contains aSelectionoperator, TiDB severely overestimates the row count ofIndexScan. This might cause suboptimal query plans to be selected instead ofIndexJoin. - To mitigate this issue, TiDB has introduced an improvement. However, due to potential query plan fallback risks, this improvement is disabled by default.
- This variable controls whether to enable the preceding improvement.
45132 New in v7.4.0
- Default value:
1000 - Possible values:
[0, 2147483647] - This variable sets the threshold for the optimizer's heuristic strategy to select access paths. If the estimated rows for an access path (such as
Index_A) is much smaller than that of other access paths (default1000times), the optimizer skips the cost comparison and directly selectsIndex_A. 0means to disable this heuristic strategy.
52869 New in v8.1.0
- Default value:
OFF - Possible values:
ON,OFF - As stated in the Note of Explain Statements Using Index Merge, if the optimizer can choose the single index scan method (other than full table scan) for a query plan, the optimizer will not automatically use index merge.
- You can remove this limitation by enabling this fix control. Removing this limitation enables the optimizer to choose index merge automatically in more queries, but might cause the optimizer to ignore the optimal execution plans. Therefore, it is recommended to conduct sufficient tests on actual use cases before removing this limitation to make sure that it will not cause performance regressions.
54337 New in v8.2.0
- Default value:
OFF - Possible values:
ON,OFF - Currently, the TiDB optimizer has limitations in deriving index ranges for complex conjunctive conditions where each conjunct comprises a list of ranges. This can be addressed by applying general range intersection.
- You can remove this limitation by enabling this fix control, allowing the optimizer to handle complex range intersections. However, for conditions with a large number of conjuncts (more than 10), there is a slight risk of increased optimization time.