This document describes how to migrate data to TiDB, including migrating data from MySQL and from CSV/SQL files.
In a cloud environment, you can directly migrate full data to TiDB by exporting snapshot from Aurora. For details, see Migrate from Amazon Aurora MySQL Using TiDB Lightning.
To migrate data from MySQL to TiDB, it is recommended to use one of the following methods:
- Use Dumpling and TiDB Lightning to migrate full data.
- Use TiDB Data Migration (DM) to migrate full and incremental data.
You can use Dumpling and TiDB Lightning to migrate full data when the data size is greater than 1 TB. If you need to replicate incremental data, it is recommended to use DM to create an incremental replication task.
- Use Dumpling to export the full MySQL data.
- Use TiDB Lightning to import the full data to TiDB. For details, refer to Migrate data using Dumpling and TiDB Lightning.
You can use DM to migrate full MySQL data and to replicate incremental data. It is suggested that the size of the full data is less than 1 TB. Otherwise, it is recommended to use Dumpling and TiDB Lightning to import the full data, and then use DM to replicate the incremental data.
For details, refer to Migrate from MySQL (Amazon Aurora).
You can migrate data from CSV/SQL files to TiDB.
You can migrate data from heterogeneous databases that are not compatible with the MySQL protocol to TiDB.
Export full data to CSV files.
Import CSV files to TiDB using one of the following methods:
Use TiDB Lightning.
Its import speed is fast. It is recommended to use TiDB Lightning in the case of large amounts of data in CSV files. For details, refer to TiDB Lightning CSV Support.
LOAD DATAstatement in TiDB to import CSV files. This is more convenient, but if an error or interruption occurs during the import, manual intervention is required to check the consistency and integrity of the data. Therefore, it is not recommended to use this method in the production environment. For details, refer to LOAD DATA.
Use Mydumper and TiDB Lightning to migrate data from SQL files to TiDB. For details, refer to Use Dumpling and TiDB Lightning.