Migration and Import Overview
You can migrate data from a wide variety of data sources to TiDB Cloud. This document gives an overview of the data migration scenarios.
Migrate data from MySQL-Compatible databases
When you migrate data from a MySQL-compatible database, you can perform full data migration and incremental data migration. The migration scenarios and methods are as follows:
Migrate MySQL-compatible databases using Data Migration
TiDB is highly compatible with MySQL. You can use Data Migration in the TiDB Cloud console to migrate data from any MySQL-compatible databases to TiDB Cloud smoothly. For more information, see Migrate MySQL-Compatible Databases to TiDB Cloud Using Data Migration.
Migrate using AWS DMS
If you want to migrate heterogeneous databases, such as PostgreSQL, Oracle, and SQL Server to TiDB Cloud, it is recommended to use AWS Database Migration Service (AWS DMS).
Migrate and merge MySQL shards
If your application uses MySQL shards for data storage, you can migrate these shards into TiDB Cloud as one table. For more information, see Migrate and Merge MySQL Shards of Large Datasets to TiDB Cloud.
Migrate from TiDB Self-Managed
You can migrate data from your TiDB Self-Managed clusters to TiDB Cloud (AWS) through Dumpling and TiCDC. For more information, see Migrate from TiDB Self-Managed to TiDB Cloud.
Import data from files to TiDB Cloud
If you have data files in SQL, CSV, Parquet, or Aurora Snapshot formats, you can import these files to TiDB Cloud in one go. The import scenarios and methods are as follows:
Import a local CSV file to TiDB Cloud
You can import a local CSV file to TiDB Cloud. For more information, see Import Local Files to TiDB Cloud.
Import sample data (SQL file) to TiDB Cloud
You can import sample data (SQL file) to TiDB Cloud to quickly get familiar with the TiDB Cloud interface and the import process. For more information, see Import Sample Data to TiDB Cloud Starter or Essential and Import Sample Data to TiDB Cloud Dedicated.
Import CSV files from Amazon S3, Google Cloud Storage (GCS), Azure Blob Storage, or Alibaba Cloud OSS into TiDB Cloud
You can import CSV files from Amazon S3, Google Cloud Storage (GCS), Azure Blob Storage, or Alibaba Cloud OSS into TiDB Cloud. For more information, see Import CSV Files from Cloud Storage into TiDB Cloud Starter or Essential and Import CSV Files from Cloud Storage into TiDB Cloud Dedicated.
Import Apache Parquet files from Amazon S3, Google Cloud Storage (GCS), Azure Blob Storage, or Alibaba Cloud OSS into TiDB Cloud
You can import Parquet files from Amazon S3, Google Cloud Storage (GCS), Azure Blob Storage, or Alibaba Cloud OSS into TiDB Cloud. For more information, see Import Apache Parquet Files from Cloud Storage into TiDB Cloud Starter or Essential and Import Apache Parquet Files from Cloud Storage into TiDB Cloud Dedicated.
Reference
Configure cloud storage access
If your source data is stored in Amazon S3, Google Cloud Storage (GCS) buckets, Azure Blob Storage containers, or Alibaba Cloud OSS buckets, before importing or migrating the data to TiDB Cloud, you need to configure access to the storage. For more information, see Configure External Storage Access for TiDB Cloud Starter or Essential and Configure External Storage Access for TiDB Cloud Dedicated.
Naming conventions for data import
To make sure that your data can be imported successfully, you need to prepare schema files and data files that conform to the naming conventions. For more information, see Naming Conventions for Data Import.
Troubleshoot access denied errors during data import from Amazon S3
You can troubleshoot access denied errors that might occur when you import data from Amazon S3 into TiDB Cloud. For more information, see Troubleshoot Access Denied Errors during Data Import from Amazon S3.