Get Started with Data Service
Data Service (beta) enables you to access TiDB Cloud data via an HTTPS request using a custom API endpoint and allows you to seamlessly integrate with any application or service that is compatible with HTTPS.
This document introduces how to quickly get started with TiDB Cloud Data Service (beta) by creating a Data App, developing, testing, deploying, and calling an endpoint. A Data App is a collection of endpoints that you can use to access data for a specific application.
Before you begin
Before creating a Data App, make sure that you have created a TiDB Cloud Serverless cluster. If you do not have one, follow the steps in Create a TiDB Cloud Serverless cluster to create one.
Get started with a sample Data App
Creating a sample Data App is the best way to get started with Data Service. If your project does not have any Data App yet, you can follow the on-screen instructions on the Data Service page to create a sample Data App and use this App to explore Data Service features.
In the TiDB Cloud console, click Data Service in the left navigation pane.
On the Data Service page, click Create Sample Data App. A dialog is displayed.
In the dialog, update the App name if necessary, select clusters that you want the Data App to access, and then click Create.
The creation process takes a few seconds.
After the sample Data App is automatically created, you can find the App name, a list of endpoints in the left pane, the SQL statements of an endpoint in the middle pane, and instructions about using the sample Data App on the right side.
Follow the instructions on the right side to choose an endpoint and use the curl command to call the endpoint.
Get started with your own Data App
To get started with Data Service, you can also create your own Data App, and then develop, test, deploy, and call endpoints according to the following steps.
Step 1. Create a Data App
To create a Data App, perform the following steps:
In the TiDB Cloud console, click Data Service in the left navigation pane.
On the Data Service page of your project, click Create DataApp in the left pane.
In the Create Data App dialog, enter a name, a description, and select clusters that you want the Data App to access.
(Optional) To automatically deploy endpoints of the Data App to your preferred GitHub repository and branch, enable Connect to GitHub, and then do the following:
- Click Install on GitHub, and then follow the on-screen instructions to install TiDB Cloud Data Service as an application on your target repository.
- Go back to the TiDB Cloud console, and then click Authorize to authorize access to the application on GitHub.
- Specify the target repository, branch, and directory where you want to save the configuration files of your Data App.
Click Create Data App. The Data Service details page is displayed.
If you have configured to connect your Data App to GitHub, check your specified GitHub directory. You will find that the Data App configuration files have been committed to the directory by
tidb-cloud-data-service
, which means that your Data App is connected to GitHub successfully.For your new Data App, Auto Sync & Deployment and Review Draft are enabled by default so you can easily synchronize Data App changes between TiDB Cloud console and GitHub and review changes before the deployment. For more information about the GitHub integration, see Deploy your Data App changes with GitHub automatically.
Step 2. Develop an endpoint
An endpoint is a web API that you can customize to execute SQL statements.
To create a new endpoint, locate the newly created Data App and click + Create Endpoint to the right of the App name.
Configure properties
On the right pane, click the Properties tab and set properties for the endpoint, such as:
Path: the path that users use to access the endpoint. The combination of the request method and the path must be unique within a Data App.
Endpoint URL: (read-only) the URL is automatically generated based on the region where the corresponding cluster is located, the service URL of the Data App, and the path of the endpoint. For example, if the path of the endpoint is
/my_endpoint/get_id
, the endpoint URL ishttps://<region>.data.tidbcloud.com/api/v1beta/app/<App ID>/endpoint/my_endpoint/get_id
.Request Method: the HTTP method of the endpoint. You can use
GET
to retrieve data, usePOST
to create or insert data, usePUT
to update or modify data, and useDELETE
to delete data.
For more information about endpoint properties, see Configure properties.
Write SQL statements
You can customize SQL statements for the endpoint in the SQL editor, which is the middle pane on the Data Service page.
Select a cluster.
On the upper part of the SQL editor, select a cluster on which you want to execute SQL statements from the drop-down list. Then, you can view all databases of this cluster in the Schema tab on the right pane.
Write SQL statements.
Before querying or modifying data, you need to first specify the database in the SQL statements. For example,
USE database_name;
.In the SQL editor, you can write statements such as table join queries, complex queries, and aggregate functions. You can also simply type
--
followed by your instructions to let AI generate SQL statements automatically.To define a parameter, you can insert it as a variable placeholder like
${ID}
in the SQL statement. For example,SELECT * FROM table_name WHERE id = ${ID}
. Then, you can click the Params tab on the right pane to change the parameter definition and test values.- In the Definition section, you can specify whether the parameter is required when a client calls the endpoint, the data type, and the default value of the parameter.
- In the Test Values section, you can set the test value for a parameter. The test values are used when you run the SQL statements or test the endpoint. If you do not set the test values, the default values are used.
- For more information, see Configure parameters.
Run SQL statements.
If you have inserted parameters in the SQL statements, make sure that you have set test values or default values for the parameters in the Params tab on the right pane. Otherwise, an error is returned.
- macOS
- Windows/Linux
For macOS:
If you have only one statement in the editor, to run it, press ⌘ + Enter or click Run.
If you have multiple statements in the editor, to run one or several of them sequentially, place your cursor on your target statement or select the lines of the target statements with your cursor, and then press ⌘ + Enter or click Run.
To run all statements in the editor sequentially, press ⇧ + ⌘ + Enter, or select the lines of all statements with your cursor and click Run.
For Windows or Linux:
If you have only one statement in the editor, to run it, press Ctrl + Enter or click Run.
If you have multiple statements in the editor, to run one or several of them sequentially, place your cursor on your target statement or select the lines of the target statements with your cursor, and then press Ctrl + Enter or click Run.
To run all statements in the editor sequentially, press Shift + Ctrl + Enter, or select the lines of all statements with your cursor and click Run.
After running the statements, you can see the query results immediately in the Result tab at the bottom of the page.
Step 3. Test the endpoint (optional)
After configuring an endpoint, you can test the endpoint to verify whether it works as expected before deploying.
To test the endpoint, click Test in the upper-right corner or press F5.
Then, you can see the response in the HTTP Response tab at the bottom of the page. For more information about the response, see Response of an endpoint.
Step 4. Deploy the endpoint
To deploy the endpoint, perform the following steps:
On the endpoint details page, click Deploy in the upper-right corner.
Click Deploy to confirm the deployment. You will get the Endpoint has been deployed prompt if the endpoint is successfully deployed.
To view the deployment history, you can click the name of your Data App in the left pane, and then click the Deployments tab in the right pane.
Step 5. Call the endpoint
You can call the endpoint by sending an HTTPS request. Before calling an endpoint, you need to first obtain an API key for the Data App.
1. Create an API key
In the left pane of the Data Service page, click the name of your Data App to view its details.
In the Authentication area, click Create API Key.
In the Create API Key dialog box, do the following:
(Optional) Enter a description for your API key.
Select a role for your API key.
The role is used to control whether the API key can read or write data to the clusters linked to the Data App. You can select the
ReadOnly
orReadAndWrite
role:ReadOnly
: only allows the API key to read data, such asSELECT
,SHOW
,USE
,DESC
, andEXPLAIN
statements.ReadAndWrite
: allows the API key to read and write data. You can use this API key to execute all SQL statements, such as DML and DDL statements.
(Optional) Set a desired rate limit for your API key.
Click Next. The public key and private key are displayed.
Make sure that you have copied and saved the private key in a secure location. After leaving this page, you will not be able to get the full private key again.
Click Done.
For more information about API keys, see API Keys in Data Service.
2. Get the code example
TiDB Cloud generates code examples to help you call an endpoint. To get the code example, perform the following steps:
In the left pane of the Data Service page, click the name of your endpoint, and then click ... > Code Example in the upper-right corner. The Code Example dialog box is displayed.
In the dialog box, select the cluster and database that you want to use to call the endpoint, and then copy the code example.
An example of the curl code example is as follows:
- Test Environment
- Online Environment
To call a draft version of the endpoint, you need to add the
endpoint-type: draft
header:curl --digest --user '<Public Key>:<Private Key>' \ --request GET 'https://<region>.data.tidbcloud.com/api/v1beta/app/<App ID>/endpoint/<Endpoint Path>' \ --header 'endpoint-type: draft'You must deploy your endpoint first before checking the code example in the online environment.
To call the current online version of the endpoint, use the following command:
curl --digest --user '<Public Key>:<Private Key>' \ --request GET 'https://<region>.data.tidbcloud.com/api/v1beta/app/<App ID>/endpoint/<Endpoint Path>'
3. Use the code example
Paste the code example in your application and run it. Then, you can get the response of the endpoint.
- You need to replace the
<Public Key>
and<Private Key>
placeholders with your API key. - If the endpoint contains parameters, specify the parameter values when calling the endpoint.
After calling an endpoint, you can see the response in JSON format. The following is an example:
{
"type": "sql_endpoint",
"data": {
"columns": [
{
"col": "id",
"data_type": "BIGINT",
"nullable": false
},
{
"col": "type",
"data_type": "VARCHAR",
"nullable": false
}
],
"rows": [
{
"id": "20008295419",
"type": "CreateEvent"
}
],
"result": {
"code": 200,
"message": "Query OK!",
"start_ms": 1678965476709,
"end_ms": 1678965476839,
"latency": "130ms",
"row_count": 1,
"row_affect": 0,
"limit": 50
}
}
}
For more information about the response, see Response of an endpoint.