Intro
Databricks is a cloud-based collaborative data science, data engineering, and data analytics platform that combines the best of data warehouses and data lakes into a lakehouse architecture. With Databricks you can access all your data, analytics, and AI on a single lakehouse platform. This simple, open, and collaborative environment helps reduce the infrastructure complexity, controls your data, and makes it easy for your teams to partner across the entire data and workflow. You can connect to your Databricks using Personal Access Token Authentication V2 account in the Data Center. This topic discusses the fields and menus that are specific to the Databricks using Personal Access Token Authentication V2 connector user interface. To add DataSets, set update schedules, and edit DataSet information, see Adding a DataSet Using a Connector.Prerequisites
To connect to your Databricks using Personal Access Token Authentication V2 account and create a DataSet, you must have the following:- Host
- Port
- Personal Access Token
- HTTP Path
Connecting to Your Databricks using Personal Access Token Authentication V2 Account
This section enumerates the options in the Credentials and Details panes in the Databricks using Personal Access Token Authentication V2 Connector page. The components of the other panes in this page, Scheduling and Name & Describe Your DataSet, are universal across most connector types and are discussed in great detail in Adding a DataSet Using a Connector.Credentials Pane
This pane contains fields for entering credentials to connect to your Databricks using Personal Access Token Authentication V2 account. The following table describes what is needed for each field:Field | Description |
|---|---|
Host | Enter the server host name. |
Port | Enter the server host port number. |
Personal Access Token | Enter the Personal Access Token. |
HTTP Path | Enter the HTTP Path. |
Details Pane
| Menu | Description | ||||||
| How would you like to import data into Domo? | From the drop-down, select how you want to import your data. | ||||||
| Catalogs | Select the catalog. | ||||||
| Database Name | Select the database name. | ||||||
| Query Type |
| ||||||
| Query | Enter your query. | ||||||
| Database Tables | From the drop-down list, select the table. | ||||||
| Table Columns | Select the columns. | ||||||
| Query Helper | The generated query appears. Edit the query if required. | ||||||
| Upsert Key Column(s) | Enter the upsert key column name or a comma separated list of upsert key column names. Note: This is required only when Import Data method is UPSERT. | ||||||
| Partition Criteria | Select if you want to partition your data using the date keys or meta query. | ||||||
| Partition Query to determine partition tags | Enter the partition meta query to determine the distinct partition tags(or keys). The column containing the Date data is your partition column. For example: SELECT DISTINCT(COLUMN_NAME) FROM TABLENAME. | ||||||
| Partition Column Name | Select the partition column name. Only date fields will appear. | ||||||
| Partition Support Format | Select the partition format. | ||||||
| Past Days | Enter the number of past days for which you want to get the data. Value can be X, where X is a positive integer. For example: 30. | ||||||
| Past Years | Enter the number of past years for which you want to get the data. Value can be X, where X is a positive integer. For example: 30. | ||||||
| Past Months | Enter the number of past months for which you want to get the data. Value can be X, where X is a positive integer. For example: 30. | ||||||
| Future Years | Enter the number of future years for which you want to get the data. Value can be X, where X is a positive integer. For example: 30. | ||||||
| Future Months | Enter the number of future months for which you want to get the data. Value can be X, where X is a positive integer. For example: 30. | ||||||
| Date Format | Select or enter the correct date format as per the date format in the partition column. By default yyyy-MM-dd is used. | ||||||
| Custom Date Format | Enter the custom date format. | ||||||
| Partition Non Date Key Column Name | Select the partition column name. | ||||||
| Fetch Size | Enter the fetch size for memory performance. The default value will be used if the fetch size is not specified. If an out of memory error occurs, then retry by decreasing the fetch size. |