Intro
Azure Data Lake Store is an enterprise-wide hyper-scale repository for big data analytic workloads. Use this connector to pull data files from your Data Lake Store into Domo. You can retrieve data files in any of the following file types: CSV, XLS, XLSX and JSON. For more information about Azure’s API, see https://docs.microsoft.com/en-us/azu…ta-lake-store/. You connect to your Microsoft Azure Storage Data Lake Gen2 account in the Data Center. This topic discusses the fields and menus that are specific to the Microsoft Azure Storage Data Lake Gen2 connector user interface. To add DataSets, set update schedules, and edit DataSet information, see Adding a DataSet Using a Connector.Prerequisites
To connect to your Microsoft Azure Data Lake Store Gen2 account and create a DataSet, you must have the following:- Account key
- Account name
Connecting to Your Microsoft Azure Storage Data Lake Gen2 Account
This section enumerates the options in the Credentials and Details panes on the Microsoft Azure Storage Data Lake Gen2 Connector page. The components of the other panes on this page, Scheduling, and Name & Describe Your DataSet, are universal across most connector types and are discussed in great detail in Adding a DataSet Using a Connector.Credentials Pane
This pane contains fields for entering credentials to connect to your Microsoft Azure Storage Data Lake Gen2 account. The following table describes what is needed for each field:Field | Description |
|---|---|
| Account Key | Enter your Microsoft Azure Storage Data Lake Gen2 account key. |
| Account Name | Enter your Microsoft Azure Storage Data Lake Gen2 account name. |
Details Pane
This pane contains a primary Reports menu, along with various other menus which may or may not appear depending on the report type you select.Menu | Description | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
Report | Select the Microsoft Azure Storage Data Lake Gen2 report you want to run. The following reports are available:
| ||||||||||
| File System | Select your file system. | ||||||||||
| How Would You Like to Choose Your File Name? | Select how you want to choose the file you intend to import into Domo. Select Files Discovery to choose your file from a list of files. Select Enter File Name to enter the name yourself. | ||||||||||
| File Name | Enter the name of the file you want to import into Domo. | ||||||||||
| Select File | Select the file you want to import into Domo. | ||||||||||
| File Format | Select the format of the file you want to import. Options include CSV, XLS, XLSX, and JSON. | ||||||||||
| Delimeter | Select the delimiter to use to parse your CSV file. To choose a custom delimiter, select Other , then enter your delimiter in the Custom Delimiter field. | ||||||||||
| Custom Delimiter | Enter the custom delimiter you want to use to parse your CSV file. Enter tab or Unicode characters in \uxxxx form (e.g. \u005e). | ||||||||||
| Quote Character | Select the desired quote character for parsing your CSV file. (A double quote is the CSV standard.) To choose a custom quote character, select Other , then enter your quote character in the Custom Quote Character field. | ||||||||||
| Custom Quote Character | Enter the custom quote character you want to use to parse your CSV file. Enter tab or Unicode characters in \uxxxx form (e.g. \u005e). | ||||||||||
| Escape Character | Select the escape character to use to parse your CSV file. To choose a custom escape character, select Other , then enter your delimiter in the Custom Escape Character field. | ||||||||||
| Custom Escape Character | Enter the desired CSV escape character. Enter Unicode chars in \uxxxx form (e.g. \u005E). | ||||||||||
| Header Start Row (Optional) | Enter the header start row for your Excel file. | ||||||||||
| Data Start Row (Optional) | Enter the data start row for your Excel file. | ||||||||||
| Footer Rows to Skip (Optional) | Enter the number of rows to skip at the end of your Excel file, if any. | ||||||||||
| Sheet Name (Optional) | If your Excel file contains more than one sheet, enter the name of the sheet you want to import. Be sure to check the sheet name for accidental spaces. If this field is left blank, the first sheet of the workbook will be used. | ||||||||||
| Data Field Key (Optional) | Enter the data field key for the JSON file you want to import. | ||||||||||
| Sublist to Flatten (Optional) | Enter the lists you want to flatten in your data. Separate multiple lists with commas. |
Other Panes
For information about the remaining sections of the connector interface, including how to configure scheduling, retry, and update options, see Adding a DataSet Using a Connector.FAQs
Where can I find the account name and account key?
Where can I find the account name and account key?
You need to create a Storage Account to get the account name and account key.To obtain the account name, follow the below steps:
- Visit Microsoft Azure Portal and sign in using your Microsoft credentials.
- Select Storage accounts.
- Find your storage account and click on it.
- Click the menu icon to the right of the title, and select ‘Copy title to clipboard’.
- Visit Microsoft Azure Portal and sign in using your Microsoft credentials.
- Select Storage accounts.
- Find your storage account and click on it.
- Open Security + networking > Access keys.
- Click the ‘Show’ button on key1 or key2 and copy the value.
Why can't I get file or directory information even though I was able to create an account?
Why can't I get file or directory information even though I was able to create an account?
Azure Data Lake Storage Gen2 requires that the Hierarchical namespace in the storage account be Enabled. If this is Disabled, the Connector will not be able to retrieve directory information and will not be able to retrieve the files.
To Enabled, click the Disabled of the Hierarchical namespace section and follow the guidance to upgrade your storage account to Azure Data Lake Storage Gen2.