Skip to main content

Intro

This connector enables you to import Parquet files from Amazon S3 into Domo. You can connect to your Amazon S3 Parquet account in the Data Center. This topic discusses the fields and menus that are specific to the Amazon S3 Parquet connector user interface. To add DataSets, set update schedules, and edit DataSet information, see Adding a DataSet Using a Connector.

Prerequisites

To connect to your Amazon S3 Parquet account and create a DataSet, you need the following:
  • Your AWS Access Key
  • Your AWS Secret Access Key
  • AWS S3 Bucket name
  • You also need to select the Amazon S3 Region.

Connecting to Your Amazon S3 Parquet Account

This section enumerates the options in the Credentials and Details panes on the Amazon S3 Parquet Connector page. The components of the other panes on this page, Scheduling and Name & Describe Your DataSet, are universal across most connector types and are discussed in great detail in Adding a DataSet Using a Connector.

Credentials Pane

This pane contains fields for entering credentials to connect to your Amazon S3 Parquet account. The following table describes what is needed for each field:

Field

Description

Access Key Enter your AWS access key, which can be found in the AWS Console in the Security Credentials section or under Users if you are using IAM.
Secret Key Enter your AWS secret access key. It becomes available when you create your Access Key. You can generate a new one in the AWS Console.
Bucket Enter the name of the AWS S3 Bucket.
Region Select the name of the AWS S3 Bucket.
Once you have entered valid Amazon S3 Parquet credentials, you can use the same account at any time to create a new Amazon S3 Parquet DataSet. You can manage connector accounts in the Accounts tab in the Data Center. For more information about this tab, see Manage Connector Accounts.

Details Pane

Menu

Description

What file type would you like to import? Select the file type that you want to parse and import.
Prefix Prefix limits the results to only those keys that begin with the specified prefix.
File Name Enter the name of the Amazon S3 Object(file) that you want to import.
File Name Match Type Specify whether the retrieved file starts with or contains the name that you have entered in File Name .
Number of Files to Ingest

Specify the number of files you want to fetch.

You can either fetch the last updated or created file that matches the file name or fetch all matching files.

Other Panes

For information about the remaining sections of the connector interface, including how to configure scheduling, retry, and update options, see Adding a DataSet Using a Connector.