Skip to main content
Important: Due to Google’s change in allowing Domo connectors to use OAuth authentication, all users must now use service account key authentication to create new data connections. To create new Google Cloud Storage DataSets, use this connector. All pre-existing Google Cloud Storage DataSets will continue to run normally.

Intro

Google Cloud Storage is an Internet service used to store data in Google’s cloud. You can use Domo’s Google Cloud Storage Service connector to get data about project buckets and objects in Google Cloud Storage. Buckets are general locations and destination for files to be stored. Projects organize the resources and permissions. Most people will use this connector to connect to the buckets that store their data. To find out more about the Google Cloud Storage API, visit https://cloud.google.com/storage/docs/json_api/. The Google Cloud Storage connector is a “File” connector, meaning it retrieves files and outputs them to Domo. In the Data Center, you can access the connector page for this and other File connectors by clicking File in the toolbar at the top of the window. You connect to your Google Cloud Storage account in the Data Center. This topic discusses the fields and menus that are specific to the Google Cloud Storage connector user interface. General information for adding DataSets, setting update schedules, and editing DataSet information is discussed in Adding a DataSet Using a Data Connector.

Primary Use Cases

Files of any size can be delivered to the Google Cloud Storage buckets. You can list the files in a bucket or retrieve individual files. You can also use this connector to pull details about the buckets and projects associated with the bucket or project name.

Primary Metrics

None. This connector is primarily used for grabbing files out of a cloud storage bucket.

Primary Company Roles

  • Data specialists

  • Analysts

  • MajorDomos

Average Implementation Time

  • Entering credentials - 15 minutes or less

  • Configuring the connector - 20 minutes

  • Allowing the connector to run - Time varies depending on file size

Ease of Use (on a 1-to-10 scale with 1 being easiest)

4

Prerequisites

To connect to a Google service account, you must have a Google service account JSON key. To generate a key, do the following:
  1. In the GCP Console, open the IAM & Admin page.
  2. Click Service accounts in the left-hand navigation pane.
  3. Select your project and click Open.
  4. Click Create Service Account.
  5. Enter a name and description for the service account.
  6. Click Create.
  7. Select Project Owner.
  8. Click Continue.
  9. Click Create key.
  10. Select JSON as the key type.
  11. Click Create.
A private key will be saved to your computer.

Connecting to a Google Service Account

This section enumerates the options in the Credentials and Details panes on the Google Cloud Storage Service Connector page. The components of the other panes on this page, Scheduling, and Name & Describe Your DataSet, are universal across most connector types and are discussed in greater length in Adding a DataSet Using a Data Connector.

Credentials Pane

This page contains fields for entering credentials to connect to a Google service account. The following table describes what is needed for each field:

Field

Description

Service Account Key JSON

Copy and paste the JSON for your Google service account key. For information about creating a key, see “Prerequisites,” above.

Once you have entered a valid key, you can use the same account any time you go to create a new Google Cloud Service DataSet. You can manage connector accounts in the Accounts tab in the Data Center. For more information about this tab, see Managing User Accounts for Connectors.

Details Pane

This pane contains a primary Report menu, along with various other menus which may or may not appear depending on the report type you select.

Menu

Description

Report

Select a Google Cloud Storage report. The following reports are available:

Report Name

Description

List Buckets

Returns the list of buckets in the project associated with the authenticated service account.

List Objects

Returns data about the objects in the specified bucket.

Import All Objects

Lets you import a CSV, XLS, XLSX object or a CSV, XLS, XLSX file that is inside all objects.

Import Multiple Objects

Lets you import a CSV, XLS, XLSX object or a CSV, XLS, XLSX file that is inside the ZIP/GZIP objects.

Import Object

Lets you import a CSV, XLS, XLSX object or a CSV, XLS, XLSX file inside a ZIP/GZIP object.

How Would You Like to Select the Cloud Storage Bucket Name?

Select Discover Bucket Name or Enter Bucket Name from the drop-down list.

Enter the Storage Bucket Name

Enter the bucket you want to use. This field populates when you select Enter Bucket Name from the How Would You Like to Select the Cloud Storage Bucket Name? field.

Bucket Name

Select the bucket you want to use from the drop-down list. This field populates when you select Discover Bucket Name from the How Would You Like to Select the Cloud Storage Bucket Name? field.

Prefix (optional)

Filters result for objects whose name begins with a prefix.

File Name

Enter * to import all files.

Object’s File Type

Select the file type for the object you want to pull into Domo.

Sub File Type

Select the file type for the zipped data file you want to retrieve.

Add Filename Column (optional)

Select YES if you want to add the BATCH_FILE_NAME column to the final output, or select NO.

Contains Header Row?

Select No if the CSV file does not contain a header row. The Connector will generate header rows for such files.

Select the Delimiting Character

Select the character used by your character-separated values (CSV) text to separate your columns. If your delimiter is not listed, select ‘Other.’

Specify Your Delimiter

Enter the character used to delimit your character-separated values (CSV) text.

Select the Quote Character (optional)

Select the desired quote character for parsing CSV files. (A double quote is the CSV standard.) If your quote character is not listed, select ‘Other.’

Specify Your Quote Character

Enter the quote character for your character-separated values (CSV) text.

Select the Escape Character (optional)

Select the desired escape character for the character-separated values (CSV) text. If the escape character is not listed, select ‘Other.’

Encoding

Select the charset encoding of your file. This fields appears when you select the Import Object and Import Multiple Objects reports.

Specify the Escape Character

Enter the escape character for the character-separated values (CSV) text.

Header Start Row (optional)

Enter the header start row number in the file.

Data Start Row (optional)

Enter the data start row number in the file.

Footer Rows to Skip (optional)

Enter the number of rows at the end of the file to skip. For example, to skip the last two rows you should enter 2 .

Sheet Name (optional)

Enter the sheet name you want to retrieve from the specific spreadsheet. Ensure to check the sheet name for accidental spaces. Use the first sheet of the workbook if the field is blank.

Excel File Password (optional)

Enter the password for the Excel file.

File Name Match Type (optional)

Specifies whether the file to be retrieved starts with or contains the name entered in the File Name field.

Subfile Name

Enter the name or a portion of the subfile name that you would like to import.

Object Name

Select the object you want to use.

Other Panes

For information about the remaining sections of the connector interface, including how to configure scheduling, retry, and update options, see Adding a DataSet Using a Data Connector.

Troubleshooting

Ensure you have the right permissions with the project to get to the bucket you’re interested in.