Connections > Google BigQuery V2 connection properties > Connect to Google BigQuery
  

Connect to Google BigQuery

Let's configure the Google BigQuery V2 connection properties to connect to Google BigQuery.

Before you begin

Before you configure a connection, ensure that you download the Google service account key file in JSON format. The service account key file is created when you create a Google service account.
You require the client email, private key, and project ID from the service account key JSON file to create a Google BigQuery connection.
The following video shows you how to get the information you need from your Google BigQuery account:
https://infa.media/3e4LzdW

Connection details

The following table describes the basic connection properties:
Property
Description
Connection Name
Name of the connection.
Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -,
Maximum length is 255 characters.
Description
Description of the connection. Maximum length is 4000 characters.
Type
Google BigQuery V2
Use Secret Vault
Stores sensitive credentials for this connection in the secrets manager that is configured for your organization.
This property appears only if secrets manager is set up for your organization.
This property is not supported by Data Ingestion and Replication.
When you enable the secret vault in the connection, you can select which credentials that the Secure Agent retrieves from the secrets manager. If you don't enable this option, the credentials are stored in the repository or on a local Secure Agent, depending on how your organization is configured.
For information about how to configure and use a secrets manager, see Secrets manager configuration.
Runtime Environment
The name of the runtime environment where you want to run tasks.
Select a Secure agent, Hosted Agent, or serverless runtime environment.
You cannot run an application ingestion and replication task, database ingestion and replication task, or streaming ingestion and replication task on a Hosted Agent or serverless runtime environment.

Authentication types

You can configure Service Account or Workload Identity Federation authentication method to access Google BigQuery.
Select the required authentication method and configure the authentication-specific parameters.
Default is Service Account authentication type.

Connection retry

The following table describes the properties for connection retry:
Property
Description
Enable Retry¹
Select this option if you want the Secure Agent to attempt a retry to receive the response from the Google BigQuery endpoint.
You can configure the retry strategy to read data from Google BigQuery in direct or staging mode and write data to Google BigQuery in bulk mode.
The retry strategy is not applicable in the CDC and streaming modes when you write data to a Google BigQuery target.
The connection retry option also applies to a connection configured to use the proxy server to connect to the endpoint.
Default is unselected.
Maximum Retry Attempts
Appears only if you select the Enable Retry property.
The maximum number of retry attempts that the Secure Agent performs to receive the response from the Google BigQuery endpoint.
If the Secure Agent fails to connect to Google BigQuery within the maximum retry attempts, the connection fails.
Default is 6 attempts.
Initial Retry Delay
Appears only if you select the Enable Retry property.
The initial wait time in seconds before the Secure Agent attempts to retry the connection.
Default is 1 second.
Retry Delay Multiplier
Appears only if you select the Enable Retry property.
The multiplier that the Secure Agent uses to exponentially increase the wait time between successive retry attempts up to the maximum retry delay time.
Default multiplier is 2.0. You can also use fractional values.
Maximum Retry Delay
Appears only if you select the Enable Retry property.
The maximum wait time in seconds that the Secure Agent waits between successive retry attempts.
Default is 32 seconds.
Total Timeout
Appears only if you select the Enable Retry property.
The total time duration in seconds that the Secure Agent attempts to retry the connection after which the connection fails.
Default is 50 seconds.
¹ Doesn't apply to mappings in advanced mode.

Related links