Connections for INFACore > Connections to source and target endpoints > Google Cloud Storage
  

Google Cloud Storage

When you create a Google Cloud Storage connection, configure the connection properties.

Feature snapshot

Operation
Support
Read
Yes
Write
Yes

Before you begin

Before you configure the connection properties, you'll need to get information from your Google account.
The following video shows you how to get information from your Google account:
https://infa.media/3R4gIwa

Connection properties

The following table describes the Google Cloud Storage connection properties:
Property
Description
Connection Name
Name of the connection.
Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -,
Maximum length is 255 characters.
Service Account ID
The client_email value in the JSON file that you download after you create a service account.
Service Account Key
The private_key value in the JSON file that you download after you create a service account.
Project ID
The project_id value in the JSON file that you download after you create a service account.
If you created multiple projects with the same service account, enter the ID of the project that contains the bucket that you want to connect to.
Is Encrypted File
Specifies whether a file is encrypted.
Select this option when you import an encrypted file from Google Cloud Storage.
Default is unselected.
Bucket Name
The Google Cloud Storage bucket name that you want to connect to.
When you select a data source, the Package Explorer lists files and folder available in the specified Google Cloud Storage bucket.
If you do not specify a bucket name, you can select a bucket from the Package Explorer to select a source.
Optimize Object Metadata Import
Optimizes the import of metadata for the selected object without parsing other objects, folders, or sub-folders available in the bucket.
Directly importing metadata for the selected object can improve performance by reducing the overhead and time taken to parse each object available in the bucket.
Default is not selected.

Read properties

The following table describes the advanced source properties that you can configure in the Python code to read from Google Cloud Storage:
Property
Description
Google Cloud Storage Path
Optional. Overrides the bucket name or folder path of the Google Cloud Storage file that you selected in the Google Cloud Storage source object.
Use the following format: gs://<bucket name> or gs://<bucket name>/<folder name>
Note: You cannot specify wildcard characters in the Google Cloud Storage path.
Source File Name
Optional. Overrides the Google Cloud Storage source file name that you specified in the Source transformation.
Note: Does not apply when you configure Is Directory option to read multiple files from a directory.
Is Directory
Select this property to read all the files available in the folder specified in the Google Cloud Storage Path property.
Note: If you do not provide the Google Cloud Storage Path value during run time, the Secure Agent considers the value of the Google Cloud Storage Path that you specify when you select a Google Cloud Storage source file in the Source transformation.
Incremental File Load
Indicates whether you want to incrementally load files when you use a directory as the source for mappings in advanced mode.
When you incrementally load files, the mapping task reads and processes only files in the directory that have changed since the mapping task last ran.
Allow Wildcard Characters
Indicates whether you want to use wildcard characters for the directory sources.
If you select this option, you can use the question mark (?) and asterisk (*) wildcard characters in the folder path or file name.
Encryption Type
Method to decrypt data.
You can select one of the following encryption types:
  • - Informatica Encryption
  • - None
Default is None.
Compression Format
Method to read compressed data from Google Cloud Storage.
You can read the compressed data in the following formats:
  • - None
  • - Gzip
Select None to read from the compressed Avro or Parquet file.
Select Gzip to read from the compressed Flat file.
Default is None.

Write properties

The following table describes the advanced target properties that you can configure in the Python code to write to Google Cloud Storage:
Property
Description
Google Cloud Storage Path
Overrides the Google Cloud Storage path where the target file exists.
Use the following format: gs://<bucket name> or gs://<bucket name>/<folder name>
Target File Name
Optional. Overrides the Google Cloud Storage target object name specified in the Target transformation.
Encryption Type
Method to encrypt data.
You can select one of the following encryption types:
  • - Informatica Encryption
  • - None
Default is None.
Compression Format
Compresses data when you write to Google Cloud Storage.
You can compress the data in the following formats:
  • - None
  • - Gzip
  • - Deflate
  • - Snappy
Default is None.
In advanced mode, you can compress data only when you run a mapping that writes data to a Google Cloud Storage file in Parquet, JSON, or Delimited file formats.