Operation | Support |
---|---|
Read | Yes |
Write | Yes |
Property | Description |
---|---|
Connection Name | Name of the connection. Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -, Maximum length is 255 characters. |
Service Account ID | The client_email value in the JSON file that you download after you create a service account. |
Service Account Key | The private_key value in the JSON file that you download after you create a service account. |
Project ID | The project_id value in the JSON file that you download after you create a service account. If you created multiple projects with the same service account, enter the ID of the project that contains the bucket that you want to connect to. |
Is Encrypted File | Specifies whether a file is encrypted. Select this option when you import an encrypted file from Google Cloud Storage. Default is unselected. |
Bucket Name | The Google Cloud Storage bucket name that you want to connect to. When you select a data source, the Package Explorer lists files and folder available in the specified Google Cloud Storage bucket. If you do not specify a bucket name, you can select a bucket from the Package Explorer to select a source. |
Optimize Object Metadata Import | Optimizes the import of metadata for the selected object without parsing other objects, folders, or sub-folders available in the bucket. Directly importing metadata for the selected object can improve performance by reducing the overhead and time taken to parse each object available in the bucket. Default is not selected. |
Property | Description |
---|---|
Google Cloud Storage Path | Optional. Overrides the bucket name or folder path of the Google Cloud Storage file that you selected in the Google Cloud Storage source object. Use the following format: gs://<bucket name> or gs://<bucket name>/<folder name> Note: You cannot specify wildcard characters in the Google Cloud Storage path. |
Source File Name | Optional. Overrides the Google Cloud Storage source file name that you specified in the Source transformation. Note: Does not apply when you configure Is Directory option to read multiple files from a directory. |
Is Directory | Select this property to read all the files available in the folder specified in the Google Cloud Storage Path property. Note: If you do not provide the Google Cloud Storage Path value during run time, the Secure Agent considers the value of the Google Cloud Storage Path that you specify when you select a Google Cloud Storage source file in the Source transformation. |
Incremental File Load | Indicates whether you want to incrementally load files when you use a directory as the source for mappings in advanced mode. When you incrementally load files, the mapping task reads and processes only files in the directory that have changed since the mapping task last ran. |
Allow Wildcard Characters | Indicates whether you want to use wildcard characters for the directory sources. If you select this option, you can use the question mark (?) and asterisk (*) wildcard characters in the folder path or file name. |
Encryption Type | Method to decrypt data. You can select one of the following encryption types:
Default is None. |
Compression Format | Method to read compressed data from Google Cloud Storage. You can read the compressed data in the following formats:
Select None to read from the compressed Avro or Parquet file. Select Gzip to read from the compressed Flat file. Default is None. |
Property | Description |
---|---|
Google Cloud Storage Path | Overrides the Google Cloud Storage path where the target file exists. Use the following format: gs://<bucket name> or gs://<bucket name>/<folder name> |
Target File Name | Optional. Overrides the Google Cloud Storage target object name specified in the Target transformation. |
Encryption Type | Method to encrypt data. You can select one of the following encryption types:
Default is None. |
Compression Format | Compresses data when you write to Google Cloud Storage. You can compress the data in the following formats:
Default is None. In advanced mode, you can compress data only when you run a mapping that writes data to a Google Cloud Storage file in Parquet, JSON, or Delimited file formats. |