Property | Description |
---|---|
Connection | Name of the active Google BigQuery connection that is associated with a dataset. |
Target Type | Type of the Google BigQuery target objects available. You can write data to a single Google BigQuery target object. You cannot write data to multiple objects or parameterize the object. |
Object | Name of the Google BigQuery target object based on the target type selected. |
Operation | Select insert as the target operation. You cannot perform update, upsert, and delete operations on a Google BigQuery target. |
Property | Description |
---|---|
Target Dataset id | Optional. Overrides the Google BigQuery dataset name that you specified in the connection. |
Target table name | Optional. Overrides the Google BigQuery target table name. |
Write disposition | Specifies how the Secure Agent must write data in bulk mode if the target table already exists. You can select one of the following values:
Note: Write disposition is not applicable for streaming mode. |
Write mode | Specifies the mode that the Secure Agent uses to write data to the BigQuery target. You can select one of the following modes:
|
Streaming template table suffix | This property applies to streaming mode. Specifies the suffix that Google BigQuery adds to the individual target tables that it creates based on the template target table. |
Rows per streaming request | This property applies to streaming mode. Specifies the number of rows that the Secure Agent streams to the BigQuery target for each request. Default is 500 rows. The maximum row size that the Secure Agent can stream to the BigQuery target for each request is 10 MB. |
Staging file name | This property applies to bulk mode. Specifies the name of the staging file that the Secure Agent creates in Google Cloud Storage before it writes the data to the BigQuery target. |
Persist stage file after loading | This property applies to bulk mode. Indicates whether the Secure Agent must persist the staging file in Google Cloud Storage after it writes the data to the BigQuery target. You can persist the staging file if you want to archive the data for future reference. By default, the Secure Agent does not persist the staging file in Google Cloud Storage. |
Enable Staging File Compression | Indicates whether the Secure Agent must compress the size of the staging file before it writes data to Google Cloud Storage and decompress the staging file before it writes the data to the BigQuery target. You can enable staging file compression to reduce cost and transfer time. |
Job Poll Interval in Seconds | Specifies the time interval in seconds after which the Secure Agent polls the status of the write job operation. Default is 10 seconds. |
Success File Directory | This property is not applicable for Google BigQuery Connector. |
Error File Directory | This property is not applicable for Google BigQuery Connector. |
Forward Rejected Rows | This property is not applicable for Google BigQuery Connector. |