Google BigQuery Connector Guide > Data Synchronization Tasks with Google BigQuery Connector > Advanced Properties for Google BigQuery Targets
  

Advanced Properties for Google BigQuery Targets

You can configure advanced target properties on the Schedule page of the Data Synchronization Task wizard.
The following table describes the advanced properties that you can configure for a Google BigQuery target:
Property
Description
Target Dataset id
Optional. Overrides the Google BigQuery dataset name that you specified in the connection.
Target table name
Optional. Overrides the Google BigQuery target table name that you specified in the Data Synchronization task.
Write disposition
Specifies how the Secure Agent must write data in bulk mode if the target table already exists.
You can select one of the following values:
  • - Write append. If the target table exists, the Secure Agent appends the data to the existing data in the table.
  • - Write truncate. If the target table exists, the Secure Agent overwrites the existing data in the table.
  • - Write empty. If the target table exists and contains data, the Secure Agent displays an error and does not write the data to the target. The Secure Agent writes the data to the target only if the target table does not contain any data.
Note: Write disposition is not applicable for streaming mode.
Write mode
Specifies the mode that the Secure Agent uses to write data to the BigQuery target.
You can select one of the following modes:
  • - Bulk. In bulk mode, the Secure Agent first writes the data to a staging file in Google Cloud Storage. When the staging file contains all the data, the Secure Agent transfers the data from the staging file to the BigQuery target. The Secure Agent then deletes the staging file unless you configure the task to persist the staging file.
  • - Streaming. In streaming mode, the Secure Agent directly writes data to the BigQuery target. The Secure Agent inserts the data into the target row by row.
Streaming template table suffix
This property applies to streaming mode.
Specifies the suffix that Google BigQuery adds to the individual target tables that it creates based on the template target table.
Rows per streaming request
This property applies to streaming mode.
Specifies the number of rows that the Secure Agent streams to the BigQuery target for each request.
Default is 500 rows.
The maximum row size that the Secure Agent can stream to the BigQuery target for each request is 10 MB.
Staging file name
This property applies to bulk mode.
Specifies the name of the staging file that the Secure Agent creates in Google Cloud Storage before it writes the data to the BigQuery target.
Persist stage file after loading
This property applies to bulk mode.
Indicates whether the Secure Agent must persist the staging file in Google Cloud Storage after it writes the data to the BigQuery target. You can persist the staging file if you want to archive the data for future reference.
By default, the Secure Agent does not persist the staging file in Google Cloud Storage.
Enable Staging File Compression
Indicates whether the Secure Agent must compress the size of the staging file before it writes data to Google Cloud Storage and decompress the staging file before it writes the data to the BigQuery target.
You can enable staging file compression to reduce cost and transfer time.
Job Poll Interval in Seconds
Specifies the time interval in seconds after which the Secure Agent polls the status of the write job operation.
Default is 10 seconds.
Success File Directory
This property is not applicable for Google BigQuery Connector.
Error File Directory
This property is not applicable for Google BigQuery Connector.