Amazon Redshift Connectors > Part III: Data Integration with Amazon Redshift Connector > Synchronization tasks with Amazon Redshift > Amazon Redshift sources in synchronization tasks
  

Amazon Redshift sources in synchronization tasks

You configure Amazon Redshift source properties on the Source page of the Synchronization Task wizard.
To optimize performance, you can configure a filter in the Data Filters page. Configure a simple filter or an advanced filter to remove rows at the source. You can improve efficiency by filtering early in the data flow. A simple filter includes a field name, operator, and value. Use an advanced filter to define a more complex filter condition, which can include multiple conditions using the AND or OR logical operators.
The following table describes the Amazon Redshift source properties:
Property
Description
Connection
Name of the source connection.
Source Type
Type of the source object. Select Single or Multiple.
Source Object
Name of the source object. Select the source object for a single source or multiple related sources.
When you configure a synchronization task to use an Amazon Redshift source, you can configure advanced source properties. Advanced source properties appear on the Schedule page of the Synchronization Task wizard.
The following table describes the Amazon Redshift advanced source properties:
Advanced Property
Description
S3 Bucket Name
Amazon S3 bucket name for the Amazon Redshift source data.
Use an S3 bucket in the same region as your Amazon Redshift cluster.
Enable Compression
Compresses staging files before writing the files to Amazon Redshift.
Task performance improves when the Secure Agent compresses the staging files.
Default is selected.
Staging Directory Location
Amazon Redshift staging directory.
When you run a task in Secure Agent runtime environment, specify a directory path that is available on each Secure Agent machine in the runtime environment.
When you run a task in Hosted Agent runtime environment, leave the staging directory location blank. The Hosted Agent creates a directory at a temporary location.
UnloadOptions Property File
Unload command options.
Add options to the Unload command to write data from an Amazon Redshift object to an S3 bucket. You can add the following options:
  • - DELIMITER
  • - PARALLEL
  • - ESCAPE
  • - AWS_IAM_ROLE
When you run a task in the Secure Agent runtime environment, either specify the path of the property file that contains the unload options or specify the unload options directly in the UnloadOptions Property File field.
When you run a task in the Hosted Agent runtime environment, specify options directly in the UnloadOptions Property File field.
Turn on S3 Client Side Encryption
Indicates that the Secure Agent encrypts data by using a private encryption key.
Encryption Type
Select the source encryption type. You can select from the following encryption types:
  • - SSE-S3
  • - SSE-KMS
Default is SSE-S3. For more information, see Data encryption in Amazon Redshift sources .
Enable Downloading S3 Files in Multiple Parts
Downloads large Amazon S3 objects in multiple parts.
When the file size of an Amazon S3 object is greater than 5 MB, you can choose to download the object in multiple parts in parallel.
Part Size
Specifies the part size of an object. Default is 5 MB.
Infa Advanced Filter
Not applicable for Amazon Redshift Connector.
Pre-SQL
The pre-SQL commands to run a query before you read data from Amazon Redshift. You can also use the UNLOAD or COPY command. The command you specify here is processed as a plain text.
Post-SQL
The post-SQL commands to run a query after you write data to Amazon Redshift. You can also use the UNLOAD or COPY command. The command you specify here is processed as a plain text.
SQL Query
Overrides the default query. Enclose column names in double quotes. The SQL query is case sensitive. Specify an SQL statement supported by the Amazon Redshift database.
Number of Sorted Ports
Number of columns used when sorting rows queried from the source. The agent adds an ORDER BY clause to the default query when it reads source rows. The ORDER BY clause includes the number of ports specified, starting from the top of the transformation. When you specify the number of sorted ports, the database sort order must match the session sort order.
Default is 0.
Select Distinct
Selects unique values. The agent includes a SELECT DISTINCT statement if you choose this option. Amazon Redshift ignores trailing spaces. Therefore, the agent might extract fewer rows than expected.
Source Table Name
You can override the default source table name.