Amazon Athena Connector > Mappings and mapping tasks with Amazon Athena Connector > Amazon Athena sources in mappings
  

Amazon Athena sources in mappings

In a mapping, you can configure a Source transformation to represent an Amazon Athena source.
The following table describes the Amazon Athena source properties that you can configure in a Source transformation:
Property
Description
Connection
Name of the source connection. Select a source connection, or click New Parameter to define a parameter for the source connection.
Source type
Type of the source object.
Select any of the following source object types:
  • - Single Object. Select to specify a single Amazon Athena object.
  • - Query. When you select the source type as query, you must map all the fields selected in the query in the Field Mapping tab.
  • - Parameter. Select to specify a parameter name.
Object
Name of the source object.
Select a single source object.
Note: When you preview a column in a table that uses binary data type, the column displays blank values.
The following table describes the query options that you can configure in a Source transformation:
Property
Description
Filter
Filter value in a read operation. Click Configure to add conditions to filter records and reduce the number of rows that the Secure Agent reads from the source.
You can specify the following filter conditions:
  • - Not parameterized. Use a basic filter to specify the object, field, operator, and value to read specific records.
  • - Completely parameterized. Use a parameter to represent the filter conditions.
  • - Advanced. Use an advanced filter to define a complex filter condition.
Sort
Conditions to sort records.
You can specify the following sort conditions:
  • - Not parameterized. Select the fields and type of sorting to use.
  • - Parameterized. Use a parameter to specify the sort condition.
  • - Sort Order. Specify whether you want to sort data in ascending or descending order.
Note: When you configure an advanced filter on a Timestamp column, you must specify the value as TIMESTAMP in the filter condition. For example,
SELECT * FROM <dbname>.<tablename> where col_date < TIMESTAMP '2030-06-22 18:30:00.000';
The following table describes the Amazon Athena advanced source properties that you can configure in a Source transformation:
Property
Description
Retain Athena Query Result On S3 File
Specifies whether you want to retain the Amazon Athena query result on the Amazon S3 file. Select the check box to retain the Amazon Athena query result on the Amazon S3 file.
The Amazon Athena query result in stored in the CSV file format.
By default, the Retain Athena Query Result on S3 File check box is not selected.
S3OutputLocation
Specifies the location of the Amazon S3 file that stores the result of the Amazon Athena query.
You can also specify the Amazon S3 file location in the S3OutputLocation parameter in the JDBC URL connection property.
If you specify the Amazon S3 output location in both the connection and the advanced source properties, the Secure Agent uses the Amazon S3 output location specified in the advanced source properties.
Fetch Size
Determines the number of rows to read in one result set from Amazon Athena.
Default is 10000.
Encryption Type
Encrypts the data in the Amazon S3 staging directory.
You can select the following encryption types:
  • - None
  • - SSE-S3
  • - SSE-KMS
  • - CSE-KMS
Default is None.
Schema Name
Overrides the schema name of the source object.
Source Table Name
Overrides the table name used in the metadata import with the table name that you specify.
SQL Query
Overrides the default SQL query.
Enclose column names in double quotes. The SQL query is case sensitive. Specify an SQL statement supported by the Amazon Athena database.
When you specify the columns in the SQL query, ensure that the column name in the query matches the source column name in the mapping.
You can set the tracing level in the Amazon Athena advanced source properties to determine the amount of details that logs contain.
The following table describes the tracing levels that you can configure:
Tracing Level
Description
Terse
The Secure Agent logs initialization information, error messages, and notification of rejected data.
Normal
The Secure Agent logs initialization and status information, errors encountered, and skipped rows due to transformation row errors. Summarizes session results, but not at the level of individual rows.
Verbose Initialization
In addition to normal tracing, the Secure Agent logs additional initialization details, names of index and data files used, and detailed transformation statistics.
Verbose Data
In addition to verbose initialization tracing, the Secure Agent logs each row that passes into the mapping. Also notes where the Secure Agent truncates string data to fit the precision of a column and provides detailed transformation statistics.
When you configure the tracing level to verbose data, the Secure Agent writes row data for all rows in a block when it processes a transformation.