The Secure Agent generates success and error files after you run a session. Success and error files are .csv files that contain row-level details. The Hosted Agent does not create success and error files after you run a session.
The Secure Agent generates a success file after you run a session. The success file contains an entry for each record that successfully writes into Amazon Redshift. Each entry contains the values that are written for all the fields of the record. Use this file to understand the data that the Secure Agent writes to the Amazon S3 bucket and then to the Amazon Redshift target.
The error file contains an entry for each data error. Each entry in the file contains the values for all fields of the record and the error message. Use the error file to understand why the Secure Agent does not write data to the Amazon Redshift target.
The Secure Agent does not overwrite success or error files. Access the error rows files and success rows files directly from the directories where they are generated. You cannot access the error rows file from the All Jobs page. You can manually delete the files that you no longer need.
Consider the following guidelines when you configure the session properties for success files:
•By default, a success rows file is generated in the following directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/success. You can specify a different directory with the Success File Directory advanced target option.
•The success rows file uses the following naming convention: infa_rs_<operation>_<schema.table_name>.batch_<batch_number>_file_<file_number>_<timestamp>_success.csv.
Consider the following guidelines when you configure the session properties for error files:
•By default, an error rows file is generated in the following directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/error. You can specify a different directory with the Error File Directory advanced target option.
•When you define a error file directory, you can use the variable $PMBadFileDir. When you use the $PMBadFileDir variable, the application writes the file to the following Secure Agent directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/error.
•For insert tasks, the error rows file uses the following naming convention: infa_rs_<operation>_<schema.table>.batch_<batch_number>_file_<file_number>_<timestamp>_error.csv. For upsert tasks, the error rows file uses the following naming convention: infa_rs_<operation>_<schema.table>_<timestamp_inLong>.batch_<batch_number>_file_<file_number>_<timestamp>_error.csv.