You can enable bulk processing to write large amounts of data to Snowflake. Bulk processing utilizes minimal number of API calls and the performance of the write operation is optimized.
To enable bulk processing, specify the property -DENABLE_WRITER_BULK_PROCESSING=true in the Secure Agent properties:
Perform the following steps to configure bulk processing before you run a mapping:
1In Administrator, select the Secure Agent listed on the Runtime Environments tab.
2Click Edit.
3In the System Configuration Details section, select Data Integration Server as the service and DTM as the type.
4Edit the JVM option, and enter -DENABLE_WRITER_BULK_PROCESSING=true.
5Click Save.
Note: This update does not apply for mapping tasks configured with SQL ELT optimization using the Snowflake ODBC connection or the Snowflake Data Cloud connection.