Data Ingestion and Replication Release Notes > Database Ingestion and Replication > Fixed issues
  

Fixed issues

The following tables describe recent Database Ingestion and Replication fixed issues. Not all monthly releases include fixed issues.

July 2024 fixed issues

Issue
Description
DBMI-19217
If you select the advanced Add Last Replicated Time property on the Target page of the task wizard and save task and then later clear the check box and save the task again, when you return to the task wizard, the check box is still selected. However, if you open the task in view mode, the property is disabled. In this case, the database ingestion and replication job does not add the last replicated time metadata column on the target, which appears to conflict with the wizard setting.
DBMI-18809
Database ingestion and replication jobs that have a Snowflake target and use the Superpipe feature to stream change data to target tables might fail with the following error if mixed-case and lowercase column identifiers are quoted and if the QUOTED_IDENTIFIERS_IGNORE_CASE=true parameter is set in the Additional JDBC URL Parameters field of the connection properties:
Exception handled: 'SQL compilation error: error line 1 at position <bytes> invalid identifier '"<identifier>"''. With error code 904
DBMI-18786
In the Data Ingestion and Replication Command-Line Interface (CLI), if you issue the job status command without the optional -f option, the command fails with the following error:
Could not get the fields for job '<job_instance>' in the 'Up and Running' state.
The failure occurs because of date-time format discrepancies that are encountered when fetching the job's start time.
DBMI-18774
Database ingestion and replication jobs that have an Amazon Redshift target might fail when creating target tables that have names in mixed case or uppercase. The failure occurs if the Amazon Redshift enable_case_sensitive_identifier cluster configuration parameter is set to false and the Enable Case Transformation target property is not selected for the job.
DBMI-18670
Database ingestion and replication jobs that use a Microsoft Azure Data Lake Storage Gen2 target connection to connect to an Azure Government cloud fail because the connection uses a specific host name by default that is incorrect. With this fix, the connection to the Azure Government cloud succeeds provided that you use Azure Service Principal authentication.
DBMI-18650
If you create and deploy an application ingestion and replication task or database ingestion and replication task that has a database target in the Data Ingestion and Replication CLI, the task is created without an apply mode setting and the default Standard apply mode is not used. Consequently, when you try to run the associated job instance, it fails.
DBMI-18629
In a database ingestion and replication task that has an Oracle source and Google BigQuery target, if you add a custom data type mapping that maps the Oracle DATE type to the Google BigQuery TIMESTAMP type, the custom mapping is ignored when you run the job. Instead, the default mapping of Oracle DATE to Google BigQuery DATETIME is used.
DBMI-18243
If you deselect the Add Operation Type metadata column for database ingestion and replication incremental load or combined load tasks that have an SAP HANA source and Snowflake target and that use Audit apply mode, the following exception occurs when you try to run the associated job:
java.lang.IndexOutOfBoundsException: Index: 139, Size: 139
DBMI-18233
Database ingestion and replication incremental load jobs that have a Db2 for i source fail repeatedly before issuing the following error message:
[CDCPUB_10066] TRACE: [IBMiLogCollector failed creating SQL IBMiLogCollector createNewLogSQLStatement(), current log start sequence <sequence_number> is greater than ending log sequence <sequence_number> for the journal receiver being processed.]
DBMI-18230
In database ingestion and replication tasks that have an Oracle source, selected tables might be automatically deselected in the following situation:
  1. 1You apply an Include * rule that includes all tables in the schema.
  2. 2Under Table View, you deselect all tables.
  3. 3Under Table View, you search for a table and then select a subset of its columns.
  4. 4You repeat step 3 multiple times.
DBMI-18216
During database ingestion and replication CDC processing, the performance of queries to the Db2 for i journal receivers for data needs to be improved.
DBMI-18169
A database ingestion and replication job that has a Kafka target configured with one-way SSL connection mode does not start because of a missing SSL KeyStore Password connection property which is not required for this mode.
DBMI-18098
A database ingestion and replication initial load job that has a Microsoft Azure Data Lake Storage Gen2 target does not attempt a retry if the upload to target fails.
DBMI-18097
Database ingestion and replication jobs that have a SQL Server source and SQL Server target might fail with the following error when processing large queries to the database:
Caused by: java.sql.SQLSyntaxErrorException: [informatica] [SQLServer JDBC Driver] [SQLServer] There is already an object named '<temp_table_name>_VER' in the database.
The problem persists even after the job is undeployed, the tables on the target are dropped, and the job is deployed again.
DBMI-16778
Redeployed database ingestion and replication combined load jobs that have an Oracle 11g source might fail with the following error when querying redo logs for start information:
PWX-36075 OCI Error: ORA-00907: missing right parenthesis.
DBMI-13489
Database ingestion and replication incremental load and combined load jobs that have a Db2 for i source need a way to prevent the deletion of source journal receivers during CDC processing.

May 2024 fixed issues

Issue
Description
DBMI-18099
Database ingestion and replication incremental load or combined initial and incremental load jobs that have Db2 for i sources might fail if the query for source journal receivers encounters an empty journal receiver name.
DBMI-18096
Database ingestion and replication incremental load jobs that have Oracle sources might fail if the TDE master key is changed.
DBMI-17805
Database ingestion and replication incremental load jobs that have Oracle sources and run in ARCHIVECOPY reader mode end abnormally after a failover from the primary database to a standby database.
DBMI-17593
The Resync option is available for a database ingestion and replication job even though the user does not have the required privileges to perform a resync.
DBMI-17552
During database ingestion and replication CDC processing of an Oracle source, a capture progress marker might be sent out of sequence after processing catches up to the current end of log.
DBMI-17547
In database ingestion and replication jobs that have an Oracle source and a Snowflake target with schema drift enabled, the target column size might be inconsistent with the source column size.
DBMI-17202
When running a database ingestion and replication initial load job that has a MySQL source, the retrieval of the first record might be delayed by hours, reducing the overall throughput of the database ingestion job. In this case, an out-of-memory issue might occur if the source table result set is large enough to exceed the available heap memory of the database ingestion and replication task container process. In combined initial and incremental load jobs, the switch to incremental load processing might also be delayed by hours.
DBMI-17189
Database ingestion and replication incremental load or combined load jobs that use the Soft Deletes apply mode might not apply all change records to the Snowflake target if you delete a source record and then add the same record shortly afterwards again. In this case, only the Delete record is captured.
DBMI-17181
Database ingestion and replication combined initial and incremental load jobs that have a MySQL source might fail with the following error:
ADAPTER MySQL <Client> Not able to get end of log position. Failed with error: The last packet successfully received is longer than the server configured value of 'wait_timeout'
DBMI-17179
When running a database ingestion and replication initial and incremental load job, the switch from initial load processing to incremental load processing might be delayed by hours.
DBMI-17174
Database ingestion and replication incremental load jobs that have a Db2 for z/OS source fail repeatedly with the following error message:
[CDCPUB_10066] TRACE: [PwxCDCReaderRunHandler encountered error :Previous sequence <sequence_number> is not less than current sequence <sequence_number>. Caused by: Previous sequence <sequence_number> is not less than current sequence <sequence_number>
DBMI-17019
Database ingestion and replication jobs might corrupt multi-byte character data in SAP HANA source tables when replicating the data to Snowflake targets. The problem occurs with encodings other than UTF-8.
DBMI-16578
Database ingestion and replication incremental load or combined initial and incremental load jobs that use a Microsoft Azure Synapse Analytics Database Ingestion connection to the target might fail with a target connection reset error during the execution of merge apply statements at the target database.
DBMI-16441
Database ingestion and replication jobs that have a Snowflake target and the Persistent Storage and Superpipe options enabled might fail when a new internal StreamObjectID is assigned to the source object schema.
DBMI-16384
Database ingestion and replication jobs that have an Oracle source might ignore transactions with no DML activity of interest after 60 minutes. Data loss might occur after a job restarts if an ignored transaction that's no longer being tracked later contains DML changes.
DBMI-16170
Database ingestion and replication incremental load jobs now detect non-responsive connections and fail if a connection is non-responsive for 5 minutes. This situation is usually caused by a network failure that leaves dead sockets.
DBMI-16138
Database ingestion and replication combined initial and incremental load jobs that have an Oracle source might incorrectly report the suspension time in the suspension duration trace message.
DBMI-15421
When database ingestion and replication jobs read Oracle logs using BFILE trailing directory separators in the Oracle directory object, the read operation might fail.
DBMI-11880
If you Abort a running database ingestion and replication initial load job for which partitioning is enabled, the job does not end immediately. Abort execution is delayed.

April 2024 fixed issues

Issue
Description
DBMI-16940
Database ingestion and replication incremental load jobs that have a Db2 for z/OS source and Snowflake target might fail repeatedly with the following error:
CDCPUB_10066] TRACE: [PwxCDCReaderRunHandler encountered error :Previous sequence <previous_sequence_numer> is not less than current sequence <current_sequence_number>. Caused by: Previous sequence <sequence_number> is not less than current sequence.
DBMI-16392
A database ingestion and replication job that has a Databricks Delta target might fail if the source table contains NULL values in a Timestamp column. The problem occurs when the Databricks Delta ANSI_MODE configuration parameter is set to TRUE and the job tries to use the Databricks Delta MERGE statement with the COALESCE function to process NULL values for the column.
DBMI-16382
During periods of no DML activity, database ingestion and replication combined initial and incremental load jobs that have a Db2 for i source might hang with subtasks in the Queued state during the initial load phase. The job log contains the following types of messages:
[CDC_COMBINED Transition Scheduler Helper(264)] INFO com.informatica.msglogger - [DBMIP_23019] The process [CDC_COMBINED] with the thread ID [264] is waiting for in-flight data from a previous run to complete. Minutes waited [17].
[CDC_COMBINED Transition Scheduler Helper(264)] INFO com.informatica.msglogger - [DBMIP_23020] Thread [264] [PUBLISHED] transition event [SCHEDULER_REQUEST_INFLIGHT_DATA_MARKER]. Details: [, time=1708074372616].
DBMI-16290
Database ingestion and replication combined initial and incremental load jobs that have an Oracle source and Snowflake target and schema drift enabled might fail it you increase the precision of a column, for example, from VARCHAR(16) to VARCHAR(20). The problem occurs if you use code page CP1252 at task deployment time, but this character set is unavailable at runtime. At runtime, the job will use the UTF-8 code page, which causes the precision to be reduced and the following exception:
[Thread-156177] LEVEL_1 trace - Exception handled: 'SQL compilation error: cannot change column <column_name> from type VARCHAR(20) to VARCHAR(16) because reducing the byte-length of a varchar is not supported. With error code 40050
DBMI-16277
A means to override the code page used with a coded character set identifier (CCSID) encoding is not available. With this fix, you can use the pwx.cdcreader.iseries.option.CCSID2CodePageOverrides (ccsid,code_page) custom property to specify an override code page for a given CCSID at the Db2 for i table level. For more information, contact Informatica Global Customer Support.
DBMI-16257
Database ingestion and replication jobs that have Db2 for i sources cannot retry queries for getting the journal receiver list from Db2 for certain SQL error codes, such as:
[CDCPUB_10066] TRACE: [IBMiClient setErrorCondition() called. Error<IBMiMetadataManager getSchemas(), Exception JDBCapi ExecuteSQL(), -443 58004 [informatica][DB2 JDBC Driver][DB2]An error occurred executing function or procedure QSYS.QDBSSUDF2 with the following parameters: (SYSTEM ERROR CONDITION 2). Refer to the joblog for more information regarding the detected error.SQL Command: ...
With this fix, you can use the pwx.cdcreader.iseries.option.useNewLogCollector=true and pwx.cdcreader.iseries.option.useJournalReceiverQueries= true custom properties with the pwx.cdcreader.iseries.option.ConnectionRetryCodes, pwx.cdcreader.iseries.option.journalReceiverRetries, and pwx.cdcreader.iseries.option.journalReceiverInterval custom properties to enable retry attempts when encountering SQL errors during journal receiver queries. For more information, contact Informatica Global Customer Support.
DBMI-16199
The pwx.cdcreader.ZOS.ConnectionRetryCodes custom property should accept negative error codes such as -443.
DBMI-16188
Database ingestion and replication incremental load jobs that replicate data from an Oracle 19c source with LOB columns and with non-LOB columns defined with the NOT NULL DEFAULT constraint might fail with following message when processing some Insert operations:
PWX-36200 ORAD: Column conversion error: [36202] NULL value found for column that is not nullable for Table name=<table_name>, column[<number>] segment[<number>] ADULT_INDICATOR. Detail Type = VARCHAR, Oracle Type = CHAR.
DBMI-16186
When database ingestion and replication jobs query Db2 for i source journal receivers, the jobs might fail with SQLCODE -443 if the SQL query is created with an invalid sequence number.
DBMI-16185
When you run a database ingestion and replication job that has a Db2 for z/OS source, the Db2 for z/OS log parser might not detect a failure in schema drift parsing, causing the job to continue to run without capturing any data.
DBMI-16184
Database ingestion and replication incremental load jobs that have an Oracle source with some LOB columns might fail with the following message when trying to process some Update operations:
PWX-36045 ORAD WarnOPASM: OP:26.1 unexpected unexpected operation type found at offset <bytes>. pKDLI->GetOp()= 2, length= <bytes> [PwxOrlCmnCV:2643] at redo log position SCN <scn> RBA <rba> (file: <number>).
The problem occurs if Oracle generates a bad redo record for the Update.
DBMI-16049
After you save a database ingestion and replication task that has Oracle or SQL Server source tables that are selected based on rules, some with a subset of selected columns, if you then add or remove selected columns for some tables and click the Refresh icon, the Table View count of source tables and the column selection for some tables are incorrect.
DBMI-16014
Database ingestion and replication incremental load jobs that have an on-premises SQL Server source and an Azure SQL Database target incorrectly replicate Update operations to the target when multiple Updates occur in a transaction for the same column using the same primary key.
DBMI-16013
Database ingestion and replication jobs that have a Kafka target might log sensitive information, such as a password, in clear text in the job log if it was entered in the Additional Connection Properties field of the connection properties.
DBMI-15796
Database ingestion and replication jobs that have source columns with the FLOAT data type and precision greater than 32 and that use the Parquet output format do not convert the source FLOAT columns to target data types consistently across all load types. Initial load jobs generate target FLOAT columns, whereas incremental load and combined load jobs generate target DOUBLE columns. Now, jobs of all load types generate target DOUBLE columns.

February 2024 fixed issues

Issue
Description
DBMI-16104
A database ingestion and replication job that has a SQL Server source and uses the query-based CDC method might incorrectly replicate INTEGER data with the value of NULL to the target as 0 and replicate BIT data with the value of NULL as FALSE.
DBMI-15903
A database ingestion and replication job that has a Db2 for i source might not capture any change data after a journal reset in new log collection mode.
DBMI-15842
When you create a new database ingestion and replication task that has an Oracle source or update an existing task, the following error might be issued when you click Apply Rules:
Cannot retrieve the list of objects. HTTP response status code is 500, Duplicate key
DBMI-15714
A database ingestion and replication job that has a SQL Server source and partitioning enabled might fail if you use Windows authentication to connect to SQL Server.
DBMI-15552
A database ingestion and replication incremental load or combined load job that has an Oracle or SQL Server source and schema drift enabled might fail with one of the following errors, instead of issuing a schema drift alert, if you select additional source columns and redeploy the job after the job has run:
A source table schema change should stop the table. Added column found :column_name conflicts with the previously ignored drop of column <same_column_name>.
A change to the source definition of table [schema.table] was encountered. The table is configured to fail. The target will no longer receive data or this table. Change description(s): [Added column found :column_name conflicts with previously ignored drop of column <same_column_name>].
DBMI-15527
Database ingestion and replication incremental load jobs that have a SAP HANA source might hang while waiting for incoming change data, although the data is present in the source tables. The job continues to run without reporting any errors.
DBMI-15494
On the Source page of the database ingestion and replication task wizard, the Table View shows only previously selected columns for a table, instead of all selected and unselected columns, if you filtered for that table in the table view after the task was in the Deployed, Completed, or Up and Running state.
DBMI-15373
If you select the Superpipe option for a database ingestion and replication job that has a SQL Server source and a Snowflake Data Cloud target and if a source column has the DATETIMEOFFSET data type, the job fails with the following error when trying to write data for that source column to a TIMESTAMP column on the target:
java.lang.RuntimeException: net.snowflake.ingest.utils.SFException: The given row cannot be converted to the internal format due to invalid value: Value cannot be ingested into Snowflake column "column_name" of type TIMESTAMP, Row Index: 0, reason: Not a valid value,...
DBMI-15321
A database ingestion and replication job that a SQL Server source and uses the query-based CDC method might fail to load the source tables if you select Windows Authentication v2 as the Authentication Mode in the SQL Server connection properties.
DBMI-14797
A database ingestion and replication task might fail with a SQL compilation error if Database Ingestion and Replication detects a Drop Column request for a column that was previously removed.
DBMI-13202
Database ingestion and replication combined initial and incremental load jobs that have an Oracle source with a VARCHAR2 column and an Oracle target fail when incremental change data processing starts. The failure occurs because of the following unique constraint error:
Exception handled: [informatica][Oracle JDBC Driver][Oracle]ORA-00001: unique constraint <constraint> violated\n'. With error code 1