Data Ingestion and Replication Release Notes > Database Ingestion and Replication > Connector and connectivity issues
  

Connector and connectivity issues

Read the following pages to learn about fixed issues, known limitations, and third-party limitations that apply to connectors that you can use in your service. Consider the following guidelines for the release notes:

Amazon S3 V2 Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23004
Database ingestion and replication combined load jobs that have an Amazon S3 target and use the Avro or Parquet format for output files might encounter the following error during backlog processing if the unload phase of the job runs on a Secure Agent different from the one that the job runs on:
Internal logic error - CacheFactory for internal DBMI task is not expected. com.infa.rat.dbmi.reader.impl.BacklogTaskSetupException: BacklogTaskMainThread Failed to configure its BacklogTask
Also, in the monitoring job details, the Stage value reported for some source tables might remain at Unloaded rather than progress.
(April 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-11732
If database ingestion and replication incremental load or combined initial and incremental load jobs replicate LOB source data to an Amazon S3 target and use the CSV format for the target output file, the LOB data appears as empty strings in the target file.
(November 2022)
DBMI-2297
Although the Amazon S3 connection properties allow users to specify an IAM role, you cannot use temporary security credentials generated by the AssumeRole method of the AWS Security Token Service API to authorize user access to AWS Amazon S3 resources.
(April 2020)

Databricks Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-21764
Database ingestion and replication jobs that have a Databricks target might replicate NULLs for columns that have LOB data types.
(February 2025)

Db2 for i Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23703
If database ingestion and replication jobs read data from a Db2 for i source physical file that’s defined in DDS with a unique index but no primary key, the unique index won’t be used when generating the corresponding target object. After this fix, if no primary key is available, unique indexes are fetched from the SYSPARTITIONINDEXES view and used to update the schema used for target generation.
(May 2025)
DBMI-23291
For database ingestion and replication jobs that have a Db2 for i source, restart advance might not occur.
(May 2025)
DBMI-23209, DBMI-23014
When a CDC Staging Task has multiple member jobs that process Db2 for i sources writing data to the same journal receiver and a job adds tables from a different schema, the CDC Staging Task stops collecting change data for the added tables with the following error message:
[IBMiLogCollector failed creating SQL IBMiLogCollector createLogSQLStatement(), retry exception, Index 4 out of bounds for length 4 Condition is retryable.]
(April 2025)
DBMI-22959
The ability to limit the journal receivers printed to the journal receivers list in the job log is needed when you do not want to print all entries every time the statistics are printed. Limiting the entries can reduce the log size and I/O.
(April 2025)
DBMI-22956
The default settings of several internal custom parameters need to be optimized to enhance the performance of database ingestion and replication jobs with Db2 for i sources and reduce their CPU usage.
(April 2025)
DBMI-21956
When you run a database ingestion and replication task with a Db2 for i source as part of the CDC Staging task, the trace messages for custom trace settings might not be found in the task log.
(April 2025)
DBMI-21990
Database ingestion and replication combined initial and incremental load jobs that have a Db2 for i source might fail during merge apply processing of change data if the source has a large number of journal receivers with frequent log sequence resets. In this case, the job log volume increases and consumes too much space.
(February 2025)
DBMI-21957
Database ingestion and replication incremental load and combined load jobs that have a Db2 for i source might encounter the following error if a log sequence reset occurs on every journal receiver switch and if the first log record timestamp on a reset journal receiver contains subseconds shorter than 23 bytes when timestamp- or position-based restart is used.
[CDCPUB_10066] TRACE: [IBMiClient setErrorCondition() called. Error<IBMiUOWManager Log sequence reset/switch error, String index out of range: 23>].
(February 2025)
DBMI-21838
Database ingestion and replication incremental load and combined load jobs that have a Db2 for i source fail if you set the Initial Start Point for Incremental Load option to Position or Specific Date and Time.
(February 2025)
DBMI-21720
Database ingestion and replication incremental load or combined load jobs that have a Db2 for i source fail with the following error if the source schema and journal are in different libraries:
[DBMIP_23002] The process [CDC-CP1AZ PWX Reader] with the thread ID [31599] received an unexpected error from the PowerExchange Capture Service. Error: [IBMiMetadataManager getTableList(), Table Schema <schema_name> or Table System Schema <schema_name> does not match Journal Schema name <jrn_schema>].
(February 2025)
DBMI-21531
Database ingestion and replication incremental load or combined load jobs might hang during periods with no change activity of interest if a premature end-of-log (EOL) is detected and the journal receiver is in the SAVED or ONLINE state. The following message is issued:
[logCollector] LEVEL_1 trace - IBMiLogCollector newEndOfLogChecks(), EOL check, ending log sequence returned <sequence> is less than current EOL sequence <current_sequence>, will continue log read at log sequence returned.
(February 2025)
DBMI-21436
For database ingestion and replication jobs that have a Db2 for i source, the ability to read sequences backward up to a maximum number of records is needed in some situations.
(April 2025)
DBMI-19816
Database ingestion and replication incremental load or combined load jobs that have a Db2 for i source might fail with the following error if the log collector misses a record in a cached journal receiver while reading to EOL and then tries to find the record by reading backwards in the log:
[CDCPUB_10066] TRACE: [IBMiClient setErrorCondition() called. Error did not return a log record. Queue contains <0> rows after attempting to retry 11 times.>].
(February 2025)
DBMI-19056
If database ingestion and replication incremental load or combined load jobs that have a Db2 for i source request the End of Log (EOL) sequence when caching is enabled on the journal, the last record can’t be retrieved. Retries are attempted but are not successful.
(April 2025)

Db2 for z/OS Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23101
If a database ingestion and replication job that has a Db2 for z/OS source tries to issue a request for source information such as the end of log when it’s not connected to Db2, the job fails. The job might become disconnected from Db2 during log collector slowdown processing, if enabled with the pwx.cdcreader.ZOS.LogCollectorSlowDown custom property.
(April 2025)
DBMI-20992
If requests to Resync multiple Db2 for z/OS source objects in the same database ingestion and replication combined load task are made at the same time, the Resync might be ignored for some of the source objects.
(April 2025)
DBMI-20084
Database ingestion incremental load jobs that have a Db2 for z/OS source might fail with the following error during CDC reader processing, even after the jobs are stopped and then resumed:
[CDCPUB_10066] TRACE: [PwxCDCReaderRunHandler encountered error :Previous sequence <sequence1> is not less than current sequence <sequence2>.
(February 2025)
DBMI-16129
When you create a database ingestion and replication incremental load task that has a Db2 for z/OS source in the new task configuration wizard, if you add a table selection rule that excludes all tables, the associated job might fail with the a misleading message that reports DATA CAPTURE CHANGES is not enabled on the excluded tables.
(Februrary 2025)

Google BigQuery V2 Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-19760
Database ingestion and replication initial load jobs that have an Oracle source and a Google BigQuery target might fail intermittently with the following error:
uploadLocalFile has been failed because of error: Remote host terminated the handshake.
(April 2025)

Google Cloud Storage V2 Connector

Known issues

The following table describes known issues:
Issue
Description
DBMI-11732
If database ingestion and replication incremental load or combined initial and incremental load jobs replicate LOB source data to a Google Cloud Storage target and use the CSV format for the target output file, the LOB data appears as empty strings in the target file.
(November 2022)

Microsoft Azure Data Lake Storage Gen2 Connector

Known issues

The following table describes known issues:
Issue
Description
DBMI-11732
If Database ingestion and replication incremental load or combined initial and incremental load jobs replicate LOB source data to a Microsoft Azure Data Lake Storage Gen2 target and use the CSV format for the target output file, the LOB data appears as empty strings in the target file.
(November 2022)

Microsoft SQL Server Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-24657
For database ingestion and replication incremental load or combined load jobs that have a SQL Server source, if an Update operation writes a non-null value of more than 100 characters to a source TEXT column, that data is truncated in the corresponding SQL Server target table. However, the target log tables contain the full, non-truncated data value.
(July 2025)
DBMI-24544
After database ingestion and replication combined jobs that have a SQL Server source and Oracle target run using Audit apply mode, if you add a source column and then perform a Resync (refresh) operation, the job fails. The problem occurs because the Add Column schema drift operation adds the column at the end of the target table. However, the Resync (refresh) operation causes the added column to appear before the audit columns in the source schema. This discrepancy leads to a mismatch in order of target columns and data received.
(July 2025)
DBMI-24125
Database ingestion and replication incremental load or combined load jobs that have a SQL Server source and use the Log-based CDC method might incorrectly process an update not involving the primary key as a pair of delete and insert operations that have the same sequence value. After restarting the job, the insert operation might have a different sequence value. This discrepancy occurs because the restart temporarily switches to CDC Tables mode, which doesn’t handle the update in the same manner as Log-based mode.
(May 2025)
DBMI-23957
Database ingestion and replication jobs that have a Microsoft SQL Server source and process an update in a primary key and a non-primary key column in a single transaction might produce an incorrect timestamp in the DATETIME column on the Microsoft SQL Server target.
(May 2025)
DBMI-23610
Database ingestion and replication jobs that have a Microsoft SQL Server source might fail to read the CDC capture instance tables because of a deadlock error.
(May 2025)
DBMI-23467
A database ingestion and replication job that has a Microsoft SQL Server source and is configured to pause between reconnection attempts might retry the connection to the database without waiting for the requested delay.
(May 2025)
DBMI-23377
For database ingestion and replication incremental load or combined load jobs that have a Microsoft SQL Server source, the SQL query that reads the CDC capture instance tables fails if a source table contains a column with the same name as a column found in the cdc.lsn_time_mapping table.
(April 2025)
DBMI-21747
After the November 2024 upgrade, database ingestion and replication incremental load jobs that have a Microsoft SQL Server source and use the CDC Tables capture method might fail because of a memory leak in the pwxodbc library. In this case, Windows Event Viewer reports a low virtual memory condition.
(February 2025)

Oracle Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-24820
Database ingestion and replication combined load jobs that have an Oracle source and Oracle target might fail with the following error when processing an Update operation if incorrect merge apply logic result in attempts to insert duplicate records to the target:
ORA-00001: unique constraint violated
(July 2025)
DBMI-24786
Database ingestion and replication incremental load jobs that have an Oracle source and Oracle target might fail with the following error because of incorrect merge apply processing:
ORA-30926: unable to get a stable set of rows in the source tables. Error code: 30926.
(July 2025)
DBMI-24710
Database ingestion and replication jobs that have an Oracle source with compressed SECUREFILE LOB columns can write incorrect data to the target.
(July 2025)
DBMI-24562
Database ingestion and replication incremental load jobs fail with the following error when an Oracle database session that is updating tables with LOB columns is killed and an unknown type of backout operation occurs:
PWX-36046 ORAD Mbr 2: Log parser found unexpected error. non-KDO_XTYPE_XR pCVRedo for DML Rollback [PwxOrlRrpRedoEntryParser:1962].
(July 2025)
DBMI-23704
After a switch to Daylight Saving Time (DST), running database ingestion and replication jobs that have an Oracle source do not detect the time zone offset change on the database server and consequently display capture progress messages that report an incorrect capture time.
(July 2025)
DBMI-24183
After the April 2025 release, database ingestion and replication initial load jobs with Oracle sources might fail with the following ODBC driver error:
*Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.SecurityException: sealing violation: package oracle.jdbc is sealed [in thread* "CDC-UNLOAD-CNS_CUST.CIS_OE_ORDER_HEADERS_DTLS Object Distributor (632)"]
The problem occurs because the February 2025 release required the odbc8.jar file to be in the <Secure Agent >/apps/Database_Ingestion/ext directory. However, in the April 2025 release, the driver isn’t expected at that location. To prevent the error, the driver has been removed from the ext directory.
(May 2025)
DBMI-24177
Database ingestion and replication jobs that have an Oracle source might produce single-digit values in some fields on the target, whereas the corresponding source fields contain multiple digits. This discrepancy is caused by an internal error, which results in random truncation of character strings.
(May 2025)
DBMI-24059
After the April 2025 release, database ingestion and replication incremental load or combined load jobs that have an Oracle source without a primary key and a Snowflake target write duplicate rows to the target when processing an Update operation.
(May 2025)
DBMI-24113
A database ingestion and replication job that has an Oracle source running on AIX, HP-UX, or Solaris platforms might fail to convert LOB data that was set as NULL on updates to Endian data formats.
(May 2025)
DBMI-23758
If database ingestion and replication initial load jobs that have an Oracle source with XMLTYPE columns use the Oracle JDBC Thin driver, as configured in the Oracle Database Ingestion connection, the jobs might write nulls to the target.
(July 2025)
DBMI-23727
A database ingestion and replication incremental load or combined load job that has an Oracle source might fail with the following message:
PWX-36196 ORAD: No logs with Start SCN 5944410182514 and resetlogs Id 855675717 are available for THREAD# 1.
(May 2025)
DBMI-23611
Database ingestion and replication incremental load or combined load jobs that have an Oracle source fail if they can’t parse redo log records that don’t have a transaction ID (XID) when processing DML changes.
(May 2025)
DBMI-23299
Database ingestion and replication incremental load and combined load jobs with Oracle sources use the Oracle V$TRANSACTION view to check for open transactions. However, this view provides results for one active RAC node, not all RAC nodes in the cluster. The global GV$TRANSACTION view should be used instead.
(May 2025)
DBMI-23003
Database ingestion and replication incremental load jobs that have an Oracle source with a NOT NULL LOB column might fail with the following error after a DML delete operation:
PWX-36200 ORAD: Column conversion error: [36202] NULL value found for column that is not nullable for Table name=<table_name>, column[n] segment[n] DATA. Detail Type = CLOB, Oracle Type = CLOB.
(April 2025)
DBMI-22984
If database ingestion and replication combined load jobs that have an Oracle source and use the ARCHIVEONLY reader mode encounter a long-running open transaction with a begin SCN that is older than the archive log start position, data loss might occur.
(July 2025)
DBMI-22981
Database ingestion and replication jobs that have an Oracle source in an Oracle Data Guard environment fail if the primary database is in an Oracle Real Application Cluster (RAC) and the RAC Members value set in the Oracle Database Ingestion connection properties is not valid. No error message describing the problem is issued.
(April 2025)
DBMI-22978
Database ingestion and replication incremental load or combined load tasks that have an Oracle source might stop capturing change data with the following internal error message:
PWX-36000 ORAD Mbr 1: Internal error SetDPLParentPseudoTxn() DPL invalid state. Expected PARENT:INITIAL Received PARENT:PARENT_PSEUDO_BEGINfor Object id 0 in module PwxOrlTMgrUow:529.
(April 2025)
DBMI-22685
A database ingestion combined load job that has an Oracle source and uses the query-based CDC method might fail if you do not have the EXECUTE ON DBMS_FLASHBACK permission.
(July 2025)
DBMI-22385
Database ingestion and replication incremental load jobs that have an Oracle source with CLOB columns replicate some special characters to the target, instead of CLOB data, when the NLS_CHARACTERSET parameter is set to a specific code page such as WE8MSWIN1252.
(April 2025)
DBMI-22213
Database ingestion and replication jobs that have an Oracle source might end with the following error if an internal race condition exists between two threads, where one thread is trying to re-create a schema cache object while the main thread is stopping the task:
[CDCPUB_10066] TRACE: [Internal logic error. schemaCache.schemaExists() threw unexpected checking for schema with ID <number>].
A schema cache isn't required when the task is shutting down.
(April 2025)
DBMI-22052
If a database ingestion and replication job that has an Oracle source on Linux encounters a Log Write Number (LWN) for a group of redo blocks that is larger than the read buffer, the job might fail with an error such as:
[CDCPUB_10066] TRACE: [Error message[1] PWX-36564 ORAD: LRdr for member n has been unresponsive for more than the timeout threshold of 600. Last response time was <date><time>.
(April 2025)
DBMI-21661
A database ingestion and replication incremental or combined initial and incremental load job that has an Oracle source might fail if you use table selection rules and the number of rules defined is greater than 100.
(February 2025)
DBMI-20142
When the source custom property transitionSchedulerType is set to CDC_WITH_BACKLOG, the EXECUTE ON DBMS_FLASHBACK privilege should not be required for combined load jobs with Oracle sources. Any change data that accumulates in the backlog queue is applied by using fuzzy logic instead of a FLASHBACK query that uses a SELECT AS OF scn statement. However, deployment of the task fails with an error stating the FLASHBACK privilege is required.
(May 2025)
DBMI-19760
Database ingestion and replication initial load jobs that have an Oracle source and a Google BigQuery target might fail intermittently with the following error:
uploadLocalFile has been failed because of error: Remote host terminated the handshake.
(April 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-24444
For database ingestion and replication tasks that have an Oracle source and use the Audit apply mode, LOB data might not be correctly replicated to the target. When a non-LOB data is updated, the remaining columns are replicated as NULLs.
Workaround: None.
(May 2025)
DBMI-23360
Database ingestion and replication incremental load or combined load jobs that have an Oracle source with XML columns and an Oracle target might fail with the following Oracle error when processing a DML operation:
[Oracle JDBC Driver][Oracle]ORA-00932: inconsistent datatypes: expected - got CLOB. Error code: 932
Workaround: None.
(April 2025)
DBMI-23048
If you configure an Oracle Database Ingestion connection to use both the Oracle JDBC Thin driver and SSL encription, when you try to test the connection, the test fails.
Workaround: Do not use the JDBC Thin driver with SSL encryption.
(April 2025)
DBMI-19145
Database ingestion and replication jobs that use the Log-based CDC method and have an Oracle source with only LOB columns selected and no primary key do not create subtasks on the tables. As a result, the jobs cannot capture change data from the tables. Messages such as the following are written to the log:
[DBMIP_23026] The process [CDC-LOBS] with the thread ID [9708] encountered new table [lob_table_name]. The new table is excluded from processing.
[CDCPUB_10066] TRACE: [PwxCDCRequestProcessor.askSchema() returned: Don't capture.].
Workaround: In the task, select some non-LOB source columns, in addition to the LOB columns, for replication if you want to continue using the table without a primary key.
(July 2024)
DBMI-14767
If a database ingestion and replication job uses an Oracle Database Ingetion source connection that's configured to use the Oracle JDBC Thin driver, the job can replicate up to 39 digits from source columns that have a numeric data type to the target. If a source numeric value has 40 or more digits, the fortieth digit and all additional digits are replaced by zeroes (0) on the target.
Workaround: None.
(September 2023)
DBMI-13605
The Oracle Database Ingestion connection properties page includes no property for entering JDBC connection properties, such as EncryptionLevel, when they're needed.
Workaround: In the Service Name field, you can add JDBC connection properties after the Oracle SID value, using a semicolon (;) as the separator.
(April 2023)
DBMI-10794
Oracle source columns with the TIMESTAMP WITH TIME ZONE data type are supported only for initial load jobs.
Workaround: To enable database ingestion and replication incremental load and combined load jobs to process change data from TIMESTAMP WITH TIME ZONE columns, set the source custom property pwx.cdcreader.oracle.option.additional ENABLETIMSTAMPWITHTZ to Y.
(July 2022)

PostgreSQL Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23490
An internal capture query to retrieve WAL information failed when called from a hot-standby replica. Capture processing that runs against a replica now uses pg_last_wal_replay_lsn() rather than pg_current_wal_lsn().
(April 2025)

SAP HANA Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-21419
For a database ingestion and replication job that has an SAP HANA source and uses the Superpipe option to stream data to a Snowflake target, the Snowflake stream might become stale and data might not be accessible if the source tables are updated very rarely, for example on a quarterly or yearly basis.
(April 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-24971
If a CDC Staging Task is running with associated apply jobs to perform SAP HANA Log-based CDC and a schema drift DDL change occurs on a source table, the schema drift change is ignored with a warning. The apply job that processes the table might fail with the following error, even if the job is restarted:
[DBMIP_23002] The process [CDC-CDC_STAGING InputEndpoint Helper] with the thread ID [HanaLogCollector pwxHanaCDCApi.readNextData() failure. null] received an unexpected error from the PowerExchange Capture Service. Error:

Caused by: java.nio.BufferUnderflowException
Workaround: None.
(July 2025)

Snowflake Data Cloud Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-24531
Database ingestion and replication combined load jobs that have a Snowflake target fail with the following error if some Snowflake tables that were previously included in the job are removed:
[CDCPUB_10066] TRACE: [Error occurred while creating the channel. Exception: java.lang.UnsupportedOperationException: net.snowflake.ingest.utils.SFException: Open channel request failed: HTTP Status: 400 ErrorBody:{ "status_code" : 4, "message" : "The supplied table does not exist or is not authorized." }
The problem occurs because the job still tries to initialize streaming channels and fetch metadata for the removed tables in Snowflake.
(July 2025)
DBMI-24059
After the April 2025 release, database ingestion and replication incremental load or combined load jobs that have an Oracle source without a primary key and a Snowflake target write duplicate rows to the target when processing an Update operation.
(May 2025)
DBMI-21892
For a database ingestion and replication combined load job that has a Snowflake target and uses the Superpipe option, the monitoring interface might report an Unload Count value under Object Detail that does not match the number of records read during the initial load phase, as reported in the unload log. This mismatch occurs if the transitionSchedulerType source custom property is set to CDC_WITH_BACKLOG, source partitioning is enabled, and the source tables contain over 2 billion records.
(February 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-25090
After the May 2025 release, database ingestion and replication jobs that have a Snowflake Data Cloud target and use Authorization Code authorization might fail with the following error when the access token that's generated from user interface expires:
:caused by: net.snowflake.client.jdbc.SnowflakeSQLLoggedException: JDBC driver internal error: Unsupported authenticator type: OAUTH
The error occurs because of the JDBC driver upgrade in the May release.
Workaround: None.
(July 2025)

Teradata Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23323
When configuring a database ingestion and replication job that has a Teradata source, if you attempt to fetch the entire schema either by applying rules or downloading include or exclude rules, an error might occur if any views have inaccessible definitions.
(May 2025)