Data Ingestion and Replication Release Notes > Database Ingestion and Replication > Connector and connectivity issues
  

Connector and connectivity issues

Read the following pages to learn about fixed issues, known limitations, and third-party limitations that apply to connectors that you can use in your service. Consider the following guidelines for the release notes:

Amazon S3 V2 Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23004
Database ingestion and replication combined load jobs that have an Amazon S3 target and use the Avro or Parquet format for output files might encounter the following error during backlog processing if the unload phase of the job runs on a Secure Agent different from the one that the job runs on:
Internal logic error - CacheFactory for internal DBMI task is not expected. com.infa.rat.dbmi.reader.impl.BacklogTaskSetupException: BacklogTaskMainThread Failed to configure its BacklogTask
Also, in the monitoring job details, the Stage value reported for some source tables might remain at Unloaded rather than progress.
(April 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-11732
If database ingestion and replication incremental load or combined initial and incremental load jobs replicate LOB source data to an Amazon S3 target and use the CSV format for the target output file, the LOB data appears as empty strings in the target file.
(November 2022)
DBMI-2297
Although the Amazon S3 connection properties allow users to specify an IAM role, you cannot use temporary security credentials generated by the AssumeRole method of the AWS Security Token Service API to authorize user access to AWS Amazon S3 resources.
(April 2020)

Databricks Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-21764
Database ingestion and replication jobs that have a Databricks target might replicate NULLs for columns that have LOB data types.
(February 2025)

Db2 for i Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23209, DBMI-23014
When a CDC Staging Task has multiple member jobs that process Db2 for i sources writing data to the same journal receiver and a job adds tables from a different schema, the CDC Staging Task stops collecting change data for the added tables with the following error message:
[IBMiLogCollector failed creating SQL IBMiLogCollector createLogSQLStatement(), retry exception, Index 4 out of bounds for length 4 Condition is retryable.]
(April 2025)
DBMI-22959
The ability to limit the journal receivers printed to the journal receivers list in the job log is needed when you do not want to print all entries every time the statistics are printed. Limiting the entries can reduce the log size and I/O.
(April 2025)
DBMI-22956
The default settings of several internal custom parameters need to be optimized to enhance the performance of database ingestion and replication jobs with Db2 for i sources and reduce their CPU usage.
(April 2025)
DBMI-21956
When you run a database ingestion and replication task with a Db2 for i source as part of the CDC Staging task, the trace messages for custom trace settings might not be found in the task log.
(April 2025)
DBMI-21990
Database ingestion and replication combined initial and incremental load jobs that have a Db2 for i source might fail during merge apply processing of change data if the source has a large number of journal receivers with frequent log sequence resets. In this case, the job log volume increases and consumes too much space.
(February 2025)
DBMI-21957
Database ingestion and replication incremental load and combined load jobs that have a Db2 for i source might encounter the following error if a log sequence reset occurs on every journal receiver switch and if the first log record timestamp on a reset journal receiver contains subseconds shorter than 23 bytes when timestamp- or position-based restart is used.
[CDCPUB_10066] TRACE: [IBMiClient setErrorCondition() called. Error<IBMiUOWManager Log sequence reset/switch error, String index out of range: 23>].
(February 2025)
DBMI-21838
Database ingestion and replication incremental load and combined load jobs that have a Db2 for i source fail if you set the Initial Start Point for Incremental Load option to Position or Specific Date and Time.
(February 2025)
DBMI-21720
Database ingestion and replication incremental load or combined load jobs that have a Db2 for i source fail with the following error if the source schema and journal are in different libraries:
[DBMIP_23002] The process [CDC-CP1AZ PWX Reader] with the thread ID [31599] received an unexpected error from the PowerExchange Capture Service. Error: [IBMiMetadataManager getTableList(), Table Schema <schema_name> or Table System Schema <schema_name> does not match Journal Schema name <jrn_schema>].
(February 2025)
DBMI-21531
Database ingestion and replication incremental load or combined load jobs might hang during periods with no change activity of interest if a premature end-of-log (EOL) is detected and the journal receiver is in the SAVED or ONLINE state. The following message is issued:
[logCollector] LEVEL_1 trace - IBMiLogCollector newEndOfLogChecks(), EOL check, ending log sequence returned <sequence> is less than current EOL sequence <current_sequence>, will continue log read at log sequence returned.
(February 2025)
DBMI-21436
For database ingestion and replication jobs that have a Db2 for i source, the ability to read sequences backward up to a maximum number of records is needed in some situations.
(April 2025)
DBMI-20755
Database ingestion and replication incremental load or combined initial and incremental load jobs that have a Db2 for i source might fail when retrying a connection for a SQL GetLogMinMax request:
[CDCPUB_10066] TRACE: [IBMiLogCollector connectionRetryChecksAndWait(), Attempts <1> from caller Info error state <58004>>].
(November 2024)
DBMI-20754
Database ingestion and replication incremental load jobs that have a Db2 for i source with version of 7.3 or earlier might intermittently fail with the following error due to a code fix in the October release:
[CDCPUB_10066] TRACE: [IBMiClient System Version <V7R3M000> does not support IBM Internal Log Reads ]
(November 2024)
DBMI-20427
When you create a database ingestion and replication task that has a Db2 for i source in the new task configuration wizard, if you add a table selection rule that excludes all tables, the associated job still fetches the metadata for the excluded tables, which degrades job performance.
(November 2024)
DBMI-19816
Database ingestion and replication incremental load or combined load jobs that have a Db2 for i source might fail with the following error if the log collector misses a record in a cached journal receiver while reading to EOL and then tries to find the record by reading backwards in the log:
[CDCPUB_10066] TRACE: [IBMiClient setErrorCondition() called. Error did not return a log record. Queue contains <0> rows after attempting to retry 11 times.>].
(February 2025)
DBMI-19056
If database ingestion and replication incremental load or combined load jobs that have a Db2 for i source request the End of Log (EOL) sequence when caching is enabled on the journal, the last record can’t be retrieved. Retries are attempted but are not successful.
(April 2025)

Db2 for z/OS Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23101
If a database ingestion and replication job that has a Db2 for z/OS source tries to issue a request for source information such as the end of log when it’s not connected to Db2, the job fails. The job might become disconnected from Db2 during log collector slowdown processing, if enabled with the pwx.cdcreader.ZOS.LogCollectorSlowDown custom property.
(April 2025)
DBMI-20992
If requests to Resync multiple Db2 for z/OS source objects in the same database ingestion and replication combined load task are made at the same time, the Resync might be ignored for some of the source objects.
(April 2025)
DBMI-20985
Database ingestion and replication incremental load or combined initial and incremental load jobs that have a Db2 for z/OS source might fail with a log parser error like the following one because of incorrect sequence token checking:
Caused by: com.infa.rat.pwxdbmi.pwxcdc.intf.CDCReaderException: zosLogParser run(), Error - zosLogParser processLogRecord(), Sequence number error for data sharing environment, 1536 Current Sequence VRS <002> HCSeq UOWSeq LogSeq <00DFB54159EB15B0A800> Last Sequence VRS <002> HCSeq UOWSeq LogSeq
You can Resume the job successfully.
(November 2024)
DBMI-20084
Database ingestion incremental load jobs that have a Db2 for z/OS source might fail with the following error during CDC reader processing, even after the jobs are stopped and then resumed:
[CDCPUB_10066] TRACE: [PwxCDCReaderRunHandler encountered error :Previous sequence <sequence1> is not less than current sequence <sequence2>.
(February 2025)
DBMI-16129
When you create a database ingestion and replication incremental load task that has a Db2 for z/OS source in the new task configuration wizard, if you add a table selection rule that excludes all tables, the associated job might fail with the a misleading message that reports DATA CAPTURE CHANGES is not enabled on the excluded tables.
(Februrary 2025)

Google BigQuery V2 Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-19760
Database ingestion and replication initial load jobs that have an Oracle source and a Google BigQuery target might fail intermittently with the following error:
uploadLocalFile has been failed because of error: Remote host terminated the handshake.
(April 2025)

Google Cloud Storage V2 Connector

Known issues

The following table describes known issues:
Issue
Description
DBMI-11732
If database ingestion and replication incremental load or combined initial and incremental load jobs replicate LOB source data to a Google Cloud Storage target and use the CSV format for the target output file, the LOB data appears as empty strings in the target file.
(November 2022)

Microsoft Azure Data Lake Storage Gen2 Connector

Known issues

The following table describes known issues:
Issue
Description
DBMI-11732
If Database ingestion and replication incremental load or combined initial and incremental load jobs replicate LOB source data to a Microsoft Azure Data Lake Storage Gen2 target and use the CSV format for the target output file, the LOB data appears as empty strings in the target file.
(November 2022)

Microsoft SQL Server Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23377
For database ingestion and replication incremental load or combined load jobs that have a SQL Server source, the SQL query that reads the CDC capture instance tables fails if a source table contains a column with the same name as a column found in the cdc.lsn_time_mapping table.
(April 2025)
DBMI-21747
After the November 2024 upgrade, database ingestion and replication incremental load jobs that have a SQL Server source and use the CDC Tables capture method might fail because of a memory leak in the pwxodbc library. In this case, Windows Event Viewer reports a low virtual memory condition.
(February 2025)
DBMI-21051
Database ingestion and replication incremental load and combined initial and incremental load jobs that have a SQL Server source and use the CDC Tables capture method apply duplicate rows to the target if multiple Update operations occur in a single commit on LOB columns in a source table that has no primary key.
(November 2024)

MySQL Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-21014
Database ingestion and replication initial load jobs that have a MySQL source fail if the source contains invalid date, datetime, time, or timestamp data that the reader or target writer cannot process. For example, the following data is invalid: “0000-00-00 00:00:00”, “02-31-2024 00:00:00”
(November 2024)
DBMI-20874
For database ingestion and replication jobs that have a MySQL source, two CDC records recorded at the same time but in different bin logs might cause the job to fail with the following error:
"Previous sequence is not less than current sequence"
(November 2024)

Oracle Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23003
Database ingestion and replication incremental load jobs that have an Oracle source with a NOT NULL LOB column might fail with the following error after a DML delete operation:
PWX-36200 ORAD: Column conversion error: [36202] NULL value found for column that is not nullable for Table name=<table_name>, column[n] segment[n] DATA. Detail Type = CLOB, Oracle Type = CLOB.
(April 2025)
DBMI-22981
Database ingestion and replication jobs that have an Oracle source in an Oracle Data Guard environment fail if the primary database is in an Oracle Real Application Cluster (RAC) and the RAC Members value set in the Oracle Database Ingestion connection properties is not valid. No error message describing the problem is issued.
(April 2025)
DBMI-22978
Database ingestion and replication incremental load or combined load tasks that have an Oracle source might stop capturing change data with the following internal error message:
PWX-36000 ORAD Mbr 1: Internal error SetDPLParentPseudoTxn() DPL invalid state. Expected PARENT:INITIAL Received PARENT:PARENT_PSEUDO_BEGINfor Object id 0 in module PwxOrlTMgrUow:529.
(April 2025)
DBMI-22385
Database ingestion and replication incremental load jobs that have an Oracle source with CLOB columns replicate some special characters to the target, instead of CLOB data, when the NLS_CHARACTERSET parameter is set to a specific code page such as WE8MSWIN1252.
(April 2025)
DBMI-22213
Database ingestion and replication jobs that have an Oracle source might end with the following error if an internal race condition exists between two threads, where one thread is trying to re-create a schema cache object while the main thread is stopping the task:
[CDCPUB_10066] TRACE: [Internal logic error. schemaCache.schemaExists() threw unexpected checking for schema with ID <number>].
A schema cache isn't required when the task is shutting down.
(April 2025)
DBMI-22052
If a database ingestion and replication job that has an Oracle source on Linux encounters a Log Write Number (LWN) for a group of redo blocks that is larger than the read buffer, the job might fail with an error such as:
[CDCPUB_10066] TRACE: [Error message[1] PWX-36564 ORAD: LRdr for member n has been unresponsive for more than the timeout threshold of 600. Last response time was <date><time>.
(April 2025)
DBMI-21661
A database ingestion and replication incremental or combined initial and incremental load job that has an Oracle source might fail if you use table selection rules and the number of rules defined is greater than 100.
(February 2025)
DBMI-20171
Database ingestion and replications incremental load or combined load jobs that have an Oracle source might appear to be Up and Running even though they’ve lost connectivity to the source while reading a redo log sequence. In this case, no data is written to the target. The jobs should issue an appropriate alert and fail.
(November 2024)
DBMI-19760
Database ingestion and replication initial load jobs that have an Oracle source and a Google BigQuery target might fail intermittently with the following error:
uploadLocalFile has been failed because of error: Remote host terminated the handshake.
(April 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-23758
If database ingestion and replication initial load jobs that have an Oracle source with XMLTYPE columns use the Oracle JDBC Thin driver, as configured in the Oracle Database Ingestion connection, the jobs might write nulls to the target.
Workaround: If you need to write data from Oracle source XMLTYPE columns to a target, use the DataDirect driver.
(April 2025)
DBMI-23360
Database ingestion and replication incremental load or combined load jobs that have an Oracle source with XML columns and an Oracle target might fail with the following Oracle error when processing a DML operation:
[Oracle JDBC Driver][Oracle]ORA-00932: inconsistent datatypes: expected - got CLOB. Error code: 932
Workaround: None.
(April 2025)
DBMI-23048
If you configure an Oracle Database Ingestion connection to use both the Oracle JDBC Thin driver and SSL encription, when you try to test the connection, the test fails.
Workaround: Do not use the JDBC Thin driver with SSL encryption.
(April 2025)
DBMI-19145
Database ingestion and replication jobs that use the Log-based CDC method and have an Oracle source with only LOB columns selected and no primary key do not create subtasks on the tables. As a result, the jobs cannot capture change data from the tables. Messages such as the following are written to the log:
[DBMIP_23026] The process [CDC-LOBS] with the thread ID [9708] encountered new table [lob_table_name]. The new table is excluded from processing.
[CDCPUB_10066] TRACE: [PwxCDCRequestProcessor.askSchema() returned: Don't capture.].
Workaround: In the task, select some non-LOB source columns, in addition to the LOB columns, for replication if you want to continue using the table without a primary key.
(July 2024)
DBMI-14767
If a database ingestion and replication job uses an Oracle Database Ingetion source connection that's configured to use the Oracle JDBC Thin driver, the job can replicate up to 39 digits from source columns that have a numeric data type to the target. If a source numeric value has 40 or more digits, the fortieth digit and all additional digits are replaced by zeroes (0) on the target.
Workaround: None.
(September 2023)
DBMI-13605
The Oracle Database Ingestion connection properties page includes no property for entering JDBC connection properties, such as EncryptionLevel, when they're needed.
Workaround: In the Service Name field, you can add JDBC connection properties after the Oracle SID value, using a semicolon (;) as the separator.
(April 2023)
DBMI-12331
If you create custom data-type mappings for Oracle source binary_double and binary_float columns in a database ingestion task, the custom mappings are ignored. Instead, the target table is generated using the default mappings of binary_double > float and binary_float > real. When the database ingestion and replication job runs, nulls are written to the target float and real columns.
Workaround: None.
(February 2023)
DBMI-10794
Oracle source columns with the TIMESTAMP WITH TIME ZONE data type are supported only for initial load jobs.
(July 2022)

PostgreSQL Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-23490
An internal capture query to retrieve WAL information failed when called from a hot-standby replica. Capture processing that runs against a replica now uses pg_last_wal_replay_lsn() rather than pg_current_wal_lsn().
(April 2025)
DBMI-21041
Database ingestion and replication jobs that have a PostgreSQL source and use the source object as a view might list NUMERIC data type columns with precision and scale as unsupported.
(November 2024)

SAP HANA Database Ingestion Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-21419
For a database ingestion and replication job that has an SAP HANA source and uses the Superpipe option to stream data to a Snowflake target, the Snowflake stream might become stale and data might not be accessible if the source tables are updated very rarely, for example on a quarterly or yearly basis.
(April 2025)

Known issues

The following table describes known issues:
Issue
Description
DBMI-15247
If database ingestion and replication jobs that have an SAP HANA source table with a multiple-column primary key use a custom data-type mapping that maps a source TIMESTAMP column to a Snowflake target VARCHAR column, data might be replicated to the target incorrectly, causing invalid data in the target column.
Workaround: None.
(November 2023)
DBMI-14370
Database ingestion and replication incremental load jobs that have an SAP HANA Cloud source with a DECIMAL column that has no precision fail with the following error message:
Error executing query job. Message: Query error: Value of type BIGNUMERIC cannot be assigned to column, which has type INT64 at [number]. Error code: 100032
Workaround: None.
(August 2023)
DBMI-12571
Database ingestion and replication jobs with a SAP HANA source might replicate data from REAL columns of 16 or more significant digits with a loss of precision on the target, causing data corruption.
Workaround: None.
(April 2023)

Snowflake Data Cloud Connector

Fixed issues

The following table describes fixed issues:
Issue
Description
DBMI-21892
For a database ingestion and replication combined load job that has a Snowflake target and uses the Superpipe option, the monitoring interface might report an Unload Count value under Object Detail that does not match the number of records read during the initial load phase, as reported in the unload log. This mismatch occurs if the transitionSchedulerType source custom property is set to CDC_WITH_BACKLOG, source partitioning is enabled, and the source tables contain over 2 billion records.
(February 2025)