立即与支持人员聊天
与支持团队交流

SharePlex 12.2 - Release Notes

Oracle to Snowflake replication

SharePlex supports replication from Oracle to Snowflake, according to the details below.

Supported operating systems

For information regarding supported source and target operating systems with specific database versions, see the Compatibility Matrix for Supported Operating Systems and Target Platforms section. To view compatibility across operating systems for remote replication, see Compatibility Across Operating Systems (Remote Collection and Posting).

Supported target versions and ODBC requirements

Snowflake 8.38.2

ODBC driver requirement: from Snowflake 3.1.4 to 3.8

Limitation: The Snowflake 3.3 to 3.5 drivers are not supported on the Windows platform. For additional details, see the description of issue SPSQL-8415 under the Known Issues in this Release section.

Supported target cloud platforms

  • Microsoft Azure

  • Amazon Web Services

Supported data types

SharePlex supports the following data types for replication from Oracle to Snowflake:

Oracle Snowflake
CLOB TEXT
NUMBER INT, INTEGER, NUMBER
CHAR(n) VARCHAR(n)
CLOB VARCHAR(n)
NCHAR CHAR(n)
VARCHAR2(n) VARCHAR(n)
CLOB VARCHAR(n)
NCLOB TEXT
CLOB VARCHAR(n)
LONG TEXT
BLOB BINARY, VARBINARY
RAW(n) VARBINARY
LONGRAW VARBINARY
BINARY_FLOAT REAL
NUMBER SMALLINT
NUMBER BIGINT
NUMBER NUMERIC, DECIMAL
DATE DATE
BINARY_DOUBLE DOUBLE PRECISION
TIMESTAMP TIMESTAMP
TIMESTAMP_TZ TIMESTAMP_TZ

Note: It is anticipated that the Snowflake DB's default "HEX" format for binary type will be maintained for Oracle binary to Snowflake binary data type replication. Since source Oracle DB binary data is stored only in "HEX" format, Shareplex does not guarantee data integrity for any other format.

Conditions of support
  • Char(n) data type - In Oracle, Char(n) is a fixed-size data type. If you insert char data with a length less than "n" into the "Char(n)" column, the remaining slots (n - length) are padded with space to occupy the complete "n" memory positions. Snowflake uses  VARCHAR(n) for char storage since Snowflake lacks a comparable fixed-length character data type and only saves char data up to its length. Live replication will ensure that char column data is correctly copied. However, if users are manually inserting data into Snowflake for the equivalent of a Char(n) Oracle column, then the user will need to handle padding as well to occupy the full "n" length so that data will be in sync in both the source and target DB.

  • Binary & Text data types - Snowflake Binary & Text data types have size limitation of 8 MB, so Oracle’s advance Data type replication will be restricted to max 8 MB size limit of equivalent counterpart. Refer table below.

Oracle Data type Max Size Snowflake Data type Max Size
LONG 2 GB TEXT 8 MB of unicode chars
CLOB 4 GB TEXT 8 MB of unicode chars
LONGRAW 2 GB BINARY or VARBINARY 8 MB
BLOB 4 GB BINARY or VARBINARY 8 MB

See Conditions of support for the additional conditions of support for the above-mentioned supported data types.

Supported operations and objects for DML replication

SharePlex supports DML operations on tables, with some conditions. DML can be replicated from an Oracle source to a Snowflake target.

Tables

SharePlex supports the following DML operations on tables when replicating data from an Oracle source to the Snowflake target:

  • Singular and bulk operation - Insert with key(s)/ non key(s)

  • Singular and bulk operation - Update with key(s)/ non key(s)

  • Singular and bulk operation - Delete with key(s)/ non key(s)

Limitations:

The following DML operations related limitations are observed while replicating data from Oracle to Snowflake:

  • Slowness while performing DML operations

    • Single Insert: Frequent commits and rollbacks can cause slowness in replication.

    • Batch Inserts: Insert with advance data types [target Snowflake data types: TEXT and BINARY] can cause significant slowness in replication for data with plain text or binary JSON and XML.

    • Single Update and Delete : Frequent commits and rollbacks can cause slowness.

For additional information, see Supported Operations and Objects for DML Replication.

Supported operations and objects for DDL replication

SharePlex does not support DDL operations and objects when replicating data from an Oracle source to a Snowflake target.

Oracle to SQL Server replication

SharePlex supports replication from Oracle to SQL Server, according to the details below.

Supported target operating systems

For information regarding supported source and target operating systems with specific database versions, see the Compatibility Matrix for Supported Operating Systems and Target Platforms section. To view compatibility across operating systems for remote replication, see Compatibility Across Operating Systems (Remote Collection and Posting).

Supported target versions and ODBC requirements

SQL Server 2016, 2017, 2019, and 2022

ODBC driver requirement: ODBC 17.10.1.1-1 and 18.3.2.1-1

Supported target cloud platforms and databases

Amazon Web Services

Amazon EC2 (IaaS) Virtual Machine

Microsoft Azure

  • Azure Virtual Machine (IaaS)
  • Azure SQL Database
  • Azure SQL Managed Instance

Supported data types

SharePlex supports the following data types for replication from Oracle to SQL Server:

Oracle SQL Server
ANYDATA VARIENT
BINARY_DOUBLE FLOAT (53)
BINARY_FLOAT FLOAT (24)
BLOB VARBINARY (MAX)
CHAR (n) CHAR (n)
CHAR (n CHAR) CHAR (n)
CLOB VARCHAR (MAX)
DATE DATETIME2 (7)
LONG VARCHAR (MAX)
LONGRAW VARBINARY (MAX)
NCHAR (n) NCHAR (n)
NCLOB NVARCHAR (MAX)
NUMBER FLOAT (53)
NUMBER (p,0:) NUMERIC (p,s)
NUMBER (p,0:)* DECIMAL
NUMBER (p,s) FLOAT (53)
NVARCHAR2 (n) NVARCHAR (n)
RAW (n) VARBINARY (n)
TIMESTAMP (8:9) DATETIME2 (7)
TIMESTAMP (p) DATETIME2 (p)
TIMESTAMP (8:9) WITH TIME ZONE DATETIMEOFFSET (7)
TIMESTAMP (p) WITH TIME ZONE DATETIMEOFFSET (p)
VARCHAR2 (n) VARCHAR (n)
VARCHAR2 (n CHAR) VARCHAR (n)

Conditions of support:

NUMBER (P, 0) - DECIMAL: If we add a new column with the Number data type in the Oracle source, the new column will be replicated with the Numeric data type to the SQL Server target.

See Conditions of support for the additional conditions for the above-mentioned supported data types.

Supported operations and objects for DML replication

SharePlex supports DML operations on tables and sequences, with some conditions. DML can be replicated from an Oracle source to an SQL Server target. For additional information, see Supported Operations and Objects for DML Replication.

Supported operations and objects for DDL replication

SharePlex supports DDL operations on tables and sequences, with some conditions. DDL can be replicated from an Oracle source to an SQL Server target. For additional information, see Oracle to open target DDL support.

System Requirements and Conditions of Support When Replicating from PostgreSQL

This chapter contains the requirements when capturing from a PostgreSQL database and replicating to supported target databases.

PostgreSQL source basics

This section contains the requirements for a PostgreSQL database as a source when capturing from a PostgreSQL database and replicating to supported target databases.

Supported operating systems

For information regarding supported source and target operating systems with specific database versions, see the Compatibility Matrix for Supported Operating Systems and Target Platforms section. To view compatibility across operating systems for remote replication, see Compatibility Across Operating Systems (Remote Collection and Posting).

Supported versions and ODBC requirements

  • PostgreSQL 13.x, 14.x, 15.x, 16, and 17

  • Enterprise Database (EDB) 15.x, 16

  • Fujitsu Enterprise PostgreSQL 15 SP2, 16, and 17

  • AlloyDB Omni 15.5.x

ODBC driver requirement:

ODBC drivers for Community Edition: postgresql13-odbc-13.02.0000, postgresql14-odbc-13.02.0000,postgresql15-odbc-16.00.0000, and postgresql16-odbc-16.00.0000

ODBC drivers for Enterprise Edition (EDB): edb-odbc-13.02.0000 and edb-odbc-16.00.0000.01

Supported cloud platforms and databases

Amazon Web Services:

  • Amazon EC2 (IaaS) Virtual Machine

  • Amazon RDS for PostgreSQL

  • Amazon Aurora

Microsoft Azure:

  • Azure Virtual Machine (IaaS)

  • Azure Flexible Server

Google Cloud Platform:

  • Cloud SQL for PostgreSQL

  • AlloyDB for PostgreSQL

PostgreSQL source basic conditions of support

Supported / non-supported SharePlex features for PostgreSQL as a source

The following table shows whether specific SharePlex features are supported for replication from PostgreSQL to Oracle and open targets .

SharePlex feature Supported targets
reconcile command (target instantiation) Oracle, PostgreSQL
compare/compare using and repair/repair using commands PostgreSQL
copy/copy using and append/append using commands Not supported
Hash horizontally partitioned replication PostgreSQL
Column-based horizontally partitioned replication PostgreSQL
Vertically partitioned replication PostgreSQL, Oracle
Column mapping PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
Key definition PostgreSQL, Oracle
Build configuration with scripts Not supported
Named queues PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
Commit Reduction (feature of Post Enhanced Performance) PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
Dependency Checking (feature of Post Enhanced Performance) Not supported
Transformation Oracle
Conflict resolution

PostgreSQL, Oracle

Peer-to-peer replication (bi-directional) PostgreSQL, Oracle
Consolidated replication (many to one) PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
Broadcast replication (one to many) PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
High availability replication (active/passive bi-directional) Not supported
Change tracking target (CDC) Not supported
Data encryption Not supported
Data compression Not supported
SSH PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
auth_hosts file Not supported
Monitoring scripts Not supported
SNMP monitoring Not supported
Continue posting on error (SP_OPX_CONT_ON_ERR) PostgreSQL, SQL Server, Kafka, Snowflake
Suspend on out of sync errors (SP_OPX_OUT_OF_SYNC_SUSPEND) PostgreSQL, SQL Server, Kafka, Snowflake
Reduced key (SP_OPX_REDUCED_KEY) PostgreSQL, SQL Server, Kafka, Snowflake
Logical Transaction Rollback on out-of-sync transactions Not supported
Tables without key1 PostgreSQL, Oracle, SQL Server, Kafka, Snowflake
Special characters2 PostgreSQL, Oracle, SQL Server, Kafka, Snowflake

Conditions of support:

  1. Data inconsistency is likely to occur in replication or compare-repair processes when SharePlex replication involves tables containing non-key columns with duplicate data.

  2. SharePlex supports special characters like hyphen (-), underscore (_), and plus (+) in PostgreSQL database names, as well as a dot (.), but other PostgreSQL objects, such as column names, do not support all special characters.

Supported and non-supported key features for physical and logical slots

The table below presents information on the metrics that are supported and not supported for physical and logical slots in on-premises and PostgreSQL Database as a Service environments.

Note: SharePlex supports logical replication with pgoutput plugin only.

SharePlex Features PostgreSQL On-Prem/Cloud VM/EDB (Enterprise Database) PGDB as a Service AWS- RDS and Aurora, Azure Flexi server
Physical Replication Logical Replication (pgoutput plugin) Logical Replication (pgoutput plugin)
Activate with LSN Supported Not supported Not supported
HA Cluster Replication with failover Applicable with On-prem PostgreSQL database CrunchyData* Not supported Applicable only with Azure Flexi server using the pg_failover_slots extension; it is not supported with AWS-RDS and Aurora.
Horizontal and Vertical Partitioning Supported Supported Supported
Utilities and Commands Supported Supported Supported
Database level Table Partitioning Supported Supported Supported
Bi-Directional Replication Supported Supported Supported
DDL Support Not supported Not supported Not supported
Replication Performance No Lag Minimal Lag Minimal Lag
Insert using PostgreSQL Copy command Not supported Not supported Not supported

* The HA Cluster Replication with Failover feature is not supported with PostgreSQL Enterprise Database (EDB).

LIMITATIONS:

The following limitations are observed related to the TRUNCATE operation:

  • Applicable only for physical replication. If the truncate operation is performed on a table in replication, the Capture process ignores the DML operations performed on the table until the commit for the truncate operation is received or processed by the Capture process. Therefore, TRUNCATE should either be performed with auto-commit enabled or both TRUNCATE and COMMIT should be executed without any DML operations in between on the table.

  • Applicable only for logical replication. In bi-directional replication, the bulk delete operations performed immediately after a TRUNCATE operation are processed with some delay by the Capture processes. There is no data inconsistency once the bulk delete operations are processed.

相关文档

The document was helpful.

选择评级

I easily found the information I needed.

选择评级