Chat now with support
Chat with Support

SharePlex Connector for Hadoop 8.5.5 - SharePlex Connector For Hadoop Release Notes

Release Notes

You are here: Release Notes

SharePlex™ Connector for Hadoop®

Version 8.5.5

Release Notes

Friday, September 05, 2014


Contents


Welcome to SharePlex™ Connector for Hadoop®

SharePlex™ Connector for Hadoop® enables log-based replication of tables from Oracle to Hadoop (HDFS and HBase).

SharePlex Connector for Hadoop also supports capturing change data (CDC) of a table on HDFS/Hive. Tables can further be replicated to Hive (Hive over HDFS and/or Hive over HBase and Hive over CDC).

SharePlex™ Connector for Hadoop® operates in conjunction with SharePlex™ for Oracle®


New Features

You are here: New Features

New in This Release

  • Support for IBM InfoSphere BigInsights (IBM BI 2.1.2) and Cloudera CDH 5.1.0.
  • Hive over HDFS (Sequence file format).
  • Support for Near Real Time replication with Avro file type.
  • Partitioning and compression support in Near Real Time replication with Avro file type.

Known Issues

You are here: Known Issues

The following is a list of issues known to exist at the time of this release.

Table 1: SharePlex for Oracle known issues

Known Issue Defect ID
For boundary value of NUMBER data type and maximum value of FLOAT data type, SharePlex sends data in exponential format. SPH-232
SharePlex sends only schema messages for maximum value of CHAR, VARCHAR, NCHAR, and NVARCHAR data types. SPH-293
For an Oracle table with no primary key, SharePlex sends SCHEMA XML having the "key" attribute set to "true" for all columns. SPH-313
For the TRUNCATE operation, SharePlex sends commitTime="1988-01-01T00:00:00.” SPH-325
SharePlex sends SCHEMA XML with the default value when the user initially adds a column with a default value, and then later drops that column and then adds the same column without default value. SPH-357
SharePlex does not send an empty tag in CDC XML for inserting a NULL value in an Oracle table. SPH-131
If an UPDATE is followed by a TRUNCATE operation on an Oracle table, messages will be stuck in the SharePlex Post Queue and NOT forwarded to the JMS queue. The SharePlex console will show error: "Index out of bounds". SPH-127

Table 2: SharePlex Connector for Hadoop known issues

Known Issue Defect ID
The SharePlex Connector for Hadoop conn_setup script when run with -c provides no error messages when the configuration parameters are incorrect. SPH-123
Hive table cannot access HDFS data if a negative value (BC dates) is present for DATE and TIMESTAMP column datatypes. SPH-207
If the user adds a column to an Oracle table with DEFAULT value, then DEFAULT value is not captured by CDC use case. SPH-359

The SharePlex™ Connector for Hadoop® conn_cleanup script cleans up data from Hive even if SharePlex™ Connector for Hadoop® has not been used to create an external Hive table.

SPH-128

Improvements to the SharePlex™ Connector for Hadoop® step-by-step procedure for replicating multiple Oracle tables.

SPH-14
Some Special Characters are not supported in SharePlex Connector for Hadoop for Custom Partitioning. SPH-406
Near real time (HDFS) replication with Avro file format fails for Oracle tables with data types INTERVAL YEAR TO MONTH, INTERVAL DAY TO SECOND and ROWID. SPH-439

 

System Requirements

You are here: System Requirements

Before installing SharePlex™ Connector for Hadoop®, ensure your system meets the following minimum requirements:

Functional Area Requirements
SharePlex for Oracle 8.5

SharePlex provides high-speed, log-based replication between Oracle instances.

Ensure SharePlex for Oracle is fully installed and operational in your Oracle environment.

Apache ActiveMQ 5.6

ActiveMQ is a JMS provider.

Ensure SharePlex for Oracle is configured to operate through ActiveMQ.

For the following:

  • Hadoop CDH4.2.0 64-bit
  • CDH 5.0.0 64-bit
  • CDH 5.1.0 64-bit
  • Hortonworks (HDP 1.3) 64-bit
  • Apache 1.2.1 64-bit
  • IBM InfoSphere BigInsights (IBM BI 2.1.2)

Install one of the following components of Hadoop, including libraries and configurations:

  • Any of these from Cloudera: CDH4.2.0 64-bit, CDH 5.0.0 64-bit, or CDH 5.1.0 64-bit
  • Hortonworks (HDP 1.3)
  • Apache 1.2.1
  • IBM InfoSphere BigInsights (IBM BI 2.1.2)

Optional: Install and configure HBase to replicate tables to HBase and Hive over HBase.

Optional: Install and configure Hive to replicate tables to Hive (Hive over HDFS or Hive over HBase).

Java Development Kit 64-bit 1.6 or later versions. Ensure the Java Development Kit is installed on the same computer as SharePlex™ Connector for Hadoop®.
Adobe Acrobat Reader 7.0 or later

Required for viewing the Installation and Setup Guide.

 

Self Service Tools
Knowledge Base
Notifications & Alerts
Product Support
Software Downloads
Technical Documentation
User Forums
Video Tutorials
RSS Feed
Contact Us
Licensing Assistance
Technical Support
View All
Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating