SharePlex™ Connector for Hadoop®
1.5
Release Notes
April 04, 2014
| New in This Release | Resolved Issues and Minor Enhancements | Known Issues | Upgrade and Compatibility | |
| System Requirements | Global Operations | Getting Started | For More Information |
SharePlex™ Connector for Hadoop® enables log-based replication of tables from Oracle to Hadoop (HDFS and HBase). SharePlex Connector for Hadoop also supports capturing change data (CDC) of a table on HDFS/Hive. Tables can further be replicated to Hive (Hive over HDFS and/or Hive over HBase and Hive over CDC).
SharePlex™ Connector for Hadoop® operates in conjunction with SharePlex™ for Oracle®
The following is a list of issues addressed in this release.
| Functional Area | Resolved Issue / Enhancement | Defect ID |
|---|---|---|
| SharePlex for Oracle | SharePlex did not send SCHEMA XML if TRUNCATE query was executed after activating configuration. | SPH-130 |
| SharePlex for Oracle | SharePlex did not send updated schema when user changed primary key to composite key. | SPH-133 |
| SharePlex Connector for Hadoop scripts | If the SharePlex Connector for Hadoop conn_monitor script was executed after the conn_snapshot script, but before replication starts, then conn_monitor displayed the wrong Message Index and Total message in the transaction parameters. | SPH-134 |
The following is a list of issues known to exist at the time of this release.
| Functional Area | Known Issue | Defect ID |
|---|---|---|
| SharePlex for Oracle | For boundary value of NUMBER data type and maximum value of FLOAT data type, SharePlex sends data in exponential format. | SPH-232 |
| SharePlex sends only schema messages for maximum value of CHAR, VARCHAR, NCHAR, and NVARCHAR data types. | SPH-293 | |
| For an Oracle table with no primary key, SharePlex sends SCHEMA XML having the "key" attribute set to "true" for all columns. | SPH-313 | |
| For the TRUNCATE operation, SharePlex sends commitTime="1988-01-01T00:00:00.” | SPH-325 | |
| SharePlex sends SCHEMA XML with the default value when the user initially adds a column with a default value, and then later drops that column and then adds the same column without default value. | SPH-357 | |
| SharePlex does not send an empty tag in CDC XML for inserting a NULL value in an Oracle table. | SPH-131 | |
| If an UPDATE is followed by a TRUNCATE operation on an Oracle table, messages will be stuck in the SharePlex Post Queue and NOT forwarded to the JMS queue. The SharePlex console will show error: "Index out of bounds". | SPH-127 | |
| SharePlex™ Connector for Hadoop® |
For file type Sequence, SharePlex Connector for Hadoop does not support replication in Hive over HDFS. |
NA |
| The SharePlex Connector for Hadoop conn_setup script when run with -c provides no error messages when the configuration parameters are incorrect. | SPH-123 | |
| Hive table cannot access HDFS data if a negative value (BC dates) is present for DATE and TIMESTAMP column datatypes. | SPH-207 | |
| If the user adds a column to an Oracle table with DEFAULT value, then DEFAULT value is not captured by CDC use case. | SPH-359 | |
|
The SharePlex™ Connector for Hadoop® conn_cleanup script cleans up data from Hive even if SharePlex™ Connector for Hadoop® has not been used to create an external Hive table. |
SPH-128 | |
|
Improvements to the SharePlex™ Connector for Hadoop® step-by-step procedure for replicating multiple Oracle tables. |
SPH-14 |
SharePlex Connector for Hadoop supports upgrade from the previous version (GA 1.0) to the current version (GA 1.5). This version supports Hadoop CDH4.2.0 64-bit, CDH 5.0.0 64-bit, Hortonworks (HDP 1.3) 64-bit, Apache 1.2.1 64-bit, and Intel 2.5.1 64-bit distributions.
Before installing SharePlex™ Connector for Hadoop®, ensure your system meets the following minimum requirements:
| SharePlex for Oracle 8.5 |
SharePlex provides high-speed, log-based replication between Oracle instances. Ensure SharePlex for Oracle is fully installed and operational in your Oracle environment. |
| Apache ActiveMQ 5.6 |
ActiveMQ is a JMS provider. Ensure SharePlex for Oracle is configured to operate through ActiveMQ. |
| Hadoop CDH4.2.0 64-bit, or CDH 5.0.0 64-bit, or Hortonworks (HDP 1.3) 64-bit, or Apache 1.2.1 64-bit, or Intel 2.5.1 64-bit |
Install Cloudera’s CDH4.2.0 64-bit, or CDH 5.0.0 64-bit, or Hortonworks (HDP 1.3), or Apache 1.2.1, or Intel 2.5.1 64-bit distribution of Hadoop including libraries and configurations. Optional. Install and configure HBase to replicate tables to HBase and Hive over HBase. Optional. Install and configure Hive to replicate tables to Hive (Hive over HDFS or Hive over HBase). |
| Java Development Kit 64-bit 1.6 | Ensure the Java Development Kit is installed on the same computer as SharePlex™ Connector for Hadoop®. |
| Adobe Acrobat Reader 7.0 or later |
Required for viewing the Installation and Setup Guide. |
This section contains information about installing and operating this product in non-English configurations, such as those needed by customers outside of North America. This section does not replace the materials about supported platforms and configurations found elsewhere in the product documentation.
This release is Unicode-enabled and supports any character set. In this release, all product components should be configured to use the same or compatible character encodings and should be installed to use the same locale and regional options. This release is targeted to support operations in the following regions: North America, Central and Eastern Europe.
The SharePlex™ Connector for Hadoop® release package contains the following products:
Refer to the SharePlex Connector for Hadoop Installation and Setup Guide for installation instructions.
Dell listens to customers and delivers worldwide innovative technology, business solutions and services they trust and value. For more information, visit www.quest.com.
Technical Support:
Online Support
Product Questions and Sales:
(800) 306-9329
Email:
info@quest.com
Technical support is available to customers who have purchased Dell software with a valid maintenance contract and to customers who have trial versions. To access the Support Portal, go to http://quest.com/support/.
The Support Portal provides self-help tools you can use to solve problems quickly and independently, 24 hours a day, 365 days a year. In addition, the portal provides direct access to product support engineers through an online Service Request system.
The site enables you to:
© 2014 Dell Inc.
ALL RIGHTS RESERVED.
This guide contains proprietary information protected by copyright. The software described in this guide is furnished under a software license or nondisclosure agreement. This software may be used or copied only in accordance with the terms of the applicable agreement. No part of this guide may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for any purpose other than the purchaser’s personal use without the written permission of Dell Software Inc.
The information in this document is provided in connection with Dell Software products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Dell Software products. EXCEPT AS SET FORTH IN DELL SOFTWARE’S TERMS AND CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, DELL SOFTWARE ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL DELL BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF DELL SOFTWARE HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Dell Software makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and product descriptions at any time without notice. Dell Software does not make any commitment to update the information contained in this document.
If you have any questions regarding your potential use of this material, contact:
Dell Software Inc.
Attn: LEGAL Dept
5 Polaris Way
Aliso Viejo, CA 92656
Refer to our web site (www.quest.com) for regional and international office information.
Patents
This product This product is protected by U.S. Patent #: 7,065,538 and 7,461,103 Additional Patents Pending.
Trademarks
Dell, the Dell logo are trademarks of Dell Inc.and/or its affiliates. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell disclaims any proprietary interest in the marks and names of others.
