サポートと今すぐチャット
サポートとのチャット

SharePlex Connector for Hadoop 1.5 - Installation and Setup Guide

conn_monitor.sh

conn_monitor.sh

Use this script to show a list of the tables being replicated. Monitor the status of a table under replication.

Shell Script Usage

conn_monitor.sh [--summary|--status <TABLE_OWNER.TABLE_NAME> [--hdfs|--hbase|--cdc]|--help|--version]

Options

Parameter

Description

--summary

Show a summary of the tables under replication.

--status <TABLE_OWNER.TABLE_NAME> [--hdfs|--hbase|--cdc]

Show the status of the given table.

Include the --hdfs option (optional) to limit the display to HDFS Near Real Time Replication.

Include the --hbase option (optional) to limit the display to HBase Real Time Replication.

Include the --cdc option (optional) to limit the display to Change Data Capture (CDC) feature.

--help

Show this help and exit.

--version

Show version information and exit.

conn_cleanup.sh

conn_cleanup.sh

Use this script to delete all data (HDFS, HBase and Hive) from a table under replication by SharePlex Connector for Hadoop.

Shell Script Usage

conn_cleanup.sh -t <TABLE_OWNER.TABLE_NAME> [-h <HIVE_HOME_DIR>] [--help] [--version]

Options

Parameter

Description

-t <TABLE_OWNER.TABLE_NAME>

Name and owner of the table data to cleanup.

-h <HIVE_HOME_DIR>

Path to the Hive home directory.

If not specified the value of the HIVE_HOME environment variable is used. If this option is not set and HIVE_HOME environment variable is also not set, this parameter will be set as relative to HADOOP_HOME.

--help

Show this help and exit.

--version

Show version information and exit.

Example

[user@host bin]$ ./conn_cleanup.sh -t Schema.Table

uninstall.sh

uninstall.sh

Use this script to uninstall SharePlex Connector for Hadoop.

TIP: It is recommended to run the uninstall script from outside of the SharePlex Connector for Hadoop home directory.

Shell Script Usage

uninstall.sh [-q] [-h <HIVE_HOME_DIR>] [-t <LIST_OF_TABLES> | -a] [--help] [--version]

Options

Parameter

Description

-q

Delete the point-to-point JMS Queue to which SharePlex Connector for Hadoop listens.

-h <HIVE_HOME_DIR>

Path to the Hive home directory. This parameter is used in conjunction with -t or -a when tables in Hive are involved in the cleanup.

If not specified the value of the HIVE_HOME environment variable is used. If this option is not set and HIVE_HOME environment variable is also not set, this parameter will be set as relative to HADOOP_HOME.

-t <LIST_OF_TABLES>

Delete all data (HDFS, HBase and Hive) from the list of tables under replication by SharePlex Connector for Hadoop.

Use a comma to delimit the list of tables.

NOTE: This option uses conn_cleanup.sh.

-a

Delete all data (HDFS, HBase and Hive) from all tables under replication by SharePlex Connector for Hadoop.

NOTE: This option uses conn_cleanup.sh.

--help

Show this help and exit.

--version

Show version information and exit.

Example

[user@host bin]$ ./uninstall.sh

SharePlex Log Files

SharePlex Connector for Hadoop Log Files

SharePlex Connector for Hadoop uses the Apache log4j library as a logging utility. Logs are created in the SharePlex Connector for Hadoop home, logs.

Log File Description

shareplex-connector.log

Contains all log messages logged with levels DEBUG and above.

shareplex-connector-alert.log

Contains ALERT log messages which may require action, like:

  • Data Inconsistency observed while replication
  • Replication for a table failed
  • Schema of table changed (alter)
  • High priority messages and un-handled critical exceptions.

shareplex-connector-icm.log

Contains all installation, configuration and management related log messages from the SharePlex Connector for Hadoop shell scripts. For more information on these scripts see the Command Reference section.

This log file does not use the Apache log4j library as a logging utility.

How to configure the logs

The log4j configuration file is SharePlex Connector for Hadoop home,

conf\opentarget-log4j.xml

To change the size of the log file

The following parameters set for 10 files each of 20MB maximum size.

<param name="MaxFileSize" value="20MB" />

<param name="MaxBackupIndex" value="10" />

To change the log level

The default log level is DEBUG. Edit this parameter.

<logger name="com.quest.shareplex">

<level value="DEBUG" />

TIP: To apply changes to log4j you need to restart SharePlex™ Connector for Hadoop®. For more information, see conn_ctrl.sh.

関連ドキュメント

The document was helpful.

評価を選択

I easily found the information I needed.

評価を選択