Environment Requirements

Hardware Environment Requirements

Data Hub (TDH) provides cluster services to ensure high availability of services, so the cluster system must be composed of more than 3 physical servers (virtual machines are not recommended), and each server must have the following minimum configuration:

  • Two 6-core or above x86 instruction set CPU servers with hyperthreading
  • Memory above 64GB
  • 2 hard disks above 300G as RAID1, as system disks
  • More than 4 hard disks with a capacity of 300GB or more as data storage hard disks
  • 2 Gigabit or more NICs

To achieve better performance and the highest cost performance, TDH recommends different configurations for different modules in the cluster. The following configurations are recommended for NameNode and Manager:

  • Two 6-core x86 instruction set CPU servers with hyperthreading (such as Intel® Xeon® Gold-5218 Processor)
  • Memory above 128GB
  • 6 hard disks above 600G as RAID1, as system disks and for managing data
  • 2 NICs with network port over Gigabit

The hardware configuration of the DataNode shall be selected according to the characteristics of different applications. Users using Inceptor, Discover and Slipstream configurations need servers with relatively high computing power. The recommended configurations of their DataNode are as follows:

  • Two 8-core or above x86 instruction set CPU servers with hyperthreading (such as Intel® Xeon® Gold-5218 Processor)
  • Memory above 128GB
  • 2 hard disks above 300G as RAID1, as system disks
  • More than 10 hard disks with more than 2TB capacity are used as data storage hard drives
  • 2 Gigabit or more NICs

The system disk can be RAID1. If the data disk needs RAID, please make RAID0.

RAID Configurations for Servers

In order to optimize the performance and stability of the system, TDH requires the following RAID configurations for servers:

  • For newly deployed clusters (with no data), if servers have RAID cards which are not turned on, users need to turn on the RAID cards and make RAID0 for each disk separately.

  • For clusters in use (with stock data), if servers have RAID cards which are not turned on, RAID0 needs to be made separately for the disks corresponding to services such as NameNode, JournalNode, TCOS Master’ etcd, TxSQL, Guardian ApacheDS, and Zookeeper.

  • If users do not have a RAID card, it is recommended that users purchase one and make RAID0 for at least the disks corresponding to services such as NameNode, JournalNode, TCOS Master’ etcd, TxSQL, Guardian ApacheDS, and Zookeeper.

Operating System Requirements

Since version 5.2 onwards, TDH supports clusters with nodes running on different operating systems. Users just need to add a different RPM repository configuration when users add a cluster server and assign the node the corresponding RPM repository.

The following operating systems are supported by TDH:

OPERATING SYSTEMVERSION
Red Hat Enterprise Linux7.5,7.6,7.7,7.8,7.9
CentOS7.5,7.6,7.7,7.8,7.9
SUSE Linux Enterprise Server12 SP2,12 SP3

Table 2-1 Operating System Requirements

Java Environment Requirements

📘

Kindly note

  • If JDK is not already installed on the machine in users’ cluster, users do not need to install JDK themself. The Data Hub installation tool provided by us will help users install it. If users’ machine has different versions of JDKs, it may conflict with the JDK installed by the installation tool. Please run the following command to check users’ JDK version:
    java -version
    
  • If users’ JDK version is different from the ones listed below, please contact us for solutions.
  • TDH currently supports the JDK version: Oracle JDK 1.8

Browsers Supported

Data Hub uses Web page as the platform management interface, and the management platform supports the following browsers:

BROWSERVERSION
Google Chrome (Recommended)71 or above
FireFox64 or above
Safari11.1.2 or above, or 12.0.2 or above

Table 2-2 Browsers Supported