Restart cluster
Restart cluster
When using Hadoop Eco, if you need to restart instances or if an error occurs requiring a cluster restart, follow these steps to restart the cluster:
- Recommended restart order: Zookeeper → HDFS → YARN → Hive → HBase → History Server → Trino → Kafka → Druid → Redis → Superset → Hue, Zeppelin, etc.
The restart order for each cluster is as follows:
- HDFS
- YARN
- Hive
- HBase
- Dataflow
- HA: journalnode > namenode > zkfc > datanode
- Single: namenode > secondary namenode > datanode
- HA, Single: resource manager > node manager
- HA, Single: metastore > hiveserver2
- HA, Single: HMaster > regionserver
- HA, Single: kafka > druid > redis > superset
tip
If a reboot or error occurs causing a component to stop, it will automatically restart every 3 minutes.
To prevent automatic restart, explicitly stop the component and set the service to disabled.
Stop Zookeeper service
sudo systemctl stop zookeeper.service
sudo systemctl disable zookeeper.service
Hadoop
Hadoop Single
Hadoop Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master | sudo systemctl restart hiveserver2.service | ||
| 6 | tez | tez | tez-ui | Master | sudo systemctl restart tezui.service |
| 7 | spark | spark-historyserver | Master | sudo systemctl restart spark-historyserver.service | |
| 8 | spark | spark-thriftserver | Master | sudo systemctl restart spark-thriftserver.service | |
| 9 | Other | hue | hue | Master | sudo systemctl restart hue.service |
| oozie | oozie | Master | sudo systemctl restart oozie.service | ||
| zeppelin | zeppelin | Master | sudo systemctl restart zeppelin.service |
Hadoop HA
Hadoop HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1, 2, 3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1, 2, 3 | sudo systemctl restart journalnode.service |
| namenode | Master 1, 2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1, 2 | sudo systemctl restart zkfc.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1, 2 | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 1, 2 | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master 1, 2, 3 | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master 1, 2, 3 | sudo systemctl restart hiveserver2.service | ||
| 6 | tez | tez | tez-ui | Master 3 | sudo systemctl restart tezui.service |
| 7 | spark | spark-historyserver | Master 3 | sudo systemctl restart spark-historyserver.service | |
| 8 | spark | spark-thriftserver | Master 3 | sudo systemctl restart spark-thriftserver.service | |
| 9 | Other | hue | hue | Master 3 | sudo systemctl restart hue.service |
| oozie | oozie | Master 3 | sudo systemctl restart oozie.service | ||
| zeppelin | zeppelin | Master 3 | sudo systemctl restart zeppelin.service |
HBase
HBase Single
HBase Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | hbase | hmaster | hmaster | Master | sudo systemctl restart hmaster.service |
| regionserver | regionserver | Master | sudo systemctl restart regionserver.service | ||
| 6 | Other | hue | hue | Master | sudo systemctl restart hue.service |
HBase HA
HBase HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1, 2, 3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1, 2, 3 | sudo systemctl restart journalnode.service |
| namenode | Master 1, 2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1, 2 | sudo systemctl restart zkfc.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1, 2 | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 3 | sudo systemctl restart jobhistoryserver.service |
| 5 | hbase | hmaster | hmaster | Master 1, 2, 3 | sudo systemctl restart hmaster.service |
| regionserver | regionserver | Worker | sudo systemctl restart regionserver.service | ||
| 6 | Other | hue | hue | Master 3 | sudo systemctl restart hue.service |
Trino
Trino Single
Trino Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master | sudo systemctl restart hiveserver2.service | ||
| 6 | trino | trino | coordinator | Master | sudo systemctl restart trino.service |
| worker | Worker | sudo systemctl restart trino.service | |||
| 7 | Other | hue | hue | Master | sudo systemctl restart hue.service |
| zeppelin | zeppelin | Master | sudo systemctl restart zeppelin.service |
Trino HA
Trino HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1, 2, 3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1, 2, 3 | sudo systemctl restart journalnode.service |
| namenode | Master 1, 2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1, 2 | sudo systemctl restart zkfc.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1, 2 | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 3 | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master 1, 2, 3 | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master 1, 2, 3 | sudo systemctl restart hiveserver2.service | ||
| 6 | trino | trino | coordinator | Master 3 | sudo systemctl restart trino.service |
| worker | Worker | sudo systemctl restart trino.service | |||
| 7 | Other | hue | hue | Master 3 | sudo systemctl restart hue.service |
| zeppelin | zeppelin | Master 3 | sudo systemctl restart zeppelin.service |
Dataflow
Dataflow Single
Dataflow Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | kafka | kafka | broker | All | sudo systemctl restart kafka.service |
| 6 | druid | master-query server | coordinator-overlord, broker, router | Master | sudo systemctl restart druid-master-query-server.service |
| data server | historical, middleManager | Master | sudo systemctl restart druid-data-server.service | ||
| 7 | redis | redis | redis | Master | sudo systemctl restart redis.service |
| 8 | Other | hue | hue | Master | sudo systemctl restart hue.service |
| superset | superset | Master | sudo systemctl restart superset.service |
Dataflow HA
Dataflow HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1,2,3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1,2,3 | sudo systemctl restart journalnode.service |
| namenode | Master 1,2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1,2 | sudo systemctl restart zkfc.service | |||
| datanode | Worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1,2 | sudo systemctl restart resourcemanager.service |
| nodemanager | Worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 3 | sudo systemctl restart jobhistoryserver.service |
| 5 | kafka | kafka | broker | All | sudo systemctl restart kafka.service |
| 6 | druid | master-broker server | coordinator-overlord, broker | Master 1,2 | sudo systemctl restart druid-master-broker-server.service |
| master-query server | coordinator-overlord, broker, router | Master 3 | sudo systemctl restart druid-master-query-server.service | ||
| data server | historical, middleManager | Worker | sudo systemctl restart druid-data-server.service | ||
| 7 | redis | redis | redis | Master 3 | sudo systemctl restart redis.service |
| 8 | Other | hue | hue | Master 3 | sudo systemctl restart hue.service |
| superset | superset | Master 3 | sudo systemctl restart superset.service |