Restart cluster
Restart cluster
When using Hadoop Eco, if you need to restart an instance or if an error occurs requiring a cluster restart, follow these steps:
- Recommended restart order: Zookeeper → HDFS → YARN → Hive → HBase → History Server → Trino → Kafka → Druid → Redis → Superset → Hue, Zeppelin, etc.
The restart order for each cluster is as follows:
- HDFS
- YARN
- Hive
- HBase
- Dataflow
- HA: journalnode > namenode > zkfc > datanode
- Single: namenode > secondary namenode > datanode
- HA, Single: resource manager > node manager
- HA, Single: metastore > hiveserver2
- HA, Single: HMaster > regionserver
- HA, Single: kafka > druid > redis > superset
tip
If a reboot or error causes a component to stop, it will automatically restart every 3 minutes.
If you do not want it to restart, you must explicitly stop the component and set the service to disabled.
Stop Zookeeper service
sudo systemctl stop zookeeper.service
sudo systemctl disable zookeeper.service
Hadoop
Hadoop Single
Hadoop Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master | sudo systemctl restart hiveserver2.service | ||
| 6 | tez | tez | tez-ui | Master | sudo systemctl restart tezui.servicee |
| 7 | spark | spark-historyserver | Master | sudo systemctl restart spark-historyserver.service | |
| 8 | spark | spark-thriftserver | Master | sudo systemctl restart spark-thriftserver.service | |
| 9 | 기타 | hue | hue | Master | sudo systemctl restart hue.service |
| oozie | oozie | Master | sudo systemctl restart oozie.service | ||
| zeppelin | zeppelin | Master | sudo systemctl restart zeppelin.service |
Hadoop HA
Hadoop HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1, 2, 3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1, 2, 3 | sudo systemctl restart journalnode.service |
| namenode | Master 1, 2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1, 2 | sudo systemctl restart zkfc.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1, 2 | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 1, 2 | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master 1, 2, 3 | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master 1, 2, 3 | sudo systemctl restart hiveserver2.service | ||
| 6 | tez | tez | tez-ui | Master 3 | sudo systemctl restart tezui.servicee |
| 7 | spark | spark-historyserver | Master 3 | sudo systemctl restart spark-historyserver.service | |
| 8 | spark | spark-thriftserver | Master 3 | sudo systemctl restart spark-thriftserver.service | |
| 9 | 기타 | hue | hue | Master 3 | sudo systemctl restart hue.service |
| oozie | oozie | Master 3 | sudo systemctl restart oozie.service | ||
| zeppelin | zeppelin | Master 3 | sudo systemctl restart zeppelin.service |
HBase
HBase Single
HBase Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | hbase | hmaster | hmaster | Master | sudo systemctl restart hmaster.service |
| regionserver | regionserver | Master | sudo systemctl restart regionserver.service | ||
| 6 | 기타 | hue | hue | Master | sudo systemctl restart hue.service |
HBase HA
HBase HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1, 2, 3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1, 2, 3 | sudo systemctl restart journalnode.service |
| namenode | Master 1, 2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1, 2 | sudo systemctl restart zkfc.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1, 2 | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 3 | sudo systemctl restart jobhistoryserver.service |
| 5 | hbase | hmaster | hmaster | Master 1, 2, 3 | sudo systemctl restart hmaster.service |
| regionserver | regionserver | worker | sudo systemctl restart regionserver.service | ||
| 6 | 기타 | hue | hue | Master 3 | sudo systemctl restart hue.service |
Trino
Trino Single
Trino Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master | sudo systemctl restart hiveserver2.service | ||
| 6 | trino | trino | coordinator | Master | sudo systemctl restart trino.service |
| worker | worker | sudo systemctl restart trino.service | |||
| 7 | 기타 | hue | hue | Master | sudo systemctl restart hue.service |
| zeppelin | zeppelin | Master | sudo systemctl restart zeppelin.service |
Trino HA
Trino HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1, 2, 3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1, 2, 3 | sudo systemctl restart journalnode.service |
| namenode | Master 1, 2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1, 2 | sudo systemctl restart zkfc.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1, 2 | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 3 | sudo systemctl restart jobhistoryserver.service |
| 5 | hive | metastore | hive metastore | Master 1, 2, 3 | sudo systemctl restart metastore.service |
| hiveserver2 | hiveserver2 | Master 1, 2, 3 | sudo systemctl restart hiveserver2.service | ||
| 6 | trino | trino | coordinator | Master 3 | sudo systemctl restart trino.service |
| worker | worker | sudo systemctl restart trino.service | |||
| 7 | 기타 | hue | hue | Master 3 | sudo systemctl restart hue.service |
| zeppelin | zeppelin | Master 3 | sudo systemctl restart zeppelin.service |
Dataflow
Dataflow Single
Dataflow Single - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | namenode | Master | sudo systemctl restart namenode.service |
| secondary namenode | Master | sudo systemctl restart secondarynamenode.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master | sudo systemctl restart jobhistoryserver.service |
| 5 | kafka | kafka | broker | 전체 | sudo systemctl restart kafka.service |
| 6 | druid | master-query server | coordinator-overlord, broker, router | Master | sudo systemctl restart druid-master-query-server.service |
| data server | historical, middleManager | Master | sudo systemctl restart druid-data-server.service | ||
| 7 | redis | redis | redis | Master | sudo systemctl restart redis.service |
| 8 | 기타 | hue | hue | Master | sudo systemctl restart hue.service |
| superset | superset | Master | sudo systemctl restart superset.service |
Dataflow HA
Dataflow HA - Cluster restart commands
| Order | Category | Service | Component | Location | Command |
|---|---|---|---|---|---|
| 1 | zookeeper | zookeeper | zookeeper | Master 1,2,3 | sudo systemctl restart zookeeper.service |
| 2 | hadoop | hdfs | journalnode | Master 1,2,3 | sudo systemctl restart journalnode.service |
| namenode | Master 1,2 | sudo systemctl restart namenode.service | |||
| zkfc | Master 1,2 | sudo systemctl restart zkfc.service | |||
| datanode | worker | sudo systemctl restart datanode.service | |||
| 3 | hadoop | yarn | resource manager | Master 1,2 | sudo systemctl restart resourcemanager.service |
| nodemanager | worker | sudo systemctl restart nodemanager.service | |||
| timeline server | Master 3 | sudo systemctl restart timelineserver.service | |||
| 4 | hadoop | mapred | job historyserver | Master 3 | sudo systemctl restart jobhistoryserver.service |
| 5 | kafka | kafka | broker | 전체 | sudo systemctl restart kafka.service |
| 6 | druid | master-broker server | coordinator-overlord, broker | Master 1,2 | sudo systemctl restart druid-master-broker-server.service |
| master-query server | coordinator-overlord, broker, router | Master 3 | sudo systemctl restart druid-master-query-server.service | ||
| data server | historical, middleManager | worker | sudo systemctl restart druid-data-server.service | ||
| 7 | redis | redis | redis | Master 3 | sudo systemctl restart redis.service |
| 8 | 기타 | hue | hue | Master 3 | sudo systemctl restart hue.service |
| superset | superset | Master 3 | sudo systemctl restart superset.service |