Create and manage cluster

A cluster consists of one or more brokers and serves as a comprehensive messaging platform, including real-time data processing, durability, scalability, and security. Clusters enable reliable data flow between multiple applications.
The following describes how to create and manage clusters in the Advanced Managed Kafka service.

Create cluster

Create a new cluster. Depending on the environment, it may take about 10 minutes to create a cluster.

info

Even if you expand the volume after creating a cluster, the maximum IOPS remains fixed at the initially specified value. Configure an appropriate volume size for stable performance.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.

2. Click the [Getting started] button to start using the Advanced Managed Kafka service.

   • A Service Agent is created to access the Advanced Managed Kafka resources.

3. In the Cluster menu, click the [Create cluster] button at the top right.

4. Enter the required information for creating the cluster and click the [Create] button.

   Item	Category	Description
   Basic settings	Cluster name	Name of the cluster to be created - Duplicate cluster names cannot be used within the same project - Example: my-cluster-01
   	Kafka version	Select the Apache Kafka version - Supported Apache Kafka versions
   	Port	Enter the port number for Apache Kafka access - Default port number: 9092 - Available range: 1024–49150
   Instance type		Select an instance type - Brokers in the cluster run based on the selected instance specifications - Instance type cannot be changed after cluster creation
   Network settings	VPC	Select the network where the cluster will be configured - Use a VPC with at least two availability zones for high availability - Choose from an existing user VPC or create a new one
   	Subnet	Select the subnet where brokers will be allocated - Choose from existing user subnets or create a new one
   	Security group	Configure the security group to apply to the cluster - Choose from existing user security groups or create a new one - For details, refer to Security groups
   Broker configuration settings	Number of specified availability zones	Check the number of availability zones and zones selected in network settings
   	Number of brokers	Enter the number of brokers distributed across each availability zone - Broker quota: Maximum of 9 per project - For details about broker quotas, refer to Quotas * Example: If 2 availability zones and 3 brokers are specified, 3 brokers are placed in each availability zone (Total brokers: 6)
   	Volume type/size	Specify the volume type and size allocated to each broker - Volume type: Only SSD type is currently available - Volume size: Minimum 50GB, maximum 5,120GB * Example: If 3 brokers and 50GB volumes are specified, 50GB is allocated per broker (Total volume size: 150GB)
   	Maximum IOPS	Check the maximum IOPS determined by the volume size
   	Detailed settings	Review and adjust other cluster settings

Manage cluster

View cluster list

You can view the list of clusters created within a project.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.

2. In the Cluster menu, view the list of currently created clusters.

   Item	Description	Remarks
   Name	Name specified by the user when creating the cluster	Click the cluster name to view detailed information
   ID	Resource ID of the cluster
   Status	Current status of the cluster	For detailed status information, refer to Cluster lifecycle and status
   Version	Apache Kafka version in use
   Instance type	Broker instance specifications selected during cluster creation	Currently, only r2a.2xlarge is available
   Availability Zones	Number of availability zones configured during cluster creation
   Brokers	Number of brokers created in the cluster	Total number of brokers: Availability Zones * Number of brokers
   Created at	Date and time the cluster was created
   Creator	User who requested cluster creation

View cluster details

You can view information about a cluster created in the project.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.

2. In the Cluster menu, click the cluster name to view details.

3. Review the information in the tabs.

   Item	Description	Remarks
   Status	Current status of the cluster	For detailed status information, refer to Cluster lifecycle and status
   Bootstrap server	Bootstrap server address for initial Kafka cluster connection and communication

Summary tab

Item	Information	Description
Cluster	Cluster name	User-specified cluster name
	Cluster ID	Resource ID of the cluster
	Instance type	Broker instance specifications selected during cluster creation
	Kafka version	Apache Kafka version information
	Creator	User who requested cluster creation
	Created at	Date and time the cluster was created
Broker configuration	Availability zones	Number of availability zones configured during cluster creation
	Brokers per zone	Number of brokers per zone and total brokers (Total brokers: Availability zones * Number of brokers)
	Volume size per broker	Volume size per broker and total volume size

Broker tab

Refer to How-to Guides > Manage broker.

Security tab

View the security group and detailed policies applied to the cluster.

Monitoring tab

Category	Description
Data period	Data period displayed on the monitoring graph
Items to view	Select monitoring items
View mode	Set the monitoring graph view mode
Auto-refresh interval	Set auto-refresh intervals
Manual refresh	Refresh the monitoring results manually

Refer to the monitoring data table in the original text for detailed metrics.

Extend volume

Increase the volume size allocated to brokers to address data growth and storage shortages while maintaining cluster stability.
Storage space can be dynamically increased without restarting brokers.

info

Volume extension refers to increasing disk capacity, but maximum IOPS will not increase. The feature to increase maximum IOPS based on extended volume size will be supported in the future.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.

2. Select the cluster to extend from the Cluster menu.

3. Click the [Extend volume] button located in the upper-right corner.

4. In Volume extension settings, adjust the volume size and click the [Save] button.

   Item	Description
   Cluster name	Check the name of the selected cluster
   Broker count	Check the total number of brokers in the selected cluster
   Volume size	Check the number of brokers deployed per availability zone and specify the volume size to extend

Expand cluster

Increase the number of brokers through cluster expansion to handle growing workloads and increased data flow.
During cluster expansion, broker partition redistribution may temporarily impact performance.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.

2. Select the cluster to expand from the Cluster menu.

3. Click the [Expand cluster] button located in the upper-right corner.

4. In Cluster expansion settings, adjust the number of brokers and click the [Save] button.

   Item	Description
   Cluster name	Check the name of the selected cluster
   Availability zone count	Check the number of availability zones in the selected cluster
   Availability zone	Check the availability zones of the selected cluster
   Broker count	Check the number of brokers deployed per availability zone and specify the number of brokers to expand

Configure cluster details

Check and modify configurable cluster settings. Changing cluster settings will restart all brokers simultaneously.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.

2. Select the cluster to configure from the Cluster menu.

3. Click the [Configure cluster details] button located in the upper-right corner.

4. In Cluster details settings, modify the configuration values and click the [Save] button.

   Item	Description
   auto.create.topics.enable	Enable or disable automatic topic creation
   delete.topic.enable	Enable or disable topic deletion
   unclean.leader.election.enable	Prohibit leader election when no in-sync replicas are available
   default.replication.factor	Default number of replicas for new topics
   num.partitions	Default number of partitions for topics
   message.max.bytes	Maximum size of a Kafka message
   min.insync.replicas	Minimum number of in-sync replicas with the leader
   num.io.threads	Number of threads for disk I/O operations
   num.network.threads	Number of threads for network requests
   num.replica.fetchers	Number of replica fetcher threads retrieving data from the leader
   socket.receive.buffer.bytes	Size of the network socket receive buffer
   socket.request.max.bytes	Maximum request size a broker can accept
   socket.send.buffer.bytes	Size of the network socket send buffer

Delete cluster

You can delete clusters that are no longer needed.

caution

When a cluster is deleted, brokers and allocated volumes are fully returned and cannot be recovered.

1. Go to the KakaoCloud console > Analytics > Advanced Managed Kafka.
2. In the Cluster menu, select the cluster to delete.
3. In the popup, enter the cluster name and click the [Delete] button.