Create and manage tables

A table is a metadata unit that belongs to a database. This document describes basic management tasks such as creating, viewing, editing, and deleting tables.

Create table

To create a table, a catalog and database must already be created. Before creating a table, the database status must be Active or Altering.

To create a table in Data Catalog:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. In the Table menu or on the database details page, click [Create table].

3. Enter the following information and click [Create].

   Field	Description
   Type	Select the table type - Standard table or Iceberg table
   Database	Select the database where the table will be created
   Table name	Table name
   Data storage path	Enter the Object Storage path where table data is stored - Bucket: Select an Object Storage bucket - Directory: Enter a subdirectory path under the bucket * Note: The full path is stored in s3a:// format
   Data format	Select the table data format - Supported Standard table formats: Avro, JSON, Parquet, ORC, CSV, TEXT - Supported Iceberg table formats: Avro, Parquet, ORC
   Pub/Sub integration	Choose whether to enable Pub/Sub integration (displayed only for the Standard type) - If enabled, select the Pub/Sub topic to use - For more information about creating Pub/Sub topics, refer to Create Pub/Sub topics
   Description (optional)	Additional description of the table
   Properties (optional)	Add table properties
   Schema	Click [Add field] to configure the schema - Partition key: Whether to specify the field as a partition key. This can be configured only when creating a table - Column No.: Position of the field in the schema - Field name: Field name   ㄴ For the avro type, field names cannot start with numbers - Field type: Data type of the field - Description (optional): Additional description for the field - [More] icon: Edit or delete the field

info

• At least one field that is not specified as a partition key is required to create a schema.
• You can add up to 50 fields, including fields and partition fields.
• Field descriptions can be up to 130 characters, and emojis are not allowed.
• For Iceberg table types, if a field with the same name as a partition field is added, a partition property that references the field with the identity transform is added.
• For details about fields, refer to Add schema fields for each type.

View table list and details

You can view key information and status for tables currently in use from the Data Catalog table list.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu to view the table list.

   Field	Description
   Name	Table name entered when the table was created - Click the table name to go to the details tab
   Associated database	Name of the database connected to the table
   Status	Table status
   Data storage path	Table data storage path entered when the table was created
   Type	Table type - Standard, Iceberg, MySQL
   Data format	Data format of the table
   Last modified	Last modified date and time of the table
   [More] icon	- View full schema: View the full schema of the table - Edit table: Edit the table data storage path and description - Delete table: Delete the table * For INACTIVE status, only single deletion is available and table editing is not available

3. Select a table from the table list to view its details. For details available by table type, refer to Manage table data.

Edit table

You can edit information for a created table. The editable fields vary depending on the table type.

1. Go to the KakaoCloud console > Analytics > Data Catalog.
2. Click the Table menu.
3. In the table list, select the [More] icon for the table to edit, then select Edit.
4. In the popup, check the editable fields.

Standard type table

Field	Description
Data storage path	Table data storage path entered when the table was created
Pub/Sub integration	Enable or disable Pub/Sub integration - If the Pub/Sub topic used for integration has been deleted, the enabled status is maintained, but a new topic must be selected for proper use
Description (optional)	Edit the table description

Iceberg type table

Field	Description
Data storage path	Table data storage path entered when the table was created
Description (optional)	Edit the table description

5. Click [Save].

Delete table

You can delete tables that are no longer used.

caution

Deleted tables and data cannot be recovered.

1. Go to the KakaoCloud console > Analytics > Data Catalog.
2. Click the Table menu.
3. In the table list, select the [More] icon for the table to delete, then select Delete.
4. In the popup, enter the exact name of the table to delete and click [Delete].

Pub/Sub integration

You can integrate with external systems by delivering table metadata changes to a Pub/Sub topic.

Integrate with Pub/Sub topic

info

Pub/Sub integration is available only for Standard tables, and a Pub/Sub topic must already be created before integration.
For how to create a topic, refer to Create Pub/Sub topics.

To integrate a Pub/Sub topic with a Data Catalog table:

1. When creating a table, enable Pub/Sub integration.
2. Check the list of available topics, then select a topic.
3. If the table has already been created, enable Pub/Sub integration through Edit.
4. Check the list of available topics, then select a topic.

Manage Pub/Sub events

When table information changes, an event is published to the specified Pub/Sub topic. You can check published events in Pub/Sub Manage subscriptions.

The generated event types and categories are as follows.

Type	Description	Categories
Table events	Generated by creating, modifying, or deleting tables in Data Catalog	- CreateTableEvent - AlterTableEvent - DropTableEvent
Partition events	Published when partition information changes through Hadoop Eco integration	- AddPartitionEvent - AlterPartitionEvent - DropPartitionEvent

Manage table data

Tables consist of various metadata, such as SerDe parameters, table properties, schemas, and partitions.
In the Data Catalog console, you can view, add, edit, and delete metadata by table type, such as Standard and Iceberg.

info

For tables created by a crawler (MySQL type), only schema data is displayed.

Standard table type

Standard table type

SerDe parameters management

View SerDe parameters

To view SerDe parameters for a Standard table:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose SerDe parameters to view from the table list.

3. Select the SerDe Parameters tab.

   Field	Description
   Key	Key of the SerDe parameter
   Value	Value of the SerDe parameter
   [More] icon	Provides the edit function (deletion is not supported)

Add SerDe parameters

To add a new SerDe parameter to a Standard table:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add SerDe parameters to from the table list.

3. In the SerDe Parameters tab, click [Add SerDe parameter].

4. In the popup, add the parameter and click [Add].

   Field	Description
   Key	Key of the SerDe parameter
   Value	Value of the SerDe parameter

Edit SerDe parameters

To edit SerDe parameters for a Standard table:

1. Go to the KakaoCloud console > Analytics > Data Catalog.
2. Click the Table menu, then select the table whose SerDe parameters to edit from the table list.
3. In the SerDe Parameters tab, select the [More] icon > Edit.
4. In the popup, edit the value and click [Edit].

---

Table properties management

View table properties

You can view the list of table properties currently in use for a Standard table.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose properties to view from the table list.

3. In the Table properties tab, check the table properties.

   Field	Description
   Key	Key of the table property
   Value	Value of the table property
   [More] icon	Edit and delete functions

Add table properties

To add properties to a Standard table:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add table properties to from the table list.

3. In the Table properties tab, click [Add table property].

4. In the popup, add the property and click [Add].

   Field	Description
   Key	Key of the table property
   Value	Value of the table property

Edit table properties

To edit properties for a Standard table:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add table properties to from the table list.

3. In the Table properties tab, select the [More] icon for the table property to edit, then select Edit.

4. In the popup, edit the property and click [Edit].

Delete table properties

You can delete table properties currently in use from Standard table details.

caution

Deleted data cannot be recovered.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose properties to delete from the table list.

3. In the Table properties tab, select the [More] icon for the table property to delete, then select Delete.

4. In the popup, click [Delete].

---

Standard schema management

View standard schema fields

You can view schema fields from Standard table details.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose schema fields to view from the table list.

3. In the Schema tab, view the schema fields.

   Field	Description
   No.	Column number used to sort partition fields - The initial column number starts at 1 - Column numbers can be set between 1 and the last number plus 1 - Not entered for partition keys
   Field name	Configured schema field name
   Field type	Data type of the field - Supported types: array, bigint, binary, boolean, char, date, decimal, double, float, int, map, smallint, string, struct, timestamp, tinyint, union, varchar
   Partition key	Whether the partition key option was specified when creating the table
   Description	Schema description
   [More] icon	Edit and delete field functions

Add standard schema fields

You can add schema fields from Standard table details. Up to 50 fields can be added.

info

For MySQL types and tables with the JSON or CSV data format, fields cannot be added, edited, or deleted after table creation.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add schema fields to from the table list.

3. Click the Schema tab, then click [Add field].

4. In the popup, enter the information and click [Add].

   Field	Description
   Column number	Number used to sort partition fields - The initial column number starts at 1 - Column numbers can be set between 1 and the last number plus 1 - Not entered for partition keys
   Field name	Enter the field name
   Field type	Data type of the field - Supported types: array, bigint, binary, boolean, char, date, decimal, double, float, int, map, smallint, string, struct, timestamp, tinyint, union, varchar
   Description (optional)	Description of the field

Modify standard schema fields

You can modify schema fields from Standard table details.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add schema fields to from the table list.

3. In the Schema tab, select the [More] icon for the schema field to modify, then select Modify.

4. In the popup, modify the information and click [Modify].

Delete standard schema fields

You can delete schema fields currently in use from Standard table details.

caution

Deleted data cannot be recovered.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose schema fields to delete from the table list.

3. In the Schema tab, select the [More] icon for the schema field to delete, then select Delete.

4. In the popup, click [Delete].

---

Partition management

View partitions

You can view partitions from Standard table details.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose partitions to view from the table list.

3. In the Partitions tab, view partition information.

   Field	Description
   Files	Linked file links for the partition
   Properties	Schema view for the partition

Iceberg table type

Iceberg table type

Table properties management

View table properties

You can view the list of table properties currently in use for an Iceberg table.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose properties to view from the table list.

3. In the Table properties tab, check the table properties.

   Field	Description
   Key	Key of the table property
   Value	Value of the table property
   [More] icon	- Edit table property - Delete table property

Add table properties

To add Iceberg table properties:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add table properties to from the table list.

3. In the Table properties tab, click [Add table property].

4. In the popup, add the property and click [Add].

   Field	Description
   Key	Key of the table property
   Value	Value of the table property

Edit table properties

To edit Iceberg table properties:

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add table properties to from the table list.

3. In the Table properties tab, select the [More] icon for the table property to edit, then select Edit table property.

4. In the popup, edit the property and click [Edit].

Delete table properties

You can delete table properties currently in use from Iceberg table details.

caution

Deleted data cannot be recovered.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose properties to delete from the table list.

3. In the Table properties tab, select the [More] icon for the table property to delete, then select Delete table property.

4. In the popup, click [Delete].

---

Partition properties management

View partition properties

You can view partition properties from Iceberg table details.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose partition properties to view from the table list.

3. In the Partition properties tab, view partition property information.

   Field	Description
   Partition information	User-created partition property information

---

Iceberg schema management

View Iceberg schema fields

You can view schema fields from Iceberg table details.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose schema fields to view from the table list.

3. In the Schema tab, view the schema fields.

   Field	Description
   No.	Column number used to sort partition fields - The initial column number starts at 1 - Column numbers can be set between 1 and the last number plus 1 - Not entered for partition keys
   Field name	Configured schema field name
   Field type	Data type of the field If a viewable schema exists, click it to check details - Supported types: binary, boolean, date, decimal, double, float, int, long, string, time, timestamp, timestamptz, uuid
   Partition key	Whether the partition key option was specified when creating the table
   Description	Schema description

Add Iceberg schema fields

You can add schema fields from Iceberg table details. Up to 50 fields can be added.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table to add schema fields to from the table list.

3. Click the Schema tab, then click [Add field].

4. In the popup, enter the information and click [Add].

   Field	Description
   Column number	Number used to sort fields - The initial column number starts at 1 - Column numbers can be set between 1 and the last number plus 1
   Field name	Field name
   Field type	Data type of the field If a viewable schema exists, click it to check details - Supported types: binary, boolean, date, double, float, int, long, string, time, timestamp, timestamptz, uuid
   Description (optional)	Additional description of the field

Modify Iceberg schema fields

You can modify schema fields from Iceberg table details.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose schema fields to modify from the table list.

3. In the Schema tab, select the [More] icon for the schema field to modify, then select Modify.

4. In the popup, modify the information and click [Modify].

Delete Iceberg schema fields

You can delete schema fields currently in use from Iceberg table details.

caution

Deleted data cannot be recovered.

1. Go to the KakaoCloud console > Analytics > Data Catalog.

2. Click the Table menu, then select the table whose schema fields to delete from the table list.

3. In the Schema tab, select the [More] icon for the schema field to delete, then select Delete.

4. In the popup, click [Delete].