Manage indexes
Advanced Managed Search (OpenSearch) provides various index management capabilities even after an index is created, enabling efficient data operations and management.
This page briefly explains the index management features supported in Advanced Managed Search and the purpose of each feature.
Supported index management features
Advanced Managed Search supports the following index management features.
- Index state management
- Index rollup
- Index transform
- Remote reindex
- Data stream
For detailed behavior and API usage of each feature, refer to the OpenSearch official documentation.
Index state management
Index state management allows you to manage read/write states and retention policies based on the lifecycle of an index. This enables operations such as the following.
- Convert an index to read-only after a certain period
- Automatically delete or archive old indexes according to retention policies
- Optimize operational cost and performance as data grows
Index rollup
Index rollup summarizes (aggregates) large volumes of time-series data to reduce storage usage and improve analysis efficiency. It is commonly used in the following scenarios.
- Long-term retention of log and metric data
- Analysis based on summarized data instead of detailed data
- Reduction of storage costs
Index transform
Index transform creates a new index with a different structure based on an existing index. This enables operations such as the following.
- Modify the existing data structure
- Create a new index that extracts only specific fields
- Process and reorganize data
Remote reindex
Remote reindex copies (reindexes) index data from another OpenSearch cluster or an external OpenSearch environment into the current cluster.
Reindex all documents example
POST _reindex
{
"source": {
"index": "source"
},
"dest": {
"index": "destination"
}
}
Reindex from a remote cluster example
POST _reindex
{
"source":{
"remote":{
"host":"61.123.22.33:443",
"username":"YOUR_USERNAME",
"password":"YOUR_PASSWORD"
},
"index": "source"
},
"dest":{
"index":"destination"
}
}
Notes when performing remote reindex
The VPC endpoint created in Advanced Managed Search cannot be used as a remote host. To perform remote reindex, the following conditions must be met.
- The remote OpenSearch cluster must be accessible through a Public IP.
- Public IP–based access must be available through a proxy or network configuration.
- The firewall (Security Group) of the destination cluster (AMS cluster) must allow the remote cluster IP (
61.109.236.21).
Before performing remote reindex, make sure to check network access policies and security configurations. If access permissions are not configured, the reindex request may fail.
Data stream
A data stream is a logical index structure designed for collecting time-series data. By managing multiple backend indexes as a single stream, it provides the following advantages.
- Efficient management of continuously incoming data
- Automatic index creation and rollover
- A structure suitable for processing log and event data