Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Elasticsearch 2 to OpenSearch 2 #1069

Open
sumobrian opened this issue Oct 13, 2024 · 0 comments
Open

Elasticsearch 2 to OpenSearch 2 #1069

sumobrian opened this issue Oct 13, 2024 · 0 comments
Labels
enhancement New feature or request MAv4.0

Comments

@sumobrian
Copy link
Collaborator

sumobrian commented Oct 13, 2024

Is your feature request related to a problem?

The lack os Elasticsearch 2 source support prevents users from performing multi-version hops during migrations to the latest version of OpenSearch.

What solution would you like?

I would like all products within the migration repo to support multi-version hops, allowing users to directly migrate to the latest version of OpenSearch from ElasticSearch 2.x (which may include indices created in Elasticsearch 1.x and its equivalent Lucene version). This should be supported across all migration paths, including metadata migrations, existing data migrations with RFS, and live capture with Capture and Replay.

Additionally, while not all transformations required for metadata, existing data, and live traffic will be supported "out of the box," there should be a mechanism for users performing such migrations to add custom transformations to the OpenSearch-Migrations transformation framework. This would allow for flexibility in handling unique data structures or transformations that may be required for successful migration.

What alternatives have you considered?

An alternative would be performing step-by-step migrations through intermediate versions, but this is time-consuming, complex, and could result in increased downtime or potential data inconsistencies.

Do you have any additional context?

The feature should account for the Lucene compatibility between versions and ensure that indices created in earlier versions are properly handled without the need for manual reindexing or intermediate version upgrades. This would greatly enhance user experience and reduce migration friction across metadata migrations, data migrations using RFS, and Capture and Replay features. By providing the ability for users to add transformations to the framework, we enable a more adaptable and extensible migration path for different use cases.

@sumobrian sumobrian added enhancement New feature or request untriaged and removed untriaged labels Oct 13, 2024
@sumobrian sumobrian changed the title [FEATURE] Add Support for Elasticsearch 2x to migrate to the latest version of OpenSearch 2.<latest> Elasticsearch 2 to OpenSearch 2 Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request MAv4.0
Projects
Status: 6 Months - 1 Year
Development

No branches or pull requests

1 participant