sync develop to master - #246
Merged
Merged
Conversation
- Swap Maven dependency: elasticsearch-rest-high-level-client:7.10.2 → opensearch-rest-high-level-client:2.19.5 - Rename all org.elasticsearch.* imports to org.opensearch.* in ElasticSearchUtil.scala; XContentType stays in org.opensearch.common.xcontent (opensearch-x-content artifact) - Remove dead certIndexType = "_doc" constant from CertificateGeneratorConfig; never consumed by ElasticSearchUtil Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Replace docker.elastic.co/elasticsearch/elasticsearch:7.10.2 with opensearchproject/opensearch:2.19.5. Add OPENSEARCH_JAVA_OPTS and disable security plugin for local dev. Service name kept as elasticsearch to avoid config churn across env files. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
OpenSearch 2.x JARs are compiled with Java 11 and use CONSTANT_Dynamic constant pool entries (tag 17). Scala 2.12.11's class file reader crashes on these with "bad constant pool index: 0". Fixed in 2.12.13; 2.12.19 is the latest patch with additional JDK 17/21 compat fixes. No API or binary format changes within the 2.12 line. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- ProgramUserInfoFunction: remove parens from StringBuilder.length() call; Scala defines length as a no-paren method, stricter compiler rejects length() as applying Int as a function - jobs-distribution assembly: add missing <id> element required by maven-assembly-plugin 3.7.1 (previously unenforced in 3.0.0) - jobs-distribution pom: add appendAssemblyId=false to preserve existing artifact naming convention Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
ElasticSearchUtil.bulkIndexWithIndexId() was reusing the same BulkRequest instance across loop iterations without clearing it after each bulk() call. This caused subsequent batches to resend all previously added operations, leading to exponential duplication and unbounded memory growth. Changed request from immutable val to mutable var and reinitialize after each successful bulk flush. Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
feat: migrate data-pipeline from Elasticsearch 7.10.2 to OpenSearch 2.19.5
pallakartheekreddy
approved these changes
Jun 8, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.