We Built Centralized Search Solution by using AWS Managed OpenSearch Service.
We ingested data from multiple sources like PostgreSQL, Snowflake, API’s, CSV etc.
We have used AWS STEP function for Bulk data ingestion and AWS SQS for Near real time data ingestion into OpenSearch.
We have 3 dedicated master node of r5.large.search instance and 12 data node of i3.2xlarge.search with 1 TB storage on each data node in OpenSearch Cluster.
We have written Search API’s on top of OpenSearch Queries for various use case such as typeahead, Faceted Search, Query Builder, Advance Search like symmentic Search etc.
Now Application developers can consume Rest Based readily available Search by ingesting data in predefined schema.