Skip to content

Search Request Processor: pipeline for transformation of queries and results inline with a search request.

License

Notifications You must be signed in to change notification settings

mingshl/search-processor

 
 

Repository files navigation

Build and Test Search Query & Request Transformers codecov PRs welcome!

Search Query & Request Transformers

Welcome!

This repository is the home of an evolving project that aims to create a pipeline of transformers to preprocess queries before search and post-process results after search. The first component here is a plugin to re-rank search results before returning them to the client inline. In the coming year, we will add hooks to configure other re-rankers and allow users to add their own components to the pipeline. Logging will also be a critical part of the pipeline in two ways:

  1. Logging information about the search experience (e.g. query, search results returned from the index, search results returned to the OpenSearch client)
  2. Logging debug information about the transformers

We will be publishing an RFC soon to give more detail and have a deeper conversation, but for now take a look at the code, open issues, comment, etc.

History

This repository has also been used for discussion and ideas around search relevance. These discussions still exist here, however due to the relatively new standard of having one repo per plugin in OpenSearch and our implementations beginning to make it into the OpenSearch build, we have two repositories now. This repository will develop into a plugin that will allow OpenSearch users to rewrite search queries, rerank results, and log data about those actions. The other repository, dashboards-search-relevance, is where we will build front-end tooling to help relevance engineers and business users tune results.

Project Resources

Code of Conduct

This project has adopted the Amazon Open Source Code of Conduct. For more information see the Code of Conduct FAQ, or contact opensource-codeofconduct@amazon.com with any additional questions or comments.

License

This project is licensed under the Apache v2.0 License.

Copyright

Copyright OpenSearch Contributors. See NOTICE for details.

About

Search Request Processor: pipeline for transformation of queries and results inline with a search request.

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 94.5%
  • Shell 5.5%