Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RELEASE] Release version 2.10.0 #995

Closed
20 of 23 tasks
opensearch-trigger-bot bot opened this issue Jul 18, 2023 · 2 comments
Closed
20 of 23 tasks

[RELEASE] Release version 2.10.0 #995

opensearch-trigger-bot bot opened this issue Jul 18, 2023 · 2 comments
Assignees
@navneet1v
Labels
release v2.10.0 Issues targeting release v2.10.0

Comments

@opensearch-trigger-bot
Copy link
Contributor

opensearch-trigger-bot bot commented Jul 18, 2023 •
edited by navneet1v
Loading

This is a component issue for 2.10.0.
Coming from opensearch-project/opensearch-build#3743. Please follow the following checklist.
Please refer to the DATES in that post.

How to use this issue

This Component Release Issue

This issue captures the state of the OpenSearch release, on component/plugin level; its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help.
Any release related work can be linked to this issue or added as comments to create visiblity into the release status.

Release Steps

There are several steps to the release process; these steps are completed as the whole component release and components that are behind present risk to the release. The component owner resolves the tasks in this issue and communicate with the overall release owner to make sure each component are moving along as expected.

Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release. The most current set of dates is on the overall release issue linked at the top of this issue.

The Overall Release Issue

Linked at the top of this issue, the overall release issue captures the state of the entire OpenSearch release including references to this issue, the release owner which is the assignee is responsible for communicating the release status broadly. Please contact them or @mention them on that issue for help.

What should I do if my plugin isn't making any changes?

If including changes in this release, increment the version on 2.x branch to 2.10.0 for Min/Core, and 2.10.0.0 for components. Otherwise, keep the version number unchanged for both.

Preparation

  • Assign this issue to a release owner.
  • Finalize scope and feature set and update the Public Roadmap.
  • All the tasks in this issue have been reviewed by the release owner.
  • Create, update, triage and label all features and issues targeted for this release with v2.10.0.

CI/CD

  • All code changes for 2.10.0 are complete.
  • Ensure working and passing CI.
  • Check that this repo is included in the distribution manifest.

Pre-Release

  • Update to the 2.10.0 release branch in the distribution manifest.
  • Increment the version on the parent branch to the next development iteration.
  • Gather, review and publish release notes following the rules and back port it to the release branch.git-release-notes may be used to generate release notes from your commit history.
  • Confirm that all changes for 2.10.0 have been merged.
  • Add this repo to the manifest for the next developer iteration.

Release Testing

  • Find/fix bugs using latest tarball and docker image provided in parent release issue and update the release notes if necessary.
  • Code Complete: Test within the distribution, ensuring integration, backwards compatibility, and performance tests pass.
  • Sanity Testing: Sanity testing and fixing of critical issues found.
  • File issues for all intermittent test failures.

Release

  • Complete documentation.
  • Verify all issued labeled for this release are closed or labelled for the next release.
  • Verify the release date mentioned in release notes is correct and matches actual release date.

Post Release

  • Prepare for an eventual security fix development iteration by incrementing the version on the release branch to the next eventual patch version.
  • Add this repo to the manifest of the next eventual security patch version.
  • Suggest improvements to this template.
  • Conduct a retrospective, and publish its results.
@jmazanec15 jmazanec15 mentioned this issue Aug 15, 2023
Closed
71 tasks
@navneet1v navneet1v self-assigned this Aug 22, 2023
@navneet1v navneet1v mentioned this issue Aug 23, 2023
Closed
5 tasks
@navneet1v navneet1v mentioned this issue Sep 4, 2023
Merged
5 tasks
@gaiksaya gaiksaya added the v2.10.0 Issues targeting release v2.10.0 label Sep 5, 2023
@bbarani bbarani mentioned this issue Sep 22, 2023
Closed
71 tasks
@navneet1v
Copy link
Collaborator

navneet1v commented Sep 23, 2023 •
edited
Loading

Performance Test Results 2.10.0

Configurations

Data Sets

Dataset Train size Dimensions Distance Format K
sift 1,000,000 128 L2 hdf5 100

Total Queries: 10,000

Cluster Configuration

Config item Value
Leader Nodes 3
Leader Node Type c5.xlarge
Leader Node Disk Space 20
Data Nodes 3
Data Node Type r5.4xlarge
Data Node Disk Space 500
Primary Shard Count 24
Replica Count 1
AZ us-east-1

Client Configuration

Config item Value
OS Amazon Linux
Instance Type c5.9xlarge
Count 1
EBS Size 800G
AZ us-east-1

Visualizations

Versions Comparisions

ingest_took
query_took_p50
query_took_p99

All HNSW Algo P99 Latency

all_hnsw_query_p99

Filters Comparisions

lucene_and_faiss_restrictive_flters_query_p99

lucene_and_faiss_relaxed_flters_query_p99

faiss_all_filters_query_p99

lucene_all_filters_query_p99

All Queries p99

query_took_p99_all

Results

NMSLib

{
  "metadata": {
    "test_name": "Nmslib HNSW Test",
    "test_id": "Nmslib HNSW Test",
    "date": "09/17/2023 03:23:12",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1136103424 (used) / 64418037760 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 406335.4007692977,
    "delete_index_took_total": 168.43705239880364,
    "create_index_took_total": 185.34664559992962,
    "ingest_took_total": 83853.6224875017,
    "refresh_index_store_kb_total": 2923897.613671875,
    "refresh_index_took_total": 11595.026193500962,
    "force_merge_took_total": 267291.38865969726,
    "warmup_operation_took_total": 253.27973059902433,
    "query_took_total": 42988.3,
    "query_took_p50": 4.0,
    "query_took_p90": 5.0,
    "query_took_p99": 6.0,
    "query_took_p99.9": 9.4,
    "query_took_p100": 774.6,
    "query_client_time_total": 74256.1,
    "query_client_time_p50": 7.0,
    "query_client_time_p90": 8.0,
    "query_client_time_p99": 9.6,
    "query_client_time_p99.9": 48.9,
    "query_client_time_p100": 778.2,
    "query_memory_kb_total": 1270854.1,
    "query_recall@K_total": 0.9998524999999999,
    "query_recall@1_total": 1.0
  }
}

Lucene-HNSW

{
  "metadata": {
    "test_name": "Lucene HNSW Perf Tool",
    "test_id": "Lucene HNSW Perf Tool",
    "date": "09/18/2023 09:14:47",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1143144448 (used) / 64410996736 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 414776.7492311863,
    "delete_index_took_total": 263.06755750556476,
    "create_index_took_total": 201.20460289763287,
    "ingest_took_total": 187483.10178190004,
    "refresh_index_store_kb_total": 1871928.6291992187,
    "refresh_index_took_total": 398.82889378932305,
    "force_merge_took_total": 173006.34639509371,
    "query_took_total": 53424.2,
    "query_took_p50": 5.0,
    "query_took_p90": 5.1,
    "query_took_p99": 6.0,
    "query_took_p99.9": 11.6,
    "query_took_p100": 1040.6,
    "query_client_time_total": 85136.2,
    "query_client_time_p50": 8.0,
    "query_client_time_p90": 8.6,
    "query_client_time_p99": 9.0,
    "query_client_time_p99.9": 142.2,
    "query_client_time_p100": 1045.1,
    "query_memory_kb_total": 0.0,
    "query_recall@K_total": 0.99907,
    "query_recall@1_total": 1.0
  }
}

Lucene HNSW Relaxed Filter

{
  "metadata": {
    "test_name": "Lucene HNSW Relaxed Filter Test",
    "test_id": "Lucene HNSW Relaxed Filter Test",
    "date": "09/18/2023 10:31:33",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1187278848 (used) / 64366854144 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 411132.2436136994,
    "delete_index_took_total": 262.367204594193,
    "create_index_took_total": 183.15607588738203,
    "ingest_multi_field_took_total": 205749.79998851195,
    "refresh_index_store_kb_total": 2534324.8072265624,
    "refresh_index_took_total": 455.4968860989902,
    "force_merge_took_total": 125338.62345860689,
    "query_with_filter_took_total": 79142.8,
    "query_with_filter_took_p50": 7.0,
    "query_with_filter_took_p90": 9.0,
    "query_with_filter_took_p99": 9.7,
    "query_with_filter_took_p99.9": 47.3,
    "query_with_filter_took_p100": 1033.7,
    "query_with_filter_client_time_total": 113661.0,
    "query_with_filter_client_time_p50": 11.0,
    "query_with_filter_client_time_p90": 12.0,
    "query_with_filter_client_time_p99": 13.0,
    "query_with_filter_client_time_p99.9": 229.2,
    "query_with_filter_client_time_p100": 1038.1,
    "query_with_filter_memory_kb_total": 0.0,
    "query_with_filter_recall@K_total": 0.9994021999999999,
    "query_with_filter_recall@1_total": 1.0
  }
}

Lucene HNSW Restrictive Filter

{
  "metadata": {
    "test_name": "Lucene HNSW Restrictive Filter Test",
    "test_id": "Lucene HNSW Restrictive Filter Test",
    "date": "09/18/2023 11:48:17",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1186574336 (used) / 64367566848 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 412223.3220603188,
    "delete_index_took_total": 235.3126900154166,
    "create_index_took_total": 180.0274140026886,
    "ingest_multi_field_took_total": 203789.9278986093,
    "refresh_index_store_kb_total": 2648743.6458007814,
    "refresh_index_took_total": 451.2767250009347,
    "force_merge_took_total": 142151.67733269045,
    "query_with_filter_took_total": 65415.1,
    "query_with_filter_took_p50": 6.0,
    "query_with_filter_took_p90": 6.2,
    "query_with_filter_took_p99": 7.0,
    "query_with_filter_took_p99.9": 17.5,
    "query_with_filter_took_p100": 1031.8,
    "query_with_filter_client_time_total": 99054.2,
    "query_with_filter_client_time_p50": 9.0,
    "query_with_filter_client_time_p90": 10.0,
    "query_with_filter_client_time_p99": 10.5,
    "query_with_filter_client_time_p99.9": 208.6,
    "query_with_filter_client_time_p100": 1036.4,
    "query_with_filter_memory_kb_total": 0.0,
    "query_with_filter_recall@K_total": 1.0,
    "query_with_filter_recall@1_total": 1.0
  }
}

Faiss-HNSWPQ

{
  "metadata": {
    "test_name": "Faiss HNSW PQ Test",
    "test_id": "Faiss HNSW PQ Test",
    "date": "09/17/2023 05:57:50",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1129291776 (used) / 64424849408 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 596367.0876317128,
    "delete_model_took_total": 59.72734500246588,
    "delete_index_took_total": 222.82452609797474,
    "train_model_took_total": 153481.88563140284,
    "create_index_took_total": 316.72268889960833,
    "ingest_took_total": 88566.83065959951,
    "refresh_index_store_kb_total": 2019979.08828125,
    "refresh_index_took_total": 7242.593670001952,
    "force_merge_took_total": 291677.84172450774,
    "warmup_operation_took_total": 447.36138620064594,
    "query_took_total": 54351.3,
    "query_took_p50": 5.1,
    "query_took_p90": 6.0,
    "query_took_p99": 7.3,
    "query_took_p99.9": 11.0,
    "query_took_p100": 574.9,
    "query_client_time_total": 85580.7,
    "query_client_time_p50": 8.0,
    "query_client_time_p90": 9.0,
    "query_client_time_p99": 11.0,
    "query_client_time_p99.9": 49.3,
    "query_client_time_p100": 601.5,
    "query_memory_kb_total": 334828.0,
    "query_recall@K_total": 0.6291205,
    "query_recall@1_total": 0.9949
  }
}

Faiss-HNSW

{
  "metadata": {
    "test_name": "Faiss HNSW Test",
    "test_id": "Faiss HNSW Test",
    "date": "09/18/2023 07:03:19",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1166209024 (used) / 64387837952 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 408460.46053130174,
    "delete_index_took_total": 282.885223912308,
    "create_index_took_total": 191.4200002909638,
    "ingest_took_total": 81116.79288399173,
    "refresh_index_store_kb_total": 2946769.2146484377,
    "refresh_index_took_total": 32319.32784759556,
    "force_merge_took_total": 238578.29831660492,
    "warmup_operation_took_total": 265.4362589062657,
    "query_took_total": 55706.3,
    "query_took_p50": 5.3,
    "query_took_p90": 6.0,
    "query_took_p99": 6.9,
    "query_took_p99.9": 10.7,
    "query_took_p100": 623.8,
    "query_client_time_total": 89167.0,
    "query_client_time_p50": 9.0,
    "query_client_time_p90": 9.4,
    "query_client_time_p99": 10.0,
    "query_client_time_p99.9": 53.5,
    "query_client_time_p100": 641.5,
    "query_memory_kb_total": 1297436.0,
    "query_recall@K_total": 0.9998870999999999,
    "query_recall@1_total": 1.0
  }
}

Faiss HNSW Relaxed Filter

{
  "metadata": {
    "test_name": "Faiss HNSW Relaxed Filter Test",
    "test_id": "Faiss HNSW Relaxed Filter Test",
    "date": "09/18/2023 14:25:25",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1181261824 (used) / 64372875264 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 433249.3112490047,
    "delete_index_took_total": 263.8268157024868,
    "create_index_took_total": 171.10857240040787,
    "ingest_multi_field_took_total": 85354.8690359923,
    "refresh_index_store_kb_total": 2989728.434765625,
    "refresh_index_took_total": 32207.926894602133,
    "force_merge_took_total": 240174.4029422116,
    "warmup_operation_took_total": 255.97698809579015,
    "query_with_filter_took_total": 74821.2,
    "query_with_filter_took_p50": 7.0,
    "query_with_filter_took_p90": 9.0,
    "query_with_filter_took_p99": 10.0,
    "query_with_filter_took_p99.9": 14.8,
    "query_with_filter_took_p100": 754.6,
    "query_with_filter_client_time_total": 109845.7,
    "query_with_filter_client_time_p50": 10.8,
    "query_with_filter_client_time_p90": 12.0,
    "query_with_filter_client_time_p99": 14.0,
    "query_with_filter_client_time_p99.9": 69.4,
    "query_with_filter_client_time_p100": 759.7,
    "query_with_filter_memory_kb_total": 1297436.0,
    "query_with_filter_recall@K_total": 0.9998972,
    "query_with_filter_recall@1_total": 1.0
  }
}

Faiss HNSW Restrictive Filter

{
  "metadata": {
    "test_name": "Faiss HNSW Restrictive Filter Test",
    "test_id": "Faiss HNSW Restrictive Filter Test",
    "date": "09/18/2023 15:42:51",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1184792576 (used) / 64369348608 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 415441.8328961778,
    "delete_index_took_total": 203.90783329494298,
    "create_index_took_total": 187.18981560086831,
    "ingest_multi_field_took_total": 85317.41634720238,
    "refresh_index_store_kb_total": 2924925.240527344,
    "refresh_index_took_total": 33852.69187049125,
    "force_merge_took_total": 249037.50273640035,
    "warmup_operation_took_total": 237.0242931880057,
    "query_with_filter_took_total": 46606.1,
    "query_with_filter_took_p50": 4.8,
    "query_with_filter_took_p90": 5.0,
    "query_with_filter_took_p99": 5.5,
    "query_with_filter_took_p99.9": 9.3,
    "query_with_filter_took_p100": 503.2,
    "query_with_filter_client_time_total": 81088.8,
    "query_with_filter_client_time_p50": 8.0,
    "query_with_filter_client_time_p90": 8.5,
    "query_with_filter_client_time_p99": 9.5,
    "query_with_filter_client_time_p99.9": 65.0,
    "query_with_filter_client_time_p100": 568.8,
    "query_with_filter_memory_kb_total": 83821.9,
    "query_with_filter_recall@K_total": 1.0,
    "query_with_filter_recall@1_total": 1.0
  }
}

Faiss-IVF

{
  "metadata": {
    "test_name": "Faiss IVF",
    "test_id": "Faiss IVF",
    "date": "09/18/2023 16:11:28",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1140625408 (used) / 64413515776 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 122377.27158713891,
    "delete_model_took_total": 64.06975720310584,
    "delete_index_took_total": 276.31378790247254,
    "train_model_took_total": 1469.665975717362,
    "create_index_took_total": 173.701382096624,
    "ingest_took_total": 79845.87392170215,
    "refresh_index_store_kb_total": 2378214.898730469,
    "refresh_index_took_total": 408.9963950100355,
    "force_merge_took_total": 6987.315576389665,
    "warmup_operation_took_total": 224.23479111748748,
    "query_took_total": 32927.1,
    "query_took_p50": 3.0,
    "query_took_p90": 3.9,
    "query_took_p99": 4.1,
    "query_took_p99.9": 9.0,
    "query_took_p100": 790.4,
    "query_client_time_total": 66122.5,
    "query_client_time_p50": 6.2,
    "query_client_time_p90": 7.0,
    "query_client_time_p99": 7.2,
    "query_client_time_p99.9": 49.2,
    "query_client_time_p100": 795.5,
    "query_memory_kb_total": 1047835.5,
    "query_recall@K_total": 0.9471356999999999,
    "query_recall@1_total": 1.0
  }
}

Faiss-IVF Relaxed Filter

{
  "metadata": {
    "test_name": "Faiss IVF Relaxed Filter Test",
    "test_id": "Faiss IVF Relaxed Filter Test",
    "date": "09/18/2023 16:45:04",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1180073984 (used) / 64374067200 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 150610.41297570168,
    "delete_model_took_total": 59.82169870403595,
    "delete_index_took_total": 233.3655559050385,
    "train_model_took_total": 1477.3306948016398,
    "create_index_took_total": 184.30843229289167,
    "ingest_multi_field_took_total": 85948.68139720638,
    "refresh_index_store_kb_total": 2396732.848828125,
    "refresh_index_took_total": 450.3978513937909,
    "force_merge_took_total": 7394.779809302418,
    "warmup_operation_took_total": 212.42753609549254,
    "query_with_filter_took_total": 54649.3,
    "query_with_filter_took_p50": 5.1,
    "query_with_filter_took_p90": 6.0,
    "query_with_filter_took_p99": 20.0,
    "query_with_filter_took_p99.9": 30.2,
    "query_with_filter_took_p100": 536.1,
    "query_with_filter_client_time_total": 89949.9,
    "query_with_filter_client_time_p50": 8.4,
    "query_with_filter_client_time_p90": 9.9,
    "query_with_filter_client_time_p99": 23.6,
    "query_with_filter_client_time_p99.9": 69.7,
    "query_with_filter_client_time_p100": 584.1,
    "query_with_filter_memory_kb_total": 1050030.0,
    "query_with_filter_recall@K_total": 0.47706109999999996,
    "query_with_filter_recall@1_total": 0.9999
  }
}

Faiss-IVF Restrictive Filter

{
  "metadata": {
    "test_name": "Faiss IVF restrictive Filter Test",
    "test_id": "Faiss IVF restrictive Filter Test",
    "date": "09/18/2023 17:17:13",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1224474624 (used) / 64329580544 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 143396.2053682299,
    "delete_model_took_total": 69.25333510152996,
    "delete_index_took_total": 196.26419759588316,
    "train_model_took_total": 1486.3071769999806,
    "create_index_took_total": 176.7438047041651,
    "ingest_multi_field_took_total": 85423.0659870198,
    "refresh_index_store_kb_total": 1410208.4731445312,
    "refresh_index_took_total": 458.4203001984861,
    "force_merge_took_total": 7376.541089208331,
    "warmup_operation_took_total": 190.10947740171105,
    "query_with_filter_took_total": 48019.5,
    "query_with_filter_took_p50": 5.0,
    "query_with_filter_took_p90": 5.0,
    "query_with_filter_took_p99": 5.3,
    "query_with_filter_took_p99.9": 10.0,
    "query_with_filter_took_p100": 754.1,
    "query_with_filter_client_time_total": 82404.0,
    "query_with_filter_client_time_p50": 8.0,
    "query_with_filter_client_time_p90": 9.0,
    "query_with_filter_client_time_p99": 9.1,
    "query_with_filter_client_time_p99.9": 61.1,
    "query_with_filter_client_time_p100": 759.4,
    "query_with_filter_memory_kb_total": 0.0,
    "query_with_filter_recall@K_total": 1.0,
    "query_with_filter_recall@1_total": 1.0
  }
}

Faiss-IVFPQ

{
  "metadata": {
    "test_name": "Faiss IVF PQ Test",
    "test_id": "Faiss IVF PQ Test",
    "date": "09/17/2023 06:59:20",
    "python_version": "3.8.18 (default, Sep 11 2023, 13:19:25) \n[GCC 11.2.0]",
    "os_version": "Linux-6.1.49-70.116.amzn2023.aarch64-aarch64-with-glibc2.26",
    "processor": "aarch64, 32 cores",
    "memory": "1130381312 (used) / 64423759872 (available) / 66212589568 (total)"
  },
  "results": {
    "test_took": 321227.18863471894,
    "delete_model_took_total": 58.37369570217561,
    "delete_index_took_total": 195.05684721225407,
    "train_model_took_total": 153153.6661320075,
    "create_index_took_total": 262.03761879587546,
    "ingest_took_total": 85881.90105300455,
    "refresh_index_store_kb_total": 1902191.683984375,
    "refresh_index_took_total": 1240.780163902673,
    "force_merge_took_total": 47961.0379160993,
    "warmup_operation_took_total": 913.9352079946548,
    "query_took_total": 31560.4,
    "query_took_p50": 3.0,
    "query_took_p90": 3.0,
    "query_took_p99": 5.0,
    "query_took_p99.9": 8.6,
    "query_took_p100": 617.8,
    "query_client_time_total": 63895.4,
    "query_client_time_p50": 6.0,
    "query_client_time_p90": 7.0,
    "query_client_time_p99": 8.8,
    "query_client_time_p99.9": 47.4,
    "query_client_time_p100": 633.4,
    "query_memory_kb_total": 87428.0,
    "query_recall@K_total": 0.6135270000000002,
    "query_recall@1_total": 0.9940999999999998
  }
}

@navneet1v
Copy link
Collaborator

Closing the github issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@navneet1v navneet1v

Labels
release v2.10.0 Issues targeting release v2.10.0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@navneet1v @jmazanec15 @gaiksaya