Integration tests for 1.2.4 OpenSearch Artifacts #1479

abhinavGupta16 · 2022-01-14T06:29:02Z

Adding testing results for 1.2.4 OpenSearch Artifacts.

abhinavGupta16 · 2022-01-14T20:10:53Z

Used job to runt the x64 integ test

2022-01-14 19:44:32 INFO     Skipping integ-tests for opensearch-observability, as it is currently not declared in the test manifest
2022-01-14 19:44:32 INFO     | alerting             | with-security        | PASS  |    0 |
2022-01-14 19:44:32 INFO     | alerting             | without-security     | PASS  |    0 |
2022-01-14 19:44:32 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2022-01-14 19:44:32 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2022-01-14 19:44:32 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2022-01-14 19:44:32 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2022-01-14 19:44:32 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2022-01-14 19:44:32 INFO     | index-management     | with-security        | PASS  |    0 |
2022-01-14 19:44:32 INFO     | index-management     | without-security     | PASS  |    0 |
2022-01-14 19:44:32 INFO     | k-NN                 | with-security        | PASS  |    0 |
2022-01-14 19:44:32 INFO     | k-NN                 | without-security     | PASS  |    0 |
2022-01-14 19:44:32 INFO     | sql                  | with-security        | PASS  |    0 |
2022-01-14 19:44:32 INFO     | sql                  | without-security     | PASS  |    0 |

abhinavGupta16 · 2022-01-14T20:13:09Z

Used job to run the arm64 integ test

2022-01-14 19:52:43 INFO     Skipping integ-tests for opensearch-observability, as it is currently not declared in the test manifest
2022-01-14 19:52:44 INFO     | alerting             | with-security        | PASS  |    0 |
2022-01-14 19:52:44 ERROR    | alerting             | without-security     | FAIL  |    1 |
2022-01-14 19:52:44 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2022-01-14 19:52:44 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2022-01-14 19:52:44 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2022-01-14 19:52:44 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2022-01-14 19:52:44 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2022-01-14 19:52:44 INFO     | index-management     | with-security        | PASS  |    0 |
2022-01-14 19:52:44 INFO     | index-management     | without-security     | PASS  |    0 |
2022-01-14 19:52:44 INFO     | k-NN                 | with-security        | PASS  |    0 |
2022-01-14 19:52:44 INFO     | k-NN                 | without-security     | PASS  |    0 |
2022-01-14 19:52:44 INFO     | sql                  | with-security        | PASS  |    0 |
2022-01-14 19:52:44 INFO     | sql                  | without-security     | PASS  |    0 |

abhinavGupta16 · 2022-01-14T22:12:27Z

Reran tests for arm64

2022-01-14 21:43:34 INFO     Skipping integ-tests for opensearch-observability, as it is currently not declared in the test manifest
2022-01-14 21:43:35 INFO     | alerting             | with-security        | PASS  |    0 |
2022-01-14 21:43:35 INFO     | alerting             | without-security     | PASS  |    0 |
2022-01-14 21:43:35 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2022-01-14 21:43:35 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2022-01-14 21:43:35 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2022-01-14 21:43:35 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2022-01-14 21:43:35 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2022-01-14 21:43:35 INFO     | index-management     | with-security        | PASS  |    0 |
2022-01-14 21:43:35 INFO     | index-management     | without-security     | PASS  |    0 |
2022-01-14 21:43:35 INFO     | k-NN                 | with-security        | PASS  |    0 |
2022-01-14 21:43:35 INFO     | k-NN                 | without-security     | PASS  |    0 |
2022-01-14 21:43:35 INFO     | sql                  | with-security        | PASS  |    0 |
2022-01-14 21:43:35 INFO     | sql                  | without-security     | PASS  |    0 |

abhinavGupta16 · 2022-01-14T22:14:00Z

All tests are green for x64 and arm64

kavilla · 2022-01-15T00:07:02Z

With security:

Alerting

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  alert_spec.js                            02:15        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  bucket_level_monitor_spec.js             00:48        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  destination_spec.js                      00:12        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  query_level_monitor_spec.js              00:17        4        4        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        03:32       17       17        -        -        -

AD

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  ad/dashboard/ad_dashboard.spec.ts        00:07        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  ad/detectorList/detector_list.spec.      00:11       10        9        -        1        - │
  │    ts                                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  ad/workflow/create_detector.spec.ts        7ms        1        -        -        1        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        00:19       17       15        -        2        -

Reports

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  01-create.spec.ts                        01:31        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  02-edit.spec.ts                          01:21        3        3        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  03-details.spec.ts                       00:27        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  04-download.spec.ts                      01:46        5        4        1        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  1 of 4 failed (25%)                      05:07       15       14        1        -        -

GANTT

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  ui.spec.js                               02:15        9        9        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        02:15        9        9        -        -        -

IM

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  indices_spec.js                          00:20        3        3        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  managed_indices_spec.js                  00:38        5        4        -        1        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  policies_spec.js                         00:19        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  rollups_spec.js                          00:28        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  transforms_spec.js                       00:22        4        4        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        02:08       21       20        -        1        -

queryWorkbench

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  ui.spec.js                               01:22       20       20        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        01:22       20       20        -        -        -

Observability

 Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  notebooks.spec.js                        05:22       26       26        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  panels.spec.js                           03:31       21       21        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  trace_analytics_dashboard.spec.js        01:05        8        8        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  trace_analytics_services.spec.js         00:31        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  trace_analytics_traces.spec.js           00:28        5        5        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        10:58       66       66        -        -        -

No security

Alerting

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  alert_spec.js                            02:13        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  bucket_level_monitor_spec.js             00:45        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  destination_spec.js                      00:11        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  query_level_monitor_spec.js              00:16        4        4        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        03:25       17       17        -        -        -

AD

     Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  ad/dashboard/ad_dashboard.spec.ts        00:07        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  ad/detectorList/detector_list.spec.      00:10       10        9        -        1        - │
  │    ts                                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  ad/workflow/create_detector.spec.ts        8ms        1        -        -        1        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        00:18       17       15        -        2        -

Reports

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  01-create.spec.ts                        01:31        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  02-edit.spec.ts                          01:21        3        3        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  03-details.spec.ts                       00:27        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  04-download.spec.ts                      01:45        5        4        1        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  1 of 4 failed (25%)                      05:06       15       14        1        -        -

GANTT

        Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  ui.spec.js                               02:14        9        9        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        02:14        9        9        -        -        -

IM

      Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  indices_spec.js                          00:19        3        3        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  managed_indices_spec.js                  00:37        5        4        -        1        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  policies_spec.js                         00:18        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  rollups_spec.js                          00:26        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  transforms_spec.js                       00:21        4        4        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        02:04       21       20        -        1        -

queryWorkbench

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  ui.spec.js                               01:22       20       20        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        01:22       20       20        -        -        -

Observability

     Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  notebooks.spec.js                        05:20       26       26        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  panels.spec.js                           03:31       21       21        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  trace_analytics_dashboard.spec.js        01:05        8        8        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  trace_analytics_services.spec.js         00:30        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  trace_analytics_traces.spec.js           00:28        5        5        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        10:56       66       66        -        -        -

abhinavGupta16 mentioned this issue Jan 14, 2022

[RELEASE] Release version 1.2.4 #1417

Closed

38 tasks

abhinavGupta16 closed this as completed Jan 14, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Integration tests for 1.2.4 OpenSearch Artifacts #1479

Integration tests for 1.2.4 OpenSearch Artifacts #1479

abhinavGupta16 commented Jan 14, 2022

abhinavGupta16 commented Jan 14, 2022 •

edited

Loading

abhinavGupta16 commented Jan 14, 2022 •

edited

Loading

abhinavGupta16 commented Jan 14, 2022

abhinavGupta16 commented Jan 14, 2022

kavilla commented Jan 15, 2022 •

edited

Loading

Integration tests for 1.2.4 OpenSearch Artifacts #1479

Integration tests for 1.2.4 OpenSearch Artifacts #1479

Comments

abhinavGupta16 commented Jan 14, 2022

abhinavGupta16 commented Jan 14, 2022 • edited Loading

abhinavGupta16 commented Jan 14, 2022 • edited Loading

abhinavGupta16 commented Jan 14, 2022

abhinavGupta16 commented Jan 14, 2022

kavilla commented Jan 15, 2022 • edited Loading

abhinavGupta16 commented Jan 14, 2022 •

edited

Loading

abhinavGupta16 commented Jan 14, 2022 •

edited

Loading

kavilla commented Jan 15, 2022 •

edited

Loading