feat: Add upgrade_yml automation for per-component upgrade testing by prasant750h · Pull Request #516 · dell/omnia-containers

prasant750h · 2026-07-15T11:33:16Z

Add upgrade_yml_func.py: check_upgrade_yml_exists, run_upgrade_yml, verify_upgrade_manifest, verify_manifest_component_status, check_software_component_enabled with process detection
Add upgrade_yml_vars.py: UPGRADE_YML_VARS (components: oim, k8s, slurm, openchami with timeouts and prerequisites)
Add upgrade_yml_msgs.py: test names, log messages, assert messages
Add molecule/upgrade_yml scenario (verify-only, 7 tests): TC-1 preflight, TC-2 run, TC-3 manifest, TC-4 OIM, TC-5 K8s conditional, TC-6 Slurm conditional, TC-7 OpenCHAMI conditional
Rename molecule/Upgrade to molecule/upgrade_omnia_sh
Update run_molecule.sh with upgrade_yml scenario and upgrade_and_rollback flow
Update init.py files for functions, vars, messages exports

- Add upgrade_yml_func.py: check_upgrade_yml_exists, run_upgrade_yml, verify_upgrade_manifest, verify_manifest_component_status, check_software_component_enabled with process detection - Add upgrade_yml_vars.py: UPGRADE_YML_VARS (components: oim, k8s, slurm, openchami with timeouts and prerequisites) - Add upgrade_yml_msgs.py: test names, log messages, assert messages - Add molecule/upgrade_yml scenario (verify-only, 7 tests): TC-1 preflight, TC-2 run, TC-3 manifest, TC-4 OIM, TC-5 K8s conditional, TC-6 Slurm conditional, TC-7 OpenCHAMI conditional - Rename molecule/Upgrade to molecule/upgrade_omnia_sh - Update run_molecule.sh with upgrade_yml scenario and upgrade_and_rollback flow - Update __init__.py files for functions, vars, messages exports

balajikumaran-c-s · 2026-07-16T06:39:25Z

dont create a folder called upgrade_yml add these in the upgrade folder only.

balajikumaran-c-s · 2026-07-16T06:41:48Z

move the files to the upgrade folder if u have added anything new.

we have moved all the upgrade test cases in the upgrade folder. so, all your test cases should be there in the upgrade folder

balajikumaran-c-s · 2026-07-16T06:42:50Z

+            "error": ""
+        }
+
+    status_cmd = run_in_container(


use existing core module function to load the yml file

balajikumaran-c-s · 2026-07-16T06:42:54Z

+    status_cmd = run_in_container(
+        host,
+        (
+            f"python3 -c \""


use existing core module function to load the yml file

balajikumaran-c-s · 2026-07-16T06:43:03Z

+        host,
+        (
+            f"python3 -c \""
+            f"import yaml, sys; "


use existing core module function to load the yml file

balajikumaran-c-s · 2026-07-16T06:43:12Z

+    parse_cmd = run_in_container(
+        host,
+        (
+            f"python3 -c \""


use existing core module function to load the yml file

balajikumaran-c-s · 2026-07-16T06:43:28Z

+    cmd = run_in_container(
+        host,
+        (
+            f"python3 -c \""


use existing core module function to load the json file

pushing changes based on the review comments

Signed-off-by: prasant750h <prasanth.charagenti@dellteam.com>

committing changes

balajikumaran-c-s · 2026-07-28T08:56:16Z

 #   ./run_molecule.sh telemetry verify --suite negative    # Run negative tests only
 #   ./run_molecule.sh discovery verify --marker smoke      # Run smoke tests
+#   ./run_molecule.sh Upgrade verify                        # Verify upgrade
+#   ./run_molecule.sh Upgrade verify -- -k upgrade_yml      # Run upgrade.yml tests only


is this -k working ?? if not remove it

balajikumaran-c-s · 2026-07-28T08:56:43Z

+#   ./run_molecule.sh Upgrade verify                        # Verify upgrade
+#   ./run_molecule.sh Upgrade verify -- -k upgrade_yml      # Run upgrade.yml tests only
+#   ./run_molecule.sh rollback_omnia_sh verify              # Verify rollback
+#   ./run_molecule.sh all verify --flow upgrade_and_rollback  # Full upgrade+rollback flow


check this commands also working or not wonce

committing changes

Signed-off-by: prasant750h <prasanth.charagenti@dellteam.com>

Signed-off-by: Abhishek S A <abhishek.sa3@dell.com>

saifudheene

No hardcoded passwords, tokens, API keys, credentials, or sensitive information are exposed in this PR

abhishek-sa1 · 2026-08-06T10:33:04Z

    prev="${COMP_WORDS[COMP_CWORD-1]}"

-    local scenarios="omnia_sh_install prepare_oim gitlab_install local_repo build_image_x86_64 build_image_aarch64 discovery provision telemetry apptainer kubernetes slurm dcgm hpc_benchmarks vast_storage build_stream one_shot_log_extraction gitlab_cleanup oim_cleanup omnia_sh_uninstall upgrade_omnia_sh rollback_omnia_sh upgrade_pre_k8s_telemetry upgrade_post_k8s_telemetry upgrade_negative_k8s_telemetry all list help"
+    local scenarios="omnia_sh_install prepare_oim gitlab_install local_repo build_image_x86_64 build_image_aarch64 discovery provision telemetry apptainer kubernetes slurm dcgm hpc_benchmarks vast_storage build_stream one_shot_log_extraction gitlab_cleanup oim_cleanup omnia_sh_uninstall Upgrade rollback_omnia_sh all list help"


Verify all the cases for upgrade and rollback. i can see few removed. Upgrade mentioned in capital

All the scenarios are inside the Upgrade folder now, earlier it was all separate but now, all are within the Upgrade folder. Will change the Upgrade to upgrade

abhishek-sa1 · 2026-08-06T10:33:31Z

    local commands="test verify converge create prepare"
    local suites="sanity negative regression smoke stress performance build_auto deploy_auto cleanup_manual build_manual deploy_manual build_stream gpu"
-    local flows="build_stream"
+    local flows="build_stream upgrade_and_rollback"


upgrade_and_rollback is local flow planned?

This got added by mistake by devin, will get this removed

abhishek-sa1 · 2026-08-06T10:33:45Z


 # --- Upgrade & Rollback ---
-upgrade_omnia_sh:
+Upgrade:


this is required to override, need to check all cases

Sushmitha-dell approved these changes Jul 23, 2026

View reviewed changes

balajikumaran-c-s reviewed Jul 27, 2026

View reviewed changes

prasant750h added 3 commits July 28, 2026 12:14

pushing changes based on the review comments

1ca30b6

pushing changes based on the review comments

Merge branch 'automation-v2.2.0.0' into upgrade_yml

12440c2

Signed-off-by: prasant750h <prasanth.charagenti@dellteam.com>

committing changes

8ae55ee

committing changes

balajikumaran-c-s reviewed Jul 28, 2026

View reviewed changes

prasant750h added 3 commits July 28, 2026 14:49

committing changes

12ec1f3

committing changes

Merge branch 'automation-v2.2.0.0' into upgrade_yml

bdac827

Signed-off-by: prasant750h <prasanth.charagenti@dellteam.com>

fixing the pylint issues

63440e9

balajikumaran-c-s approved these changes Aug 6, 2026

View reviewed changes

Merge branch 'automation-v2.2.0.0' into upgrade_yml

166aa63

Signed-off-by: Abhishek S A <abhishek.sa3@dell.com>

saifudheene approved these changes Aug 6, 2026

View reviewed changes

abhishek-sa1 approved these changes Aug 6, 2026

View reviewed changes

abhishek-sa1 reviewed Aug 6, 2026

View reviewed changes

pushing changes based on the review comments

76fc7c0

abhishek-sa1 approved these changes Aug 6, 2026

View reviewed changes

abhishek-sa1 merged commit 50a8fda into dell:automation-v2.2.0.0 Aug 6, 2026
3 checks passed

Uh oh!

Conversation

prasant750h commented Jul 15, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

saifudheene left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants