Skip to content

test(conformance): add plan-driven continuity verification - #3107

Draft
elezar wants to merge 8 commits into
mainfrom
codex/gateway-restart-conformance
Draft

test(conformance): add plan-driven continuity verification#3107
elezar wants to merge 8 commits into
mainfrom
codex/gateway-restart-conformance

Conversation

@elezar

@elezar elezar commented Sep 1, 2026

Copy link
Copy Markdown
Member

Summary

Add reusable, plan-driven sandbox continuity conformance coverage. Targets provide opaque, ordered host actions; scenarios retain portable OpenShell CLI assertions.

Related Issue

No issue required: this adds focused conformance-test infrastructure and CI coverage.

Changes

  • Added versioned TOML conformance plans, including stdin input and per-action timeouts.
  • Generalized gateway-restart into sandbox-continuity, which verifies retained running and stopped sandbox state plus workspace continuity across declared actions.
  • Added rootless-Podman test-guest provisioners and target actions for gateway restart, RPM reinstall, and RPM upgrade.
  • Added Fedora artifact/restart and RPM-upgrade continuity CI plans using prebuilt artifacts.
  • Kept target-specific mutation and diagnostics outside reusable conformance scenarios.

Testing

  • mise run pre-commit passes
  • Unit tests added/updated (cargo test -p openshell-conformance -p openshell-conformance-cli)
  • Fedora test-guest smoke and gateway-restart continuity plan passes locally
  • E2E tests added/updated (not applicable: this validates conformance independently of the Rust e2e harness)

Checklist

  • Follows Conventional Commits
  • Commits are signed off (DCO)

@copy-pr-bot

copy-pr-bot Bot commented Sep 1, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@elezar

elezar commented Sep 1, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test b9b58c0

@elezar elezar added the test:e2e Requires end-to-end coverage label Sep 1, 2026
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown

Label test:e2e applied for b9b58c0. Open the existing run and click Re-run all jobs to execute with the label set. The run will execute the standard E2E suite after building the required gateway and supervisor images once. The matching required CI gate status on this PR will flip green automatically once the run finishes.

Comment thread .github/workflows/build-rpm.yml Fixed
@elezar

elezar commented Sep 1, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test b9b58c0

@elezar

elezar commented Sep 1, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test

@elezar
elezar force-pushed the codex/gateway-restart-conformance branch 2 times, most recently from 2eb770d to 124f7e8 Compare September 2, 2026 08:23
@elezar

elezar commented Sep 2, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test 124f7e8

@elezar elezar changed the title test(conformance): add gateway restart coverage test(conformance): add plan-driven continuity verification Sep 2, 2026
@elezar
elezar force-pushed the codex/gateway-restart-conformance branch from 124f7e8 to c1eb28b Compare September 2, 2026 08:45
@elezar

elezar commented Sep 2, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test

Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
@elezar
elezar force-pushed the codex/gateway-restart-conformance branch from c1eb28b to 78b29e0 Compare September 2, 2026 10:15
@elezar

elezar commented Sep 2, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test

1 similar comment
@elezar

elezar commented Sep 2, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test

@elezar
elezar force-pushed the codex/gateway-restart-conformance branch from 78b29e0 to 3193ac6 Compare September 2, 2026 10:31
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
@elezar

elezar commented Sep 2, 2026

Copy link
Copy Markdown
Member Author

/ok-to-test

@elezar
elezar force-pushed the codex/gateway-restart-conformance branch from 3193ac6 to 032df7d Compare September 2, 2026 11:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test:e2e Requires end-to-end coverage

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants