Skip to content

feat: report current Actions check failures - #450

Open
huang47 wants to merge 1 commit into
codex/readiness-shadow-reportfrom
codex/readiness-check-failures
Open

huang47 wants to merge 1 commit into
codex/readiness-shadow-reportfrom
codex/readiness-check-failures

Conversation

@huang47

@huang47 huang47 commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

ELI5

A failed required job should remain visible even if other evidence is missing. The report checks which workflow ran it and which PR revisions it belongs to before treating its failure as a blocker.

actions-flow

Summary

  • Add an opt-in policy selector for named GitHub Actions jobs and their workflow paths. Read check runs, jobs and workflow runs; reject stale or ambiguous associations.
  • A current reported failure blocks. Success never satisfies a passing requirement because the job's actual tested revision has not been established.
  • Exercise the read-only collector in the existing shadow workflow test. No merge setting or publication surface is changed.

Verification

  • 58 Python tests passed, including the actual CLI with a simulated paginated GitHub API, stale revisions, reruns, source errors and snapshot changes.
  • A fault injection removing workflow-path validation caused the wrong-workflow regression to fail.
  • A read-only live run matched a real build job and returned WAITING because successful test revision evidence remains missing.
  • 558 workflow-pins tests, actionlint and repository checks passed. The current-head Actions run matched the selected job and retained a WAITING report under a synthetic policy.

Limits

The policy and its required check sources need owner validation. GitHub metadata can race collection, and check-run head does not prove the tested merge revision. Missing or incomplete evidence cannot make the result READY. This is an advisory artifact, not a merge gate.

Stack

Stack order: 6/9, follows #449 — feat: retain integrated review shadow reports; followed by #452 — fix: keep unverified approvals incomplete.

Provenance

Authored and verified in an interactive session. Recovery: remove the optional policy selectors or revert this PR.

@coderabbitai

coderabbitai Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: 1191799c-6b74-4d17-ac66-0548c96b6b8f

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants