Skip to content

feat: retain integrated review shadow reports - #449

Open
huang47 wants to merge 2 commits into
codex/readiness-review-inventoryfrom
codex/readiness-shadow-report
Open

huang47 wants to merge 2 commits into
codex/readiness-review-inventoryfrom
codex/readiness-shadow-report

Conversation

@huang47

@huang47 huang47 commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

ELI5

A reviewer needs one place to see the risk grade and the available review evidence. This workflow collects both and saves a report, while clearly marking the evidence it has not checked.

shadow-flow

Summary

  • Run the existing grader in report-only mode and collect GitHub review evidence for the same supplied snapshot.
  • Retain one advisory JSON artifact for 30 days. No label, review, comment, optional check run, or repository policy is written. Actions run and job checks still exist.
  • Add a CI caller that exercises the reusable workflow and downloads its artifact with a synthetic policy.

Verification

  • 46 Python tests passed, including the real risk grader, review evaluator, stale snapshots, and publication switches.
  • A read-only local run against a draft PR with a synthetic policy returned a current risk grade and WAITING for missing evidence.
  • Actionlint and repository checks passed. The current-head Actions run ran the reusable workflow and downloaded its artifact: WAITING with a synthetic policy. The workflow-pins suite passed after registering the new input contract.

Limits

The caller must provide an authorized policy and verify the tested SHA. Reviews and thread reads are not atomic; reviewer permissions and other finding sources remain unverified. This report cannot produce READY and is not a merge gate. No pilot or policy activation is included.

Stack

Stack order: 5/9, follows #448 — feat: collect scoped GitHub review evidence; followed by #450 — feat: report current Actions check failures.

Provenance

Implemented and verified with an interactive coding agent and human direction. Recovery: remove the caller or revert the provider pin; retained artifacts expire normally.

@coderabbitai

coderabbitai Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: b30b0ea7-65e8-4f46-8578-c77bc1a35575

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants