Skip to content

feat(rust-first): prove retrieval parity on frozen golden baseline#71

Merged
shtse8 merged 39 commits into
mainfrom
rust-first/parity-proven-retrieval
Jul 10, 2026
Merged

feat(rust-first): prove retrieval parity on frozen golden baseline#71
shtse8 merged 39 commits into
mainfrom
rust-first/parity-proven-retrieval

Conversation

@shtse8

@shtse8 shtse8 commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Rust-First migration slice

Advances two in-scope capabilities from rust_implparity_proven toward ts_deleted:

Capability Before After
tool/codebase_search rust_impl parity_proven
transport/stdio-rust-rmcp rust_impl parity_proven

Changes

  • fixtures/golden-retrieval-baseline.json — frozen rust-tfidf authority contract (top-hit paths + ranked paths for 3 golden queries)
  • test/retrieval-parity.test.ts — asserts Rust CLI matches frozen baseline exactly
  • crates/coderag-mcp-server/tests/golden_parity.rs — MCP codebase_search tool parity on benchmark corpus
  • docs/specs/coderag-migration-ledger.json — repo migration ledger (Phase 0 denominator lock)
  • CI + release gate — new parity:frozen_baseline, fixtures:parity_baseline, tests:retrieval_parity checks

Tests

bun test test/retrieval-parity.test.ts
cargo test -p coderag-mcp-server --test golden_parity
bun run benchmark:release-gate

Blockers to ts_deleted (next slices)

  • transport/web-mcp-http — Web MCP Streamable HTTP not shipped
  • transport/stdio-ts-adapter — TS stdio adapter retained for semantic/OpenAI hybrid until Web MCP cutover
  • Production deploy probe + readback artifact not yet recorded for this slice

Fleet ledger

Control plane ledgers/SylphxAI__coderag.json updated to parity_proven for the two capabilities above.

Advance tool/codebase_search and transport/stdio-rust-rmcp toward
ts_deleted by locking a frozen golden baseline fixture and enforcing
Rust authority parity in CI and release gate.

- Add fixtures/golden-retrieval-baseline.json (captured rust-tfidf contract)
- Add test/retrieval-parity.test.ts and MCP golden_parity integration test
- Add docs/specs/coderag-migration-ledger.json (parity_proven states)
- Wire parity checks into CI and benchmark:release-gate
@shtse8 shtse8 added this pull request to the merge queue Jul 9, 2026
@shtse8 shtse8 closed this Jul 9, 2026
@shtse8 shtse8 deleted the rust-first/parity-proven-retrieval branch July 9, 2026 22:07
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to a manual request Jul 9, 2026
@shtse8 shtse8 restored the rust-first/parity-proven-retrieval branch July 9, 2026 22:30
@shtse8 shtse8 reopened this Jul 9, 2026
shtse8 added 15 commits July 10, 2026 17:27
packages/mcp-server no longer depends on @sylphx/mcp-server-sdk or
@sylphx/vex, but bun.lock still listed them. CI `bun install
--frozen-lockfile` failed on the test job (PR #71).
- Record transport/web-mcp-http, stdio-rust-rmcp, codebase_search as
  rust_impl under rej-010 (proof missing/stale; no authority_rust)
- Mark transport/stdio-ts-adapter ts_deleted; freeze promotions
- Accept PACKAGE_ROOT-relative native bin path in differential harness test
- Atomic write (tmp + rename) for rust-index / file-hashes persistence
- Serialize all fixture-corpus unit tests behind one lock
- Isolate persists_and_reloads_index_snapshot onto a private temp root
CI runners resolve `node` via Bun, which treats `node -` as a module path
(`Module not found '.../-'`). Switch authority-gate ledger checks to
python3 stdin scripts for portable fail-closed evaluation.
@shtse8 shtse8 added this pull request to the merge queue Jul 10, 2026
Merged via the queue into main with commit d365ccf Jul 10, 2026
2 checks passed
@shtse8 shtse8 deleted the rust-first/parity-proven-retrieval branch July 10, 2026 23:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant