Skip to content

feat(format): define a unified tagged fragment reuse history - #9065

Closed
LuQQiu wants to merge 17 commits into
lu/fri-row-mapfrom
lu/fri-format
Closed

feat(format): define a unified tagged fragment reuse history#9065
LuQQiu wants to merge 17 commits into
lu/fri-row-mapfrom
lu/fri-format

Conversation

@LuQQiu

@LuQQiu LuQQiu commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Superseded by #9136, which puts this format proposal directly on main as the first PR in native stack #9137. Existing discussion is retained here.

Add tagged transitions alongside legacy versions in the existing FRI details envelope. A transition contains ordered source/destination digests and an explicit mapping: ordered compaction or an immutable stable-partition row-map reference. Index version 0 retains its existing format; version 1 introduces tagged history.

Scope: proto definitions, minimal compile adapters, and the proposed FLAG_FRAGMENT_REUSE_INDEX = 1 << 9 constant with its reader/writer rationale. Mapping implementations are in #9106/#9064, decoding in #9067, and runtime flag support, stamping, inheritance, validation, and reader behavior in #9068. The three format documentation pages are unchanged, as agreed; format review documentation comes last.

Validation: the dependent reader stack compiles against these definitions; workspace Clippy and targeted FRI tests pass.

Latest main synchronization (2026-09-10): merged d7b031f9c through the stack without rewriting history. cargo fmt --all and whitespace checks pass. Workspace Clippy could not run: main now requires object_store_opendal 0.60.1, but the crates.io index currently resolves only up to 0.60.0. Tests were not rerun after this synchronization because dependency resolution is blocked. Earlier validation above predates this merge.

@github-actions github-actions Bot added A-format On-disk format: protos and format spec docs format-change A change to the format spec, which requires a vote. Remove if minor (e.g. fixing typo). enhancement New feature or request labels Sep 8, 2026
@LuQQiu
LuQQiu removed this pull request from stack #9066 September 9, 2026 19:15
@LuQQiu
LuQQiu added this pull request to stack #9108 September 9, 2026 19:16
LuQQiu and others added 6 commits September 9, 2026 13:15
Document FLAG_FRAGMENT_REUSE_INDEX with its paired sticky semantics,
the index-version negotiation and transition lineage invariants, the
stable-partition row map file schema with its counts matrix layout and
reader navigation, and the append_fri_transitions operation.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016RynpAxtwGB9Q9CL4JCvR4
The flag table row and the required-columns already state the contract.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016RynpAxtwGB9Q9CL4JCvR4
Restructure around the two use cases, specify version negotiation and
shared transition metadata, define both mapping encodings with full
translation algorithms and validation rules, and state the reader and
writer compatibility contract.
@LuQQiu
LuQQiu removed this pull request from stack #9108 September 10, 2026 03:15
@LuQQiu
LuQQiu added this pull request to stack #9117 September 10, 2026 03:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-format On-disk format: protos and format spec docs enhancement New feature or request format-change A change to the format spec, which requires a vote. Remove if minor (e.g. fixing typo).

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant