Skip to content

[WIP] Share RAFT keyed row-reduction kernels - #2916

Draft
divyegala wants to merge 3 commits into
mainfrom
codex/dedup-raft-keyed-row-reduction
Draft

divyegala wants to merge 3 commits into
mainfrom
codex/dedup-raft-keyed-row-reduction

Conversation

@divyegala

@divyegala divyegala commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Share keyed row-reduction dispatch through per-instantiation CUDA launchers and lower kernel owners.

The existing generate_inst_matrix expands ordinary JSON matrices directly into separate .cu files, with one concrete owning instantiation per generated translation unit. Launcher declarations stay in headers; host definitions and the corresponding device kernels stay in CUDA sources. Shared lower kernels have their own owners.

Prerequisites: main.

Diff against this PR’s parent: 10 files, +352/−4 lines.

Validation: native JSON/CMake generation checked on this exact branch and its dependency closure; each generated owner has one owning instantiation. Complete-library builds, device-kernel census, and focused runtime checks are tracked in #2888.

Binary savings: the previous figures measured the grouped-owner implementation and are retired for this revised layout. Per-PR CUDA 12.9 and 13.3 complete-library remeasurement is pending; increased fatbin-container overhead means the old figures must not be carried forward.

@copy-pr-bot

copy-pr-bot Bot commented Oct 22, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@divyegala
divyegala force-pushed the codex/dedup-raft-keyed-row-reduction branch from 9790aa8 to fe6650a Compare October 23, 2026 02:23
@divyegala divyegala changed the title [WIP] Own shared RAFT keyed row reductions [WIP] Share RAFT keyed row-reduction kernels Oct 23, 2026
@divyegala
divyegala changed the base branch from main to codex/dedup-cuda-radix-sorting October 23, 2026 02:23
@divyegala
divyegala force-pushed the codex/dedup-raft-keyed-row-reduction branch from fe6650a to c72d00a Compare October 23, 2026 06:33
@divyegala
divyegala changed the base branch from codex/dedup-cuda-radix-sorting to main October 23, 2026 06:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant