Skip to content

[WIP] Share CUDA radix-sort kernel instantiations - #2908

Draft
divyegala wants to merge 4 commits into
codex/dedup-cub-ptx-queryfrom
codex/dedup-cuda-radix-sorting
Draft

divyegala wants to merge 4 commits into
codex/dedup-cub-ptx-queryfrom
codex/dedup-cuda-radix-sorting

Conversation

@divyegala

@divyegala divyegala commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Own radix-sort kernel function templates and ordinary sort launchers in separate CUDA sources, with normal host getter declarations for shared lower kernels.

The existing generate_inst_matrix expands ordinary JSON matrices directly into separate .cu files, with one concrete owning instantiation per generated translation unit. Launcher declarations stay in headers; host definitions and the corresponding device kernels stay in CUDA sources. Shared lower kernels have their own owners.

Prerequisites: #2937.

Diff against this PR’s parent: 34 files, +1711/−85 lines.

Validation: native JSON/CMake generation checked on this exact branch and its dependency closure; each generated owner has one owning instantiation. Complete-library builds, device-kernel census, and focused runtime checks are tracked in #2888.

Binary savings: the previous figures measured the grouped-owner implementation and are retired for this revised layout. Per-PR CUDA 12.9 and 13.3 complete-library remeasurement is pending; increased fatbin-container overhead means the old figures must not be carried forward.

@copy-pr-bot

copy-pr-bot Bot commented Oct 22, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@divyegala divyegala changed the title [WIP] Centralize shared CUDA radix-sort dispatch [WIP] Own shared CUDA radix-sort dispatch Oct 22, 2026
@divyegala
divyegala force-pushed the codex/dedup-cuda-radix-sorting branch from 5dfdec8 to 2f352ae Compare October 22, 2026 21:50
@divyegala divyegala changed the title [WIP] Own shared CUDA radix-sort dispatch [WIP] Own shared CUDA radix-sort launchers Oct 22, 2026
@divyegala
divyegala force-pushed the codex/dedup-cuda-radix-sorting branch from 2f352ae to 55a7deb Compare October 23, 2026 02:20
@divyegala divyegala changed the title [WIP] Own shared CUDA radix-sort launchers [WIP] Share CUDA radix-sort kernels Oct 23, 2026
@divyegala
divyegala force-pushed the codex/dedup-cuda-radix-sorting branch from 55a7deb to 5d40575 Compare October 23, 2026 07:47
@divyegala divyegala changed the title [WIP] Share CUDA radix-sort kernels [WIP] Share CUDA radix-sort kernel instantiations Oct 23, 2026
@divyegala
divyegala changed the base branch from main to codex/dedup-cub-ptx-query October 23, 2026 07:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant