Skip to content

[cute] Support explicit rank-1 column broadcasts - #3159

Open
ethche wants to merge 1 commit into
helion-cute-leading-k-tailfrom
helion-cute-rank1-leading-broadcast
Open

[cute] Support explicit rank-1 column broadcasts#3159
ethche wants to merge 1 commit into
helion-cute-leading-k-tailfrom
helion-cute-rank1-leading-broadcast

Conversation

@ethche

@ethche ethche commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Recognize explicit column-vector epilogues such as:

acc + bias[tile_m].unsqueeze(-1)

The auxiliary-operand analyzer now normalizes supported casts, scalar scaling, and rank-1 unsqueezes while retaining the explicit data axis. Classification validates index provenance, tile extent, global
extent, and storage layout.

Codegen constructs a logical 2D CuTe view with stride (1, 0) over the original rank-1 storage and reuses the existing column-vector epilogue. No expanded tensor or materialized transpose is required.

Bare rank-1 operands retain normal PyTorch trailing-axis broadcast semantics.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 24, 2026
@jansel

jansel commented Jul 25, 2026

Copy link
Copy Markdown
Contributor

Failing CI?

@ethche
ethche force-pushed the helion-cute-leading-k-tail branch from c81f7ca to 11b4e53 Compare July 25, 2026 01:50
@ethche
ethche force-pushed the helion-cute-rank1-leading-broadcast branch from 7b3d281 to a159d68 Compare July 25, 2026 01:50
@ethche
ethche force-pushed the helion-cute-rank1-leading-broadcast branch from a159d68 to 523c0be Compare July 28, 2026 18:03
@ethche

ethche commented Jul 29, 2026

Copy link
Copy Markdown
Contributor Author

@jansel should be okay now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants