A smarter, dynamic, quant and model agnostic Memory Manager. - #948

Open

Zironic wants to merge 20 commits into

ostris:mainfrom

Zironic:upstream/mm-arena-offload

Commits on Jul 16, 2026

Add budgeted host memory safety primitives
Rydén Johan
committed
f7e375d
Add generic arena offload runtime
Rydén Johan
committed
26a5f05
Wire arena offload through shared training lifecycle
Rydén Johan
committed
f7131ae
Complete arena lifecycle and compiled execution
Rydén Johan
committed
2eea80b
Reject train-time text encoders with arena offload
Rydén Johan
committed
ce40dfe
Fix arena offload lifecycle correctness
Rydén Johan
committed
d5b8271
Fix checkpoint replay and compile policy
Rydén Johan
committed
3f3bf4b
Make arena pinning residency-aware
Rydén Johan
committed
a1e6284
Restore arena WDDM allocator control
Rydén Johan
committed
287fb44
Rebind arena allocator cap per step
Rydén Johan
committed
3fa1435
Preserve allocator GC feedback
Rydén Johan
committed
6b215dc
Stabilize arena calibration and compiled sampling
Rydén Johan
committed
28aa9ad
Remove retired Arena predecessor layout
Rydén Johan
committed
2f8f062
Remove unpublished Arena configuration and compile tuning
Rydén Johan
committed
285c4c0
Pin tested TorchAO and preserve 0.10 compatibility
Rydén Johan
committed
a3bcca4
Narrow Arena PR surface
Rydén Johan
committed
5ad04ab
Remove orphaned Arena support paths
Rydén Johan
committed
ed5545d
Enable Arena fullgraph MegaCache
Rydén Johan
committed
8ca15af
Use runtime allocator GC threshold in Arena
Rydén Johan
committed
23d6a54
Ignore canceled timer measurements
Rydén Johan
committed
5f1f8ac