Support v1 raw multimodal image offload - #2836

Open

eligotts wants to merge 64 commits into

mainfrom

feat/v1-raw-mm-offload

Commits on Jun 25, 2026

Support v1 raw multimodal offload
eligotts
committed
034e83e
Update raw image renderer pin
eligotts
committed
b7903f6

Commits on Jun 27, 2026

Simplify v1 raw multimodal serving: always materialize refs

S1ro1
and
claude
committed
6c0157a
serving: use canonical split_raw_mm_ref + bump renderers pin

S1ro1
and
claude
committed
5ec8148
Bump renderers pin (drop orphaned image_cache_max)

S1ro1
and
claude
committed
bcc93c2

Commits on Jun 28, 2026

Commits on Jun 29, 2026

Simplify raw multimodal offload path
eligotts
committed
f37ceac
Merge remote-tracking branch 'origin/main' into feat/v1-raw-mm-offload
eligotts
committed
a66f1b1
Simplify raw multimodal validation
eligotts
committed
80dc59f
Clarify raw image asset env wiring
eligotts
committed
bf2bc8e
Use URI-complete raw multimodal refs
eligotts
committed
805486f
Merge branch 'main' into feat/v1-raw-mm-offload
eligotts
committed
2f000f3
Drop raw multimodal descriptor version
eligotts
committed
dce2759
Bump verifiers raw multimodal client prep
eligotts
committed
0b0f1fb
Merge remote-tracking branch 'origin/main' into feat/v1-raw-mm-offload
eligotts
committed
d8218c3

Commits on Jun 30, 2026

Bump renderers for processed multimodal output
eligotts
committed
d18ed10
Bump renderers lock cleanup
eligotts
committed
0da60a8

Commits on Jul 1, 2026

Bump verifiers for main sync
eligotts
committed
c7deb3b
Merge remote-tracking branch 'origin/main' into feat/v1-raw-mm-offload
eligotts
committed
89fcbc1

Commits on Jul 3, 2026

fix: truncate raw multimodal refs safely
eligotts
committed
36b5042

Commits on Jul 4, 2026

Tighten raw multimodal validation and trainer mm plumbing

eligotts
and
claude
committed
53d9ed8
Bump renderers and verifiers for raw multimodal hardening

eligotts
and
claude
committed
a13a214

Commits on Jul 5, 2026

Merge remote-tracking branch 'origin/main' into feat/v1-raw-mm-offload
eligotts
committed
7ea71a9
Document multimodal offload monitoring in the monitor-run skill

eligotts
and
claude
committed
1f290dc

Commits on Jul 23, 2026

Commits on Jul 31, 2026

Commits on Aug 1, 2026

Bump renderers: raw mode accepts file:// URLs only
eligotts
committed
37ff96a

Commits on Aug 3, 2026

refactor: derive processor fingerprints from renderer layout specs

eligotts
and
claude
committed
743a022

Commits on Aug 4, 2026

Merge remote-tracking branch 'origin/main' into feat/v1-raw-mm-offload

eligotts
and
claude
committed
ccb0cd2
refactor: trust the train-time checkpoint contract at materialize

eligotts
and
claude
committed
4b4f9e3
refactor: prune RawMMItem to the fields materialize reads

eligotts
and
claude
committed
52adc59
chore: bump renderers for shared mm_image helpers

eligotts
and
cursoragent
committed
f753800
chore: bump renderers after dropping image cache

eligotts
and
cursoragent
committed
21e0430
chore: bump renderers for local-only processed image sources

eligotts
and
cursoragent
committed
8e00291

Commits on Aug 5, 2026

Merge remote-tracking branch 'origin/main' into feat/v1-raw-mm-offload

eligotts
and
claude
committed
97c08a2

Commits on Aug 6, 2026

chore: bump renderers for the Pillow-only vision extra

eligotts
and
claude
committed
0e54032

Commits on Aug 7, 2026

chore: bump verifiers to latest raw-image-offload head

eligotts
and
cursoragent
committed
98480ba
refactor: env servers resolve their own image-asset dir

eligotts
and
claude
committed
8bcd811
chore: relock for the verifiers pin; exclude nemo-gym-weather-v1

eligotts
and
claude
committed
3888738
chore: bump verifiers for the nemo-gym relock

eligotts
and
claude
committed
b92dbd5
refactor(trainer): always fail-fast on missing MM images

eligotts
and
cursoragent
committed
ab09483
fix(inference): retain strong refs to mm materialize tasks

eligotts
and
cursoragent
committed
bbb9dce
docs: drop advanced.md VLM limitation churn from this PR

eligotts
and
cursoragent
committed
49fa709
docs: correct VF_RENDERER_IMAGE_OFFLOAD_DIR wiring notes

eligotts
and
cursoragent
committed
0ea481a
docs: drop configuration.md multimodal offload note

eligotts
and
cursoragent
committed
454b438
docs: shorten SFT multimodal_output validator messaging

eligotts
and
cursoragent
committed
17b1735
refactor: lean PROTECTED_ENV_VARS change for image offload dir

eligotts
and
cursoragent
committed
4cde3d8
docs: drop monitor-run multimodal offload skill section

eligotts
and
cursoragent
committed
f92bb05
refactor(mm): share image load/verify; trim serving_tokens helpers

eligotts
and
cursoragent
committed
b57c4ac