Prep workflow - #702

Open

mhmdk0 wants to merge 25 commits into

mlcommons:mainfrom

mhmdk0:prep-workflow

Commits on Jul 2, 2026

prep workflows initial commit
hasan7n
committed
5b5cb86

Commits on Jul 9, 2026

update rano dockerfile
hasan7n
committed
efbbaae

Commits on Jul 19, 2026

update `workflow.yaml` files in prep_workflow examples
mhmdk0
committed
bcf7f87
update `container_config.yaml` files in prep_workflow examples
mhmdk0
committed
65cdb59
update preparation steps in prep_workflow examples
mhmdk0
committed
ed26665
update prep_workflow core
mhmdk0
committed
fc6db29
add `check_no_prepare` and remove `sanity_check`, `statistics` from data_preparator template
mhmdk0
committed
bc35bda
update chestxray_tutorial in examples
mhmdk0
committed
855db5a
update `rano` and prep_workflow README
mhmdk0
committed
285d177
Modify DataPreparation, SimpleContainerParser, config, and decorators to support the new preparation flow
mhmdk0
committed
f420cb4
add `check_no_prepare` in get_container_type - webui utils
mhmdk0
committed
ae4af81
update dataset preparation tests and prep_workflow tests
mhmdk0
committed
587ea60
add tests for main in prep_workflow
mhmdk0
committed
8a1b370
update container docs
mhmdk0
committed
cbcf909

Commits on Jul 24, 2026

rename `check_no_prepare` taskname to `statistics` in `container_config.yaml`
mhmdk0
committed
4558307
update `null`s to `sanity_check` in `workflow.yaml`
mhmdk0
committed
4860d91
update `prepare_steps.py` docstrings
mhmdk0
committed
dcc27ee
update `hemnet` and `rano` steps docstrings
mhmdk0
committed
574541c
update graph, engine, and update thier tests
mhmdk0
committed
f3e3408
update prepare, container parser and their tests
mhmdk0
committed
8c5a056
update webui utls - change check_no_prepare to statistics
mhmdk0
committed
c6057bd
update containers docs and prepworkflow readme
mhmdk0
committed
be79057

Commits on Jul 25, 2026

remove check_no_prepare timeouts and add statistics
mhmdk0
committed
339d764
add migrations in profiles
mhmdk0
committed
e4821f2

Commits on Aug 5, 2026

add tests and README for examples
mhmdk0
committed
b0e9d0b