feat(engine): add Datum-based forward, backward, and optimizer APIs - #3614

feat(engine): add Datum-based forward, backward, and optimizer APIs#3614

HuiyingLi wants to merge 30 commits into

mainNVIDIA-NeMo/Automodel:mainfrom

huiyingl/feat/datum-forward-backwardNVIDIA-NeMo/Automodel:huiyingl/feat/datum-forward-backwardCopy head branch name to clipboard