Add typed KV cache configuration and runtime reporting#453

aleroot wants to merge 2 commits into

ml-explore:mainml-explore/mlx-swift-lm:mainfrom

aleroot:lampo-turboquant-integrationaleroot/mlx-swift-lm:lampo-turboquant-integrationCopy head branch name to clipboard