Skip to content

Add --distribute_latents: shard the latent dimension across ranks - #143

Open
alepot55 wants to merge 2 commits into
EleutherAI:mainfrom
alepot55:pr-latent-parallel
Open

Add --distribute_latents: shard the latent dimension across ranks#143
alepot55 wants to merge 2 commits into
EleutherAI:mainfrom
alepot55:pr-latent-parallel

feat: shard the latent dimension across ranks with --distribute_latents

bbbe0da
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs