Skip to content

Commit 56758af

Browse files
[Stacked PR 5/5] Add GDN backward pass 8k and 64k latency and memory benchmark suite
- Add standalone 8k and 64k Ghostfish Cloud TPU latency and memory benchmark suite (gdn_benchmark_test.py). - Provide comparative benchmarking between Pure JAX remat and Decoupled GDN Pallas backward pass kernel across sequence lengths up to 64k.
1 parent a8d6db0 commit 56758af

1 file changed

Lines changed: 1724 additions & 0 deletions

File tree

0 commit comments

Comments
 (0)