Commit 56758af
committed
[Stacked PR 5/5] Add GDN backward pass 8k and 64k latency and memory benchmark suite
- Add standalone 8k and 64k Ghostfish Cloud TPU latency and memory benchmark suite (gdn_benchmark_test.py).
- Provide comparative benchmarking between Pure JAX remat and Decoupled GDN Pallas backward pass kernel across sequence lengths up to 64k.1 parent a8d6db0 commit 56758af
1 file changed
Lines changed: 1724 additions & 0 deletions
0 commit comments