A collection of stand-alone documentation and guides used for creating the NB-models. We use this for documenting our work, but we also hope that it can be useful for others working on similar topics.
- Overview Processing the NCC
- Step-by-Step Guide Processing the NCC
- Creating and Uploading HuggingFace Dataset
- Processing MC4
- Create Google Cloud VM, Bucket and TPU
- Flax - Configure for training RoBERTa, T5 and GPTNeo
- Set up a VM and Configure Tensorflow for Training BERT