Currently Working On

• Refactoring repository structure and building a fully customized GPT implementation from scratch.

Completed

• [Done] Read and reproduce the nanoGPT source code.
• [Done] Complete Task 2 from llm-beginner: nndl/llm-beginner.

Acknowledgements & References

⚠️ Disclaimer: This repository is created strictly for personal study, hands-on learning, and educational purposes.

This project is my personal journey to demystify modern LLM architectures by building them line by line. Along the way, I have leaned heavily on, learned from, and referenced the work of several brilliant open-source projects:

• nanoGPT: karpathy/nanoGPT

• llm-beginner: nndl/llm-beginner

• annotated_deep_learning_paper_implementations: labmlai/annotated_deep_learning_paper_implementations

All original code, architectural concepts, and copyrights belong to their respective authors. Immense gratitude to the open-source community for sharing their work and making deep learning accessible to curious learners!