nanochat Acknowledgements

nanochat builds on open data, prior work, and community contributions. Thank you to everyone who has made this project possible.

Inspiration

The name derives from nanoGPT, Andrej Karpathy's earlier project that only covered pretraining. nanochat is also inspired by modded-nanoGPT, which gamified nanoGPT with clear metrics and a leaderboard.

Data

Thank you to Hugging Face for FineWeb and SmolTalk datasets.

Compute

Thank you to Lambda for the compute used in developing this project.

Guidance

Thank you to chief LLM whisperer Alec Radford for advice and guidance.

Community

Thank you to Sofie (@svlandeg) for help managing issues, pull requests, and discussions on the GitHub repo.