SmolGPT · a tiny GPT that writes stories

Fetching the model

One-time download of about 300 MB; your browser caches it. You can start writing while it loads.

Write the first line of a story. SmolGPT continues it in this ink, one word at a time, entirely on your device.

SmolGPT is a story-continuation model, not a chatbot: it keeps writing whatever it is given.

Library

story 0 new 0 0 / 256

The model sees 256 tokens at once: the end of your story plus the words it is about to write.

length 120 tokens temperature 0.80 top-k 40 repetition penalty 1.10

Trained from scratch in PyTorch, with the embedding and output layers sharing weights. Training code →