SmolLM🤗 Llama.cpp

SmolLM2, a family of three small language models, performs well in instruction following and reasoning. The largest model significantly improves over its predecessor through advanced training techniques. This interactive chat interface allows you to experiment with the SmolLM2-360M-Instruct and SmolLM2-135M-Instruct text models using various prompts and generation parameters. Users can select different model variants (GGUF format), system prompts, and observe generated responses in real-time. Key generation parameters, such as ⁣temperature, max_tokens, top_k and others are exposed below for tuning model behavior.

Model

Select the AI model to use for chat

512 2048
0.1 2
0.1 1
1 100
1 2