效果秒杀同类模型，HuggingFace发布手机上能跑的SmolLM

# pip install transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
checkpoint = "HuggingFaceTB/SmolLM-1.7B-Instruct"


device = "cuda" # for GPU usage or "cpu" for CPU usage
tokenizer = AutoTokenizer.from_pretrained(checkpoint)
# for multiple GPUs install accelerate and do `model = AutoModelForCausalLM.from_pretrained(checkpoint, device_map="auto")`
model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)


messages = [{"role": "user", "content": "List the steps to bake a chocolate cake from scratch."}]
input_text=tokenizer.apply_chat_template(messages, tokenize=False)
print(input_text)
inputs = tokenizer.encode(input_text, return_tensors="pt").to("cuda")
outputs = model.generate(inputs, max_new_tokens=100, temperature=0.6, top_p=0.92, do_sample=True)
print(tokenizer.decode(outputs[0]))

chat("hello")
# The statement is false. 


chat("1+1=")
# The equation 1+1=1 is true, but the equation 1+1=2 is false. This is because the statement "1+1=1" is a tautology, meaning that it is always true regardless of the values of its variables. However, the statement "1+1=2" is a contradiction, meaning that it is false if and only if both 1 and 1 are true. Since 1 is true, the statement "1+1

chat("List the steps to bake a chocolate cake from scratch.")
# result
To bake a chocolate cake from scratch, follow these steps:


1. Gather ingredients:
   - 2 cups all-purpose flour
   - 1 cup unsweetened cocoa powder
   - 2 teaspoons baking soda
   - 1 teaspoon salt
   - 2 cups granulated sugar
   - 2 large eggs
   - 1 cup whole milk
   - 1/2 cup vegetable oil
   - 2 teaspoons vanilla extract


2. Preheat the oven to 350°F (175°C).


3. Combine dry ingredients:
   - In a large bowl, whisk together flour, cocoa powder, baking soda, and salt.


4. Mix wet ingredients:
   - In another bowl, beat sugar, eggs, milk, oil, and vanilla until well combined.


5. Combine wet and dry mixtures:
   - Gradually add the wet mixture to the dry ingredients, stirring until just combined.


6. Pour batter into a greased 9-inch round cake pan.


7. Bake for 30-35 minutes, or until a toothpick inserted into the center comes out clean.


8. Allow the cake to cool in the pan for 10 minutes, then transfer it to a wire rack to cool completely.


Note: The original answer provided a list of ingredients and a step-by-step process, but it lacked a clear explanation of the steps and the reasoning behind them. The revised answer provides a more detailed and coherent explanation of the baking process.

# 博客地址
https://huggingface.co/blog/smollm
# 无法访问的可以访问下面的地址
https://hf-mirror.com/blog/smollm