Skip the system prompt and the template writes one
A quarter of the chat templates on Hugging Face's top models tell the model who it is or what day it is, and Llama 3.1's still says July 2024 on vLLM.
#llm
1 post tagged llm. Or see every tag.
1 post tagged llm. Or see every tag.
A quarter of the chat templates on Hugging Face's top models tell the model who it is or what day it is, and Llama 3.1's still says July 2024 on vLLM.