Skip the system prompt and the template writes one
A quarter of the chat templates on Hugging Face's top models tell the model who it is or what day it is, and Llama 3.1's still says July 2024 on vLLM.
#open-source
3 posts tagged open-source. Or see every tag.
37 of the top 50 self-hosted apps can go closed
I read the licences and contributor agreements of the 50 most-starred self-hosted apps. 11 already ship non-open code, 26 could next release, AGPL or not.
Your GitHub cron is 20 minutes late, or six hours
Since a GitHub incident in late August, scheduled Actions runs have split into two lanes, and small repos mostly get the slow one. Here's how to dodge it.