this post was submitted on 18 Aug 2025
2 points (62.5% liked)
Large Language Models
243 readers
1 users here now
A place to discuss large language models.
Rules
- Please tag [not libre software] and [never on-device] services as such (those not green in the License column here).
- Be useful to others
Resources
github.com/ollama/ollama
https://github.com/danny-avila/LibreChat
github.com/Aider-AI/aider
wikipedia.org/wiki/List_of_large_language_models
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
and also, how are you getting the wiki? i would first scrape it . if it is something like fandom, then do not scrape directly, first host your own breeze wiki (https://docs.breezewiki.com/Running.html), then use wget with a optimal rate limit. using breeezewiki will remove some junk, and you will get cleaner html to begin with.
for small models, try to keep total input (prompt plus data) to be small, as they general can not reatin there smarts for much (even if they advertise larger contexts).