-4
A program to automatically generate commit messages locally without an LLM? (realbitcoin.cash)
submitted 6 days ago by to c/programming@programming.dev
38 comments fedilink hide all child comments
 

Ello Ello.

Can you recommend a program with which I can generate commit messages locally? I DO NOT want an LLM local or cloud API. What I want is a tiny or small language model. If I could easily swap or customize the model for each project, it would be better, too. So I could have smaller models for specific projects. I can do the training meself.

Thanks in advance!

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 5 points 6 days ago (3 children)

8GB means around 8B parameters. It's no where near small. I meant the classic language models before LLMs existed. Something which I can easily execute on CPU to generate the commit messages.

And here, I'm not asking for "what model" rather "what utility" which uses such these models. Finding or training a model is much easier than maintaining such a software and keeping it useful.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 6 points 6 days ago (1 child)

    the classic language models before LLMs existed

    Which models are you referring to here? Earlier versions of GPT (like GPT-2)?

    There are small LLMs like Phi 4 Mini that you could look at. Those were part of the "small language model" craze (SLMs).

    If you want meaningful commit messages though, nothing beats handwritten messages. Commit frequently and the messages should be short and easy to come up with.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •