-4
A program to automatically generate commit messages locally without an LLM? (realbitcoin.cash)
submitted 5 days ago by to c/programming@programming.dev
38 comments fedilink hide all child comments
 

Ello Ello.

Can you recommend a program with which I can generate commit messages locally? I DO NOT want an LLM local or cloud API. What I want is a tiny or small language model. If I could easily swap or customize the model for each project, it would be better, too. So I could have smaller models for specific projects. I can do the training meself.

Thanks in advance!

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 5 days ago (5 children)

How the hell is 8GB a small amount for a side utility? Are you using LLMs to count to 50?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 3 points 5 days ago (4 children)

    Its small in the sense it'll run on basically any GPU from the last decade, rather than high end or specialised GPUs. And there is a 1GB gemma4 model, which is meant for CPU/phones.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 5 days ago (3 children)

    Gotcha. Sorry for being snarky.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 4 points 5 days ago (2 children)

    You're not wrong though, even 1GB is quite lot for writing commit messages, I gave it a quick go, and it takes around 15-30s to analyse a very small diff. Kinda silly for git messages.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] [S] 3 points 5 days ago (1 child)

    Thanks for letting us know. Yeah sure. It's not worth it. I personally take about 10s to write the commit message. So such a thing will just make it worse.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 4 days ago

    For shits and giggles, I had a go at writing a script that could rewrite all the commits in a branch with LLM generated commits. Couldn't work out how to do the commit changing, tried cherry picking, but it doesnt work well for conflicts (had no idea that was possible). But, I can report timings at least.

    On my M1 16GB macbook air, each commit was summarised in about 10s. So its a plausible approach if you just do all your commits, and then run a script to fix up the messages, go get a glass of water and you'll come back to automatic messages.

    If it's of interest to you, I can share the script, its a starting point, but I am pretty ashamed of it :D

  • permalink
  • fedilink
  • source
  • parent