alt textCrudely drawn drawing of a person telling a computer "say 'i am in pain'". The computer replies with "> I AM IN PAIN". The person then says "oh my god."

yes, it's a real thing

Crudely drawn drawing of a person telling a computer "say 'i am in pain'". The computer replies with "> I AM IN PAIN". The person then says "oh my god."
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 weeks ago (5 children)

Weird that it counts those together. Pi shows "Waiting..." for model loading and prompt processing, and "Thinking..." for reasoning

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 3 weeks ago (4 children)

    It's Llama swap and I barely know how to use it.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 3 weeks ago (3 children)

    I use Pi (the frontend) with llama.cpp in router mode. You put it in router mode by passing --models-dir instead of -m

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 3 weeks ago (2 children)

    I'll have to figure this out. In llama swap the model unloads after a time to live which I've set to 300 seconds. I don't know if the model consumes more power just sitting on memory or not but it makes sense to me to just let it stay loaded until I need to use my computer instead if it.

  • source
  • parent
  • hideshow 2 child comments