Absolutely needed: to get high efficiency for this beast ... as it gets better, we'll become too dependent.

"all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,,,"

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 1 year ago (5 children)

Advanced reasoning? Having LLM talk to itself?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 1 year ago

    Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it's initial approach based on later parts.

    Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.

  • source
  • parent
  • [–] -1 points 1 year ago* (3 children)

    Lul yes but no, but they are clearly better at many types of tasks.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -1 points 1 year ago* (2 children)

    For example? Citations?

    Pretty sure these "tasks" are meaningless metrics made up by pseudo-scientific grifters.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 1 year ago

    Small bits of code, language related tasks, basic context understanding, not metrics I have literally measured simply noticed has improved compared to non reasoning models in my homelab testing. 🤷‍♂️

  • source
  • parent