Absolutely needed: to get high efficiency for this beast ... as it gets better, we'll become too dependent.

"all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,,,"

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 1 year ago (21 children)

Which chatbots are getting smarter?

I know AI has potential, but specifically LLMs (which most people mean when talking about AI) seem to have hit their technological limits.

  • source
  • parent
  • hideshow 21 child comments
  • [–] 2 points 1 year ago (13 children)

    Copilot, ChatGPT, pretty much all of them.

  • source
  • parent
  • hideshow 13 child comments
  • [–] 1 point 1 year ago (12 children)

    Smarter how? Synthetic benchmarks?

    Because I've heard the opposite from users and bloggers.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 1 point 1 year ago (11 children)

    So you want me to provide some evidence that it's getting smarter, but you can't provide any that it's getting worse other than anecdotal evidence?

    What evidence would you accept?

  • source
  • parent
  • hideshow 11 child comments
  • [–] 1 point 1 year ago (10 children)

    Any proof that we have moved past the current architecture.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 0 points 1 year ago (9 children)

    What does "architecture" mean in this scenario?

  • source
  • parent
  • hideshow 9 child comments
  • [–] 1 point 1 year ago (8 children)

    Any significant shift in the model, or a complete restructuralization of the approach.

    As it is, it won't grow anywhere.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 0 points 1 year ago* (last edited 1 year ago) (7 children)

    So you’ve got access to all this stuffs source code and know what has and hasn’t changed with every update?

  • source
  • parent
  • hideshow 7 child comments
  • [–] 1 point 1 year ago (6 children)

    No, if there was any major breakthrough, it would be advertised everywhere.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 1 point 1 year ago (5 children)

    They’re constantly advertising updates to these chat bots in what they can do.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 0 points 1 year ago (3 children)

    No, they are spreading lies about shit that doesn't matter as to not lose the hype.

    If anyone made any significant advance, they would be all over the world.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    You’re not backing this up with anything. Those of us who use them know they’ve been making big updates regularly.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago (6 children)

    Advanced Reasoning models came out like 4 months ago lol

  • source
  • parent
  • hideshow 6 child comments
  • [–] 4 points 1 year ago (5 children)

    Advanced reasoning? Having LLM talk to itself?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 1 year ago

    Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it's initial approach based on later parts.

    Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.

  • source
  • parent
  • [–] -1 points 1 year ago* (3 children)

    Lul yes but no, but they are clearly better at many types of tasks.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -1 points 1 year ago* (2 children)

    For example? Citations?

    Pretty sure these "tasks" are meaningless metrics made up by pseudo-scientific grifters.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 1 year ago

    Small bits of code, language related tasks, basic context understanding, not metrics I have literally measured simply noticed has improved compared to non reasoning models in my homelab testing. 🤷‍♂️

  • source
  • parent