902
Cruel and abusive behavior (europe.pub)
submitted 5 days ago by to c/programmer_humor@programming.dev
186 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 4 days ago (1 child)

Yes but that's related to LLMs specifically, not backpropagation. There's plenty of ML paradigms that use backprop and have continual learning setups.

Backprop is the process of how the weights are updated.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 4 days ago

    Well to be precise the pretraining is prevented by this but the online post training does have this issue. The reinforcement learning trials show some sort of automation but I am not aware of any unsupervised methods that have been as successful as the latest batches of llms — haven’t been in this field for a while so honestly dunno.

  • permalink
  • fedilink
  • source
  • parent