you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 3 months ago

Especially if you could use the space to display what the model is actually doing, like the thinking process or other current model states (prefill, decode, idly waiting for a slot...)

  • source
  • parent