4
Tokasaurus: An LLM Inference Engine for High-Throughput Workloads
(scalingintelligence.stanford.edu)
this post was submitted on 06 Jun 2025
4 points (75.0% liked)
Technology
1174 readers
54 users here now
A tech news sub for communists
founded 3 years ago
MODERATORS
there doesn't seem to be anything here