Soofi S 30B-A3B is a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mambaโ€“Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment.

Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14โ€“27B models on aggregate English and German benchmarks, achieves the best code aggregates in both languages among 17 open base models, and outperforms every European sovereign baseline in our comparison โ€” including ones far larger in active parameters. Among fully open models, it obtains the highest English and German evaluation scores, ahead of Olmo 3 32B and Apertus 70B. Soofi S was built end-to-end on the German Industrial AI Cloud, a sovereign HPC-scale AI infrastructure operated by Deutsche Telekom in Munich.

...

you are viewing a single comment's thread
view the rest of the comments
[โ€“] 10 points 2 months ago

They claim it is an open-source model but at least for now it has a custom unspecified license. I hope they change that before the actual release because right now I wouldnโ€™t even call it open-weight

  • source