Soofi S 30B-A3B is a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mambaโ€“Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment.

Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14โ€“27B models on aggregate English and German benchmarks, achieves the best code aggregates in both languages among 17 open base models, and outperforms every European sovereign baseline in our comparison โ€” including ones far larger in active parameters. Among fully open models, it obtains the highest English and German evaluation scores, ahead of Olmo 3 32B and Apertus 70B. Soofi S was built end-to-end on the German Industrial AI Cloud, a sovereign HPC-scale AI infrastructure operated by Deutsche Telekom in Munich.

...

you are viewing a single comment's thread
view the rest of the comments
[โ€“] 6 points 2 months ago

"We have our own SOVEREIGN Torment Nexus!"

  • source