cross-posted from: https://mander.xyz/post/55582711
The scientific publication: A Sovereign, Open-Source Foundation Model for German and English
Soofi S 30B-A3B is a sovereign, open-source Mixture-of-Experts (MoE) hybrid MambaโTransformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment.
Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14โ27B models on aggregate English and German benchmarks, achieves the best code aggregates in both languages among 17 open base models, and outperforms every European sovereign baseline in our comparison โ including ones far larger in active parameters. Among fully open models, it obtains the highest English and German evaluation scores, ahead of Olmo 3 32B and Apertus 70B. Soofi S was built end-to-end on the German Industrial AI Cloud, a sovereign HPC-scale AI infrastructure operated by Deutsche Telekom in Munich.
...
cross-posted from: https://mander.xyz/post/55582711
The scientific publication: A Sovereign, Open-Source Foundation Model for German and English
Soofi S 30B-A3B is a sovereign, open-source Mixture-of-Experts (MoE) hybrid MambaโTransformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment.
Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14โ27B models on aggregate English and German benchmarks, achieves the best code aggregates in both languages among 17 open base models, and outperforms every European sovereign baseline in our comparison โ including ones far larger in active parameters. Among fully open models, it obtains the highest English and German evaluation scores, ahead of Olmo 3 32B and Apertus 70B. Soofi S was built end-to-end on the German Industrial AI Cloud, a sovereign HPC-scale AI infrastructure operated by Deutsche Telekom in Munich.
...
The scientific publication: A Sovereign, Open-Source Foundation Model for German and English
Soofi S 30B-A3B is a sovereign, open-source Mixture-of-Experts (MoE) hybrid MambaโTransformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment.
Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14โ27B models on aggregate English and German benchmarks, achieves the best code aggregates in both languages among 17 open base models, and outperforms every European sovereign baseline in our comparison โ including ones far larger in active parameters. Among fully open models, it obtains the highest English and German evaluation scores, ahead of Olmo 3 32B and Apertus 70B. Soofi S was built end-to-end on the German Industrial AI Cloud, a sovereign HPC-scale AI infrastructure operated by Deutsche Telekom in Munich.
...