Artificial Intelligence thread

european_guy

Junior Member
Registered Member
Big news! Qwen 3 is here!

Please, Log in or Register to view URLs content!

qwen3-235a22.jpg
A lot of models, all open sourced!

Among them an impressive 235B parameter MoE model (same model family like DeepSeek)

Today, we are excited to announce the release of Qwen3, the latest addition to the Qwen family of large language models. Our flagship model, Qwen3-235B-A22B, achieves competitive results in benchmark evaluations of coding, math, general capabilities, etc., when compared to other top-tier models such as DeepSeek-R1, o1, o3-mini, Grok-3, and Gemini-2.5-Pro. Additionally, the small MoE model, Qwen3-30B-A3B, outcompetes QwQ-32B with 10 times of activated parameters, and even a tiny model like Qwen3-4B can rival the performance of Qwen2.5-72B-Instruct.

Trained on 36T tokens! That's impressive, the biggest token budget among opensource models (closed ones don't publish this info)

While Qwen2.5 was pre-trained on 18 trillion tokens, Qwen3 uses nearly twice that amount, with approximately 36 trillion tokens covering 119 languages and dialects.
 
Top