This source claims inference in around 38 t/s, which is not bad:
Artificial Intelligence thread
- Thread starter 9dashline
- Start date
This source claims inference in around 38 t/s, which is not bad:
"Scientists from the two countries have developed a breakthrough algorithm using information from reverse engineering video card accelerators. The algorithm allows gaming GPUs to be used for scientific computing[...].
The innovation was achieved by specialists from Shenzhen MSU-BIT University, co-founded by Lomonosov Moscow State University and Beijing Institute of Technology[...]It also means that Russia and China need to buy less NVIDIA GPUs[...]
These advancements highlight Russia’s technological expertise, allowing collaboration with China and potential future partnerships with India." Sputnikintl
The innovation was achieved by specialists from Shenzhen MSU-BIT University, co-founded by Lomonosov Moscow State University and Beijing Institute of Technology[...]It also means that Russia and China need to buy less NVIDIA GPUs[...]
These advancements highlight Russia’s technological expertise, allowing collaboration with China and potential future partnerships with India." Sputnikintl
Not sure what to make of this tweet from DeepSeek AI researcher Guo Daya:
manqiangrexue
Brigadier
They want Chinese people to benefit the US and NOT benefit China; that's their stupid logic. They used to welcome China's brightest minds. The result is that those minds came, learned,benefitted America but a large portion went back and did much more for China. So American politicians closed America to Chinese minds and the result is that Chinese scientists just worked for China and the US got left behind. Now they want to go back to inviting Chinese minds cus they already forgot why they closed off in the first place and that started just 2 years ago. That's how smart these people are... It's like a guy going back and forth cus he can't decide if he prefers to get stabbed or shot to death and he has really bad memory so it's kinda funny cus he looks surprised every time.but but but USA has advantage in ''attracting global talent''
US should ‘steal’ China’s best AI talent to keep pace, Senate hears
The US should welcome China’s best scientific minds into its universities to compete with the mainland’s success in , American lawmakers in Washington heard on Thursday, as Chinese start-up this week.
“Let’s steal their best engineers,” said Melanie Hart of the Washington-based Atlantic Council at a hearing convened by the Senate Foreign Relations Committee.
View attachment 144745
Means their next R2 will be a lot smarter, probably beating o3
Okay, this is cheaper than average corporate laptop now.....