Artificial Intelligence thread

T

tokenanalyst

Brigadier
Registered Member
siegecrossbow said:
Please, Log in or Register to view URLs content!

We gonna jail people for using DeepSeek now? Maybe this is how they’ll arrest the oligarchs and nationalize their assets?
Click to expand...
I don't think is going to pass because DeepSeek was, ironically, a wake up call about open source for a lot of very influential but clueless people and this bill will kill hugginface, LLAMA and US open source AIs in general because the ONLY way to comply with this bill is to publish nothing, not even to the US public.

IF for some stupid reason the bill pass, the US will remember that "You can't compete in a walled garden" to compete you need to race with others players in a real track. The US WILL become a desert of AI research and talent.

Xi Art Of War.
1738508831390.png
 
T

tonyget

Senior Member
Registered Member
Please, Log in or Register to view URLs content!


Attempt to run deepseek-r 671b on Ascend 910b3，unsuccessful

国产适配ollama 华为升腾运行deepseek-r 671b
环境openouer，国产系统
NPU 华为升腾910b3，无sudo root权限编译。
6:30 编译开始速度很慢可以跳过，35:13 编译完成，可以看后续。
最终报错原因，
这个报错估计是数值类型的问题，由于仓库构建时候用的Atlas_A2_series，这里910B3可能与Atlas_A2_series不一样。加载都是没有问题，推理时候估计也不能全部利用NPU，可能有些算子没有实现。核心在于 Range 操作中的输出大小（outSize）不一致，可能是由于在框架和分块计算中使用了不同的浮点精度（double 和 float）。
Click to expand...

Judging form comments，it seems that the problem is Huawei did not release working guidance about Ascend 910，only those business who have bought large volume of Atlas server have official support from Huawei, retail users of Huawei chips don't
 
Last edited:
You must log in or register to reply here.
Top