Artificial Intelligence thread

tonyget

Senior Member
Registered Member
Please, Log in or Register to view URLs content!


Attempt to run deepseek-r 671b on Ascend 910b3,unsuccessful

国产适配ollama 华为升腾运行deepseek-r 671b
环境openouer,国产系统
NPU 华为升腾910b3,无sudo root权限编译。
6:30 编译开始速度很慢可以跳过,35:13 编译完成,可以看后续。
最终报错原因,
这个报错估计是数值类型的问题,由于仓库构建时候用的Atlas_A2_series,这里910B3可能与Atlas_A2_series不一样。加载都是没有问题,推理时候估计也不能全部利用NPU,可能有些算子没有实现。核心在于 Range 操作中的输出大小(outSize)不一致,可能是由于在框架和分块计算中使用了不同的浮点精度(double 和 float)。

Judging form comments,it seems that the problem is Huawei did not release working guidance about Ascend 910,only those business who have bought large volume of Atlas server have official support from Huawei, retail users of Huawei chips don't
 
Last edited:

huemens

Junior Member
Registered Member
Please, Log in or Register to view URLs content!

Attempt to run deepseek-r 671b on Ascend 910b3,unsuccessful

Judging form comments,it seems that the problem is Huawei did not release working guidance about Ascend 910,only those business who have bought large volume of Atlas server have official support from Huawei, retail users of Huawei chips don't

Instructions have been published from day 1. The link is there in Deepseek Github. He is not following it. He is trying to run it using ollama, which is not the recommended way for Ascend. Huawei has it's own application called MindIE for running models on Ascend Hardware.

6.7 Recommended Inference Functionality with Huawei Ascend NPUs​

The
Please, Log in or Register to view URLs content!
framework from the Huawei Ascend community has successfully adapted the BF16 version of DeepSeek-V3. For step-by-step guidance on Ascend NPUs, please follow the
Please, Log in or Register to view URLs content!
.

Please, Log in or Register to view URLs content!
 
Last edited:

european_guy

Junior Member
Registered Member

DeepSeek Becomes Top AI App, India Leads the Way in User Adoption​


Please, Log in or Register to view URLs content!


India contributed 15.6% of all downloads across platforms since its launch, the data showed.

Well... :)

It seems these guys provide DeepSeek here:

Please, Log in or Register to view URLs content!

Apparently they have their own cloud infrastructure on Intel Gaudi CPus:

Please, Log in or Register to view URLs content!

But they also partner with AWS, so it is not clear if the servers for DeepSeek are actually in India or they simply act as front interface for AWS.
 
Last edited:

tphuang

Lieutenant General
Staff member
Super Moderator
VIP Professional
Registered Member
Guys, let me say this again. Please raise your standard of post here. There is a rule in this forum about one-liner. If you are just looking to take a zinger against American politicians, there are other threads for that.
 

tphuang

Lieutenant General
Staff member
Super Moderator
VIP Professional
Registered Member
I'm watching for this to happen. Rest of the world using DeepSeek to develop their AI sector because cost is so much lower.

Please, Log in or Register to view URLs content!

Usage and hope for it in Brazil

Please, Log in or Register to view URLs content!

Thailand using DeepSeek

Please, Log in or Register to view URLs content!

DeepSeek and Indonesia
Please, Log in or Register to view URLs content!

Please, Log in or Register to view URLs content!

looks like in fact DeepSeek is working with AlonOS to set up data center in Indonesia

Please, Log in or Register to view URLs content!

It seems like Chinese models need to make their performance better in other languages, like Russian for example

Please, Log in or Register to view URLs content!
 
Top