big picture: they're paying high salaries to train Chinese GPU design engineers.
where do they go?
Awesome, now ban Nvidia from further development in China. That would be a fair reciprocal move. Chinese AI/cloud service companies were given no time to make adjustment. Neither should Nvidia be given time to further research on Chinese brains. Then, all those Nvidia employees can go work at Biren Technology and Nvidia has to take longer to finish its new chips.
In the meanwhile, you need to work on enticing more ethnic Chinese engineers in this field to move back to China.
So, I took look at what Alibaba cloud, which has like 1/3 market share in China uses. Looks like a lot of their ECSs are using A100 GPUs. I know they had developed Yitian-710, but it looks like it is still in low production and is not an AI accelerator.
Still, this seems like a good move toward using domestic product on domestic cloud services. It also seems to me that ramp up for production even in a large tech firm like Alibaba could take a while. It took them 6 months after announcement to even get to this point.
Then, I took a look at Baidu cloud and what they had domestically. That was the Kunlun 2 chip
In this case, it does seem like a chip designed for AI. However, it seems designed just for Baidu Brain 7.0. I'm not sure if this will ever appear outside of Baidu data centers anytime soon. On top of that, there hasn't been news about it even in their recent earnings call. Also, the good people at XPeng that is building a large self driving center with Baidu is still using A100 based on their recent social media post
Well, that's discouraging. That tells me Kunlun 2 at this point is probably still just testing out in limited number of Baidu server boxes.
Then I took a look at Huawei/Hisilicon. Looks like they actually had a really compelling product in Ascend 910 when it got launched. It was actually using 7 nm process and had better performance than the previous generation V100 (which was the flagship product of Nvidia back in 2019 and using 12 nm proces)
But as we know, Huawei/Hisilicon got crushed by sanctions. Now, I'm optimistic that Huawei will be back and designing great chips with the domestic line. However, they will have to balance the need for AI chips with smartphone chips and other areas. But this is at least a good contender.
Which brings us to Biren BR100. I read a great article here. Honestly, they seem to have some really solid people behind the project and a lot of funding. And more importantly, they have already started shipping their flagship BR100/104 product.
Looks like it won one of the awards here along with Huawei cloud's drug design platform and Horizon Robotics's Journey 5 chips.
Biren has really moved fast. They managed to launch this flagship chip in 3 years. It was designed from start to be 10 times the speed of the leading edge V100 chip at the time. So when it got released, it is best in the world. Although probably behind H100 when the latter comes out. So, China slowing down Nvidia development by not allowing them to finish their H100 project in China is probably fair.
Just 5 months ago, they said they had successfully tested BR100. Now, they are able to already ship it. That's impressive.
Again, Biren believes their product is even competitive vs H100. It aimed very high in the design phase.
Looks like their initial customer is probably going to be Alibaba cloud, but I'm sure more people will join later. If their project was supported by Alibaba cloud, then it makes sense they would've been working with Alibaba to fine tune their GPU up until now. If the performance is as good as advertised, it's just a matter of ramping up production. They'd be well served now to stock enough TSMC chips for a while until they can get a similar chip designed with SMIC 7nm process. TSMC is seeing orders slow down, so Biren should put in a major order in for the next year.
I'm also curious about this other company enflame mentioned here on GT article.