Artificial Intelligence thread

[diadact]

Good report on the State of AI in 2024 from Air Street Capital

Please, Log in or Register to view URLs content!

 

[jnd85]

Very interesting interview
Dylan says that SMIC has 60K WPM capacity in Shanghai
SMIC can make 50-80 dies of Ascend 910B from 1 wafer
Is Ascend 910C on 5 nm node?

Very interesting interview
Dylan says that SMIC has 60K WPM capacity in Shanghai
SMIC can make 50-80 dies of Ascend 910B from 1 wafer
Is Ascend 910C on 5 nm node?

I love that channel

 

[tphuang]

Please, Log in or Register to view URLs content!

Bytedance and Qinghua AIR opening up combined research in cooperation in language models

 

[BoraTas]

Seriously whenever I hear this crap I wonder what environment they're working in. I have been using GPT 4, Co-pilot etc. tailored to our (large codebase) systems and it just produces slop all the time. Useful slop, yes, but slop nonetheless.

It makes it so I don't have to break out regex as often and reduces boiler plate, but that's something compilers have been doing since forever. It's also fundamentally reliant on problems being common. But common coding was never difficult or time-consuming to begin with. It's always been obscure bugs, constraints that are hidden in 1 commit in a 10,000 of a public library, dealing with obtuse management requests, etc. that consume the most time and energy and that's not something LLMs help with.

Going from 3 to 3.5 to 4 has improved the quality of the slop but hasn't tackled any of the other issues that taking developer time. The limitations are baked in to the way LLMs work.

The GPT4 totally sucks in hardware description languages. I know from my job. Very probably because there is far less code on the internet compared to Python and JavaScript.

 

[Hyper]

The GPT4 totally sucks in hardware description languages. I know from my job. Very probably because there is far less code on the internet compared to Python and JavaScript.

r/LocalLlama on reddit think OpenAI underperforms in usage compared to benchmark scores. Users find better performance from Llama 3.1 and Claude Sonnet.

 

[siegecrossbow]

Claude is currently the best software development AI bar non.

 

[Hyper]

Claude is currently the best software development AI bar non.

DeepSeek is at par with it. But Llama and Qwen are one generation behind. Also reddit now think that OpenAI is fudging benchmarks.

 

[tphuang]

Please, Log in or Register to view URLs content!

China mobile has unveiled 30+ self developed industry large models (I assume for telecom scenario)

九天善智多模态基座大模型是基于万卡国产算力集群和国产算法框架训练的全栈国产化全模态基座模型，适配了 11 个厂家 17 款国产 AI 芯片，支持模型在异构芯片间的平滑转化和续训。

It's Jiutian multi-model foundational model is trained on 10k+ domestic card GPU cluster using 17 types of AI chips from 11 suppliers. That seems to be too many suppliers, but they have worked with pretty much all domestic players based on previous reporting.

 

[GulfLander]

https://twitter.com/i/web/status/1845301829032132772

 

[tphuang]

https://twitter.com/i/web/status/1846245604890116457

Yi-lightning is out and ranking 9th in Arena's ranking.