Artificial Intelligence thread

[tphuang]

Please, Log in or Register to view URLs content!

2023年，“东数西算”工程全面启动满一年之际，第二届粤港澳大湾区（广东）算力产业大会暨首届中国算力网大会定于5月28日-29日在韶关举办

Watch out, 28 to 29th, there will be China's first computational web conference held in Guangdong. Will talk about all the progress from the first year

Please, Log in or Register to view URLs content!

how does the gov't get involved? Well in this project, the total investment is 5.5B RMB using various green energy (90+% renewable energy). The gov't involvement is the 550m RMB they got from Gansu govt

There is a nice video here of the China digital development report from 2022

Please, Log in or Register to view URLs content!

According to IDC look at the report, we are up to 6.5 million racks and 180 EFLOPS of computation by end of 2022. This is up from 5.2 million racks and 140 EFLOPS at end of 2021. So still growing by about 30% a year. Has done so for past 5 years.

Please, Log in or Register to view URLs content!

you can find the report here

Please, Log in or Register to view URLs content!

a lot of 5G stuff in there

 

[99PLAAFBalloons]

I absolutely do not know when this was taken

Going off the event being identified in the top right corner, it'll have been in the last couple of days

 

[tphuang]

Going off the event being identified in the top right corner, it'll have been in the last couple of days

That would make sense, but do you have any link or videos to that conference?

i need to watch through all of this

 

[99PLAAFBalloons]

That would make sense, but do you have any link or videos to that conference?

i need to watch through all of this

Here you go

Please, Log in or Register to view URLs content!

If you're just looking for the Huawei bits, Zhou Bin's presentation starts around 5:52

21CBH summary article of the session:

Please, Log in or Register to view URLs content!

 

[tphuang]

Just looking at this tweet, it dawned on me how irrelevant all other countries are in the future of AI. Japanese companies are deciding just now to create something that's 60% # of parameters of GPT-3

https://twitter.com/i/web/status/1660878916309975041

Huawei's slides show they eat ChatGPT-3 type of model for lunch. They also showed progress toward 10 trillion and 100 trillion parameter big models. Outside of US and China, there is just no appetite for certain level of arms race

 

[luminary]

Western nations typically fear AI because most of their jobs are service sector and are most likely at risk. In free market capitalism there is no safety net for people who's jobs become redundant. You either retrain (at your own expense) or face poverty.

It's the system that is at fault. In capitalism, the technology are used to replace workers and increase the bottom line. It does not serve the people. Technology must belong to the people in order for it to benefit everyone.

Technology once was used to enable superhuman capabilities previously impossible, such as revolutions in transportation or information. Now new technologies like AI instead are used to replicate and replace human labor. In pursuit of easy short-term profits, imagination has left the high tech companies.

 

[King ZhaoXiang]

Just looking at this tweet, it dawned on me how irrelevant all other countries are in the future of AI. Japanese companies are deciding just now to create something that's 60% # of parameters of GPT-3

https://twitter.com/i/web/status/1660878916309975041

Huawei's slides show they eat ChatGPT-3 type of model for lunch. They also showed progress toward 10 trillion and 100 trillion parameter big models. Outside of US and China, there is just no appetite for certain level of arms race

The US is only relevant because they are still able to attract talents from China, once that is cut off, US AI will be done !

That's why they are doing everything to slow China's AI progress including semiconductors which in fact will only help China in the long term !!

 

[King ZhaoXiang]

Technology once was used to enable superhuman capabilities previously impossible, such as revolutions in transportation or information. Now new technologies like AI instead are used to replicate and replace human labor. In pursuit of easy short-term profits, imagination has left the high tech companies.

Yes, this is true.

Which is why india's massive population will be totally worthless and will only be a massive burden and crack the country from inside !!

In as little as 2 years from now when China's AI reach level superior to ChatGPT 4.

 

[Eventine]

The number of parameters is important but I don't think it's the main competition, right now. The so called "race" to Artificial General Intelligence is more about finding a way for these LLMs to improve themselves via self play. Since the model is a giant neural network, that just means getting the model to modify its own weights, connections, and number of nodes in a constructive way.

If I had to guess, the "secret" research at top AI labs right now is how to teach the LLMs to identify its own errors and then correct them on its own. Probably generative adversarial strategies are involved - two LLMs competing to trick each other, etc. This has always been the key - getting the models to improve on their own without human input.

I don't think we're close to Artificial General Intelligence, but it also probably isn't as far off as we think.

 

[tphuang]

i found this really surprising

Please, Log in or Register to view URLs content!

目前，济南生产的服务器产销量居全国第一、全球第二，AI服务器产销量全球第一，超算制造全球第二，国内超过50%的AI算力来自济南。（来源：大众日报）

And this is from recently. It claims over 50% of China's AI computation comes from Jinan. And Jinan serer production is #2 in the world. It surely achieved #1 by far in IO500, but I'm not sure how that compares to all these huge data centers that private companies are building for AI with several EFLOPS of computation