Miscellaneous News

siegecrossbow

General
Staff member
Super Moderator

tygyg1111

Captain
Registered Member
Yes further development in NAND flash and in PCIE interface since Optane's production stopped have made it so M.2 NVME can now exceed Optane in terms of sequential read/write. However to this day Optane is still a lot faster than NAND in low queue depth random read/write. Here's the difference with my C drive (a Samsung 990 Pro) with the Optane based cache turned off and on:

Off:
View attachment 144694

On:
View attachment 144695

So when accessing lots of small files constantly, as an OS (and AI) does in it's operation an Optane cache makes it much faster.

With AI model it would be interest to test out. If it uses say 700GB of memory to fit the whole R1 671b model but at any one time it's only reading/writing to a small subset of that 700GB than a two tier memory with Optane as the bigger slower layer would work well for a "consumer grade" setup. But if it's constantly reading/writing the entire dataset all the time then Optane as memory would be very slow.
TBH was expecting a diff type of "off / on" when the pics loaded
 

tygyg1111

Captain
Registered Member
We will just hit back with a true international law that states no wage earning American or American aligned person will be able to have stable housing, healthcare, nor education. That way they'll permanently stay down.

Oh wait it's already becoming de facto reality because of the ongoing economic war.

US has a lot to catch up on in escalation.
They will, however, have unfettered access to pharmaceutical grade fentanyl at highly competitive prices
 

Temstar

Brigadier
Registered Member
Top