Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

All about AI
User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/9tQeXB5wiwM

DeepSeek R-1 671B on 14x RTX 3090s !!!!


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/u0LdArHMvoY

AMD Ryzen 7 8845HS CPU vs 870M iGPU


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

M3 ultra AI performance !!


youtu.be/1MLWA-7_V6M

DeepSeek 671B params on Mac Studio


youtu.be/nwIZ5VI3Eus


youtu.be/d8yS-2OyJhw


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/av1eTzsu0wA

Running Full FP16 Deepseek-R1 671B Model on a Virtualization Host


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/aVIgSVOVmSg
This board can get very cheap ES Xeon procesors and support AVX-512 also use DDR5!
DeepSeek R1 671B Running locally at 10+ TPS : Xeon 8480


youtu.be/r7gVGIwkZDc

Must watch video for people who wana get 10k value CPU for like 200 - 300 usd :))

https://forums.servethehome.com/index.p ... 06/page-10

More for the platform and new intel AMX instruction that shall be 2 to 3x faster on llama.cpp!


youtu.be/HOM52p7BMbM


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

Deepseek R1 671b on a $500 AI PC!
It runs ~ 1-2Tk/S but it can run!


youtu.be/t_hh2-KG6Bw


Post Reply