Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

All about AI
User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

Let`s test AI models on diffrent hardware !

Join our telegram group if you wana chat or have specific questions:
https://t.me/+h2K5CX5jEZA0MWJk


youtu.be/A5A-aP_5B5s

mac mini M4 24GB of ram model 6-7 t/s on deepseek 32B model :))

Image


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

DeepSeek R1 on Intel Arc B580: More Performance with llama.cpp and Overclocking


youtu.be/-9hQdTqAIeE

Image

Image

Image


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

DeepSeek R1 671B MoE LLM running on Epyc 9374F and 384GB of RAM (llama.cpp, Q4_K_S, real time)


youtu.be/wKZHoGlllu4


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

Benchmarking LLMs on Ollama Windows 11 ARM


youtu.be/G5qfL6kEy04


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/zRIDov52ejk

Deepseek 14B and 32B tested on Radeon 6950XT with RoCm


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

Testing DeepSeek & AMUSE AI on Minisforum AI X1 Pro


youtu.be/wL4us0wHzFE


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »

Dual RTX 3060 12GB Build For Running AI Models


youtu.be/RllCtcVKYt8


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/Ju0ndy2kwlw

I built an AI supercomputer with 5 Mac Studios


User avatar
david
Site Admin
Posts: 366
Joined: Sat May 21, 2016 7:50 pm

Re: Benchmarks on AI models share your results! amd ,nvidia, Intel ,apple, NPU`s and cpu only

Post by david »


youtu.be/YxJYhhrhrDk
Run LLM on 5090 vs 3090 - how the 5090 performs running deepseek-r1 using Ollama?


Post Reply