INSANE Ollama AI Home Server - Quad 3090 Hardware Build, Costs, Tips and Tricks

Interested in Training your own Ai Models? Wanting to speed up your inference from a Dual GPU, locally hosted ai home server? This video is a must watch. You can run A LOT of containers against a small fleet of GPUs like this. I cover the complete hardware build, drop a ton of mounting, cooling, pcie and gpu tips and tricks for this EPYC server sporting 512GB of DDR4. Ollama GPU servers have make use of multiple GPUs automatically so I am building a monster rig that we will be testing out. 👇 All Parts Used Linked Below 👇

Written piece and GPU Rack Modification Instructions
https://digitalspaceport.com/ollama-gpu-3090-home-server-quad-gpu-ai-training-rig/

GPU Rack Frame https://geni.us/GPU_Rack_Frame
Gigabyte MZ32-AR0 Motherboard https://geni.us/mz32-ar0_motherboard
Supermicro H12ssl-i Motherboard https://geni.us/MBD_H12SSL-I-O
RTX 3090 24GB GPU (x4) https://geni.us/GPU3090
Kritical Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads
256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable
AMD EPYC 7702p https://geni.us/EPYC_7702p
iCUE H170i ELITE CAPELLIX https://geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste
CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4) https://geni.us/SFF8654_to_SFF8654
HDD Rack Screws for Fans https://geni.us/HDD_RackScrews

AI Playlist https://www.youtube.com/playlist?list=PLarJAzZsWRGBiEryA9E6LIA9ba7ir7cfA

Be sure to 👍✅Subscribe✅👍 for more content like this!

Join this channel https://www.youtube.com/@DigitalSpaceport/join

Thanks for watching!

Digital Spaceport Website
🌐 https://digitalspaceport.com

*****
As an Amazon Associate I earn from qualifying purchases.

When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****

0:00 Intro
1:09 Which motherboard
5:49 GPU rack frame
6:59 Which power supply
10:16 Water cooling
12:08 Wattage vs other servers
13:43 How much did it cost
20:37 Conclusions

Тэги:

#ai_rig #ai_home_server #server_rack #3090 #quad_3090 #3090_gpu #homelab #ai_home_rig #ai_2024 #ai_rig_build #ollama_gpu #ollama_ai #home_server #homelab_gpu_server #4_3090_gpu #quad_gpu_server #epyc_gpu_server #amd_epyc #server_build_guide #deep_learning_server #machine_learning_build #how_to_build_ai_server #how_to_build_homelab_ai_server #how_to_build_ai_home_server #amd_epyc_ai_server_build #amd_epyc_7702 #mz32_ar0_motherboard #gpu_rack_ai_server

Скачать видео