Is it actually possible to run DeepSeek V4 Flash locally without spending five grand on hardware? Im getting so frustrated trying to figure out if I should just grab two 3090s off eBay or hold out for a used Mac Studio M2 Ultra. My budget is around 2k max and I need this for my local dev server by next month.
Honestly, skip the Mac. Just snag two used NVIDIA GeForce RTX 3090 24GB GDDR6X cards. Itll fit your budget way better, just make sure you have a massive power supply ready.
If you go the dual 3090 route, just make sure you grab a board with enough PCIe spacing. You'll definitely need something like a EVGA SuperNOVA 1600 P2 1600W Platinum to keep everything stable. Honestly, cooling those cards in a tight case is the real nightmare. Keep the airflow high and maybe undervolt them to save your power bill and keep the temps from hitting a wall.
Just catching up on this thread. Honestly, trying to run something that massive locally is a headache. You could try setting up a workstation with two NVIDIA GeForce RTX 3090 24GB GDDR6X cards, but watch your thermals.