im trying to get that deepseek-v3 thing working on my own computer for some writing projects i have. i got about 800 dollars saved but honestly all these technical specs make my head spin. sorry if this is dumb but what gpu do i actually need to buy so it works?
> A used 3090 is your best bet! To add: im happy with the NVIDIA GeForce RTX 3090 24GB VRAM over NVIDIA GeForce RTX 4060 Ti 16GB for more vram. Check Ollama docs!
Man, I remember my first setup, it was such a rush! Are you running the full version or quantized? A used NVIDIA GeForce RTX 3090 24GB VRAM is honestly your best bet!
To add to the point above: honestly vram is basically the only thing that matters for this. If you cant find a used 3090, you could maybe look at a NVIDIA GeForce RTX 4070 Ti Super 16GB since its newer, but 16gb is gonna be a real struggle for deepseek-v3. Tbh you might even consider picking up two used NVIDIA GeForce RTX 3060 12GB cards if your motherboard has the slots... that gets you 24gb total for way under your $800 budget. ngl the NVIDIA GeForce RTX 3090 24GB VRAM is still the best pick tho. Just make sure your power supply is beefy enough because those things draw a ton of juice. It is a bit of a balancing act for sure... but vram is king.