What is the most affordable GPU web hosting for AI startups?

Question

Which gpu hosting is actually the best value for a tiny ai startup? Im currently torn between RunPod and Lambda Labs and leaning towards RunPod because their community cloud prices are so low, but I keep hearing Lambda has better stability. I need to get an LLM fine-tuning job done by next friday and I only have a $400 budget for the month. Based in Berlin but location isnt a huge deal.

Is the reliability on RunPod actually okay or should I just shell out for Lambda? Or is Vast.ai actually usable for something serious? I dont want my instance dying halfway through a long training run...

umrkvvqesr · Accepted Answer

I've been using RunPod for a while now and honestly, I'm super satisfied with the performance for the price. I had to push through a massive finetuning task last month and used an NVIDIA A100 80GB PCIe on their secure cloud. No complaints at all, it stayed up the whole time and didn't break the bank. With a $400 budget, you'll get way more runtime there than on Lambda. Lambda is nice but it's often hard to find available instances when you're in a rush. If you're worried about reliability on the community cloud, just filter for hosts with 99% uptime or use the NVIDIA RTX 4090 24GB nodes in their data centers. Vast.ai is fine for hobby projects but it can be a bit of a headache to set up. For a Friday deadline, the RunPod template system just works better.

WilliamLouBy · Answer

Like someone mentioned, RunPod is usually the go-to, but honestly I've had some pretty frustrating experiences with their community cloud lately. I tried saving a few bucks on a fine-tuning job using a NVIDIA RTX 4090 24GB instance from a community provider, and the thing just vanished halfway through the night. No warning, no logs, just gone. Unfortunately, if you're on a tight deadline like next Friday, gambling on the cheapest nodes is a massive risk. Vast.ai is even more of a wild west in my experience. I love the concept, but for something serious? It's just not as good as expected. I've had nodes go offline because the host basically just turned their machine off at home. It's super discouraging when you're watching that progress bar... A couple quick tips for that $400 budget:Set up automatic checkpoints to an external bucket every hour. Dont skip this or you're gonna regret it.If you use RunPod, stick to Secure Cloud and grab an NVIDIA A100 80GB SXM node even if it costs more hourly.Use a monitoring tool so you can at least see where things died. It really sucks when a long run fails and you lose the progress, so just make sure you're prepared for the worst. If you need a hand setting up a script to auto-resume from the last checkpoint, let me know. I've got a python snippet that saved my skin after my last disaster... ngl it's the only way I sleep at night during training sessions tho.