Which hosting provi...
 
Notifications
Clear all

Which hosting providers offer the best GPU support for AI apps?

4 Posts
5 Users
0 Reactions
219 Views
0
Topic starter

I am so stoked because Im finally getting my art generation project off the ground for a local gallery show here in Seattle next month but man picking a host is stressing me out lol. I need something that can handle stable diffusion without costing me my entire life savings since I only got about 250 bucks a month to play with for the server costs.

Right now Im stuck between Lambda Labs and RunPod. Lambda looks amazing on paper because the prices are dirt cheap but every time I check it seems like they have literally zero GPUs available like what is even the point if I cant rent one?? Then there is RunPod which everyone says is super easy to set up and they always have stock but I heard some weird things about their uptime for production stuff and I dont want my app crashing right when people are trying to use it during the opening night. I also glanced at DigitalOcean since I use them for web stuff but their GPU prices seem kinda high compared to the others.

Im leaning toward RunPod just for the availability factor but I really dont want to regret it if the performance is spotty. Between those three or maybe something else I missed which one actually has the most reliable GPU support for a live app?


4 Answers
12

Like someone mentioned, hunting for stock on those ultra-cheap sites is basically a full-time job and probably not what you want to be doing right before a gallery opening. In my experience, if you actually need the app to stay up when people are watching, you need a provider with better service level agreements than the budget rental marketplaces. I've tried many over the years and these are way more reliable for a live setup:

  • Paperspace Core NVIDIA A6000 48GB
  • This is my go-to because the A6000 has massive VRAM for high-res art and the Core instances don't just disappear on you like spot instances do.
  • Vultr Cloud GPU NVIDIA A16 16GB
  • A bit more corporate but their uptime is rock solid compared to the startup hosts. Since you got 250 bucks, you could honestly just spin up a dedicated instance for the duration of the show and then kill it. Better to pay a tiny bit more for peace of mind than have a black screen when the curator walks by.


12

@Reply #1 - good point! RunPod works, but for your $250 budget, look at TensorDock's NVIDIA RTX 3090 24GB instances. Dedicated core hosts give better uptime than community pools for live shows.


2

Man I totally feel your pain with Lambda Labs, availability is a total joke there! Honestly for a live gallery show you should absolutely go with RunPod. I love using their NVIDIA RTX 4090 24GB VRAM instances, they are fantastic for Stable Diffusion and super cheap. Uptime is actually awesome if you use their secure cloud instead of community pods. DigitalOcean is just way too overpriced. RunPod is amazing, go for it!


1

> Lambda looks amazing on paper because the prices are dirt cheap but every time I check it seems like they have literally zero GPUs available Honestly its ridiculous how bad the GPU market has gotten lately. I have tried many providers over the years, and the lack of reliable stock is just a joke. It drives me crazy that we have to choose between getting ripped off by major cloud providers or dealing with zero availability on the budget sites. How are we supposed to deploy production apps when instances just vanish or arent even in stock when you need to scale? Its such a scam...


Share: