Who is actually the best web host for GPU support right now? I am getting so frustrated with this. I checked out Lambda Labs because people said they were the go-to but literally every time I log in the instances are totally sold out so what is even the point?
Then I tried looking at AWS but their pricing calculator makes no sense and I just need to host a simple PyTorch model for an image app I'm building for a client here in Chicago. My budget is around $200 a month and I need this live by next Friday. Are there any smaller providers that actually have stock and wont kill me on hidden fees?
I had issues with Lambda too, their stock situation is just terrible lately. For a $200 monthly budget, you have a couple of decent alternative options that wont hit you with hidden fees.
Re: I had issues with Lambda too... you gotta try Jarvis Labs NVIDIA RTX 5000 Ada! Its amazing for PyTorch, fits your budget, and setup is super fast. Youll love it!
Lambda is basically a ghost town lately. I switched over to Vultr Cloud GPU NVIDIA A16 because they actually have stock and the pricing is straightforward. For $200 you can easily get a fractional GPU instance that handles PyTorch stuff fine. Another solid choice is DigitalOcean Paperspace RTX 5000 which fits that budget. Much simpler than messing with AWS billing cycles honestly.