im honestly so fed up with heroku and their stupid slug size limits. my logic was to keep it simple but it just crashes every time i try to load my pytorch model. im on a $15 budget for this school project and need something that actually works for python ai without being a total nightmare...
Honestly, Heroku is basically a toy once you start loading heavy weights like PyTorch or Transformers into memory. Those slug limits exist because they are trying to pack too many containers onto one node. Its frustrating when you spend more time shrinking your requirements file than actually coding. Unfortunately, most managed platforms like Render or Railway have similar hidden walls that make them not as good as expected for data science projects. If you want to stay under that $15 mark, you really need to look at raw VPS providers where you control the swap space and disk partition. Most PaaS solutions will kill your process the moment it hits 512MB or 1GB of RAM, which happens instantly with most AI models.
Been thinking about your build issues. Over the years, I have learned that RAM is the real killer for PyTorch. Quick question tho... how much memory does your model actually pull during inference? In my experience, these are safer bets:
I honestly had the exact same issues with those one-click platforms and they were not as good as expected. Heroku is a total headache for machine learning because their slug limits are tiny and they dont tell you that until your build fails for the tenth time... Unfortunately, I wasted a week trying to make it work before switching to a real VPS. If you want reliability on a $15 budget, do this: