• 0 Posts
  • 2 Comments
Joined 5 years ago
cake
Cake day: September 14th, 2021

help-circle

  • It is very expensive to self host your AI/LLM and have it function locally. You sure can self host it and get it to work correctly but it too slow or too inaccurate for anything useful. Maybe some new model can be made to run on comoddity hardware or that new cheap hardware can be made to run AI decently, but as of now, on all the equipment I have, I cannot get it to a usable state. You can watch videos on internet on what it takes to get it to run and still have mediocre results.