I love playing with LLMs locally at home. The cost of running hobby projects against paid services like OpenAI is too high for me so in this article you can find out how I work around that to keep my LLM infra deployed locally at home and still use it anywhere I like.
This is literally what I do all day everyday for the last like 6 months or so. Kind of at the point where my Hardware is limiting me on what I can do but I continue to press forward so kudos. I am 100% sure it’ll be worth it.