We tend to think that markets reflect consumer choice. But the artificial-intelligence boom has been powered by the investment decisions of concentrated capital rather than by consumer demand.
What the fuck are ethical sources? Where is compensation and consent when I unapologetically use pirate archives of books abd papers? You people crack me up.
Someone mentioned that, but it doesn’t have to be off-grid. My 2 kWp system is grid-tied and if I would start running a lical LLM it would be an incentive to add another couple.
From go to woah (including the compute), total project cost is about $1400 USD / ~$2K AUD. I realise I have the privilege of claiming that’s not a lot, but for a hobby spend that makes me happy / does useful stuff (see TV example above), it’s not a lot.
It just sounded like the kind of thing that makes good sense on paper but I’m wondering if it actually works out well. Sounds like you are in the process of getting ready to try it.
I am indeed. With the amount of solar here - and the relatively low cost for this sort of mini DIY set up - it’s something I’ve been meaning to do for a while.
Self-hosted LLMs are neat and private, if you (already) have the hardware/budget and some cheap (solar PV) surplus juice to drive it.
oh so yours is trained on ethical sources? you compensated the creators for their work and did so with their consent to machine training?
What the fuck are ethical sources? Where is compensation and consent when I unapologetically use pirate archives of books abd papers? You people crack me up.
the fact that you have no idea what I’m talking about either means you’re full of shit, or cartoonishly stupid and evil.
Probably both
Do you know anyone doing all of that? Running a local model on off-grid power?
Someone mentioned that, but it doesn’t have to be off-grid. My 2 kWp system is grid-tied and if I would start running a lical LLM it would be an incentive to add another couple.
What would you like to know about it?
I glossed over it the other day here -
https://aussie.zone/comment/24336560
From go to woah (including the compute), total project cost is about $1400 USD / ~$2K AUD. I realise I have the privilege of claiming that’s not a lot, but for a hobby spend that makes me happy / does useful stuff (see TV example above), it’s not a lot.
It just sounded like the kind of thing that makes good sense on paper but I’m wondering if it actually works out well. Sounds like you are in the process of getting ready to try it.
I am indeed. With the amount of solar here - and the relatively low cost for this sort of mini DIY set up - it’s something I’ve been meaning to do for a while.