Does that even work out to be cheaper, once you factor in how much extra power y... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		gruez 68 days ago \| parent \| context \| favorite \| on: Speed up responses with fast mode Does that even work out to be cheaper, once you factor in how much extra power you'd need?

HumanOstrich 68 days ago [–]

How much extra power do you think you would need to run an LLM on a CPU (that will fit in RAM and be useful still)? I have a beefy CPU and if I ran it 24/7 for a month it would only cost about $30 in electricity.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact