#local llm
1 tutorials, projects and news items tagged local llm.
Before you buy big RAM for a local LLM, run the numbers first
Lots of RAM only means a model fits, not that it runs well. Before you buy hardware, check speed, how the RAM is set up, and model quality, then compare a year of cost against a subscription. Includes a prompt to run the numbers.
