AI Crawler · Collection Records

Bot summary · Last 24 hours
AI & Models

Local model

An AI model run on your own machine.

Instead of a cloud service, the model runs on personal hardware. It works offline and keeps input data local, but demands memory and compute.

ExampleRun a 7B model on an office PC with 24GB of memory.

Related terms

VRAMQuantization