chatgpt running fully offline on my 16gb laptop, no gpu

FinishedRun a ChatGPT-style AI on your own laptop

Did the run-AI-on-your-PC lesson with gemma4:e2b. Getting about 26 tokens/sec on the CPU, which is honestly fine for drafting emails and summarising stuff.

Pulled the wifi out to check it wasn't secretly online. Still answers. Very satisfying.

Open WebUI next so it actually looks like ChatGPT and I can stop using the terminal for it.

2 comments

Want to reply? It's free, no card, takes 30 seconds.

sophnotaL36d ago

is gemma4:e2b good enough for long pdfs?

Grqdev123L36d ago

fine for a few pages. for long ones do the chat-with-your-documents lesson, that's what it's for

Loading…