~/your-project $ brimkern chat
Your coding assistant runs on your GPU, in your terminal.
Qwen 3 4B on hand-written WGSL kernels. No server, no API key, no account: your code never leaves the machine.
curl -fsSL https://brimkern.com/install.sh | bash01 · a real session
It answers as it goes, at the speed you will get.
A capture of the terminal, not a mock-up. Markdown is rendered while it streams: bold, code, lists.
02 · your project
Ask about your repo. It has read the README.
Started in a folder, Brimkern gives the model the README, the package description and the git branch. Mention a file with @path/file.ts to add it, or run /diff to review your changes.
kern › what is this project for? answer in two sentences This project aims to provide a local, GPU-accelerated AI model running environment without requiring an API key or server setup. It allows users to stream and run Hugging Face models directly in their browser using WebGPU and other technologies, with all processing done locally on the user's device. ⏱ 8.45s · ~7.1 tok/s · 60 tokens · ≈ $0.0017 saved (session: $0.0017) (Dawn (Metal))
┌─ Brimkern session status ──────────────────────────────────────────────────┐ │ Active model : Qwen 3 4B (BRIK int4) │ │ Engine & GPU : Native Dawn (in-process) · Dawn (Metal) │ │ AI mode : [CODE] Direct code generation, exact syntax, concise │ │ Reasoning : auto (Detects and formats <think>...</think> blocks) │ │ Git repo : main (modified *) │ │ Inference : 100% local · 60 tokens · ~7.1 tok/s (8.4s) · ≈ $0.0017 │ │ saved │ └────────────────────────────────────────────────────────────────────────────┘
03 · models
Switch models mid-session, or bring one from Hugging Face.
| preset | model | speed | for |
|---|---|---|---|
| coder | Qwen 3 4B BRIK int4 · 2.53 GB | 13–16 tok/s | the default, runs on any machine |
| super-coder | Qwen 3.5 4B GGUF Q4_0 · 2.61 GB | ~24 tok/s | reasons before answering, better at bug fixing |
| coder-max | Qwen 3.6 35B-A3B GGUF Q4_K_M · 11.4 GB | ~15 tok/s | the strongest, 2 problems short of Claude Sonnet 5 · 20 GB+ machine |
Or any single-file GGUF from Hugging Face, the best quantization picked for you: --model=Qwen/Qwen3-0.6B-GGUF
┌─ Brimkern · On-device model selector ────────────────────────────────────────┐ Use ↑/↓ to scroll · Enter to activate · Esc to cancel ┄ coder Qwen 3 4B [BRIK int4 ] 2.53 GB ● active super-coder Qwen 3.5 4B Super Coder [GGUF Q4_0 ] 2.61 GB ❯ coder-max Qwen 3.6 35B-A3B Coder [GGUF Q4_K_M] 11.4 GB ┄ ┌─ Spec sheet: Qwen 3.6 35B-A3B Coder ─────────────────────────────────────────┐ │ Architecture: Qwen 3.6 35B-A3B Coder · Size: 11.4 GB · [MoE · 20 GB+ │ │ RAM] │ │ The strongest preset: 184/202 on our five code suites, 2 short of Claude │ │ Sonnet 5 (186). MoE with ~3 B of its 19 B parameters active per token. 12 GB │ │ of memory in use: needs a 20 GB+ machine. │ │ Format: GGUF Q4_K_M · Engine: WebGPU (native Dawn) │ │ Command: /model coder-max │ └──────────────────────────────────────────────────────────────────────────────┘
04 · local
Nothing leaves the machine.
The last figure is an estimate, shown as one: what a paid API would have billed for the same conversation (tokens ≈ characters / 4, history counted on every turn, $3 / $15 per million input / output tokens; set BRIMKERN_PRICE_IN and BRIMKERN_PRICE_OUT for your own).