0ARCH Core
Our AI starts with a model we trained from nothing.
Core is the AI line at 0ARCH. This is the real training record of Kisoku, the language model we built from scratch, step by step.
Scroll to watch it learn
Stage 1: learning language
199,000 steps of general text. The loss falls fast, then slowly, as the model works out how language fits together. The preview you can download today was cut at the end of this stage.
Stage 2: math and code
25,000 steps with much more math and code in the mix, aimed at the preview's weakest spots. Part of the sudden drop is the new data being easier to predict.
Stage 3: cool-down
The last 19,000 steps. The learning rate winds down and reasoning examples come in, so what it learned settles. The October release is built on the end of this line.
Training loss, lower is better. Each point averages 1,000 training steps, about 1.5 billion words, from our run log. The log starts at step 28,650; earlier steps weren't kept.
Ask it something
Real answers from the preview, copied word for word from our test log. Tap a question to replay one.
You
Who are you?
Kisoku
A small, free language model that runs offline on your own laptop, so nothing you type leaves your computer. Good at everyday questions, short writing and simple code. Still a preview, so it gets math wrong and can sound sure when it isn't.
- Size
- 1.6 billion parameters
- Runs
- Offline on a laptop, through Ollama
- License
- MIT
- Status
- Preview now, full release in October
$ ollama create kisoku -f Modelfile$ ollama run kisoku
After downloading the model file. Full steps
AI built for your business
The same work, pointed at your problem. Fixed price, and you own the code.
A private AI on your own hardware
An open model running on a machine in your office, with a chat window your team can use. Nothing anyone types goes to an outside AI company.
Answers from your own documents
Ask questions about your manuals, contracts or past jobs and get answers that point to the page they came from.
Paperwork that fills itself in
AI that reads the emails, invoices and order forms coming in and puts the details into the system you already use.