Manchego v2.1 · calibrated on unseen tasks

An independent AI research lab

Intelligence,closer tothe signal.

We build small decision models you can inspect, and bring EEG foundation models to Apple devices. Every release ships with its evidence and its limits.

Fig. 000Signal → Structure → Decision

A generative study. Not recorded EEG or model output.

8

releases in the catalog

Decision models, conversions, and EEG packages

0.805

JevBench accuracy

Manchego v2.1 on 231 public decisions: 3= of 28 open ~4B models

0.040

calibration error, unseen tasks

Down from 0.153 in v2, on a sealed set opened once

210/210

decisions preserved

Motor imagery, PyTorch to Core ML, on real EEG

01Selected work

Two lines of research.One standard of evidence.

How machines choose, and how neural signals become usable. Each release is small, specific, and measured.

Decision models · Manchego

A decision is
a distribution.

Manchego reads a state, a question and a closed set of options, and returns a probability for every option in one forward pass. It never writes text. The recorded response below it shows what that looks like, including the question it was unsure about.

JevBench
0.805 · 3= of 28
Unseen-task calibration
0.153 → 0.040
Smallest build
2.4 GB, MLX 4-bit

Fig. 01 · Recorded response

What the model reads

Which team should handle this message?

State:
Customer: the blender I bought last week smells of burning and stopped working. Order 5521.

Options:
A = returns — refunds, exchanges and defective items
B = shipping — delivery status and lost parcels
C = billing

Reply with only the letter of the best option.

What it returns

  1. Areturns0.998
  2. Bshipping0.001
  3. Cbilling0.001

choiceconfidence 0.998

Replayed from a response recorded on the MLX 8-bit build and published in the manchego-serve README. Nothing runs in your browser.

EEG & brain–computer interfaces

Closer to the
neural signal.

Foundation models for EEG, packaged for the device that records it. Reconstruct missing channels with ZUNA, extract representations with CBraMod, and classify cue-paced motor imagery, all in Core ML, all checked against PyTorch.

Fig. 02 · Illustration

Fourteen electrodes, three missing

ZUNA takes the channels that were recorded, with their 3D positions, and estimates the ones that were not by iterative denoising.

AF3F7F3FC5T7P7O1O2P8T8FC6F4F8AF4
5 s window · 256 Hzstep 20 / 20
F3measured
T7estimated
O2estimated
F4estimated
P8measured
Electrode positions are the real EPOC X layout (MNE standard_1005). The traces are synthetic, drawn to show the task: not recorded EEG and not model output.

02How we release

Every claim has a number.Every number has a boundary.

03Open models

Built here.Shared openly.

Each model card documents provenance, evaluation, and limitations.8 models shown

04From the lab

Notes and signals.

Open source

manchego-serve: Manchego, offline.

A small HTTP server that serves exactly the policy behind the model card’s numbers, with pinned, hash-verified weights and no outbound connections. On an NVIDIA A10: 81 ms median per question.

Model update

Manchego, against the whole field.

The Manchego cards now compare v2.1 with every trained open ~4B decision model that could be run as shipped (28 in all), and disclose how its training data was designed, audited and selected.

Model update

Manchego, on Apple silicon.

The MLX 8-bit and 4-bit builds of v2.1, with format results on their cards. Eight bits stays within one decision of bf16; four bits costs six of 80 held-out rows, and says so.

Release

Meet Manchego v2.1.

A second training stage on human-written task definitions repairs v2’s overconfidence on unfamiliar tasks. Calibration error on a sealed set of 25 unseen tasks: 0.153 to 0.040.

Follow the work

Good questions.Measured answers.