Vincent van Gogh, Wheatfield with Crows, 1890

AI still misses most bugs in chip designs.

About

Umwelt trains AI models to verify hardware.

We train our own models to read a chip design and its specification, and to write the properties the design must satisfy. Every property they write goes to a formal engine, which returns a proof or a counterexample.

That verdict is exact, so we use it as the training signal. Our models are rewarded only when a formal engine confirms they are right, and penalised for false alarms.

The name comes from Jakob von Uexküll, a biologist who used the word Umwelt for the part of the world an organism can perceive.

Vincent van Gogh, A Wheatfield, with Cypresses, 1889
Vincent van Gogh, A Wheatfield, with Cypresses, 1889. National Gallery, London.

Why hardware

Design tools can check a property once it is written. Deciding what to check is still done by hand, by specialists, and it is where bugs slip through. That is what we train our models to do.

Research

We built First Silicon, a benchmark of 86 fixes that engineers made in open-source chip designs, 84 of them real bugs, judged by an exact formal checker. The best frontier model we tested catches 16 of them without a false alarm. Most bugs escape every model.

Opus 5.5max effortOpus 5.5defaultFable 5.1Sonnet 5.5Haiku 5.5
Caught, zero false alarmsSTRICT · all 86 cases18.6%16 / 8614.0%12 / 869.3%8 / 868.1%7 / 863.5%3 / 86
Without defective promptsSTRICT · 80 bugs17.5%14 / 8015.0%12 / 8010.0%8 / 808.8%7 / 803.8%3 / 80
OpenTitanSTRICT · 70 bugs15.7%11 / 7012.9%9 / 705.7%4 / 705.7%4 / 701.4%1 / 70
Other open-source projectsSTRICT · 16 bugs in 10 projects31.3%5 / 1618.8%3 / 1625.0%4 / 1618.8%3 / 1612.5%2 / 16
Caught, false alarms allowed86 cases32.6%28 / 8625.6%22 / 8615.1%13 / 8610.5%9 / 863.5%3 / 86
Precision of alarmstrue alarms / all alarms34%49 / 14532%34 / 10522%21 / 9432%15 / 4721%6 / 28
False alarm on the fixed designbugs · lower is better31.4%27 / 8625.6%22 / 8624.4%21 / 8612.8%11 / 869.3%8 / 86
Fixed after June 2026STRICT · 3 bugs, after training cutoff0 / 30 / 30 / 30 / 30 / 3
Bugs caught with zero false alarms (STRICT) and related measures on First Silicon. Best result per row in bold, in grey when it is not the highlighted model.

Careers

We are looking for a cofounder and our first engineers in formal methods, hardware verification and machine learning. We are early: if you want to build this with us, write to contact@umwelt.vision. We would also like to hear from design teams who want to test our models on their own RTL.

Contact

Working on a chip that has to be right the first time, or want to work with us? Write to us below, or at contact@umwelt.vision.