benchmarks

The model that doesn't generate anything

I benchmarked TypeSafe's Jev against my own assistant's classifier on 1,123 real prompts. It was 27x faster and 26x cheaper — but the more useful finding was that the accuracy number I started with was measuring the wrong thing.

11 min read