"jev as a judge" cheap and fast semantic verifiers!

@hwchase17 Harrison Chase · Sep 20, 2026 · case #796549 · listed via Jev Hub

Still from the clip posted with this case; watch it in the original post on X.

Used Jev as a cheap semantic judge for grading large volumes of agent traces in online evals.

The original post

"jev as a judge" cheap and fast semantic verifiers! great for evals - especially online evals where you want to grade LOTS of traces

Engagement when collected

Views47K

Likes42

Bookmarks0

Reposts0

Replies0

Quotes0

Numbers are a snapshot taken from X when the case was added to the library (schema v1, collected 2026-09-19); they will not match today.

Where this case fits

Filed under classification & data extraction. In the pattern Jev is built for, the model answers a bounded question per step — and ordinary code acts on the answer, because the answer is already a value rather than a paragraph. Other posts in the same family are on the classification & data extraction page.

🗂️ Classification & data extraction