Skip to content
All Jev use cases

Prompt pack

Jev essay grading prompts

Prompts for grading written work against an answer key: flag wrong short answers, give a first pass or fail, pick the better of two student answers or two arguments, check which side an argument takes, and check a worked math solution. Each Jev essay grading prompt was run on real Jev against teacher or rater labels from public datasets, and the agreement rate is listed next to it.

Jev essay grading checks a short answer, a worked solution, or an argument. It can flag a wrong short answer, give a first pass or fail, check a worked math solution, pick the stronger argument or the better student answer, or say which side an argument takes. Use Jev essay grading as a first pass. It does not write feedback.

The weak line in Jev essay grading is Pass or fail a short answer: 68% on 40. Do not record that yes or no as the grade. The math step check in Jev essay grading was 88% on 40. Agreement is the share of examples where Jev essay grading matched the human label. Send a close score or pick to a teacher. Mark your own answers before Jev essay grading passes or fails a student. This site is unofficial. TypeSafe does not run it. You call Jev essay grading with your own key.

How we tested these Jev essay grading prompts

Model
typesafe/jev-1.14-20261014
Tested on
Sent as
Decisions API request (state + questions) → typesafe/jev-1.14, served by TypeSafe

We ran these tests ourselves. TheJevAI is an unofficial, independent site and is not affiliated with TypeSafe.

Free Jev essay grading prompts

Copy a request, put your own data where the placeholders in double braces are, and send it. To send it to TypeSafe's API, add "model": "jev-1.14.0" to the request body.

Download the free prompts (JSON)

Jev essay grading: Flag a wrong short answer

This Jev essay grading prompt says whether a student answer is wrong or misses the point, compared with the answer key.

Request body
{
  "state": {
    "question": "{{question}}",
    "reference_answer": "{{reference_answer}}",
    "student_answer": "{{student_answer}}"
  },
  "questions": {
    "wrong": {
      "type": "noul",
      "instructions": "Is `student_answer` wrong, judged against `reference_answer` as an answer to `question`? Wrong means it gets the main point wrong, misses all the key points, or answers something else. An answer that is incomplete but partly right is not wrong."
    }
  }
}

Fill in `question`, `reference_answer` (your answer key or marking notes) and `student_answer`. A yes means the answer is wrong or misses the point; an answer that is incomplete but partly right should come back no. On tutor-graded university networking answers Jev agreed 34 times out of 40. Use it to put the likely wrong answers at the top of a teacher's pile; the marks stay with the teacher. Telling full marks from partial credit did not work well enough for us to include: a three-way grade we tested matched the tutors only 51 times out of 90 across two versions.

85% agreement (34 of 40): yes means incorrect, partial counts correct, Jev essay grading at 0.5

Dataset: Short Answer Feedback (SAF), communication networks, EnglishLicense: CC BY 4.0

Jev essay grading: Check a worked math solution

Use this Jev essay grading prompt to say whether every step of a written solution to a word problem is correct.

88% agreement (35 of 40): jev essay grading matches error step or none, yes from 0.5Dataset: ProcessBench (Qwen)

Jev essay grading FAQ