Skip to main content
Exact Dx synthetic data · demonstration

Results

What the check found across the 28 demonstration notes. SIMULATED synthetic patients; not a measured rate.

7 notes leave out something the results show.

3 notes say more than the results support.

8 notes could not be checked, and the screen says why.

Agreement with a coder

SIMULATED Label set synthetic-demo: synthetic labels written for this demonstration; replace with a coder's labels. 33 checks on 28 notes.

  • Alerts the coder would also query (precision): 12/13 = 92% [67%–99%]
  • Coder queries the tool also raised (recall): 12/13 = 92% [67%–99%]
  • False alerts per 100 notes: 1 in 28 notes = 3.6
  • Does the note state it? Agreement on presence: kappa 0.94, AC1 0.94, positive 97%, negative 97% (n = 33)

Every miss (1)

  • KE-P10.kidney: coder would query; tool said “Not assessable: the data cannot decide” · coder: “stated 3b but the latest results are mixed; I would ask”

Every false alert (1)

  • KE-P13.kidney: tool said “Definitions disagree; the tool does not choose”; coder would not query · “outside lab report is enough for me; would not query”
Import a coder's labels (CSV)

Columns: item_id,labeller,stated,would_query,minutes,comment. item_id is the encounter id and .kidney or .aki (for example KE-P05.kidney); stated is one of none, unstaged, stage_1, stage_2, stage_3, stage_3a, stage_3b, stage_4, stage_5, end_stage, acute, negated, history, family; would_query is yes or no. Use a role or pseudonym as the labeller, never a name. Labels should be written before the labeller sees the tool's output.

Both directions, by who drafted the note
Latest check per note · SIMULATED synthetic cohort · two-sided cannot be turned off
NotesnMet, not statedStated, not supported Stage differs (higher / lower)Definitions disagreeNot assessable Read it yourselfNet
All notes2871 2 / 2110 0+6
AI-drafted620 2 / 001 0+2
Clinician-typed2251 0 / 219 0+4

Net = met-not-stated minus stated-not-supported. Stage differences, disagreeing definitions and not-assessable checks are counted in neither direction.

Alert budget

SIMULATED <built-in method items of dict object at 0x7925fc2104c0> things to look at across 28 notes = 46 per 100 notes against a budget of 25 per 100 (an assumed planning figure; set per site). Over budget.

Decisions recorded: 0.