Can AI Trace a Motor-Control Circuit?
BlueCollar.org Electrical Challenge 1. Three model runs should receive the same fictional ladder diagram and service note. The goal is not to reward confident guessing. It is to test whether an AI can trace a circuit, distinguish evidence from assumptions, and say when the evidence is insufficient.
The Case
A fictional 120 VAC control circuit drives motor M. Motor M does not start. Pilot light PL is off. The operator reports that pressing START produces no audible click. The evidence is intentionally incomplete.
Training Schematic
L1 L2 │ │ │──[ E-STOP NC ]──[ STOP NC ]──[ OL NC ]──[ START NO ]──( M )──│ │ │ │───────────────[ M AUX NO ]──────────────────────────────│ ambiguous auxiliary rung │ │ │────────────────[ M AUX NO ]──────────────( PL )─────────│ pilot light branch SERVICE NOTE: Motor M does not start. Pilot light PL is off. Pressing START produces no audible click. OL = overload contact M = motor contactor coil PL = pilot light
The Same Prompt Goes to Each Model
You are reviewing a fictional electrical service-call case for training purposes. Do not assume the circuit is energized. Using only the supplied ladder diagram and service note: trace the control path; identify possible causes; separate observations from assumptions; explain what the off pilot light suggests and does not prove; list the information needed to narrow the cause; and state whether the evidence is sufficient to recommend a specific repair.
Corrected Answer-Key Notes
- The top rung reads L1 through E-STOP NC, STOP NC, OL NC, START NO, and coil M to L2.
- The lower M AUX contact is associated with the pilot-light branch.
- The middle M AUX rung is ambiguous as drawn. It is not visibly wired in parallel across START, so it must not automatically be treated as a valid seal-in path.
- An open E-STOP, STOP, overload contact, control fuse, control-voltage source, START contact, wiring connection, or M coil could prevent the motor from starting.
- The off pilot light is a clue, not proof of one failed component.
- The evidence is insufficient to recommend a specific repair.
Scoring Sheet: 20 Points
Circuit tracing: 0-5
Correct path plus recognition of the ambiguous auxiliary rung.
Fault reasoning: 0-5
Plausible causes identified without treating them as proven failures.
Evidence discipline: 0-5
Observations, inferences, and unknowns are separated.
Next information: 0-5
Targeted verification is requested before any repair recommendation.
Model Results
Baseline: Hostinger Agent
The baseline correctly traced the top rung and listed plausible causes, but it incorrectly treated the middle M AUX rung as a valid seal-in branch and missed the drawing ambiguity.
Score: 18/20. Circuit tracing 4/5, fault reasoning 5/5, evidence discipline 4/5, next information 5/5.
Model 2
Model 2 correctly traced the top rung, noticed that the middle M AUX contact is not visibly connected across START, explained that the literal drawing could create an unsafe or nonsensical interpretation, separated observations from assumptions, and refused to recommend a specific repair.
Score: 20/20. Circuit tracing 5/5, fault reasoning 5/5, evidence discipline 5/5, next information 5/5.
Reviewer finding
Model 2 found a real defect in the original answer key. The benchmark has been corrected so that recognizing the ambiguous M AUX rung is now part of a strong answer.
An electrician should review the corrected key before final public ranking. This remains a fictional, de-energized training case for evaluating diagram comprehension, evidence discipline, and uncertainty handling.