Not affiliated with Spotter AI.

Methodology

How the engine decides, and how you can check it

Three layers decide every file: federal law, a versioned rulebook and a risk index built on FMCSA SMS mechanics. Below: what is reproduced, what is adapted, the basis for every weight, and tests you can run here.

1 · Federal law

Clearinghouse prohibited or CDL suspended bars the driver. An expired license or medical certificate, a missing endorsement or a missing required record holds the file for review.

2 · The rulebook

Experience floor, major-violation window, serious-conviction count, crashes not ruled non-preventable, out-of-service orders, recent return-to-duty - each with its own outcome.

3 · The score band

The risk index against the rulebook's review and adverse bands. It catches a heavy volume of recent violations that no single rule sees.

Each layer can only raise the outcome. The binding rule is the first rule, in that order, at the final outcome. Engine v2.1.0; the input hash on every record changes if the file, the rulebook, the scale or any what-if changes.

Reproduced from FMCSA methodology and regulation
  • Recency weights 3 / 2 / 1 for events up to 6 / 12 / 24 months old; older events score zero.
  • On the 1-10 scale, +2 severity when a violation put the driver or vehicle out of service.
  • The severities one inspection adds to one category are capped at 30 before time weighting, attributed worst-first.
  • The enhanced SMS in Federal Register notice 2024-27087: severity 1 or 2, Controlled Substances/Alcohol folded into Unsafe Driving, and Vehicle Maintenance: Driver Observed as its own category.
  • Crash weights 1 (tow-away) or 2 (injury or fatality); a crash determined not preventable scores zero.
  • Federal bars and holds from 49 CFR 382, 383 and 391, and the 383.51 major / serious offense classes.
Adapted, and why
  • SMS scores carriers against peer groups. Here its mechanics are applied to one driver's file. FMCSA's own Driver SMS is an enforcement tool, not available to carriers; the PSP report is the per-driver record a carrier can use.
  • The risk index is round(100 x (1 - e^(-points / N))) with N = 60 on the 1-10 scale and 20 on the 1-2 scale. N is a calibration constant, not fitted to crash or claims outcomes and not an FMCSA percentile.
  • The enhanced-SMS mode changes severities and categories but keeps the 3 / 2 / 1 recency weights. FMCSA has not announced when the enhanced SMS goes live.
  • A conviction and a roadside violation for the same conduct within a month are treated as one event (scored once, shown with both sources).
  • The rulebooks are synthetic examples written for the segment each names; none is a real carrier's or insurer's criteria.
  • All driver files and incidents are synthetic. No real person, license or FMCSA query is involved.
Severity catalog

The basis for every weight

“SMS table” weights follow FMCSA's published SMS violation severity table for that code; “set here” weights are chosen for this catalog where the code or conviction has no direct SMS weight. The 1-2 column is what the enhanced scale assigns (shown without an out-of-service order).

Roadside violations (PSP inspection history)
CodeViolationBASIC (1-10 scale)Category (1-2 scale)1-101-2Basis
392.2-SLLS2Speeding 6-10 mph over the limitUnsafe DrivingUnsafe Driving41SMS table
392.2-SLLS3Speeding 11-14 mph over the limitUnsafe DrivingUnsafe Driving71SMS table
392.2-SLLS4Speeding 15 or more mph over the limitUnsafe DrivingUnsafe Driving102SMS table
392.2RReckless drivingUnsafe DrivingUnsafe Driving102SMS table
392.2CFailure to obey a traffic control deviceUnsafe DrivingUnsafe Driving51set here
392.2FCFollowing too closelyUnsafe DrivingUnsafe Driving52SMS table
392.2LCImproper lane changeUnsafe DrivingUnsafe Driving52SMS table
392.80Texting while operating a CMVUnsafe DrivingUnsafe Driving102SMS table
392.82Hand-held mobile phone use while drivingUnsafe DrivingUnsafe Driving102SMS table
392.16Failing to use a seat beltUnsafe DrivingUnsafe Driving71SMS table
395.3A3Driving beyond the 11-hour driving limitHOS ComplianceHOS Compliance71SMS table
395.3A2Driving beyond the 14-hour on-duty windowHOS ComplianceHOS Compliance71set here
395.3BDriving beyond the 60/70-hour limitHOS ComplianceHOS Compliance71set here
395.8EFalse record of duty statusHOS ComplianceHOS Compliance71SMS table
395.8ANo record of duty statusHOS ComplianceHOS Compliance51SMS table
393.75Flat tire or fabric exposedVehicle MaintenanceVehicle Maintenance: Driver Observed81SMS table
393.48Inoperative or defective brakesVehicle MaintenanceVehicle Maintenance41SMS table
393.47Brakes out of adjustmentVehicle MaintenanceVehicle Maintenance41SMS table
393.9Inoperative required lampVehicle MaintenanceVehicle Maintenance: Driver Observed61SMS table
396.3A1Parts and accessories not in safe conditionVehicle MaintenanceVehicle Maintenance41SMS table
393.95Missing or unsecured emergency equipmentVehicle MaintenanceVehicle Maintenance: Driver Observed21SMS table
396.17COperating without a periodic inspectionVehicle MaintenanceVehicle Maintenance41set here
392.4APossession or use of a controlled substance on dutyControlled Substances/AlcoholUnsafe Driving102SMS table
392.5APossession or use of alcohol on dutyControlled Substances/AlcoholUnsafe Driving102SMS table
383.23A2Operating a CMV without a valid CDLDriver FitnessDriver Fitness81set here
391.41ANo valid medical certificateDriver FitnessDriver Fitness41set here
391.15ADriving while disqualifiedDriver FitnessDriver Fitness101set here
State convictions (MVR)
ConvictionClassClassified by1-10Same conduct at roadsideBasis
Speeding 6-10 mph overminorState conviction4392.2-SLLS2SMS table
Speeding 11-14 mph overminorState conviction7392.2-SLLS3SMS table
Speeding 15+ mph overserious49 CFR 383.51(c)10392.2-SLLS4SMS table
Reckless drivingserious49 CFR 383.51(c)10392.2RSMS table
Following too closelyserious49 CFR 383.51(c)5392.2FCSMS table
Improper or erratic lane changeserious49 CFR 383.51(c)5392.2LCSMS table
Texting while driving a CMVserious49 CFR 383.51(c)10392.80SMS table
Hand-held phone while driving a CMVserious49 CFR 383.51(c)10392.82SMS table
Driving a CMV without a CDLserious49 CFR 383.51(c)8383.23A2set here
Failure to obey a traffic control deviceminorState conviction5392.2Cset here
Seat belt violationminorState conviction7392.16SMS table
Driving under the influencemajor49 CFR 383.51(b)10-set here
Leaving the scene of a crashmajor49 CFR 383.51(b)10-set here

A state MVR carries convictions and license actions; roadside codes (tires, hours of service, testing) appear only in the PSP inspection history. Rulebooks and their parameters are on the Guidelines page.

Validation

Tests that can fail - and are shown failing

Two kinds. The persona contract states, in advance, the outcome a safety director would expect for each sample file and fails if the engine disagrees on either scale. The mutation tests plant one realistic defect at a time and check that the test written for it catches it.

Persona contract · in-force carrier rulebook
13 of 13 pass
  • Clean veteran
    Driver A-1042
    pass
    Expected: Approve · both scales agree
  • Solid regional driver
    Driver L-5120
    pass
    Expected: Approve · both scales agree
  • Borderline file
    Driver B-2207
    pass
    Expected: Manual review · both scales agree
  • Recent out-of-service orders
    Driver C-3318
    pass
    Expected: Adverse action recommended · both scales agree
  • Clearinghouse prohibited
    Driver D-4471
    pass
    Expected: Not qualified: federal bar · both scales agree
  • CDL suspended
    Driver E-5530
    pass
    Expected: Not qualified: federal bar · both scales agree
  • Fatal crash and reckless driving
    Driver F-6614
    pass
    Expected: Adverse action recommended · both scales agree
  • New CDL, thin file
    Driver G-7702
    pass
    Expected: Manual review · both scales agree
  • Early-career driver
    Driver M-6031
    pass
    Expected: Manual review · both scales agree
  • Missing HazMat endorsement
    Driver H-8819
    pass
    Expected: Manual review · both scales agree
  • Expired CDL and medical certificate
    Driver I-9925
    pass
    Expected: Manual review · both scales agree
  • Return-to-duty complete
    Driver J-1108
    pass
    Expected: Manual review · both scales agree
  • One severe inspection
    Driver K-3042
    pass
    Expected: Manual review · both scales agree
The checks run on every workbench input
  • Line items, categories and total agree
  • Same input, same output
  • Independent recompute matches the total
  • Every what-if matches the independent prediction
  • Removing a violation never raises the total
  • One inspection adds at most 30 severity per category
  • Nothing older than 24 months scores
  • Every weight matches the reference catalog
  • An event on two records is scored once
  • Non-preventable crashes score zero

The expected values come from outside the engine: an independent recompute of the written spec that shares no aggregation code with it, the reference catalogs, and the raw record.

Mutation tests · runs in your browser
300 seeded random configurations per run, each checked against an independent recompute and the reference catalogs. Pick a defective engine to watch the check written for it fail, with a counterexample.
Engine under test
seed 20260926 · same seed, same trials, same result
Run the trials. The production engine should pass all of them; each planted defect should not.
Sources

Regulations and figures cited

From here to a deployment

What a customer deployment adds

Live, consented record pulls

MVR vendors, PSP through FMCSA's contractor, Clearinghouse queries with driver consent, CDLIS, and prior-employer 391.23 inquiries, replacing the sample book.

Continuous monitoring

Re-underwrite on every new conviction or license action, and schedule the 391.25 annual review from the record itself.

Calibration

Fit the index and the bands to the customer's own crash and claims outcomes, and report lift by band before any band is trusted.

Controls

SSO and role-based access, a reviewer queue with override reasons, retention to 391.51, and a bias test run on every rulebook change.