Feedback methodology and limitations

How Every Practice Session Becomes a Focused Improvement Plan

SurgiTest feedback connects the entire preparation system. After a spoken case, the platform identifies what the candidate did well, what was missing, where the response became unsafe or inconsistent, and which focused activity should come next. The purpose is not to reproduce an official board score. It is to turn each practice performance into a clear, specialty-specific improvement plan.

01

Purpose and limitations

Feedback supports educational deliberate practice. It is not an official board score, certification prediction, guarantee, substitute for current board requirements, or tool for direct patient-care decision-making. Candidates should use current sources, local policy, and qualified supervision for clinical care.

02

Specialty-specific evaluation dimensions

Evaluation varies by specialty, feature, case, and version. Applicable frameworks may examine initial stabilization, diagnostic prioritization, judgment, operative indications, technical sequence, complication recognition, rescue management, communication, adaptability, or case ownership. SurgiTest does not claim that every specialty uses one universal rubric.

03

Evidence taken from the candidate response

Where supported by the applicable experience, feedback considers decisions explicitly stated, order and prioritization, rationale, recognition of instability, procedural detail, responses to evolving information, contradictions, important omissions, unsafe actions, and communication clarity. An important action should not be silently credited when the candidate never stated it.

04

Omissions, unsafe actions, and contradictions

A missing element is an expected relevant action or explanation that was not stated. An incomplete response begins the element but lacks necessary depth or commitment. A contradiction conflicts with another stated decision. A delayed safety action appears after the point it was needed. An explicitly unsafe action creates a direct safety concern. A critical failure pattern is a high-consequence educational pattern defined by the applicable approved framework—not an invented official board pass/fail rule.

05

How follow-up questions affect evaluation

Follow-up may clarify ambiguity, test a changing physiology, challenge an unsupported decision, test procedural depth, introduce a complication, or evaluate adaptation. Recovery can add evidence, but the resulting feedback may still distinguish a prompt-dependent recovery from an action stated promptly and independently. Evaluation varies by feature and the applicable framework.

06

Connected remediation routing

Recommendations connect observable weaknesses to the most relevant available activity. Poor answer organization can route to Board Answer Lab; an unfocused differential to Diagnostic Reasoning; a weak operation description to Operation Studio; failure to recognize deterioration to Complication Rescue; a repeated unsafe pattern to Critical Error Vault; a knowledge gap to Board Library, Guidelines, or Reading Guides; personal-case vulnerability to Case Defense where applicable; and uncertain improvement to targeted reassessment. Routing is limited to integrations available to the candidate.

07

Confidence and uncertainty

When response evidence is incomplete or ambiguous, feedback should avoid false precision and identify the uncertainty. Specialty context changes how a statement is interpreted. Candidates can challenge an incorrect interpretation through Help & Feedback, identify the relevant session and excerpt, and provide the minimum context needed for review without submitting PHI.

08

Human clinical review

Clinical review can apply to case content, rubrics, critical-error definitions, teaching points, specialty mappings, source currency, and feedback frameworks. This review of underlying educational material is separate from feedback on an individual attempt. A physician does not review every attempt unless a separately disclosed service explicitly provides that review.

09

Technology transparency

SurgiTest uses automated systems to conduct responsive practice sessions and generate educational feedback. Safeguards control account access, eligible content, session state, and candidate-visible results; generative systems support examiner interaction and bounded educational assessment where configured. Outputs can be incomplete or incorrect and remain subject to the stated constraints and review pathway.

10

How this methodology changes

This public explanation was last updated August 16, 2026. SurgiTest may update feedback frameworks as the product, specialty requirements, or review evidence changes. Material changes should be dated and explained. Prior sessions are not automatically recalculated.

11

Data-retention boundaries

Raw candidate audio is not part of the ordinary retained learning record and may be transient or temporarily retained through acknowledgment, recovery, grading, or authorized review before deletion, subject to support, security, or legal holds. Transcripts, turns, scores, and feedback may be retained for the life of the account or until a supported session or account deletion. Personal-case material must be fully de-identified and must not contain PHI. The current Privacy Policy controls and describes provider-side limits, deletion, and quality-improvement use.

12

Official-score disclaimer

SurgiTest provides independent educational feedback and readiness tracking. It is not affiliated with the certifying boards, does not reproduce secure examination content, and does not calculate an official board score or guarantee certification.

13

Correction and review pathway

Use Help & Feedback to report incorrect feedback. Select the relevant category, identify the session or surface, and quote only the minimum transcript excerpt needed. The existing workflow can acknowledge submission and communicate statuses such as received, under review, resolved, or closed. Material corrections follow the applicable content or product workflow; an updated result is generated only when the reviewed system supports reprocessing.

Continue with specialty-specific preparation

Source and review information

Official board pages are the source of truth for their examination requirements. SurgiTest is independent of the listed organizations and is not endorsed by them.