SOAP Scoring & Scorecards

Set up SOAP-specific scorecards, score your SOAP applicants, and configure aggregate scoring to automatically populate the SOAP Rank List.

Roles: Program Director, Program Coordinator, Program Administrator, Program Interviewer (scoring only)
Prerequisites: Creating a score card is available at the time SOAP mode is enabled. 

Note: Scoring an applicant using a SOAP scorecard will be available during SOAP week for authorized SOAP applicants

Why You Need a SOAP Scorecard

SOAP applicants must be scored using a scorecard with the type set to "SOAP". Only scores submitted on SOAP scorecards will appear on the SOAP Rank List. Scores entered on Core or Cortex scorecards will not carry over to the SOAP rank list.

Option 1: Create a New SOAP Scorecard

1. Navigate to Score Administration from the upper menu bar.
2. Select the Scorecards tab.
3. Click "+ Add Scorecard".
4. Click the pencil-paper icon to edit the new scorecard.
5. In the "Scorecard to be used in" dropdown, select "SOAP".
6. Name the scorecard (e.g., "SOAP Interview Scorecard").
7. Add competencies and questions as needed. For detailed guidance, see Creating a Scorecard.
8. Click Save Changes.

Option 2: Duplicate an Existing Core or Cortex Scorecard

If you want to reuse the same questions from your regular season scorecard, duplicating is the fastest approach.

1. Navigate to Score Administration → Scorecards tab.
2. Locate the scorecard you want to duplicate.
3. Click the pencil-paper icon to expand the scorecard.
4. Click the triple-dot menu (⋮) and select "Duplicate scorecard".

5. The new scorecard appears at the bottom of your list as "Copy 1 of [Scorecard Name]".
6. Click into the duplicated scorecard to update:
   • Scorecard name — rename to something clear (e.g., "SOAP Interview Scorecard")
   • Questions — edit as needed for your SOAP evaluation criteria
7. In the "Scorecard to be used in" dropdown, select "SOAP".
8. Click Save Changes.

Configuring Aggregate SOAP Scores

SOAP submitted scorecards can be aggregated by specific scorecards or competencies. When enabled, only those submitted scorecards or competencies will be aggregated and counted towards the applicant's SOAP score — which automatically assigns a SOAP rank.

1. Navigate to Score Administration → Step 4: Aggregate Scores.
2. Select the SOAP Score tab.
3. Choose how the SOAP score should be calculated: by submitted competencies or submitted scorecards.
4. Enable the specific scorecards or competencies you want included in the SOAP score aggregation. Anything not enabled will not count towards the score.
5. Click Save Changes.

Enabled SOAP scorecards within the Aggregate Scores tab will roll up to the SOAP Rank List. This can be changed at any time.

Score administrators can view the aggregated SOAP Score by navigating to the Overall Scores tab and selecting SOAP Score.

For more detail on aggregation formulas, see Understanding Aggregate Scores.

Snippet Video: Creating a SOAP Scorecard

Scoring SOAP Applicants

SOAP scorecards can be submitted from multiple locations within Cortex and Thalamus Core using the Score Drawer:

• Cortex: Click on the Applicant Score to open the score drawer
• Thalamus Core: Applicants page, MySchedule page, Thalamus Video Interview panel, or Rank panel

To score an applicant:

1. Open the applicant's Score Drawer from any of the locations listed above.
2. Select the SOAP Scorecards tab.
3. Select the SOAP scorecard you want to complete.
4. Fill in your responses for each competency/question.
5. Click Submit.

Submitted scores can be edited at a later time if needed.

Snippet Video: Scoring SOAP Applicants

What's Next

Success: You have a SOAP scorecard created (or duplicated), applicants are being scored, and aggregate scoring is configured to auto-populate the SOAP Rank List.

Next step:

• SOAP Rank List & NRMP Export — review, reorder, and export your SOAP rank list to the NRMP R3 system

If you need additional assistance, click the help icon at the bottom right of any Thalamus page or submit a support request.