Ramsay Corporation’s Reporting System contains “job profile” creation. This advanced feature allows examinees’ test scores to be compared to a desired “job profile”. Simply put, “job profiles” allow for a candidate’s performance to be compared to cutting or passing scores developed during validation or determined by individual organizations.

Ramsay Corporation usually establishes cutting scores by using a modified Angoff procedure as part of a test validation study. This requires a panel of job experts who go through a process of job analysis; generation of knowledge, skills and abilities; and Angoff procedure during which each test question is reviewed and rated by each job expert.

These cutting scores may be set for custom-made tests, off-the-shelf tests, or in some circumstances, pre-existing client-made tests. When a cutting score has been established for a test, it may be used to establish job profile qualification.

These job profiles can be created with the help of Ramsay Corporation. Included with a validation study is the creation of job profiles with suggested cut scores. Companies may also purchase the Enterprise subscription to set additional cut scores.

A job profile can be defined with a single cutting score on one assessment or a battery of tests with each component having its own cutting score. For example:

 

JOB PROFILE 1
ASSESSMENT PRIMARY SCORE
Maintest – A 90
JOB PROFILE 2
ASSESSMENT PRIMARY SCORE
Combined Basic Skills – Reading 8
Combined Basic Skills – Arithmetic 10
Combined Basic Skills – Inspection & Measurement 8
Combined Basic Skills – Process Monitoring 6
Mechanical Aptitude Test 24
JOB PROFILE 3
ASSESSMENT PRIMARY SCORE
Maintenance Mechanic A 75
-or-
Maintenance Mechanic B 75

 

Job profiles can also account for multiple skill levels allowing for examinees to be easily weighed against three different cutting scores for a single assessment. This can allow for classification of an applicant to a certain level of a job. Tests can have total score requirements or test sub-section requirements depending on these qualification scores.

Form letters for qualified and unqualified candidates can also be generated, streamlining the process of informing candidates.

Qualification-Based Reports are different than Score-Based Reports in that they compare the candidate’s scores to required cutting scores. Advanced score requirements can be set to allow for multiple scores and multiple tests.

Cutting scores are set in a Job Profile. More information on setting up Job Profiles can be found in our help page: What are Job Profiles?.

As a note, Qualification Results do not contain raw scores and are available to all administrators other than Proctors.
Click here for a Visual Walk-Through

Categories: Score-Based Reports

The Individual Scoring Report provides a breakdown of the examinee’s overall raw score and sub-section raw scores. The Individual Scoring Report can also display the items that were incorrectly answered.

Local Percentile allows for comparison between the examinee and other examinees in the same account. Local Percentile is automatically recalculated for each additional candidate who takes the assessment within the account.

The National Percentile allows for comparison between the examinee and all other examinees in the Ramsay Corporation database. National percentiles may not be available for all assessments.

Click here for a Visual Walkthrough

Categories: Score-Based Reports

The Summary of Scores Report contains a listing of examinees, their raw score, local percentile, and national percentile (when available). This report allows for direct comparison of examinees and can be sorted by Name, Date, or Score. This report is exportable into Microsoft® Excel.

If you are combining multiple accounts, this report can also optionally show the results broken down by separate accounts.

Click here for a Visual Walkthrough

The Detailed Qualification Summary Report will display whether or not a candidate is qualified or unqualified in each section of a test, as well as whether he or she was qualified overall.

Click here for a Visual Walkthrough

Categories: Score-Based Reports

The Category Summary Report allows for comparison of all examinees sub-section and total scores. This report is exportable into Microsoft® Excel. The data can also be arranged by name, score, and date in ascending or descending order.

Click here for a Visual Walkthrough

The Qualification Statistics Report gives you the sample size, number of examinees who met the qualification score, number of examinees who did not, and percent of examinees who met the qualification score.

Click here for a Visual Walkthrough

Categories: Score-Based Reports

The Frequency Report allows you to see the detailed percentile ranks for each total score received, as well as each sectional score. This report also provides descriptive statistics such as the mean, standard deviation, and reliability (KR20).

Click here for a Visual Walkthrough

The Gap Analysis Report compares the average raw score per section on a test against the cut scores in the job profile. This report will show areas of relative weakness and strength in a group of candidates against a standard percentage. The Gap Analysis Report is especially useful for training/diagnostic purposes, providing vital feedback on the group performance in each area of knowledge.
Optionally, this report can be filtered by custom survey fields, providing reports that can compare performance of a group of candidates separated by factors of your choosing, such as comparing internal versus external candidates, candidates of varying experience levels, or any other factors.

Click here for a Visual Walkthrough