Intended Use of Exclude

Categories: How-Tos and Help Guides, Results and Reporting

The exclude checkbox is intended to be a permanent exclusion of data in the account. This is generally used to exclude data from:

  • Managers who have taken the test to see what is on it
  • Test takers who do not complete a test or portion of a test battery
  • Other accidental taking of tests

When you exclude a test taker’s results, you are removing the person’s results from the data used to calculate local percentiles. The local percentile columns, consequently, will update to show the results with the excluded test taker removed.

Before Tests Are Excluded: After Tests Are Excluded:
exclude before wa exclude after wa
n before wa n after wa

If you would like to separate out groups of test takers’ results, we would recommend that you move the test takers into subaccounts.

You can find more details about setting up subaccounts here.

FAQ: How to exclude a test from results

Categories: Results and Reporting

Q: How do I exclude a test from the results?

A: See Below

Step 1 Step 2 Step 3 Step 4

Instructions:

Select "Reporting Center" in the left sidebar

Image:

Instructions:

Select Standard

Image:

Instructions:

Open the account picker and select the account you would like.

Image:

Instructions:

Select the examinees you would like to exclude from the reports.

Image:

Excluding a Test From Results

You may occasionally want to exclude a test from the results (including the summary and local percentile).  Typically, you would want your results to include only those examinees who will be compared to each other.  You may want to exclude managers or persons that have reviewed the test to prevent skewing of the local percentile ranks.

Excluding a test will change the local percentile ranks since the excluded score will no longer be included in the local pool of examinees.

You can find out more information on how Exclude is intended to be used in this article.

FAQ: Why do some examinees have the option to “View Responses” and others have “View / Edit Responses”

Categories: Results and Reporting, Testing Basics, Troubleshooting

In the Examinee Entry System, there are multiple sources of test data.  You can only “View Responses” for examinees from the Online Testing System and that were scored by Ramsay Corporation.

You can “View / Edit Responses” for examinees that were entered into the Examinee Entry System by you or someone in your account.

FAQ: What is percentile rank?

Categories: Results and Reporting, Testing Basics

Q: What is the local percentile rank?

A: A percentile rank is the percentage of examinees that score the same or lower than our subject examinee’s specific score.  The local percentile rank refers to the local group of examinees.  In the case of the Online Testing System, the local group is the group of examinees that have completed that specific test in that specific account.  For example, if you were viewing a report for ABC Company and there are 10 examinees that have completed the Mechanical Aptitude Test, the local group would consist of those 10 examinees.  The local percentile rank would indicate how one examinee ranks against the other 9 examinees.

Q: What is the national percentile rank?

A: A percentile rank is the percentage of examinees that score the same or lower than our subject examinee’s specific score. The national pool consists of a group of examinees, most often the same examinees in our test manual’s normative data section.  The pool size may vary depending on the test that is in use. Refer to the test manual for specifics on the pool size.

Q: How is percentile rank calculated?


A: The formula Wikipedia uses is shown above. The equation describes the total number of people who received a lower score than the score in question (cℓ), plus ½ of the number of people who received the same score as the score in question (ƒi), divided by to the total number of people (N). You then take that number and multiply it by 100 to get the percentile rank. ƒi includes the count of the score of the question.

FAQ: Entries

Categories: Results and Reporting, Troubleshooting

Q: What are Entries and how many do I have available?

A: An entry is an examinee’s test answers placed into a format for our system to utilize, score, and analyze. For every paper test you buy, the option to score it through our Examinee Scoring System is bundled. We do not provide the option to score examinees without a purchase. If the option to enter a new examinee is not available, you either need to purchase additional tests or the test may not yet be available to score through our entry system.

Q: Editing an entry vs. Creating a new entry.

A: Editing an entry is provided for corrections. If you notice a typo or if you missed a question while keying in the examinee’s answers, you can and should edit the entry. You can also change the test if you mistakenly entered the examinee’s answers under an incorrect test title.

You should create a new entry for every examinee. If an examinee has taken a test more than once there should be an entry for every time the examinee has taken the test. The entries have timestamps on completion or entry time, depending on type of entry. Therefore it is not necessary to vary the names of examinees if you are entering multiple entries for an examinee.

Q: What does “Entry Type” mean?

A: “Entry Type” refers the source of the examinee in the scoring system. There are three ways for tests to be entered into the scoring system:

  1. Through the online testing system (designated by “Online Test”)
  2. Entered into the Ramsay Test Entry System (designated by “Entry System”)
  3. Scored by Ramsay Corporation and placed into your account (designated by “Ramsay Scored”)

Q: Can I delete an Entry?

A: Deleting entries is not an available option. Each test purchased and administered is provided with a complementary entry in the system. If you have accidentally entered the examinee under the wrong test please Edit the entry and change the test to correct this problem.

FAQ: How can I see all of the test results at once?

Categories: Results and Reporting, Troubleshooting

Q: How can I see all of the test results at once?

A: In the reporting center there are three options under recently assigned tests, 25, 50, and 100 examinees.  However if you wish to view more than 100 examinees, viewing the results requires a few more steps.

Step 1 Step 2 Step 3 Step 4 Step 5

Instructions:

First click "Reporting Center".

Image:

Instructions:

Next click "Standard".**

**Note: If you do not see "Standard" on this screen, you do not have the proper permissions to view these reports.
Please contact a supervisor or administrator responsible for your account for details.

Image:

Instructions:

Next click "Open Account Picker" and select the accounts you wish to view results for.

Image:

Instructions:

Next, select a test you wish to view results for.

Image:

Instructions:

Finally, you can click on any of the "Group Reports" links for combined reports showing all candidates in the accounts selected, or you can click Score Report next to each candidate's name for their individual result.

Image:

FAQ: Custom-Organizational Groups

Categories: Administrative Tasks, Results and Reporting

Q: What are Custom-Organizational Groups?

A: Custom-organizational groups are groupings of accounts that may or may not share results with each other. This is typically set up to the benefit of our clients who may have an assessment solution validated with us. Custom-organizational groups also provide the customization of a pre-testing survey.

Examples of implementations can be found below:

Example: Company A

  • Background:
    • Company A has 140 locations, each location is set up as a subaccount of Corporate.
    • Company A’s retesting policy is as follows: a “pass” is valid for 1 year; a “fail” is eligible for retesting in 6 months.
    • Tests are valid for all locations.
    • Employees at any location may apply to any other location.
  • Solution:
  1. Company A has a shared custom-organizational group set up. This allows any group member to access results of any other group member, thus allowing each location to search other locations’ candidates to verify their test results.

 

Example: Company B

  • Background:
  1. Company B has 4 locations and wants to use assessments for a number of reasons, including gauging new-hires and diagnosing existing employees.
  2. Among employees, some groups may use the same tests with different cut scores.
  3. Company B is set up with two tiers under the corporate account.
  • First tier contains each location as a separate subaccount.
  • Each location subaccount has a number of groups set up as subaccounts.

Finally, Company B corporate would like to see pass rates across all locations for each job.

Solution:
Company B sets up a custom-organizational group for each of the jobs across each location.
Each custom-organizational group has its own set of survey questions that can be used as fields to filter later in the reports.
Custom-organizational groups are set up as not-shared, as locations do not need to be able to access each others’ results.

Q: What are the costs involved in setting up a custom-organizational group?

A: Clients who have validated a test with us can utilize this system at no additional cost. This feature is also available to companies who have purchased an Enterprise Subscription with us.

Q: How do I create or edit my custom-organizational group or my survey fields?

A: Please email Ramsay Corporation’s IT department with requests to create new custom-organizational groups (itgroup@ramsaycorp.com).
If you wish to edit your custom-organizational group, please use the Manage Custom Fields item from the Navigation menu. If it is not available to you, you may not have permissions to manage the custom-organizational groups or the survey fields.

FAQ: Can I print the Test Inspection page?

Categories: Administrative Tasks, Results and Reporting

The Test Inspection page (formerly Test Review page) is purposefully NOT intended to be printable. We provide this page for the administrative purposes of review of content and missed items in scoring reports. Creation of unauthorized copies of test content without explicit consent from Ramsay Corporation is a violation of US Copyright Law. If you need a paper version of an online test, please call us at 412-257-0732 and we would be happy to assist you.

FAQ: Are test results available to examinees?

Categories: Results and Reporting, Testing Basics

Q: Are test results available to examinees?

No, test results are not available to examinees. Test results are only available to administrators.

FAQ: How do I determine what qualification score to use?

Categories: Administrative Tasks, Results and Reporting

Q: How do I determine what qualification score to use?

A qualification or passing score is specific to an organization and job function and should indicate a score that a qualified person should have. Ramsay Corporation does not provide qualification scores for off-the-shelf tests because these tests are used for a variety of job titles in many different settings.

However, Ramsay Corporation can provide you with a score by conducting a validation study for your organization. Please call us at (412) 257-0732 for more information.

FAQ: Am I notified when a test has been completed?

Categories: Administrative Tasks, Results and Reporting, Testing Basics

No. As all Ramsay tests should be administered in a proctored environment, typically the proctors can notify administrators when tests are completed. Sometimes the proctor and the administrator are the same person.

The administrators can then access the results as they are immediately available after the test taker completes the test.

Viewing Candidate Qualification

Categories: Results and Reporting, Test Reports

Qualification-Based Reports are different than Score-Based Reports in that they compare the candidate’s scores to required cutting scores. Advanced score requirements can be set to allow for multiple scores and multiple tests.

Cutting scores are set in a Job Profile. More information on setting up Job Profiles can be found in our help page: What are Job Profiles?.

As a note, Qualification Results do not contain raw scores and are available to all administrators other than Proctors.
Click here for a Visual Walk-Through