How can I create a custom test for my company?

You can create your own tests and add them to your assessments right from your TestGorilla dashboard.

Applies to: Scale, Business plans; Owner, Admin, Recruiter roles

 

Using the TestGorilla platform, you can create your own automatically-scored tests to evaluate your candidates. Your tests can be added to your assessments in combination with the tests we offer. Any tests you create will only be available for use in your company account, and will not appear in our public test library.

This article walks you through the steps for creating your own test on the platform, provides resources for creating the contents of your test, and explains how to use your test in an assessment. 

  1. Creating the content of your test
    1. Types of questions you can use for your test
  2. Create a new test
  3. Create the landing page
  4. Add questions
    1. Add preview questions
    2. Add skill areas
  5. Configure your test
    1. Choose the number of questions
    2. Provide a time limit
  6. Publish your test
  7. How to add your own test to an assessment

1. Creating the content of your test

Before you begin creating your test in the TestGorilla platform, we recommend outlining the content of your test to ensure that it covers its topic comprehensively. You can do this by following these simple steps:

  1. Break down your test into skill areas: Every test is meant to test candidates for something specific. It’s important to take time to clarify what exactly you're trying to measure. This will form the foundation of your test.


    For example, in a language proficiency test, you may want to have skill areas such as:

    • Grammar & Vocabulary
    • Sentence composition
    • Reading comprehension
    • Listening comprehension

  2. Break down each skill area into categories or specific skills: Each skill area tests candidates in a specific section of the overall scope of the test. It's important to define the specific skills or categories that each skill area covers. This will give you a framework for writing questions in the next step.

  3. Write questions for each skill: Your test's questions should only relate to the skills that you've defined in the previous step. Each question should address only one skill or skill area. Another expert in your field should be able to read your questions and immediately understand which skill areas they relate to.
 
Tip: For more information on how to write good questions (as well as how to define the skill areas and skills of your test), see the in-depth guide we've created here.

Back to top


1.a. Types of questions you can use for your test

The TestGorilla platform has four question types you can use in your test: 

  1. Multiple-choice questions: In a multiple-choice question, a test-taker has to choose one right answer from a list of choices. If designed well, multiple-choice questions have very good psychometric properties, meaning they can clearly distinguish good candidates from poor ones. This makes them the best question type for your tests in general

  2. Multiple-response questions: Multiple-response questions have more than one correct answer and candidates must select all correct options for full points. These questions offer a creative approach for testing certain skills. However, it can be more challenging for you to come up with the right balance of correct answers and wrong ones (called distractor options) in your list of choices. These questions are often less reliable than standard multiple-choice questions and should be used sparingly, though we do encourage you to include a few.

  3. True or false questions: True/false questions are a special case of multiple-choice questions. They allow for a faster response from the test-taker. You can use this type if you feel that some of your other questions take longer and you'd like to reduce the average response time of your questions. As test-takers have a 50% chance of guessing the right answer, we advise you to use this question type sparingly.

  4. Short text question: This question type should only be used for short answers expressed in specific words (and only those words). This question type works well for testing vocabulary and spelling in a language test, checking terminology (such as the name of a function or method in coding), and for questions that have only one specific answer.
 
Tip: For more information on how to write good questions, as well as how to define the skill areas and skills of your test, see the in-depth guide we've created for our subject matter experts here.

Back to top

2. Create a new test

Once you have an idea of how you want to structure your test, you can begin creating it in the TestGorilla platform. From your TestGorilla dashboard, navigate to the Tests tab in the top bar menu and then click on My company tests in the top right-hand corner. 

From the My tests screen, click on Create new test in the top right-hand corner

Back to top

3. Create the landing page

The first step is to create a landing page for your new test. This page will describe your test, letting you and other account users know what the test is about as well as which job roles to use it for.

Note: Landing pages are only viewable by members of your TestGorilla account during assessment creation. These pages are never shown to candidates.

 

The landing page will include the following inputs:

Test name* This is how users will recognize your test. Avoid adding Skills or Test to the name

Example: Negotiation
Single line text,
60 character limit
Test summary* Summarize the contents of the test. Be concise yet comprehensive. Multi-line text,
255 character limit
Test type* Select up to two types Cognitive ability
Language
Situational judgment
Role-specific skills
Programming skills
Software skills
Difficulty level* Select one Entry-level
Intermediate
Advanced
Audience

The language requirement of candidates taking the test.

Select one.

English
This test is relevant for* Describe which job roles this job role is relevant for Multi-line text,
255 character limit
*Indicates a required field
 
Tip: We currently only offer tests in English in our public test library, so the only available audience to choose is English. You can still create a test in a different language! Just don't choose an audience.

Back to top

 

 

4. Add questions

Now that you've filled in your landing page, the Questions tab will become available. This is where you can add your test questions. The first time you navigate to the Questions tab, you'll see a message with information about creating questions, as shown in the below screenshot.


Click on the Add questions button, to begin adding your questions. The following page will look like the screenshot below.

The red banner at the top warns you that you need at least 1 question per test, and that you should distribute your questions evenly per skill area. This is to ensure that each skill area receives a similar amount of attention for a comprehensive test.

 

4.a. Add preview questions

The first questions you'll want to add are preview questions. These are questions will appear to your candidates before an actual test begins so that they know what to expect from the test. These questions should be a good representation of your test questions, but should not be identical to any questions used in your test!

These questions do not count toward the candidate's score.

To add a preview question, click the Add first question button on the right side of the screen.

The next page will ask you to select your question type:

  • Multiple-choice
  • Multiple response
  • True or false
  • Short text

The types of questions are discussed in more detail in section one of this article, Types of questions you can use for your test.



Selecting a question type will take you to the next screen where you will enter your questions and answers. For the sake of this guide, select a multiple-choice question, which will bring up the following screen.

All question editors will look similar. Follow the on-screen instructions to create your questions, and remember to save them before moving on!

  • On the left side of the screen is the question editor, where you can create the actual question that the candidate sees.
  • On the right side of the screen, you will add your answer choices.
    • If you'd like to add more choices, click the +add another answer button found below the answers
    • If you'd like to remove choices, click the X to the right of the answer choices that are available
    • Be sure to select the correct answer before saving the question

Repeat these steps for each of your preview questions.

Tip: While making your questions, there are helpful articles in the lower right corner of the question editor to help with the detailed things like:


Back to top

4.b. Add skill areas

Once you're done with adding preview questions, you'll want to add your skill areas, as discussed above in the section Creating the content of your test.

By default, new tests have two skill areas.

  • You can delete a skill area by clicking the X to the right of the skill area name.
  • You can also add skill areas by clicking the Add another skill area button beneath the skill areas.

To add your skill areas, click on the pencil icon to the right of the Untiled skill area.

Naming a skill area causes a new button to show up, allowing you to add your questions to the skill area. You can click the Add first question button to begin adding questions, in the same manner that is discussed earlier in this guide in the section Add preview questions.

 
Note: The system will not allow you to publish the test if you have skill areas without any questions. If you have empty skill areas, delete them!

Back to top

5. Configure your test

After you've finished adding your bank of questions, you'll want to tell us how many we should use for each test, and how long the test should take.

For example, most of TestGorilla's multiple-choice tests have question banks of no less than 100 questions, but only 12, 15, or 20 questions are provided for each assessment that a test is used in. Additionally, all of our own multiple-choice tests are only 10 minutes long.


We understand that every business has a different use case, so you might want to have 50 questions in a 60-minute test. You can do that!

Back to top

5.a.  Choose the number of questions

It is your choice how many questions you want us to randomly use when this test is added to one of your assessments.

To do this, simply type in the number you'd like to use in the blank box found in the Question usage section at the bottom of the page, keeping in mind that you can only use the total number of questions that you've included in the question bank.


Back to top

 

5.b. Provide a time limit

You can choose a time limit after choosing the number of questions in the test. This is presented as a drop-down. The lower limit is 15 seconds per question. Does the drop-down not give you the right test duration? You can also type a custom duration in the input field.

 

Tip: If you're not sure what time length to choose, we have a comprehensive article discussing how to choose an appropriate time limit for your tests here.

Back to top

6. Publish your test

After defining your skill areas, adding your question bank, selecting how many questions we should use in each assessment, and how long your test should take, you will finally be able to publish your test!


You can do this by clicking the Publish test button in the top right corner of the platform. It's also worth reading the tooltip called Read this before publishing as it gives you a fun little checklist to be sure your test is fully edited and ready for sending to your candidates!

Note: If the Publish test button is grayed out, you have an error somewhere and your test isn't complete. Check the Landing page to be sure it's filled in, and check the Questions page to be certain that you've added enough questions and that all skill areas are filled in.

Back to top

    7. How to add your own test to an assessment

    Once you've created your test, you can use it in any of your assessments along with tests from our test library (and any custom questions you may want to include). 

    In the second step of creating an assessment, on the test selection screen, click on the Test type field towards the top right-hand corner of the screen. From the drop-down menu, choose My company tests. Next, click Add on the test you wish to add to your assessment. You'll see the test appear in the test blocks at the top of the screen.

    add your own test to an assessment

    Back to top

     
     

    Support 
    If you still need help, you can always reach out to the support team. We're happy to answer your questions.