Our approach & methodology

At TestInvite, we believe in creating custom assessments that are tailored to the specific needs of each organization. We do this by maintaining a diverse collection of items that measure various skills, qualities, and capabilities. These items are stored in our question bank, which allows us to create custom assessments that precisely match each organization's specific requirements.

Our approach to custom assessments suits roles that matter most to a company. Custom assessments help to find the best candidates for these roles, giving a competitive edge. By continuously enhancing the workforce's composition, these assessments contribute to an ongoing cycle of improvement.

In the following sections, we will discuss our approach and methodology in more detail. We will explain how we ensure the reliability and validity of our assessments, even in the absence of conventional standardized tests.

Balancing flexibility and standardization

TestInvite's approach to assessment creation strikes a harmonious balance between flexibility and standardization. Our primary objective is to design assessments that are both reliable and valid, while also being adaptable to the unique needs of each organization. Unlike traditional standardized tests that rigidly apply a fixed structure, TestInvite values customization. Organizations have the autonomy to customize questions, scoring, and create fully customized assessments. This adaptive framework caters to assessments that are aligned with specific roles.

The role of item analysis to ensure reliability and validity

TestInvite is committed to ensuring the reliability and validity of its assessments. Reliability refers to the consistency of the results of an assessment, while validity refers to the extent to which an assessment measures what it is intended to measure.

Item analysis is a process of statistically analyzing assessment data to evaluate the quality and performance of the items in the item bank. This is an important step in the test development cycle, not only because it helps improve the quality of the test, but because it provides documentation for validity: evidence that the test performs well and score interpretations mean what you intend.

The specific items that are flagged for review will vary depending on the specific assessment and the criteria that are used for item analysis. However, item analysis typically examines the following factors:

• Item difficulty: The difficulty of an item is the percentage of test-takers who answer it correctly. An item that is too easy or too difficult will not be a good measure of the skills or knowledge that the assessment is intended to measure.

• Item discrimination: The discrimination of an item is the extent to which it differentiates between high-performing and low-performing test-takers. An item with good discrimination will be answered correctly by more high-performing test-takers than low-performing test-takers.

• Item distractors: The distractors of an item are the incorrect answer choices. Good distractors should be plausible and should attract a significant number of incorrect responses.

Item analysis can be conducted using both classical test theory (CTT) and item response theory (IRT). CTT is a simpler approach that is based on the assumption that the items are measuring a single underlying trait. IRT is a more complex approach that allows for the assessment of multiple traits and the estimation of individual item parameters.

Overall, item analysis is an important tool for ensuring the reliability and validity of assessments. By carefully conducting item analysis, Testinvite reinforces the credibility of its assessments.

The relationship between item analysis and the fundamental concepts of validity and reliability is essential to understanding how assessments are rigorously developed:

Validity: Validity refers to the extent to which an assessment measures what it is intended to measure. Item analysis can help to ensure the validity of an assessment by identifying items that are not measuring what they are intended to measure. For example, an item that is too easy may not be a valid measure of the skills or knowledge that the assessment is intended to measure. This is because an item that is too easy will be answered correctly by most test-takers, regardless of whether they have the skills or knowledge that the assessment is intended to measure.

Reliability: Reliability refers to the consistency of the results of an assessment. Item analysis can help to ensure the reliability of an assessment by identifying items that are not consistent in their measurement. For example, an item that is answered correctly by a large percentage of test-takers may not be a reliable measure of the skills or knowledge that the assessment is intended to measure. This is because an item that is answered correctly by a large percentage of test-takers is likely to be too easy and will not be able to differentiate between high-performing and low-performing test-takers.

Conclusion

TestInvite's approach to assessments stands out through its meticulous item analysis. This methodology distinguishes it from conventional standardized tests. Focusing on the careful analysis of items provides a solid foundation for assessments that are built on sound principles. We use a variety of statistical techniques to evaluate the quality of our items, and we are constantly striving to improve the quality of our assessments.

TestInvite's approach is more tailored to the specific needs of each organization. We believe that each organization has unique requirements, and we want to create assessments that are specifically designed to meet those requirements.