Modality of Testing/Evaluating Can Invalidate Results Or Mislead
In a discussion of web versus paper and pencil type evaluations, tests etc, often used by trainers or even by HR in selection, someone contended that the modality did not affect results. Dead wrong, and dangerously so particularly if the evaluation is challenged in court. Robert explains
The deal with personality tests, etc., and perhaps other tests is that when you change the administration mode of the test you MUST go back and revalidate the test and it’s results. Common tests like the MMPI, IQ tests and so on are called STANDARDIZED TESTS because they administration protocol IS standard and as unvarying as possible. They are only considered as having demonstrated validity (such that it is) under ONLY those conditions). Ability and acheivement tests also.
Who cares? It’s a legal issue. If you use testing procedures that are not validated for a different mode, you open yourself up to the usual legal challenges, like disparate impact, etc.
For that matter, if it’s anything beyond a performance test like typing, ANY testing opens the Pandora’s box of validation. Purchased tests MUST be administered exactly as in the manual, assuming they are validated. Home grown tests are always dangerous since they are often not validated.
In court if someone asks a company to demonstrate the test actually measures what it measures, better have the info.