The Next Generation of Assessments

Online assessment is a phenomenon that has become central to recruitment. Computer-based testing has existed for more than 20 years, but the advent of the Internet age has pushed psychometric testing out of the interviewers’ offices and into the candidates’ homes.

The first generation of online testing consisted of paper-and-pencil tests such as verbal reasoning. This format of text-based tests was easy to implement at a time when broadband connectivity was limited to business and educational institutions.

The second generation witnessed the introduction of graphics into online testing, allowing for charts, tables and diagrams of numerical and logical reasoning tests to be displayed with fidelity very close to traditional printed tests.

These first two generations spanned from the late 1990s to 2005. Now, well into a third generation, online testing is undergoing a rapid and dramatic transformation-one where tests don’t have to look like tests and candidates take a much more active role in their own assessment.

The most immediate development has been the visual integration of online tests with employers’ recruitment processes. Where previous attempts at branding tests were limited to using the employer’s logo and color, current tests can be infinitely configured, resulting in a seamless fit with the employer’s brand.

In addition, where previous tests relied on the tried-and-trusted multiple choice format, new response methods are now commonly used. For example, imagine a memory test. The candidate must remember the location of 15 items after viewing them for 20 seconds. Instead of choosing one correct answer out of five possible options, he/she can place the items in the appropriateplace by dragging and dropping them. So now, instead of simply getting the answer right or wrong, we can measure how close or far the candidate was from the perfect answer. Not only does this reduce the chance that the candidate gets the answer right just by luck, it also allows for a much higher resolution of measurement.

Test authors can now design the test interface from scratch instead of having to “shoehorn” new tests into old formats. This means that intuitive interfaces can be designed to reduce the risk of misinterpreting the instructions or looking at the wrong screen location. Candidates are shown a situation (in this example, one where a hair dryer has been put in a sink full of water while still plugged in) and must choose from four possible options. A narrator also reads any text that appears on screen. When choosing the correct option, the candidate sees small animations of each of the possible actions. This has the effect of minimizing the literacy level that the candidate must have to understand the instructions and complete the test.

That last point is significant. Through careful interface design, coupled with the use of animations and audio, we are able to reliably assess candidates with lower levels of literacy. Many jobs will attract candidates with lower-than-average literacy, so this style of assessment may prove extremely useful.

The increasing use of multimedia is having a big impact on online Situational Judgment Tests (SJTs). A SJT consists of a number of questions that describe a hypothetical scenario and ask the candidate to indicate what he/she thinks would be the best resolution. The effectiveness of SJT performance predicting job performance has long been established. However, in their usual written format, candidates with lower-than-average literacy levels may perform poorly because their comprehension of the scenario, and of the possible responses, affects their results.

Research in the 1990s indicated that replacing text-based scenarios with video and audio scenarios had a positive effect on minimizing some of these literacy effects. Of course, the cost of producing a video SJT far exceeded the cost of producing a text-based SJT, and so video SJTs have not been commonplace in the past.

However, as production costs have decreased, video and animated SJTs have started to become more common. With the advent of low-cost animation software, animated SJTs can be created even more economically than their video counterparts.

We are seeing a rapidly growing interest in animated SJTs. Why animation rather than video? The answer is globalization. Using video means that for every language the SJT is deployed in, new video has to be shot-unless you’re aiming for that “badly dubbed foreign film” look. However, with animation, only the new audio needs to be recorded, and the software will synchronize the animation to the new voices in seconds.

Broadband take-up has boomed over the past five years. More bandwidth for domestic Internet users allows them to download more data, more quickly. At the same time, the power of the average home computers continues to increase every year. Even entry-level machines have audio and graphic capabilities that would have cost many times what they do now just five years ago.

The increase in IT literacy has also played a part in the prevalence of online testing. Approximately 25 years ago, computers were introduced to schools. Now that they are ubiquitous throughout education and the workplace, the majority of job applicants are likely to be quite comfortable using a computer to take a test.

Implications of broadband growth, better computers and increased literacy are easy to see and will impact http://www.kenexa.com/ : hr management. The same trends that have brought massive year-on-year growth in online gaming, http://www.youtube.com/ : YouTube and Voice over IP services are now impacting employee assessment and employee evaluation.

Author Bio: Andrea Watkins writes articles about how hr management from Kenexa helps organizations source, hire and retain talents from around the world. Employee Assessments and employee evaluation are coupled in to ensure the right person is selected for the right job.

Category: Business Management
Keywords: hr management, assessments, employee evaluation

Leave a Reply