Reflection on Week 10 Reading

Technology in testing: the present and the future. (Alderson, 2000)

This paper reviews the advantages and disadvantages of computer-based tests using the examples of the Test of ENglish as a Foreign Language (TOEFL) and DIALANG.

The disadvantages mentioned in this paper include: 1) computer-based tests (CBTs) are limited in the item types they allow. Some item types may not be easily written using computers, 2) test taker should have known some computer knowledge, otherwise they may not be able to do the question due to the insufficient knowledge of computer skills, 3) productive skills may not be easily tested using computers when compared with receptive skills.

The advantages mentioned include: 1.) test takers can do the tests anywhere and anytime they like, 2.) the results will be available very quickly after the test. 3) some software allows test writers to construct tailor-made tests.

The writer also mentions computer-adaptive testing. In the tests, the computer estimates the user's ability level. Once it has reached a rough estimate of the candidate's ability, the computer will choose the next item which may close to the candidate's ability level. In other words, if the test taker can get it right, then a more difficult question will be shown.

I think computers do play an important role in testing. To certain extent, computer-based test can help teachers or employers know the candidates abilities without wasting much time and manpower. However, as mentioned before, computer-based tests restrict some question types. In other words, it may affect the validity of the tests. For example, MC items are difficult to write but easy to mark and most of the question types in computer-based tests are MC questions. Therefore, if teachers or employers do not pay attention to the distractors in MC questions, students may get the answers correct by chance or elimination and therefore affect the validity of the test.