论文部分内容阅读
评分量表代表了测试构念的操作化定义,是写作评分的重要组成部分。为了解整体和分项量表对EFL作文评分信度的影响,本研究对9名评分员对同样50份作文使用整体和分项量表所作的评分进行了多层面Rasch模型分析。研究发现,分项量表的使用能够使评分员对考生的英语写作能力作出更加细致和准确的区分,而其严厉度上的差异对考生能力估计的影响也更小。同时,较之整体量表,分项量表各分数间的区别也更加明显。总的来说,分项量表的使用对EFL写作测试的评分信度能产生更为有益的影响。
The rating scale represents the operational definition of the test construct and is an important part of the writing score. To understand the impact of overall and sub-scale ratings on EFL essay rating, this study conducted a multi-level Rasch model analysis of the ratings of nine submissions using the same overall and sub-item scale for the same fifty submissions. The study found that the use of sub-scale can make the scorers to make more detailed and accurate distinction between the candidates’ English writing ability, while the severity of the differences have less impact on the candidate’s ability estimation. At the same time, compared with the overall scale, the difference between the scores of the sub-scale is also more obvious. In general, the use of sub-scales can have a more beneficial effect on the EFL writing test’s credit rating.