Reliable Peer Assessment for Team-project-based Learning using Item Response Theory

来源 :The 23rd International Conference on Computers in Education( | 被引量 : 0次 | 上传用户:kennshi
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
  This study addresses the reliability of peer assessment in team-project-based learning using item response models that incorporate rater characteristic parameters.The following difficulties can arise when applying item response models to peer assessment in team-projectbased learning.(1)Earlier item response models incorporate the assumption that peer rating data consist of three-way data,which are learners × performance tasks × raters.However,the data used for this article are four-way data,which are learners × project tasks × raters × dimensions of abilities because multiple dimensions of learner abilities are generally assessed in project-based learning.Previous models are not directly applicable to four-way data.(2)In team-project-based learning,the learners are partitioned into several teams and are peer assessed within each team.In this case,the peer assessment reliability depends on the team assembly because the ability estimation accuracy for each learner depends on the characteristics of peer raters within the same team.If the teams are assembled randomly or fixed for all project tasks,then differences in the accuracy of ability estimation among learners would increase.To resolve this problem,this article presents a proposal of reliable peer assessment in team-projectbased learning.Concretely,we extend the previous item response model that incorporates rater characteristic parameters to apply to four-way data.Furthermore,we formulate a team assembly problem for team-project-based learning as an integer programming problem.The team assembly method maximizes the difference between teams that are assembled for a project task and those assembled for previous project tasks.
其他文献
In the traditional classroom model,students learn concepts in class and apply what they learnt while working on related problems at home.In the flipped classroom,students would learn content outside c
The purpose of this study is to investigate the effects of applying Graphic Reasoning Simulation Tool on sixth-grade students learning of scientific creativity.The participants included 90 elementary
Cooperative learning is important by some students.However,in Japan,the number of small classes has increased in schools,and it is difficult to conduct cooperative learning in small classes.This study
This paper presents research about the blended learning that is carried out in the classroom using the Learning Management System; we have conducted a time series analysis by utilizing the viewing tim
In this paper,we describe how to improve our Japanese dictogloss system to realize richer dialogue to pseudo learners partner(called learner agent)and more usable operation using the system on the stu
Historical events include lessons of good and bad behaviors of human beings.To discover these lessons,we must generalize the historical event by the basic attributes,so that we can notice the underlyi
Computational Thinking(CT)is becoming a core element of current K-12 science curricula.In spite of the known synergies between CT and science education,few attempts have been made to leverage this syn
Analyses on students learning behaviors comprise an important thrust in education research.This study focused on e-books system used in the classroom and this system recorded students learning logs in
The aim of this paper is to show a framework to facilitate students metacognitive skill,named CIRCLE,an acronym for "Collaborative discussion,Interactive environment and Representation of thinking pro
Multiple External Representations(MERs)have been known to facilitate and strengthen learning processes,and are common in Technology Enhanced Learning(TEL)environments.However,learners face difficulty