Self and Peer Rating in Multi-Disciplinary Group Projects

Self and Peer Rating in Multi-Disciplinary Group Projects

J. Hermon, C. McCartan, J. Kuttenkeuler, S. Hallström (2012).  Self and Peer Rating in Multi-Disciplinary Group Projects. 10.

The ability to self and peer assess performance within a multi-disciplinary group is a valuable skill and one of many detailed in the CDIO syllabus as being desirable for graduate engineers. The design, build and test environment in which a student applies technical knowledge and develops teambuilding and other professional skills such as self and peer assessment is complex and challenging for both students and assessors. Operating such activities as multi-disciplinary and multi-national projects adds further layers of complexity.

This paper seeks to examine the reliability of students’ self and peer assessments in such complex team environments. The study examined peer ratings from 5 teams from Queen’s University Belfast (QUB) and 6 teams from the Royal Institute of Technology (KTH) in Stockholm, and involved in total 105 students from 6 different disciplines. The analysis suggested that students tended to show bias in favour of those from the same discipline and against those from a minority grouping or from outside of their own university. Further analysis from many more institutions would be required to determine if such tendencies are generally typical.

 

Authors (New): 
John Paul Hermon
Charles McCartan
Jakob Kuttenkeuler
Stefan Hallström
Pages: 
10
Affiliations: 
Queen's University Belfast, Northern Ireland, United Kingdom
KTH Royal Institute of Technology,Sweden
Keywords: 
Peer rating
peer assessment
multi-disciplinary
group projects
Year: 
2012
Reference: 
Crawley E.F., Malmqvist J., Lucas W.A., Brodeur, D.R., “The CDIO Syllabus v2.0: An Updated Statement of Goals for Engineering Education”, Proceedings of the 7th International CDIO Conference, Technical University of Denmark, June 20-23, 2011. : 
Loddington S., “Peer assessment of group work: a review of the literature:, JISC WebPA Project, May 2008, http://webpa.ac.uk/files/Literature%20review%207_0.doc (accessed April 2011) : 
Kruger, J., Dunning, D., “Unskilled and Unaware of It: Difficulties in Recognizing One’s Own Incompetence Lead to Inflated Self-Assessments”, Personality and Social Psychology, Vol 77, No 6, (1999) p1121-1134 : 
Brown-Parker, J., Thomas, I. & Wellington, P,, “Peer Assessment of Student Performance: Measuring Congruency of Perceptions in a Multidisciplinary Team”, Proceedings of: Advancing International Perspectives, (1997), Adelaide, South Australia : 
Oldfield, K.A. & Macalpine, J.M.K., “Peer and Self-assessment at Tertiary Level” Assessment and Evaluation in Higher Education, Vol 20, No 1 (1995), p125-132 : 
Norton, S.M., “Peer assessments of performance and ability: An explanatory meta-analysis of statistical artefacts and contextual moderators”, Journal of Business and Psychology, Vol 6, No 3 (1992), p387-399 : 
Falchikov, N., “Peer Feedback Marking: Developing Peer Assessment”, Innovations in Education and Teaching International, Vol 32, No 2 (1995), p175-187 : 
Boud, D., “Assessment and the promotion of academic values”, Studies in Higher Education, Vol 15, No 1 (1990), p101-111 : 
Willey, K., Gardner, A., “Developing team skills with self and peer assessment”, Campus-Wide Information Systems, Vol 26, No 5 (2009), p365-378 : 
Hermon J.P., McCartan C.D., “Peer Rating for Feedback in Group Projects”, Proceedings of the 7th International CDIO Conference, Technical University of Denmark, Copenhagen, June 20-23, 2011: 
Go to top