Outcomes-Focused Evaluation of Engineering Programs - Inhibitor or Stimulant for Improvement

Outcomes-Focused Evaluation of Engineering Programs - Inhibitor or Stimulant for Improvement

In Sweden, a new model for quality evaluation of higher education is being introduced. It is internationally unique. A very strong emphasis on assessing the quality of an entire education through its outcomes, defined by samples of final degree reports, is perhaps the most original feature of the model. This is claimed to enable a direct assessment of quality rather than the indirect assessment used in conventional models. The model has, however, been intensively debated during its development and first years of use. The aims of this paper are first to evaluate in what ways and to what extent the Swedish national model for evaluation of higher education contributes to the quality improvement of the evaluated programs, and second to describe and evaluate an approach for organizing the project to prepare the evaluation documentation for a large-scale education evaluation. The paper concludes that on an overall and averaged level, the project participants estimated that the model will contribute to positive effects. Specific areas are identified including ethics and focus of final degree reports. However, there is a strong variance in the data: There is a substantial fraction of participants who have not identified any improvements or weak spots, and who do not think that the evaluation preparation will positively affect education quality development. Chalmers University of Technology chose to approach the evaluation with a centrally managed project. The setup gave possibilities for rationalization through common training, supporting materials, a common document database and for information sharing across departmental boundaries. Nevertheless, the project was very time-consuming with an average of 540 hours spent for each program/degree.

Proceedings of the 9th International CDIO Conference, Massachusetts Institute of Technology and Harvard University School of Engineering and Applied Sciences, Cambridge, Massachusetts, June 9 – 13, 2013.

Authors (New): 
Marie Arehag
Josefin Bertilsson
Åsa Ekvall
Erika Hansson
Johan Malmqvist
Lena Peterson
Ulla Rilby
Pages: 
13
Affiliations: 
Chalmers University of Technology, Sweden
Keywords: 
Program evaluation
accreditation
Education Quality Assurance
Sweden
Year: 
2013
Reference: 
Gray, P. J., Patil, A. S., Codner, G., “The Background of Quality Assurance in Higher Education and Engineering Education”, in Engineering Quality Assurance – A Global Perspective, pp 3-25, Springer-Verlag, 2009.: 
Swedish National Agency for Higher Education (HSV), Högskoleverkets system för kvalitetsutvärdering 2011–2014 (HSV System for Quality Evaluation), Rapport 2010:22 R, Stockholm. Sweden, 2010. In Swedish.: 
Ministry of Education and Research. Higher Education Ordinance, SFS 1993:100, with amendments up to SFS 2006:1054, Stockholm, Sweden, 2006.: 
European Network for Accreditation of Engineering Education (ENAEE). EUR-ACE Framework Standards for the Accreditation of Engineering Programmes. Retrieved May 4, 2009 from http://www.enaee.eu/pdf/EUR-ACE_Framework_Standards_20110209.pdf, 2008.: 
Swedish National Agency for Higher Education (HSV), Evaluation of Civil Engineering Programs at Swedish Universities and Institutions of Higher Education, Rapport 2006:31 R, Stockholm, Sweden, 2006.: 
Nilsson, K.-A., Direkt kvalitetssäkring. Bedömning av utbildningens resultat och relevans (Direct Quality Assurance. Assessment of Educational Outcomes and Relevance), Lund University, Department of Evaluation, Report Nr 2009:255, Lund, Sweden, 2009. In Swedish.: 
Utbildningsdepartementet, Högskolepolitiska propositionen: Ny värld – ny högskola (Proposal for Higher Education Policy: New World – New Universities), Stockholm, Sweden, 2004. In Swedish.: 
Lindberg-Sand, Å., Koloss på lerfötter? Utveckling av metodik för resultatbaserat nationellt kvalitetssystem i svensk högre utbildning (Colossus on Clay Feet? Development of OutcomesBased National Quality System for Swedish Higher Education), Centre for Educational Development, Lund University, Lund, Sweden, 2011. In Swedish.: 
Accreditation Organisation of the Netherlands and the Flanders (NVAO), Swedish National Agency for Higher Education: Review of ENQA Membership, Technical Report, 2012.: 
Adamson, L, Flodström, A., “Political Meddling in Quality Assurance Spells Chaos”, University Worlds News, 11 November 2012, http://www.universityworldnews.com/article.php?story=20121107150730970#comments, accessed on March 6, 2013.: 
Go to top