Faculty Mentoring, Evidence-Based Assessment, And Student Learning: An Australian Exploration Of American Initiatives

Faculty Mentoring, Evidence-Based Assessment, And Student Learning: An Australian Exploration Of American Initiatives

W. Boles, B. Narayan, H. Beck (2012).  Faculty Mentoring, Evidence-Based Assessment, And Student Learning: An Australian Exploration Of American Initiatives. 14.

There have been many improvements in Australian engineering education since the 1990s. However, given the recent drive for assuring the achievement of identified academic standards, more progress needs to be made, particularly in the area of evidence-based assessment.

This paper reports on initiatives gathered from the literature and engineering academics in the USA, through an Australian National Teaching Fellowship program. The program aims to establish a process to help academics in designing and implementing evidence-based assessments that meet the needs of not only students and the staff that teach them, but also industry as well as accreditation bodies.

The paper also examines the kinds and levels of support necessary for engineering academics, especially early career ones, to help meet the expectations of the current drive for assured quality and standards of both research and teaching. Academics are experiencing competing demands on their time and energy with very high expectations in research performance and increased teaching responsibilities, although many are researchers who have not had much pedagogic training.

Based on the literature and investigation of relevant initiatives in the USA, we conducted interviews with several identified experts and change agents who have wrought effective academic cultural change within their institutions and beyond. These reveal that assuring the standards and quality of student learning outcomes through evidence-based assessments cannot be appropriately addressed without also addressing the issue of pedagogic training for academic staff. To be sustainable, such training needs to be complemented by a culture of on-going mentoring support from senior academics, formalised through the university administration, so that mentors are afforded resources, time, and appropriate recognition. 


Authors (New): 
Wageeh Boles
Bhuva Narayan
Hilary Beck
Queensland University of Technology, Australia
Mentoring academics
learning outcomes
assessment methods
evidenced learning
teaching quality
Australian Bureau of Statistics 2006 Census data: 
QUT Blueprint for the future. 2011. Retrieved March 22, 2012, from http://www.qut.edu.au/about/the-university/blueprint-for-the-future: 
Knight, P., & Trowler, P., Department-level cultures and the improvement of learning and teaching. Studies in Higher Education, Vol. 25, no.1, 2000.: 
James, R, McInnis, C., and Devlin, M,. Assessing Learning in Australian Universities, Centre for the Study of Higher Education and The Australian Universities Teaching Committee. Melbourne. 2002. Accessible from: http://www.cshe.unimelb.edu.au/assessinglearning/docs/AssessingLearning.pdf: 
Boud, D. and Associates. Assessment 2020. Seven propositions for assessments reform in higher education. Australian Learning and Teaching Council Project Report. 2010. Accessible from http://www.iml.uts.edu.au/assessment-futures/Assessment-2020_propositions_final.pdf: 
McAlpine, M.. Principles of Assessment. Blue paper for Computer Assisted Assessments. CCA Centre Centre, UK. 2010. Accessible from http://www.caacentre.ac.uk/resources/bluepapers/index.shtml: 
Palmer, S., Authenticity in assessment : reflecting undergraduate study and professional practice. European Journal of Engineering Education, vol. 29, no. 2, pp. 193-202, 2004.: 
Edwards, S. L. and Associates. ALTC Leadership Grant: Changing the culture of teaching & learning in ICT and engineering: facilitating research professors to be T&L leaders. Australian Learning and Teaching Council Project Report. 2012. Accessible from http://www.olt.edu.au: 
Bergmann, D. M. A study of adjunct faculty. Montana State University). 2011. ProQuest Dissertations and Theses. Accessible from http://search.proquest.com/docview/888454935?accountid=13380: 
Bradley, D., Noonan, P., Nugent, H., and Scales, B., DEEWR Review of Australian Higher Education Report, 2008. Available at <http://www.deewr.gov.au/he_review_final report: 
Gover, J., and Huray, P. G. (01/11/1998). The U.S. Engineers Shortage: How Real? Research Technology Management , 41 (6), p. 9.: 
Felder, R.M. (2010). The Link Between Research and Teaching; Does It Exist? Chemical Engineering Education. Vol 44, 2010, no. 2, pp 109 Retrieved December 23, 2011, from http://www.ncsu.edu/felder-public/Columns/Nexus1.pdf: 
Gibbs, G., and Coffey, M., The impact of training of university teachers on their teaching skills, their approach to teaching and the approach to learning of their students. Active Learning in Higher Education. Vol. 5 (1), 2004, p. 87: 
Bauerlein, M. How to Stop the Shadow Scholar – Brainstorm. The Chronicle of Higher Education. 2010. Retrieved December 23, 2011, from http://chronicle.com/blogs/brainstorm/howto-stop-the-shadow-scholar/29102: 
Cuthbert, R. H. & MacGillivray, H L., Investigation of completion rates of engineering students In D'Arcy-Warmington, Anne, Luaces, Victor Martinez, Oates, Greg, & Varsavsky, Cristina (Eds.) 6th Southern Hemisphere conference on Mathematics and Statistics Teaching and learning (El Calafate DELTA' 07), 26-30 November 2007, El Calafate, Argentina.: 
King, R., Engineers for the future: addressing the supply and quality of Engineering graduates for the new century. Australian Learning and Teaching Council Project Report. 2008. Accessible from: http://www.engineersaustralia.org.au/sites/default/files/shado/ACED/Engineers%20for%20the%20 Future.pdf: 
Australian National Engineering Taskforce report: Scoping Our Future: Addressing Australia’s Engineering Skills Shortage. Australian National Engineering Taskforce. 2010. Retrieved December 23, 2011, from http://www.anet.org.au/wp-content/uploads/2010/12/Scoping-ourfutureWEB.pdf: 
Bland, C.J., Taylor, A.L., Shollen, S.L., Weber-Main, A.M., and Mulcahey, P.A. Faculty Success through Mentoring: A Guide for Mentors, Mentees, and Leaders. Lanham, MD: Rowman and Littlefield. 2009.: 
Macpherson, I., Brooker, R., Aspland, T., & Cuskelly, E., Constructing a territory for professional practice research: Some introductory considerations. In Action research in education: Fundamentals of applied research, Vol. 1. Sage: New York. 2010.: 
American Society for Engineering Education. How Do You Measure Success? Designing Effective Processes for Assessing Engineering Education. Washington, D.C., 1998.: 
Thornton, J., Positions of Power. In Mechanical Engineering Magazine. January 2010. Accessible from http://memagazine.asme.org/Articles/2010/January/Positions_Power.cfm: 
National Academy of Engineering. Engineer of 2020. 2012. Accessible from http://www.nae.edu/programs/education/activities10374/engineerof2020.aspx: 
National Academy of Engineering. Educating the Engineer Of 2020: Adapting Engineering education to the new century. Washington: National Academies Press Oct. 2005.: 
Fitzpatrick, J.J., Byrne, E.P., Kennedy, D,. Making programme learning outcomes explicit for students of process and chemical engineering. Education for Chemical Engineers, Volume 4, Issue 2, July 2009, Pages 21-28: 
Adam, S., Using Learning Outcomes: a consideration of the nature, role, application, and implications for European education of employing learning outcomes at the local, national and international levels. Report on United Kingdom Bologna Seminar, July 2004, Herriot-Watt University. : 
Allan, J., Learning outcomes in higher education Studies in Higher Education, vol. 21, no.1, 1996, pp. 93–108: 
Felder, R.M., and Brent, R. (2003). Designing and Teaching Courses to Satisfy the ABET Engineering Criteria. Journal of Engineering Education, vol.92 no. 1, 2003, pp 7-25.: 
Clutterbuck, D., Everyone Needs a Mentor. Fostering Talent at Work. 3rd edn. Chartered Institute of Personnel and Development. London: 2000.: 
Ensher, E. A., Grant-Vallone, E., & Marelich, W., Effects of perceived attitudinal and demographic similarity on protegees support and satisfaction gained from their mentoring relationships. Journal of Applied Social Psychology, vol. 32, 2002. pp 1–26. : 
Bullard, L. G, and Felder, R. M. Mentoring: A Personal Perspective. College Teaching, ISSN 8756- 7555, 04/2003, vol 51, iss 2, 2003. pp 66 – 69: 
Felder, R.M., Teaching teachers to teach: The case for mentoring. Chemical Engineering Education, vol 27, no 3, 1993. 176-177.: 
Felder, R., Brent, R., and Prince, M., Engineering Instructional Development Programs, Best Practices and Recommendations. Journal of Engineering Education, vol100 no1, 2001 pp 89-122.: 
Sanchez-Goni., ABET accreditation criteria, Outcome and global competencies in engineering education. Doctoral Dissertation. West Virginia University. 2000. Accessible from http://udini.proquest.com/view/abet-accreditation-criteria-outcome-pqid:1974028981/: 
ABET - Accreditation Board for Engineering and Technology. Accreditation Criteria for Engineering Courses. 2012. http://www.abet.org/accreditation-criteria-policies-documents/: 
Lattuca, L., Terenzini, P., and Volkwein, J.F., Center for the Study of Higher Education, The Pennsylvania State University. Engineering Change: A Study of the Impact of EC2000, Executive Summary (Baltimore, MD: ABET. Inc). 2006. Executive Summary available online at: www.abet.org/papers.shtml.: 
Spurlin, J., Assessment methods used in undergraduate program assessment. In J. Spurlin, S. Rajala, & J. Lavelle (eds.) Designing Better Engineering Education Through Assessment: A Practical Resource for Faculty and Department Chairs on Using Assessment and ABET Criteria to Improve Student Learning. Sterling, Va: Stylus Publishing. 2008.: 
Goubeaud, K., How is science learning assessed at the post-secondary level? Assessment and grading practices in college biology, chemistry and physics. Journal of Science Education Technology, vol 19, 2009. pp 237-245.: 
Goubeaud, K., How is science learning assessed at the post-secondary level? Assessment and grading practices in college biology, chemistry and physics. Journal of Science Education Technology, vol 19, 2009. pp 237-245.: 
Froyd, Jeffrey E; Ohland, Matthew W. Integrated Engineering Curricula. Journal of Engineering Education. Vol 94, no 1, January 2005: pp 147-164.: 
Froyd, J. and Frair, K., Theoretical Foundations for the Foundation Coalition Core Competencies”, Proceedings, 2000 ASEE National Conference, St. Louis, MO, 18–21 June 2000: 
Cox, M.D. and Richlin, L., Editors, Building Faculty Learning Communities. New Directions for Teaching and Learning, No. 97. San Francisco: Jossey-Bass Publishers, 2004: 
ISBN 0-7879- 7568-0.
Cox, M. D., and Sorenson, D. L., Student collaboration in faculty development: Connecting directly to the learning revolution to Improve the Academy, vol 18, 1999, pp 97-127: 
McGlothlin, W.J., Patterns of Professional Education, G.P. Putnam’s and Sons, New York, 1960.: 
Bright, A., and Philips, J. R., The Harvey Mudd Engineering Clinic: Past, Present, Future. Journal of Engineering Education. April 1999.: 
Brodeur, D. R., Crawley, E. F., Ingermarsson, I., Malmqvist, J., & Ostlund, S., International collaboration in the reform of engineering education. Proceedings of the American Society of Engineering Education Annual Conference and Exposition, Montreal, Canada. 2002.: 
Brodeur, D. R. & Crawley, E. F., CDIO and quality assurance: Using the standards for continuous program improvement. In Engineering Education Quality Assurance. Sterling Publishers. 2009.: 
Goos, M., Hughes, C., and Ann Webster-Wright, A., Building capacity for assessment leadership via professional development and mentoring of course coordinators. Australian Learning and Teaching Council Final Project Report. 2009. http://www.olt.gov.au/system/files/resources/Goos%20UQ%20Fellowship%20Report%202009.pdf Last accessed 2 April 2012.: 
Go to top