Evaluation Unit (EVAL) - completed projects

Evaluation and follow-upp: the Complementary programme for physicians with a medical degree from outside the EU/EES, 2009-2014

Aim and Scope 

An evaluation of the Complementary programme for physicians with a medical degree from outside the EU/EES and Switzerland, and a follow-up of the participants´ establishment on the labour market (admission years 2009-2014). 

Funder and/or Steering Group

The higher Board of Education at Karolinska Institutet

Project Manager

Linda Sturesson

Project Assistent

Anna Dyar and Louise Bergman

Evaluation of improvements supported by quality-registers

Aim and Scope

The aim was to evaluate a program for clinicians aiming to increase the use of quality registry data in continuous improvement processes. Data was gathered using observations, document analysis, interviews and questionnaires.

Funder and/or Steering Group

Styrgruppen för Nationella Kvalitetsregister

Project Management Team

Terese Stenfors-Hayes, Helena Hvitfeldt Forsberg and Johan Thor (KI)

Publications and Presentations

Coaching Data-Driven Healthcare Improvement: Microsystemfestivalen, februari 2014

Att mäta och förbättra vårdens kvalitet med hjälp av kvalitetsregister – framgångar, utmaningar och möjligheter, Nationella kvalitetsregisterkonferensen januari 2015

Testing of an instrument for assessing profession focus in examinations

Aim and Scope

The aim of the project was to explore the degree to which assessments in medical education have a focus on the future profession. We had constructed an instrument, Evaluation Structure with Questions for Alignment of Profession and Education (ESQAPE), designed to evaluate the profession focus in medical education. This project was to evaluate the instrument.

Funder and/or Steering Group

Rosanders Stiftelse

Project Management Team

Daniel Gustavsson, Anna Josephson and Terese Stenfors-Hayes (KI)

Doctoral Education Exit poll 2015

Aim and scope

The aim of the project was to analyze data from collected by the Board of Doctoral Education for their exit poll 2015. Since the exit poll had been conducted in two different computer programs the commission consisted of merging the data, conducting the analysis and then writing the report in collaboration with the Board of Doctoral Education.  From the analysis, conclusions about the quality of the doctoral education at KI could be made.

Funder and/or steering Group

Board of Doctoral Education

Project Management Team

Louise Bergman, Aleksandra Sjöström-Bujacz, Karin Vågstrand (KI)

Report: Exit Poll for Doctral Students. Results from 2015 and comparison with previous years  

Employability survey

Aim and Scope

The aim of the project is to develop a process and tool for a mandatory employability survey to be used by all study programs on undergraduate level at Karolinska Institutet. The survey should investigate whether the study programs correspond to employer demands and how employable students are after graduation.

Funder and/or Steering Group

The Board of Education

Project Management Team

Anna Bonnevier, Anna Josephson and Terese Stenfors-Hayes (KI)

Cross-cultural comparison on doctoral experience

Aim and Scope

The research project aims to gain better understanding of successful doctoral journey by carrying out international comparison. The purpose is to obtain an overview of the current state and central development needs of the doctoral education by exploring doctoral experience across five European countries. The focus is on exploring doctoral experience, and in identifying core regulators of doctoral studies, including risk factors/buffers for attrition and prolonged studies. Both promoting and hindering factors within doctoral journey will be explored. Cross-cultural comparison enables identification of both contextual features as well as invariants of the doctoral experience across the countries, doctoral education systems, and disciplines. The investigation also enables identifying, analyzing and explaining similarities and differences across the disciplines and different kinds of doctoral education models.

Funder and/or Steering Group 

Data collection at KI was funded by The Board of Research Education (KI)

Project Manager

Kirsi Pyhältö, University of Helsinki

Project Management Team (KI)

Aleksandra Bujacz, Terese Stenfors-Hayes, Juha Nieminen, and Cormac Mcgrath

Pilot study: New course evaluation system for post graduate education courses 

Aim and Scope

The aim of the pilot study was to set up and to ensure a process of course and activity evaluation. The Evaluation Unit has from the spring semester 2016 the assignment to run course and activity evaluations for post graduate education. This includes sending out the questionnaires; assist with consultations regarding possible additional questions; compiling the answers to reports that will be used for feedback to participants and course organizers, linked in the course catalogue and sent to central administrative officers for quality assurance (autumn 2015).  

Funder and/or Steering Group

The Board of Research Education (KI)

Project Manager

Linda Sturesson

Evaluation of the project Future education leaders 

Aim and Scope

To evaluate the one year project Future education leader, a program for teachers and researchers at Karolinska Institutet with leading rolls and different responsibilities in the first cycle and second cycle education. The overall objective for the program was to ensure the future supply of scientifically qualified educational leaders in order to achieve high quality (autumn 2015).

Funder and/or Steering Group

The Board of Higher Education at Karolinska Institutet 

Project Manager

Linda Sturesson

Evaluation of progress tests used in the general practice specialty training

Aim and Scope

The aim of the project is to evaluate the attitudes towards progress testing during the general practice specialty training.

Residents are introduced to the concept of progress testing and are asked to fill out a questionnaire Results will be analyzed regarding the motivation to learn, reactions to being tested by using progress testing and the feeling of usefulness in self-directing the specialty training. 

Project Management Team

Remy Waardenburg, Aleksandra Bujacz and Terese Stenfors-Hayes (KI&SLL)

Quality assurance and evaluation plan for post graduate education

Aim and Scope

The aim of the project was to develop a process for evaluation and quality assurance of the graduate education programs at Karolinska Institutet.

Funder and/or Steering Group

The Board of Research Education

Project Management Team

Terese Stenfors-Hayes and Linda Sturesson (KI)

A quality assurance plan for first- and second-cycle courses and study programs

Aim and Scope

The aim of the project was to develop a plan for quality assurance of first- and second-cycle courses and study programs at Karolinska Institutet. This plan provides regulations for quality assurance procedures, functions as a guideline for boards or departments and supports teachers during quality enhancement activities.

Funder and/or Steering Group

The Board of Education

Project Management Team

Terese Stenfors-Hayes, Anna Bonnevier, Aleksandra Bujacz and Linda Sturesson

Publications and Presentations

Action plan for quality evaluation of first cycle and second cycle education at Karolinska Institutet

Development and validation of a mandatory course evaluation questionnaire

Aim and Scope

The aim of the project was to develop, implement and validate a mandatory course experience questionnaire to be used by all first- and second cycle courses at Karolinska Institutet. The content of the questionnaire should address important strategic areas and the tool provide opportunities for comparisons between and within courses. 

Funder and/or Steering Group

The Board of Education

Project Management Team

Terese Stenfors-Hayes, Anna Bonnevier, Aleksandra Bujacz, Linda Sturesson and project team (KI)

Publications and Presentations

Handlingsplan för kvalitetsutvärdering på grundnivå och avancerad nivå

Web page

Evaluation of a student-led primary health care center

Aim and Scope

To evaluate the student-led primary care clinic in Gustavsberg. Data is gathered from patients, students and staff.

Funder and/or Steering Group

ALF (education)

Project Management Team

Terese Stenfors-Hayes, Sandra Astnell, Maria Fröberg, Charlotte Leanderson, Kersti Ejeby, Erik Hedman, Ulrica Gillblad, Annika Pettersson, Birgitta Fläckman and Gunnar Nilsson (KI&SLL)

Employees’ experiences of how work environment and patient care were influences by changes in scheduling of physicians

Aim and Scope

The aim of the project was to investigate how employees at the Orthopedic Clinic experienced their work environment and care of patients as influenced by changes in the orthopedic doctors working schedule.

Interviews were conducted with staff members at the clinic and based on the findings, a questionnaire was developed and distributed to all staff members.

Funder and/or Steering Group

Sari Ponzer, Operations Manager of the Orthopedic Clinic at Södersjukhuset

Project Management Team

Terese Stenfors-Hayes and Anna Bonnevier (KI)

Publications and Presentations

Report 2014

Distance course format and campus course format in specialist training of nurses: What are the differences and similarities?

Aim and Scope

The aim of the project was to compare differences and similarities between a course given in two different formats: as a distance part-time course and as a regular campus based full-time course. The quality of the course was measured in reference to the expectations and regulations of the National Agency for Higher Education.

Funder and/or Steering Group

The Specialist Nursing Study Program

Project Management Team

Anna Bonnevier and Hans Hindbeck (KI)

Publications and Presentations

Please contact Anna Bonnevier for a copy of the report.

Evaluation of a mentorship program for dental students

Aim and Scope

The aim of the project was to evaluate the mentor program, a part of the undergraduate dentist program. The evaluation included both student and mentor perspective.

Project Management Team

Terese Stenfors-Hayes, Lars-Erik Lindgren Lena Boman and Sofia Traneaus (KI)

Publications and Presentations

Stenfors-Hayes, T., Lindgren, L-E., Traneaus, S. (2011) Perspectives on being a mentor for undergraduate Dental students. European Journal of Dental Education 15(3):153-158.

Assessment criteria for the examination of manual skills

Aim and Scope

The aim of the project was to develop assessment criteria to be used in examination and training. Interviews were conducted with students and faculty in dentistry.

Funder and/or Steering Group

KI pedagogiska projektmedel 2010

Project Management Team

Anna Hartman and Terese Stenfors-Hayes (KI)

Longitudinal Clinical Medical Education (Samläk)

Aim and Scope

The aim of the project was to investigate aspects of a longitudinal clinical medical education as an arena for medical education.

Funder and/or Steering Group

ALF funding/Samläk-project steering comittee, Karolinska Institutet, Södersjukhuset

Project Management Team

Sari Ponzer, Margaretha Forsberg Larm, Uffe Hylin, Susanne Kalén, Anna Bonnevier, Terese Stenfors-Hayes and Hans Hindbeck (KI&SLL)

Publications and Presentations

Samläk: Sammanhållen klinisk läkarutbildning vid KI SÖS Projektrapport 2009

Evaluation