Projects at Evaluation Unit (EVAL)
All of our projects rely on state-of-the-art research and have a strong scientific foundation, regarding both the field of the evaluation and the evaluation methods used.
Our team of evaluation experts can help with anything from a short consultation to designing and conducting large evaluations including multiple data sources and evaluation methods. We can:
- Design, plan and conduct evaluations for your research project, course, innovation, or intervention.
- Assess and advise in evaluation design and instruments (surveys, interview guides, observation templates etc.)
Our evaluations have covered diverse subjects such as patient experience, IT support, collaboration, animal welfare, and education.
Previous stakeholders for these kinds of projects include research groups; Stockholm County Council; National Board of Health and Welfare; interest associations such as patient organisations; educators; central administrative functions; and departments both within and outside of KI.
Evaluation of courses, programmes and teaching innovations
We evaluate courses as well as whole programmes, teaching methods, and other innovations for learning, such as mentor programmes. In this area, we have recently worked with:
- Programme for future education leaders: Participants were teachers and researchers with leading roles and different responsibilities in the first cycle and second cycle education (undergraduate and master’s level) at Karolinska Institutet. To evaluate the programme, we studied course material and conducted and analysed semi-structured participant interviews.
- A student-led primary health care clinic: For this evaluation, data from patients, students and supervisors were gathered using questionnaire surveys and interviews. This evaluation resulted in further research collaboration funded by Stockholm County Council and a publication.
- Evaluation of a programme for clinicians aiming to increase the use of quality registry data in continuous improvement processes: Data were gathered using observations, document analysis, interviews and questionnaires.
- Evaluation of complementary programmes for nurses, dentists and physicians with degrees from outside the EU/EEA and Switzerland. Depending on profession, the programmes ran at Gothenburg University, Karolinska Institutet and/or Linköping University. The programmes were evaluated and participant follow-up concerned primary employment. Methods used were both quantitative (e.g. in the form of questionnaires sent to previous participants and registry data) and qualitative (based on semi-structured interviews with previous participants):
> Utvärdering och uppföljning: Kompletteringsutbildningen för sjuksköterskor med examen från land utanför EU/EES, 2009-2015
> Utvärdering och uppföljning: Kompletteringsutbildningen för läkare med examen från land utanför EU/EES, 2009-2014
> Läkartidningen kommenterar rapporten av kompletteringsutbildningen för läkare med examen från land utanför EU/EES, Läkartidningen (March 2017)
> Utvärdering och uppföljning: Kompletterande utbildning för tandläkare med examen från land utanför EU/EES samt Schweiz 2010–2016.
Development of education quality systems
We are working together with different education programmes to develop functional, effective and useful quality systems with the goal of enhancing the quality of the education. Within these projects we develop reliable and valid ways to measure the students’ experience of their education.
We have an ongoing collaboration with Karolinska Institutet’s Speech Therapy and Medical programmes, where we follow and support the programmes’ continuous efforts to improve educational quality. These efforts include giving advice on all of the programmes’ student evaluation surveys, analysing these surveys and giving recommendations on what needs to be improved and why.
We have together with Nordic Consortium for Laboratory Animal Science Education and Training (NCLASET) created, developed and refined a quality-assurance framework that supports the development of a quality culture. This framework also actively contributes to the quality monitoring of the consortium´s training modules used by a large number of stakeholders nationally.
Employees’ experiences of how work environment and patient care were influenced by changes in scheduling of physicians
The aim of the project was to investigate how employees at a clinic experienced their work environment and care of patients as influenced by changes in the doctors’ working schedule. Interviews were conducted with staff members at the clinic, and based on the findings a questionnaire was developed and distributed to all staff members.