Scottish Health Council Participation Evaluation Toolkit
- Scientific Rigour
- Patient and Public Perspective
Multiple instruments meant at planning evaluation projects and to track progress; develop interviews, focus groups, questionnaires, surveys etc.; promote good practice and assure staff-led Patient Focus and Public Involvement work; ensure that learning points and actions are identified and implemented or taken forward appropriately; plan, check and/or audit actions for evaluation findings; and improve practices of involvement.
Scottish Health Council, “Evaluating Participation. A guide and toolkit for health and social care and practitioners”, 2014. 34p
* tools can be found at p. 145 to p. 151
We provide a five-point rating for each of the following four criteria:
- Scientific Rigour: Was the development of the evaluation tool scientifically rigorous and based on existing evidence on patient and public engagement?
- Patient and Public Perspective: Does the evaluation tool take into account the views of patients and the public (both in its development and use)?
- Comprehensiveness: Is the tool comprehensive in evaluating the context, process, outcomes and impacts of patient and public engagement?
- Usability: Is the evaluation tool easy to use?
Each criterion has 5 question-items. We gave 1 point per item if the answer to the question was YES, 0 points if the answer was NO or CANNOT ANSWER.
- Is the evaluation tool based on a comprehensive literature review on patient and public engagement research?
- Is the evaluation tool based on the experience/expertise of key stakeholders?
- Is the evaluation tool based on a conceptual/theoretical framework of patient and public engagement?
- Was the evaluation tool tested for validity (i.e., the tool evaluates what it is purported to evaluate)?
- Was the evaluation tool tested for reliability (i.e., the tool produces stable and consistent results)?
- Were patients and/or the public involved in the development of the evaluation tool?
- Is the tool designed to be completed by patients and/or members of the public (self-administered)?
- Does the tool explicitly state that the evaluation results must be reported back to patients and the public?
- Was the tool specifically designed to evaluate patient and public engagement activities?
- Does the tool capture the influence of patients and the public? (e.g., on the engagement process, on the final decisions, etc.)
- Does the tool document the context of engagement?
- Does the tool document the process of engagement?
- Does the tool document the outcome/impact of engagement?
- Does the tool monitor the engagement process at multiple moments?
- Does the tool consist of a set of open and closed questions?
- Is the purpose of the evaluation tool stated?
- Is the evaluation tool freely available?
- Is the evaluation tool available in an applicable format?
- Is the evaluation tool easy to read and understand?
- Is the tool accompanied by instructions for use?
An initiative of the Université de Montréal
Direction collaboration partenariat patient
Faculté de médecine de l'Université de Montréal
Canada Research Chair in Patient and Public Partnership
CHUM Research Centre
Institut de recherche en santé publique de l'Université de Montréal
Canadian Foundation for Innovation