Public Involvement Impact Assessment Framework (PIIAF)
Objective
To help researchers assess the impacts of involving members of the public in health and social care research.
Reference
Popay, J., M. Collins, and with the PiiAF Study Group. “The public involvement impact assessment framework guidance.” Universities of Lancaster, Liverpool and Exeter (2014).
Download : http://piiaf.org.uk/documents/piiaf-guidance-jan14.pdf
Assessment
Assessment Grid
We provide a five-point rating for each of the following four criteria:
- Scientific Rigour: Was the development of the evaluation tool scientifically rigorous and based on existing evidence on patient and public engagement?
- Patient and Public Perspective: Does the evaluation tool take into account the views of patients and the public (both in its development and use)?
- Comprehensiveness: Is the tool comprehensive in evaluating the context, process, outcomes and impacts of patient and public engagement?
- Usability: Is the evaluation tool easy to use?
Each criterion has 5 question-items. We gave 1 point per item if the answer to the question was YES, 0 points if the answer was NO or CANNOT ANSWER.
Scientific Rigour
Patient and Public Perspective
Comprehensiveness
Usability
Scientific Rigour
- Is the evaluation tool based on a comprehensive literature review on patient and public engagement research?
- Is the evaluation tool based on the experience/expertise of key stakeholders?
- Is the evaluation tool based on a conceptual/theoretical framework of patient and public engagement?
- Was the evaluation tool tested for validity (i.e., the tool evaluates what it is purported to evaluate)?
- Was the evaluation tool tested for reliability (i.e., the tool produces stable and consistent results)?
Patient and Public Perspective
- Were patients and/or the public involved in the development of the evaluation tool?
- Is the tool designed to be completed by patients and/or members of the public (self-administered)?
- Does the tool explicitly state that the evaluation results must be reported back to patients and the public?
- Was the tool specifically designed to evaluate patient and public engagement activities?
- Does the tool capture the influence of patients and the public? (e.g., on the engagement process, on the final decisions, etc.)
Comprehensiveness
- Does the tool document the context of engagement?
- Does the tool document the process of engagement?
- Does the tool document the outcome/impact of engagement?
- Does the tool monitor the engagement process at multiple moments?
- Does the tool consist of a set of open and closed questions?
Usability
- Is the purpose of the evaluation tool stated?
- Is the evaluation tool freely available?
- Is the evaluation tool available in an applicable format?
- Is the evaluation tool easy to read and understand?
- Is the tool accompanied by instructions for use?