PCORI Engagement Activity Inventory (NET-ENACT AND WE-ENACT)
Objective
(1) To capture researchers’ experience with patient and other stakeholders engagement in research, (2) to describe the role of patients and other health care stakeholders in research projects, and (3) to describe engagement in research from the researcher point of view.
Reference
“How We Evaluate Key Aspects of Our Work”, on pcori website, consulted : June, 15th 2017.
Online : https://www.pcori.org/about/evaluating-our-work/evaluating-key-aspects-our-work
* The Net-ENACT tool is currently in development.
Evaluation
Assessment Grid
We provide a score of five points for each of the following four criteria:
- Scientific rigor: Was the development of the assessment tool scientifically rigorous and evidence-based on patient and public engagement?
- Patient and Public Perspective: Does the assessment tool take into account the views of patients and the public (both in their development and use)?
- Comprehensiveness: Is the tool comprehensive in evaluating the context, process, outcomes and impacts of patient and public engagement?
- Usability: Is the evaluation tool easy to use?
Each criterion has 5 question-items. We gave 1 point per item if the answer to the question was YES, 0 points if the answer was NO or CANNOT ANSWER.
Scientific Rigour
Patients and Public Perspective
Comprehensiveness
Usability
Scientific Rigour
- Is the evaluation tool based on a comprehensive literature review on patient and public engagement research?
- Is the evaluation tool based on the experience/expertise of key stakeholders?
- Is the evaluation tool based on a conceptual/theoretical framework of patient and public engagement?
- Was the evaluation tool tested for validity (i.e., the tool evaluates what it is purported to evaluate)?
- Was the evaluation tool tested for reliability (i.e., the tool produces stable and consistent results)?
Patients and Public Perspective
- Were patients and/or the public involved in the development of the evaluation tool?
- Is the tool designed to be completed by patients and/or members of the public (self-administered)?
- Does the tool explicitly state that the evaluation results must be reported back to patients and the public?
- Was the tool specifically designed to evaluate patient and public engagement activities?
- Does the tool capture the influence of patients and the public? (e.g., on the engagement process, on the final decisions, etc.)
Comprehensiveness
- Does the tool document the context of engagement?
- Does the tool document the process of engagement?
- Does the tool document the outcome/impact of engagement?
- Does the tool monitor the engagement process at multiple moments?
- Does the tool consist of a set of open and closed questions?
Usability
- Is the purpose of the evaluation tool stated?
- Is the evaluation tool freely available?
- Is the evaluation tool available in an applicable format?
- Is the evaluation tool easy to read and understand?
- Is the tool accompanied by instructions for use?