Indicator

Data collection procedure

Results, requirements and interpretation

Use

Method and instrument

Coverage (or scope): number or proportion of the target population and/or the intermediary population reached.

Instrument: questionnaires, interviews or observation logs to collect information about:

• Number of target population.
• Number of intermediary population.
• Characteristics of the participants (as defined in the intervention: age, educational level, etc.)

Some questions about coverage:

How many people have participated in the activity/treatment?

How many people have received the intervention material?

What are the characteristics of the people participating in the activity/treatment?

Quantitative and qualitative information from the administrators

• Expressed in absolute numbers and percentages.
• Qualitative information on participant profiles is required.
• Details of the population to be reached with the intervention (number and characteristics).
• Setting a minimum coverage threshold (e.g., reaching 40% of the population).

• Understanding whether the actions need to be adjusted to reach the estimated population participating in the intervention.
• Interpreting the results of the intervention according to population coverage.

Exhaustiveness (implementation of the actions):

Number and type of actions implemented.

Instrument: questionnaires, interviews or observation logs to collect information about:

• Number and type of actions implemented.
• Duration of the activity/treatment.
• Location of the intervention.
• Procedure and materials used.
• Incidents, etc.

Some questions on action implementation:

What percentage of the activities has been carried out?

Which activities have been carried out in the intervention?

What procedures and materials have been used?

How long have the activities lasted?

• Expressed in absolute numbers and percentages, or implementation conditions are described if the information is qualitative.
• Details of the actions carried out.
• Evaluating quality: set a minimum implementation threshold and type of action (e.g., to carry out at least 70% of the planned actions).

• Understanding the degree of implementation of the actions and/or the intervention in general.
• Adjusting action plan activities.
• Interpreting the results of the intervention according to the level of implementation.

Accuracy (adherence).

Implementation of the actions according to the proposed plan.

This is an indicator of intervention quality.

Instrument: questionnaires, interviews or observation logs to collect information about:

• Number and type of actions implemented.
• Duration of the activity.
• Location of the intervention.
• Procedure and materials used.

Some questions on accuracy:

Has the programme been implemented as described in the action plan?

How has the action plan been implemented?

How long have the actions lasted?

Quantitative and qualitative information from the administrators

Example of instruments to measure compliance with the intervention plan.

• Expressed in absolute numbers and percentages, or implementation conditions are described if the information collected is qualitative.
• A previous action plan is required.
• To evaluate quality: set a minimum implementation threshold for the number of actions or sessions and their type (e.g., to carry out at least 60% of the proposed actions of content X).

• Understanding how much the intervention adheres to or deviates from the proposed actions. 
• Interpreting the results of the intervention according to the degree of compliance with the proposed plan.

Adequacy of actions.

Cultural relevance, understanding and adequacy of actions

Instrument: questionnaires, interviews or observation logs to collect information about:

• Understanding and relevance of the contents.
• Language (cultural) adequacy.
• Adequacy of the materials/format/medium used for messages.

Some questions on adequacy:

Has the content of the activities been understood?

Is the information transmitted in a language appropriate to the characteristics of the population?

Is the format of the actions suitable?

How is intervention accessibility rated?

• Expressed in absolute numbers and percentages, or adequacy conditions are described if the information collected is qualitative.

• Understanding the degree of adequacy of the intervention.
• Adapting the actions to the characteristics of the population and the administrators.
• Modifying or removing components of the action plan that provoke rejection in the target population or administrators.

Participant satisfaction.

Appeal of the actions.

Instrument: questionnaires, interviews or observation logs to collect information about:

• Satisfaction of intervention users (score or scale)
• Satisfaction of intervention administrators when carrying it out (score or scale).
• Description of what has been more/less pleasant.

Some questions on satisfaction:

What is the overall satisfaction with the programme?

What do you like most/like least?

Would you recommend this activity/intervention?

Quantitative and qualitative information from the target population, intermediary population and administrators.

• Expressed in absolute numbers and percentages, or the degree of satisfaction is described if the information collected is qualitative.

• Understanding participant/administrator satisfaction with the actions and/or intervention in general.
• Adapting the actions to the characteristics of the population and the administrators.
• Changing components of the action plan to improve satisfaction. 

Participant involvement.

Interest and participation in the actions.

Instrument: questionnaires, interviews or observation logs to collect information about:

- Population interest in the intervention.

- Population participation in the activities.

Some questions on involvement:

How is population interest in the intervention rated?

To what extent is the population involved in the intervention?

Quantitative and qualitative information from the target population, intermediary population and administrators.

An example of an instrument to measure the involvement of participants in an activity: 

• Expressed in absolute numbers and percentages, or the level of participant involvement is described if the information collected is qualitative.

• Understanding participant/administrator involvement with the actions and/or intervention in general.
• Adapting the actions to the characteristics of the population and administrators.
• Changing components of the action plan to increase involvement.