Evaluating impact is knowing how much people change with the program and monitoring is looking at what is happening now. Monitoring constantly checks whether the activities are being carried out. impact assessment seeks to know if these changes are due to the program and not just to the passage of time or luck. Together, they help make clearer decisions about what to keep, what to adjust, and what to scale.
How is tracking done?
Tracking is watching the show while it's happening, not just at the end. The idea is to have a simple routine to know if the activities are being carried out, if people are participating.
In practice, monitoring is set up like this:
- First, you define what you are going to review each time. For example, assistance, use of the service, calls made.
- Then, you decide how often you are going to look at it (weekly, biweekly or monthly) and who is the person responsible for updating the information.
- Finally, you agree what happens when a piece of information goes beyond what was expected. For example, if scheduled emails are not sent, if planned visits are cancelled, if fewer workshops or sessions are held than planned
You don't need a complex system, a simple dashboard with a few key metrics and a short, regular meeting to review them is enough to get started.
Why is it important to combine them?
Monitoring alone, without an evaluation framework, tends to remain in counts. Evaluation without follow-up, on the other hand, arrives late and with little capacity for adjustment. Integrating them allows:
- Detect implementation failures in weeks and correct course.
- See results (what takes time to happen) and not just outputs (what happens immediately).
- Define when to go from learning quickly to attributing changes with more rigor.
The central idea is: monitoring + evaluation = they organize learning and avoid measuring for the sake of measuring.
What to measure at each level of the program (and how detailed)
It is measured in three simple groups:
- Coordination and relationship actions: everything that has to do with moving actors so that the program exists. For example, emails sent, invitation and reminder calls, meetings with allies, articulation spaces held, documents shared.
- Direct implementation actions: are specific contacts with the population or with the teams. This can be seen in things such as sessions taught, visits made, workshops facilitated, accompaniment provided, materials delivered, field activities executed.
- Information management actions: are the steps that allow what happens in the program to be recorded. For example, completed forms, updated databases, reports uploaded to platforms, minutes prepared and shared.
From there, you can add some simple indicators from the second group (first signs of progress), for example: people who complete a course, who begin to use a service or who apply a practice that is promoted in the intervention. More profound changes are usually looked at less frequently, within specific evaluation exercises.
Guiding questions to decide what to measure can be:
- What activities are so important that, if they are not done, the program does not work?
- What early signs in people show us that we are going in the right direction?
- What deeper changes do we want to review from time to time to know if the intervention is fulfilling its promise?
Monitoring focuses on the activities that support the program and on some early signs, evaluations look, less frequently, at the deeper changes in people's lives.
How to do it?
Before filling out surveys, start with the theory of change, that is, with the road map to change the lives of others (the step by step to achieve it). From there, choose a few key indicators for each level: outputs, results and impacts.
In practice, the process looks like this:
First, define who you serve (target population) and how many people you hope to cover. Then agree on indicators that can actually be measured over time, without burning people out, for example, program attendance, average income, skill level, retention in the education system.
Next, put together a simple schedule: an initial measurement (either with baseline or retrospective baseline), a few breaks during the program (for example, every three months), and a measurement at the end. It also defines who collects the data, how consent is requested and how this data will be stored and cared for.
For monitoring, simple dashboards with a few key metrics (no more than 10) are sufficient. They can be reviewed every two weeks or every month to see if something is going out of control.
How often to measure and how to use those measurements
The frequency depends on how modifiable the indicator is. There are things that change in weeks and others that are only seen in months.
A practical way to organize it is:
- Weekly or biweekly (tracking): watch the operation. How many people attended, how many use the service, if the schedules are being met.
- Monthly or bimonthly (monitoring): Check if the first results appear: people who finish the course, changes in habits, satisfaction with the service.
- Quarterly or semiannual (impact evaluation): look more calmly at the changes in results and impacts. Here you can compare before-after and, if you have control group, differences between groups.
In each review it leaves three decisions: what to keep?, what to adjust?, what to pause? Document changes to interpret them later in the evaluation.
How to read data without deceiving ourselves
Measuring does not guarantee understanding, you have to interpret carefully. Avoid common mistakes:
- Confusing outputs with **impacts: delivering is not changing lives.
- Attribute changes without a comparison group: if there is no control group, talk about results results and explain limits of causality (explain that you cannot be sure that all the change is due to the program).
- Forget that there are different times of the year: always compare similar months or periods. For example, some attendance drops during holidays.
- Change questions or scales in each measurement: If you change the way you ask, then you cannot compare the before-after well.
- Measuring too often or too late: if you ask all the time, you tire people out; If you only ask at the end, you can't adjust anything anymore.
Honesty when reading data increases credibility and avoids promises you can't keep.
Brief Case: From Tracking to Impact
Imagine a program that seeks to reduce the youth unemployment rate, at the end of a cohort of this, the evaluation shows something curious, 79% of people are actively looking for work (they send resumes, go to fairs, apply on platforms and LinkedIn), but only 18% manage to be hired. That is, there is movement, but the result does not arrive as expected.
When reviewing the monitoring metrics, they found that the practical job interview workshops, which were a key piece of the strategy, were almost not done due to logistical problems (several sessions were cancelled, there were agenda changes and they were not rescheduled in time, etc.). When looking at the figures in more detail, the team sees that around 60% of those who applied did get to an interview, but did not pass that filter. On paper, the theory of change included those workshops, but in practice they were not executed as planned.
With that information, the decision for the next cohort is clear:
- Reactivate and prioritize practical interview workshops as a central part of the route.
- Offer additional or booster versions to people who have already gone through the program and did not receive them.
- Adjust tracking so that if a key workshop is cancelled, it is recorded and reacted quickly.
Learning is direct, impact is limited if execution is not carried out as expected. The evaluation helps to see the symptom (young people who are looking for work but are not hired), but it is the monitoring that explains what happened with the implementation and guides the specific adjustments in the program.
Frequently asked questions
/ 10
Conclusion
Assessing impact and monitoring are not separate exercises: they are parts of the same system. Monitoring allows you to see how the program is doing as it happens, evaluation helps you understand if important changes can be attributed to the program. Together, these two practices support better decisions and help deliver on the promise of social impact - changing the lives of others - with clear, honest data. Do you want to put together a simple and useful monitoring and evaluation scheme for your program? Let's talk.