The field of evaluation is plagued with definitional problems, some of which are important and others mere pedantry. The terms “monitoring” and “evaluation” are one such example; for many people monitoring is seen as a subset of evaluation while others see them as quite distinct. At Nexus, we develop many monitoring and evaluation (M&E) frameworks, and our approach is to clearly differentiate between the two to help our clients track and assess their projects effectively.
We use the term monitoring to refer to the systematic, routine gathering and reporting of operational data. These data are usually collected regularly – be it daily, weekly, monthly, or annually – and often track activities and outputs and, ideally, outcomes if practicable. For example, monitoring can show if a program is meeting its targets by counting metrics like attendance, delivery rates, or other measurable indicators of activity. Ideally, monitoring systems works best and are easiest when data is an administrative by-product of running the program.
Monitoring is used to give program managers timely feedback on whether everything is proceeding according to plan. It enables teams to spot potential issues, make adjustments in real-time, and ensure that resources are being used effectively. Monitoring ensures you stay aligned with project goals, and it provides the groundwork for deeper analysis later.
The sense in which we use the term evaluation, in contrast to monitoring, is an opportunity to undertake special data collection or analysis to capture more detail and occasionally additional analysis of routinely collected data. These additional data collections, which can be quantitative and qualitative, provide more detailed and nuanced insights into your program and its effects. This level of analysis is crucial for identifying areas for improvement and informing future decisions, as well as for meeting accountability requirements. Evaluations can also encompass more methodologically rigorous approaches such as quais-experimental studies that are usually not available to monitoring systems.
Evaluation can help answer “bigger picture” questions such as whether the program was successful in achieving its intended outcomes, what factors contributed to or hindered success, or how the program could be improved.
In practice, monitoring and evaluation work best together. Monitoring is necessary for providing a real-time view of operational progress, whilst through evaluating you can identify improvement opportunities and insights into program effectiveness that can guide strategic decision making. By distinguishing between these two practices, organisations can ensure a well-rounded view of a project’s trajectory and its results, enabling teams to make data-informed decisions that enhance long-term outcomes.
At Nexus, we are experts in helping organisations develop tailored monitoring and evaluation (M&E) plans that clearly distinguish between monitoring and evaluation activities. Most recently, we have developed a number of M&E plans in the health sector (e.g. the NSW virtual care strategy; emergency department and hospital relief packages; a new state-wide menopause service; the Isolated Patients Travel and Accommodation Scheme; a virtual rural generalist service), for local government (Newcastle City Council), and for the Department of Customer Service strata management reforms. If you are interested in developing a monitoring and evaluation plan, get in touch with the Nexus team today.
