donor evaluation consultants Kenya: commissioning evidence that decision-makers can use
donor evaluation consultants Kenya should begin with the programme decision, evaluation questions, intended users, target populations and the evidence needed for accountability and learning. The design should be proportionate to the decision and explicit about limitations.
Key takeaways
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Evaluation questions and evidence needs
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Evaluation design
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Sampling and stakeholder coverage
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Quantitative and qualitative methods
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Data quality assurance
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Ethics, safeguarding and privacy
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Analysis and triangulation
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Assessing outcomes and contribution
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Learning and recommendations
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Common commissioning mistakes
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
What this means for your organization
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Selecting an evaluation partner
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Using findings after the report
Define the decision first, then select methods that can credibly answer it. Quantitative evidence can measure patterns and change; qualitative evidence can explain context, mechanisms and stakeholder perspectives. Sampling, fieldwork controls and analysis should be documented. Kenya’s geographic and social diversity means findings should clearly state the populations and locations represented.
Recommendations should be traceable to evidence and distinguish observed findings from interpretation. Where attribution is not supported by the design, report contribution and plausible alternative explanations rather than claiming causation. Agree action owners and learning questions before the final report so evidence can influence implementation.
Evaluation decision framework
| Question | Evidence | Output |
|---|---|---|
| What changed? | Baseline/endline or outcome measures | Change assessment |
| Why? | Implementation and stakeholder evidence | Contribution analysis |
| For whom? | Segmented findings | Equity and reach analysis |
| What next? | Evidence strength and feasibility | Prioritized recommendations |
Frequently asked questions
When should evaluation planning begin?
Ideally before implementation or early enough to establish useful baselines and data systems.
Which methods are appropriate?
Methods should follow the evaluation questions, available comparison evidence, population and ethical constraints.
What should a final evaluation report contain?
Questions, methodology, sample, limitations, findings, triangulated analysis, conclusions, recommendations and a clear evidence trail.
How Walaco Africa can help
Explore Monitoring and Evaluation, Perception Surveys and contact Walaco Africa.