home / skills / a5c-ai / babysitter / program-evaluation

This skill helps design and implement rigorous program evaluations using logic models and mixed methods to improve interventions.

npx playbooks add skill a5c-ai/babysitter --skill program-evaluation

Review the files below or copy the command above to add this skill to your agents.

Files (1)
SKILL.md
2.0 KB
---
name: program-evaluation
description: Design and implement formative, summative, and developmental evaluations using logic models and mixed methods
allowed-tools:
  - Read
  - Write
  - Edit
  - Grep
  - Glob
  - Bash
---

# Program Evaluation Skill

Design and implement rigorous evaluations of social programs and policy interventions using established frameworks.

## Overview

The Program Evaluation skill enables design and implementation of formative, summative, and developmental evaluations using logic models, theory of change frameworks, and mixed methods approaches for assessing program effectiveness and informing improvement.

## Capabilities

### Evaluation Design
- Formative evaluation
- Summative evaluation
- Developmental evaluation
- Impact evaluation
- Process evaluation

### Logic Models
- Theory of change development
- Input-output mapping
- Outcome identification
- Assumption articulation
- Indicator specification

### Data Collection
- Multiple data sources
- Quantitative measures
- Qualitative methods
- Mixed approaches
- Participatory methods

### Analysis and Reporting
- Outcome measurement
- Attribution assessment
- Cost-effectiveness analysis
- Stakeholder reporting
- Recommendation development

### Utilization Focus
- Stakeholder engagement
- Use identification
- Findings translation
- Recommendation implementation
- Learning facilitation

## Usage Guidelines

### When to Use
- Assessing program effectiveness
- Improving interventions
- Supporting decision-making
- Demonstrating accountability
- Building evidence base

### Best Practices
- Engage stakeholders early
- Clarify evaluation questions
- Use multiple methods
- Consider context
- Focus on utilization

### Integration Points
- Causal Inference Methods skill
- Mixed Methods Integration skill
- Policy Communication skill
- Quantitative Methods skill

## References

- Program Evaluation process
- Policy Impact Assessment process
- Cost-Benefit Analysis process
- Program Evaluation Specialist agent

Overview

This skill designs and implements formative, summative, and developmental evaluations using logic models, theory of change, and mixed methods. It helps teams clarify outcomes, specify indicators, and generate actionable findings for program improvement and accountability. The focus is on practical, stakeholder-centered evaluation that supports decision-making and learning.

How this skill works

The skill guides creation of logic models and theories of change, maps inputs to outputs and outcomes, and articulates assumptions and indicators. It supports mixed-methods data collection (quantitative, qualitative, participatory) and combines process and impact analyses to assess effectiveness and attribution. Outputs include analysis, cost-effectiveness assessments, stakeholder reports, and implementation-focused recommendations.

When to use it

  • Designing an evaluation plan for a new or scaled program
  • Assessing program effectiveness for funders or oversight bodies
  • Improving ongoing interventions through formative feedback
  • Documenting impact and attribution for accountability or publication
  • Integrating stakeholder perspectives into evaluation and learning

Best practices

  • Engage stakeholders early to define evaluation questions and uses
  • Specify a clear logic model or theory of change before data collection
  • Use mixed methods to triangulate findings and strengthen validity
  • Align indicators with available data and feasibility constraints
  • Produce usable recommendations tied to implementation and resources

Example use cases

  • Create a theory of change and indicator matrix for a community health program
  • Design a mixed-methods formative evaluation to refine a pilot intervention
  • Conduct a summative impact evaluation with attribution and cost-effectiveness analysis
  • Run a developmental evaluation to adapt an innovation in complex, changing contexts
  • Generate stakeholder-facing reports and implementation recommendations to support scaling

FAQ

What types of evaluation does this skill cover?

It covers formative, summative, developmental, process, and impact evaluations, including logic model development and mixed-methods designs.

How does the skill handle attribution and causality?

It integrates causal inference approaches where appropriate, combines quantitative and qualitative evidence, and documents assumptions to support attribution judgments.