Every program eventually faces the same question. The grant cycle ends, the pilot period closes, or a board meets to set next year’s budget, and someone asks whether the program should continue. This guide walks through how to answer that question with evidence rather than momentum. It covers the five questions the decision turns on, the data each one requires, and when an outside evaluator is worth bringing in.
A program continuation decision is a structured choice among four options: continue the program as it operates now, adapt it, expand it, or end it. The assessment behind that choice is sometimes called a summative evaluation, a program sustainability assessment, or a continuation review. Whatever the label, it combines evidence on outcomes, ongoing need, cost, and organizational capacity into a recommendation that a board or funder can act on.
I’m Dr. James Pann, principal consultant at EvalNetwork. For more than 25 years, I have served as the external evaluator on federally funded justice system, behavioral health, and youth development programs, and continuation decisions are among the most consequential questions clients bring to us.
Why continuation decisions go wrong without evaluation
Most programs are not continued or ended on evidence. Some continue because they already exist, because staff are committed, or because ending anything feels like failure. Others end because a champion left or a budget tightened, sometimes in the same year the program finally started working. Both errors are expensive. An ineffective program that continues spends money a stronger program could use. An effective program that ends discards years of investment spent building it.
An evaluation reframes the choice. The question is not “do we like this program?” The questions are what the program was supposed to achieve, what the evidence says it achieved, and what would happen if the resources went elsewhere. That framing also protects the people in the room. A decision grounded in data is easier to explain to funders, staff, and the community than a decision grounded in preference.
The five questions that decide whether a program should continue
1. Is the program producing its intended outcomes? This is the summative core. Set the program’s actual results next to the goals in its logic model or original proposal. Use the strongest data available: outcome measures, pre-post comparisons, benchmark data from similar programs, or participant trajectories. If the program never defined intended outcomes, that fact itself is the first finding. The assessment then starts by reconstructing them.
2. Does the need still exist? Programs are built for a moment, and moments change. A needs reassessment asks whether the population, problem, and context the program was designed for still look the way they did at launch. A program can run exactly as designed and still be the wrong program for the current need.
3. What does each outcome cost? Continuation decisions are resource decisions. The assessment should connect spending to results. Most cases do not need a formal cost-benefit analysis. A defensible cost-per-participant or cost-per-outcome figure, compared honestly against alternatives, is usually enough. A board can then weigh the program against other uses of the same funds.
4. Can the organization sustain it? A program worth continuing still needs funding stability, staff capacity, leadership support, and partnerships to survive. The Program Sustainability Assessment Tool from the Center for Public Health Systems Science at Washington University in St. Louis measures capacity across eight domains. Use it as a structured input to this question.
5. What would the program need to change to earn continuation? Strong assessments leave room between continue and end. When the evidence is mixed, name the specific adaptations, the measures that will show whether they worked, and a date to revisit the decision. The vote then becomes a manageable improvement plan with accountability built in, not only a difficult yes or no.
What data the decision needs
Begin with records the program already keeps. That usually includes attendance and participation, outcome measures, participant feedback, and whatever reporting the funder required. Most programs hold more decision-relevant data than they realize. Organizing that existing evidence is often the first step in an assessment, before anyone gathers new evidence.
Then fill the gaps deliberately. Stakeholder interviews and focus groups capture what the numbers miss: why participants stay or leave, and what staff see day to day. Where baseline data was never collected, retrospective pretest surveys can recover a credible before-and-after comparison. Assemble cost data from budgets when you can, rather than launching a new collection effort.
Structure helps. We often organize continuation assessments with the CIPP framework. Across the life of a program, that framework asks context, input, process, and product questions. The product component asks whether the program succeeded and what should happen next. That is the summative heart of a continuation decision. Our interview with Dr. Guili Zhang on the CIPP model explains the framework. Our evaluation of a university mindfulness program shows the framework applied to a real program, from logic model through evidence of impact.
When to bring in an external evaluator
Organizations can run parts of this assessment internally, and many should. An outside evaluator is most useful when the decision is contested, when the data work exceeds internal capacity, or when the stakes are high. Boards and funders often trust an independent assessment more than an internal review, because the evaluator has no stake in the outcome. Capacity gaps include outcome analysis, survey design, and reconstructing baselines. High stakes means being wrong would cost more than the evaluation, which is true for most multi-year programs.
Timing matters more than most organizations expect. The strongest continuation assessments start six months to a year before the decision date. That window leaves time to collect a final round of outcome data, instead of settling for whatever happens to be on hand.
Frequently Asked Questions About Program Continuation Decisions
How do you decide whether to continue a program?
Compare the program’s evidence against five questions: whether it produces its intended outcomes, whether the need still exists, what each outcome costs, whether the organization can sustain it, and what would need to change to justify continuation. The realistic options are continue, adapt, expand, or end. The recommendation should name which option the evidence supports and what to measure next.
What is a program sustainability assessment?
A program sustainability assessment asks whether an organization can keep a program running over time. It looks at funding stability, organizational capacity, partnerships, communications, and program evaluation itself. The Program Sustainability Assessment Tool developed at Washington University in St. Louis is a widely used instrument. It scores capacity across eight domains.
What data do you need to decide whether to keep a program?
You need outcome data set against the program’s original goals, evidence that the need remains, cost per participant or per outcome, and input from participants and staff. Attendance records, funder reports, and past surveys already hold much of this for most programs. Fill gaps with interviews, focus groups, and retrospective pretest surveys where baselines were never collected.
Should the evaluation be done internally or by an outside evaluator?
Internal teams can assemble existing data and run simple analyses. An external evaluator adds independence. Hire that help when the decision is contested, when funders and boards need a recommendation from someone with no stake in the outcome, or when the assessment requires outcome analysis or survey design beyond internal capacity.
When should a nonprofit end a program?
A program becomes a candidate for ending if the evidence shows it is not producing its intended outcomes after a fair implementation period, if the need it was built for has substantially changed, or if its costs displace stronger uses of the same resources. A documented assessment should come first, along with a plan for participants who depend on the program and clear communication with funders. Do not quietly defund it.
Facing a continuation decision?
EvalNetwork provides program evaluation consulting to nonprofits, foundations, and grant-funded organizations. That work includes independent assessments of whether a program should continue, adapt, expand, or end. We organize the evidence you already have, fill the gaps with sound measurement, and deliver a recommendation your board and funders can act on. If you are deciding whether to bring in outside help, our guide to choosing a program evaluator covers what to look for.
