An overview of the evaluation process

Most evaluations that incorporate both formative (i.e. 'during') and summative (i.e. 'after') evaluation have the following steps, although the order in which they are undertaken may vary. There may also be some retracing of steps — e.g. during planning (at Step 3), the evaluation team may feel it necessary to revisit Steps 1 and 2, revising the evaluation objectives.
 

Steps in the process

Decision making
1.

Specify, select, refine, or modify project goals and evaluation objectives. (See Fig. 2.1 ‘Project evaluation framework’)

What is the general focus of the evaluation?

  • What is to be evaluated?
  • Why — what are the purposes?
  • Who is the evaluation for?
2.

Establish standards/criteria (performance measures) where appropriate

What benchmarks or measures will be used to evaluate the success of the project?
3.

Plan appropriate evaluation design
  • What are the key questions that need answering?
  • What is feasible in terms of budget, time, available resources and expertise?
4.

Select and/or develop data gathering methods

What information will be gathered?

  • From whom?
  • By whom?
  • How will the information be gathered?
5.

Collect relevant data
6.

Process, summarise, analyse relevant data

How will the information be analysed and interpreted, and by whom? (Criteria for judging will relate to Step 2.)
7.

Contrast data with evaluation standards/criteria
8.

Report and feedback results

How will the results be communicated?

  • To whom?
  • By when?
9.

Assess cost-benefit/effectiveness
  • What were the benefits?
  • Was the investment worth it?
  • Who will make such judgements?
10.

Reflect (evaluate) the evaluation

How will the evaluation itself be evaluated?

  • How will the design be evaluated?
  • How will you know if the evaluation is proceeding according to plan (a management issue)?
  • How will the overall evaluation effort be judged?

Throughout Steps 1-10

How will the evaluation be managed — in terms of identifying, allocating tasks, resources, personnel etc.?

 
?>?>