- Lodestar (Professional Evaluators) | Factors to consider | Evaluation Notes
Lodestar (Professional Evaluation Team)
- Morgan: MorganL@lmresearch.org
- Monica: MonicaK@lmresearch.org
- Sally: SallyB@lmresearch.org
- Mail to entire evaluation team.
-
Factors to consider when evaluating the effectiveness of the CSP.
-
Notes adapted from a presentation by Dr. Howard Levine: CSP Meeting 9/00
-
EVALUATION = THE DETERMINATION OF WORTH, MERIT, or VALUE
- 3 STEPS TO BRIDGING THE FACTS TO VALUE GAP
- 1. Clarity in the five key areas of evaluation questions:
- a. WHO - Teacher-participants
- b. WHAT - Content Knowledge
- c. WHY- Assessment of needs; Determination of Success
- d. WHEN - Intervention; Formative; Summative
- e. WHOM - Teacher-participants; Districts; CSP
- 2. What are the CRITERIA that must be collected to answer the questions and bridge the gap? All evaluations have 4 generic criteria:
- a. Description - Achieving stakeholder agreement about 1a.-e. above (e.g., what does content knowledge include)
- b. Need/Market - number affected, social significance, absence of substitutes, multiplier effect, dissemination plan
- c. Performance/Outcomes - intended effects (e.g., gains on pre-post instruments), unintended effects, secondary effects (e.g., improved student scores)
- d. Comparisons - treatment vs. no treatment (robust correlation), existing competitors, cost-effectiveness, standards
- 3. What are the TECHNIQUES needed to collect the evidence (data) of the criteria (e.g., content knowledge)?
- a. Pre-post instruments
- b. Lesson plans
- c. Concept maps
- d. Classroom observations
- e. Science journals
- f. Questionnaires
- g. Portfolio assessment
- h. Projects (e.g., science station development)
- i. Additional science activities (e.g., family science, web sites)