A unique aspect of the LSC initiative was the creation of a cross-project "core" evaluation system. The goal of the evaluation system was not only to allow local project evaluators to examine individual projects, but also to allow for aggregation of data across projects to glean broader insights about the design, quality, and impact of the LSCs. Project evaluators collected data using standardized questionnaires and protocols designed to answer core evaluation questions. The methodology section describes the core evaluation data collection system and the strategies used to analyze the data.
Core Evaluation Data Collection
Project evaluators were asked to collect data using standardized questionnaires and protocols designed to answer core evaluation questions, and to complete ratings on the quality of LSC professional development programs. Data collection activities completed by evaluators of each LSC project included the following:
- Observations of professional development activities (details);
- Classroom observations (details);
- Teacher questionnaires (details);
- Principal questionnaires (details); and
- Teacher interviews (details).
Additional data collected from the LSCs included:
- HRI Interviews with LSC Principal Investigators (details);
- Project ratings completed jointly by evaluators and PIs (details); and
- Project strategies questionnaires completed jointly by evaluators and PIs (details).
A variety of strategies were used in analyzing the LSC core evaluation data. Quantitative data were typically analyzed using various forms of regression modeling, including hierarchical modeling (HLM or HGLM) and path analysis. No predetermined coding scheme was used in the analysis of qualitative data. Rather, themes were developed as they emerged from the data.