Dr. Michal Perlman

Professor, University of Toronto and Director, Dr. R.G.N. Laidlaw Research Centre, University of Toronto


Curriculum vitae



416-978-0596


Ontario Institute for Studies in Education (OISE)

University of Toronto

252 Bloor Street West
Toronto, Ontario, Canada
M5S 1V6


Understanding variation in classroom quality within early childhood centers: Evidence from Colorado's Quality Rating and Improvement System


Journal article


Karoly L.A., Zellman G.L., M. Perlman
vol. 28, 2013, pp. 645-657

DOI: doi.org/10.1016/j.ecresq.2013.05.001

View PDF
Cite

Cite

APA   Click to copy
Karoly, L. A., Zellman, G. L., & Perlman, M. (2013). Understanding variation in classroom quality within early childhood centers: Evidence from Colorado's Quality Rating and Improvement System, 28, 645–657. https://doi.org/doi.org/10.1016/j.ecresq.2013.05.001


Chicago/Turabian   Click to copy
Karoly, L.A., G.L. Zellman, and M. Perlman. “Understanding Variation in Classroom Quality within Early Childhood Centers: Evidence from Colorado's Quality Rating and Improvement System” 28 (2013): 645–657.


MLA   Click to copy
Karoly, L. A., et al. Understanding Variation in Classroom Quality within Early Childhood Centers: Evidence from Colorado's Quality Rating and Improvement System. Vol. 28, 2013, pp. 645–57, doi:doi.org/10.1016/j.ecresq.2013.05.001.


BibTeX   Click to copy

@article{karoly2013a,
  title = {Understanding variation in classroom quality within early childhood centers: Evidence from Colorado's Quality Rating and Improvement System},
  year = {2013},
  pages = {645-657},
  volume = {28},
  doi = {doi.org/10.1016/j.ecresq.2013.05.001},
  author = {Karoly, L.A. and Zellman, G.L. and Perlman, M.}
}

Abstract

This study examines variability in quality across classrooms within early childhood centers and its implications for how quality rating systems (QRSs) capture center-level quality. We used data collected for administrative purposes by Qualistar Colorado which includes the environmental rating scale (ERS) collected in all classrooms in the 433 centers participating in Colorado's QRS between 2008 and 2010. We conducted variance components analysis for the ERS and found that between 26% and 28% of the variation in quality captured by the ERS occurred across classrooms within the same center serving children in the same age range. This finding reveals that capturing center-level quality based on average ERS will often miss important within-center quality differences and points to the merits of using “no score below” rules along with rating tier cutpoints in determining center-level ERS. Most QRSs assess center-level quality for a randomly selected subset of classrooms. To test the implications of cross-classroom quality variation for this practice, we simulated four classroom selection strategies in current use: selecting 50% of the rooms, 33% of the rooms, two rooms, or one room. In general, the larger the share of classrooms measured under a selection rule, the lower the chance that a center's rating tier will be misclassified. The error rates under each selection rule also depend on the extent of cross-classroom quality variability, how centers are distributed by size, and the QRS structure. QRS designers, therefore, need to consider the tradeoff between the costs of measuring more classrooms in each center versus the costs of misclassifying centers. The paper quantifies the magnitude of these tradeoffs using the Colorado data and two illustrative QRSs. The implications of our findings for QRS designers, parents, and other stakeholders are discussed.



Share



Follow this website


You need to create an Owlstown account to follow this website.


Sign up

Already an Owlstown member?

Log in