Table 1.
54-point screening rubric.
Table 2.
Applicant characteristics for internal and external applicant ratings.
Fig 1.
Distribution of total ratings for internal and external applicants.
Fig 2.
Distribution of subcomponent ratings for internal and external applicants.
Table 3.
Mixed effect models for summative total score.
Fig 3.
Mean and range of summative ratings of applicants rated multiple times between 2009–2013.
Each vertical line connects summative ratings given to single applicant during this period. Applicants are ordered by average summative rating (solid circles).
Fig 4.
Variance decomposition for internal and external applicants calculated using Model (3) jointly on all data.
Fig 5.
Within-school IRR estimates for internal applicants, external applicants and their difference, including bootstrap confidence intervals, calculated using Model (3) jointly on all data.
Table 4.
Effect of number of raters on reliability, standard error and predictive validity of scoring.