Scoring Staff and Operations at Measured Progress
The scoring director responds to requests for proposals and is involved in initial planning stages and budgeting processes for each contract. He works closely with program management, test development, measurement, and information technology staff, as well as our clients, to develop and maintain high-quality scoring guides and benchmarking, training, and qualification materials during the scoring process. He leads efforts to implement state-of-the-art scoring practices, procedures, and technologies.
iScore administrators create the contract database and user authorizations in the iScore system, our patented software program that allows computer-based scoring of student responses. They are also responsible for data cleanup after scoring is complete, as well as the export of scoring results to data processing.
Chief readers, assistant chief readers, and quality assurance coordinators are content experts in science, math, writing, arts and humanities, and social studies who prepare benchmarking materials and lead the review of materials, working closely with test development staff and our clients. After approval from the client on the benchmarking/training materials, they train, qualify, and monitor scorers during the scoring process.
Scoring center managers oversee all scoring activities at their scoring site, coordinate the recruitment of all temporary scoring staff, manage scoring assignments, monitor scoring progress for all grades and content areas (e.g., math and writing) assigned to their location, and approve millions of dollars in payroll for accounts payable.
Scoring project managers, one assigned to each contract, oversee the overall contract from a scoring perspective and act as a liaison with contract management staff, data analysis staff, and the client while managing the content experts (chief readers, quality assurance coordinators, etc.) assigned to each contract. They also prepare scoring specifications at the beginning of the project, provide reports to the client during the scoring process, ensure that scoring is progressing on schedule, monitor labor costs, and produce a final report at the end of the project.
The scoring production manager identifies the number of scorers required to score all grades and content areas of each contract within the predetermined scoring window and assigns the scoring workload across all scoring centers based on talent, prior experience, and capacity. Administrative support staff at each of our locations helps with all the support requirements: supplies, equipment, purchasing, scanning, copying, mailing, ID badges, timekeeping for payroll purposes, travel arrangements, assigning charges to contracts, researching unique scoring needs, and a multitude of other activities.
Our scorers (readers), trained by our chief readers, are qualified temporary staff members who spend a scoring season evaluating and scoring student responses according to the guidelines provided for each contract, grade level, and content area.
