Administrator For Science Test Development

The Education Secretariat is committed to equity and valuing the unique and diverse characteristics and experiences of every member of its workforce. We encourage an authentic workplace where colleagues show up as their full selves, and where collaboration, innovation, and connections are key to realizing our mission that all children, youth, and families thrive socially, academically, and economically. We seek teammates who are committed to promoting a diverse and inclusive work environment, where everyone is valued and engaged. We encourage you to apply and identify your strengths in these areas.
The Department of Elementary and Secondary Education (DESE) knows that our most important asset is our staff and that creating strong schools starts with recruiting the best talent. DESE continuously strives for a workplace that values a community of diverse talent where everyone works together to improve education for all students as outlined in our Educational Vision (mass.edu). ). We believe in diverse talent. A strong, innovative, and effective team has members with diverse experiences. We believe in, and work toward, equity for all protected classes. We are an Equal Opportunity/Affirmative Action Employer. Women, minorities, veterans, and people with disabilities are strongly encouraged to apply. Our staff have the chance to lead and support work that influences over 400 school districts that serve almost 1 million learners a year. We are committed to the success of our staff and support the growth of all employees. We offer a comprehensive benefit plan that includes medical, dental, and vision coverage and competitive salaries in accordance with individuals' experience and education. Careers at DESE also include a state pension plan.
The Department of Elementary and Secondary Education's (DESE) Office for Student Assessment Services (SAS) is responsible for coordinating the development, administration, and reporting of the Commonwealth's statewide student assessment programs.
The Administrator for Science Test Development will be assigned to the Office of Student Assessment Services and will be supervised by the Director of Test Development. The selected candidate will work with DESE staff and an external contractor to manage and implement the state Science Tests. Results of these tests are used for student, school, and district accountability. The high school Biology and Introductory Physics tests currently serve as a basis for the Competency Determination, a requirement for graduation from high schools in Massachusetts.
Job Description
The Administrator for Science Test Development manages the development of the state's grades 5 and 8 Science and Technology/Engineering (STE) tests and the high school Biology and Introductory Physics tests to ensure high-quality, content-accurate, and standards-aligned tests. Specifically, the administrator supervises Science Test Development staff members, manages, and coordinates science-assessment work with the MCAS contractor, and uses the universal design for learning (UDL) principles and cultural responsiveness in the development of all Science Test materials.
All test questions are aligned to the learning standards in the 2016 Massachusetts Science and Technology/Engineering Framework . The Test Development process includes reviewing and editing questions prior to educator feedback; attending meetings with Massachusetts educators to capture critical feedback and edits; developing scoring materials; and reviewing and revising test forms constructed by the contractor. Additional Test Development and Science Test design information are available on the DESE website.
The selected candidate will be provided training and guidance on the tasks described below. It is not expected that the candidate will have experience with every facet of the position; however, there is an expectation that the candidate will be a quick learner who is highly organized and able to retain and apply information.
Key Duties:
Manage and support members of the Science Test Development team by setting clear expectations, providing protocols, checklists, and deadlines throughout the entire Test Development process
Collaborate with the Science Test Development team by reviewing and revising their work (as needed) during item development, scoring, and test construction to ensure test questions are aligned to the STE standards, practices, and cognitive skill levels; are accurate from a content perspective; are grade-level appropriate; and adhere to MCAS style guidelines
Work closely with the state's testing contractor to assist with the development of schedules; provide clear and coherent feedback on test questions and scoring materials; provide detailed feedback during test construction, including analysis of the psychometric qualities of each test; and provide input and judgments regarding the review of scoring materials
Manage tasks related to the development of simulation tasks for the grades 5 and 8 STE tests, including communicating internally and externally with interest groups about the new tests
Manage, coordinate, and attend Assessment Development Committee (educator) meetings for the Science Tests (approximately 20 days/year), including: managing and approving selections of committee members; assisting with preparation for and facilitation of meetings; recording educator feedback; and providing improvements to test questions during meetings
Review and provide input on the scoring of student constructed responses, including participating in benchmarking meetings (approximately 22 days/year) with the contractor and DESE test developers
Monitor the contractor's scoring of the Science Tests, including managing observations of DESE staff during scorer trainings and reviewing and editing annotations of benchmarked student responses
Review and edit test forms to ensure that all Science Tests meet the requirements for large-scale assessments, test design requirements and psychometric criteria, including participating in test construction meetings for the Science Tests (approximately 22 days/year)
Collaborate with the MCAS Test Development Director and leadership in other content areas to provide policy recommendations and to coordinate tasks
Develop in-person and virtual presentations and provide professional development to educators about the MCAS Science Tests
Work with other Student Assessment staff members to ensure data reporting language is clear and accurate, administration resources are up-to-date, inclusive and MCAS Alternative resources are accurate, and editorial reviews are coordinated with the Science Test Development schedule
Collaborate on initiatives with colleagues in the Center for Instructional Support and District and School Accountability
Perform other duties, as assigned.
Desired Knowledge, Skills, and Experience
The successful candidate will possess:
Master's or higher degree in science, preferably in Biology, or a related field
Broad understanding of scientific concepts within the disciplines of Earth and space science, life science, physical science, and engineering
Strong familiarity with the 2016 Massachusetts Curriculum Framework standards and practices, and proven working experience with the standards and practices, or with NGSS-like science standards and practices
Proven ability to supervise, train, and motivate people to effectively perform their work, including coordinating and overseeing the efforts of others in accomplishing assigned work objectives
Excellent written and oral communication skills and proven experience creating Word documents and PowerPoint presentations
Experience in writing and editing test questions and scoring materials with strong attention to detail
Experience with scientific simulations and performance tasks
General familiarity with relevant principles of statistics in assessments, including working with Excel files
Proven ability to facilitate meetings and develop and deliver high-quality, large-group presentations, both in person and virtually
Experience with and proven ability to work with external contractors
Excellent computer skills, including the ability to quickly orient knowledge and skills to utilize new applications and tools
Ability to manage multiple tasks and to work independently in a complex work environment, including being highly organized and showing close attention to detail
Ability to interact with DESE staff members and external educators in a culturally responsive, professional manner
Willingness and ability to acquire skills and seek out personal growth opportunities to further the work of supporting DESE initiatives
Willingness to accept feedback and engage in self-reflection, including being adaptable and flexible in an evolving work landscape
You must submit a cover letter with your online application.
Travel will be required with this position.
Questions regarding this position or the application process should be directed to Dawn.E.DeRoche@mass.gov.
Qualifications:
MINIMUM ENTRANCE REQUIREMENTS:
Applicants must have at least (A) five (5) years of full-time or, equivalent part-time, professional, administrative, supervisory, or managerial experience in business administration, business management, public administration, public management, clinical administration or clinical management of which (B) at least one (1) year must have been in a project management, supervisory or managerial capacity or (C) any equivalent combination of the required experience and substitutions below.
Substitutions:
I. A certificate in a relevant or related field may be substituted for one (1) year of the required (A) experience.
II. A Bachelor's degree in a related field may be substituted for two (2) years of the required (A) experience.
III. A Graduate degree in a related field may be substituted for three (3) years of the required (A) experience.
IV. A Doctorate degree in a related field may be substituted for four (4) years of the required (A) experience.
Comprehensive Benefits
When you embark on a career with the Commonwealth, you are offered an outstanding suite of employee benefits that add to the overall value of your compensation package. We take pride in providing a work experience that supports you, your loved ones, and your future.
Want the specifics? Explore our Employee Benefits and Rewards!
An Equal Opportunity / Affirmative Action Employer. Females, minorities, veterans, and persons with disabilities are strongly encouraged to apply.
The Commonwealth is an Equal Opportunity Employer and does not discriminate on the basis of race, religion, color, sex, gender identity or expression, sexual orientation, age, disability, national origin, veteran status, or any other basis covered by appropriate law. Research suggests that qualified women, Black, Indigenous, and Persons of Color (BIPOC) may self-select out of opportunities if they don't meet 100% of the job requirements. We encourage individuals who believe they have the skills necessary to thrive to apply for this role.