Evaluation Specialist Ii, Accountability Section, 60254

APPLICANTS MAY BE EDUCATIONAL OFFICERS, TEACHERS AND OTHER QUALIFIED INDIVIDUALS

TYPE OF APPOINTMENT ISSUED: This position is included in the Educational Officers’ Bargaining Unit and will be filled as a clear line appointment.

MINIMUM QUALIFICATIONS

Education: Graduation from an accredited college or university with a master’s degree in education with specialization in educational psychology or any other field of education, which included coursework in research and statistics in education.
Desired Education: Master’s degree from an accredited college or university in public policy, public administration, political science, sociology, or related field, which included coursework in educational research, evaluation, or educational assessment.
Experience: Six (6) years of responsible professional work experience in education of which four (4) years shall have been in teaching and two (2) years in education evaluation.
Desired Experience: Teaching or conducting research.
Combined Education and Experience: An equivalent combination of education and experience may be acceptable, as determined by the Department. Substitutions can be considered for the requirement of experience in an education program, agency or system.
Knowledge: Foundations of curriculum and instruction; instructional media and computers; foundations of American education; tests and measurements; principles of learning and individual differences; educational statistics; design and evaluation procedures in educational research; research developments, trends and current issues or problems pertinent to the area(s) of assignment; laws, rules, regulations and administrative procedures pertinent to the area(s) of assignment.
Ability to: Provide leadership, planning and coordination in the area or areas of assignment; develop, analyze and evaluate plans, programs and procedures; communicate effectively with others both orally and writing; operate computer and other business machines; maintain awareness of developments in education evaluation.
Desired Ability to: Work with and make presentations to individuals and groups; conduct training; prepare, review, edit, and rewrite memos, letters, testimony, reports and manuals; operate personal computers and related technological devices and equipment to perform word processing, create textual documents, charts, graphs, spreadsheets and databases, and conduct statistical analyses; develop specifications for program and project plans, contracts, staffing and other resources.

Under the general supervision of the Evaluation Specialist III of the Accountability Section, the Evaluation Specialist II:

• Plans, develops, and implements research and evaluation strategies and procedures designed to support programs or projects for educational improvement and equity. Clarifies and defines objectives as required. Develops data collection plans for evaluation of projects and educational research; including sampling design, procedures and statistical analysis as appropriate. Compiles, analyzes and interprets data for projects assigned. Conducts quality control checks based on established quality assurance procedures. Provides technical and consultative services to Hawaii State Department of Education staff, program managers, and others as needed or assigned.
• Designs and develops data collection instruments (including survey questionnaires, interview schedules and forms) and determines the technical adequacy of data collection instruments for use in conducting the accountability or evaluation project assigned; reviews, assesses and selects appropriate data collection instruments where extant instruments are available. Plans and conducts surveys on educational outcomes and other issues as assigned; develops sampling designs, data collection plans, interview protocols, and other instruments required for assessment and evaluation projects.
• Develops, produces and distributes (a) individual, annual educational assessment reports and school accountability report cards for schools under the jurisdiction of the Hawaii State Department of Education and (b) state and complex area summary reports on system and school accountability. Provides in-service training on the conduct of a full range of educational accountability institutional research and evaluation activities; school accountability, student growth models, needs assessment, prerequisites for program or project evaluation, evaluation standards, evaluation designs, instrumentation, data collection and analysis, data interpretation and report, etc. Conducts research and development work on educational indicators and the analysis and reporting of both system and school performance and improvement efforts. Conducts institutional research and analytic studies as assigned.
• Provides leadership in planning, establishing and revising procedures and criteria to compute metrics, monitor institutional performance; plans and leads the preparation of growth data files and programming code required to generate growth analyses and results for school and educator accountability; collaborates with vendors/other offices in managing the development, production, distribution and improvement of internal/external surveys and evaluation results.
• Plans, coordinates, and attends meetings as required for the project assigned; attends committee or other meetings as required. Writes technical reports to present findings or material clearly and concisely for a range of audiences and decision-makers; may report orally and present materials to audiences and decision-makers.
• Researches, reviews and monitors federal and state requirements related to school and state educational accountability reporting. Researches, reviews, and evaluates strengths and limitations of student achievement growth models potentially useful as components in school accountability or educator evaluation systems.
• Performs other related duties as assigned.