Evaluation and Survey Specialist

Evaluation and Survey Specialist 
Office of Assessment and Educational Development

Summary:  Under the supervision of the Associate Dean for Assessment and Educational Development, this position plays a key role in monitoring, developing, analyzing, and reporting on evaluations and surveys for WVSOM.  This includes but is not limited to: institutional and program evaluations, course and faculty evaluations, evaluation data analysis and reporting, curriculum analysis and reporting, and survey development. This position oversees data collection in many forms such as interviews, questionnaires/surveys, and focus groups.  This position oversees data analysis and reporting from both quantitative and qualitative methods.  This position consults with and assists WVSOM colleagues in evaluation and survey methodologies.

General Duties and Responsibilities

Evaluation Oversight and Reporting

• Oversees institutional evaluations, specifically for institutional outcomes, methods, trends, and strategic review processes.  Provides direction for curriculum evaluation and assessment, specifically for educational outcomes, educational evaluation methods, competencies tracking, and curriculum review processes.  Primarily concerned with the improvement of learning outcomes from year one through residency years by setting up appropriate accountability systems.  Supports program development and evaluation for both undergraduate and graduate medical education. Manages the system for student feedback on program, courses, and faculty teaching performance. Manages the system for employee feedback on departments, services, institutional culture/climate, etc.

Survey Development and Processes

• Develops, directs and reports on institutional evaluations such as student exit surveys, institutional services evaluations, climate surveys, course and faculty evaluations, etc. Conduct background research on survey topics Plan and design surveys, and determine appropriate survey methods Program and test check survey functionalities, look and data outputs Monitor and manage live surveys, ensuring any inconsistencies or issues are resolved in a timely manner Provide partial survey data to team leader / clients as needed Analyze data and prepare top line findings using statistical software and techniques Help to ensure the high quality of all survey outputs through constant review of survey building processes and methodologies Evaluate surveys, the methods underlying them, and their performance to improve future surveys Work with others to develop appropriate interview guides for focus groups Coordinate the work of interviewers and data collectors

Other Job Responsibilities

• Monitors national developments in health professions education, in order to stay current in and recommend implementation of new and innovative evaluation strategies and methods to the Associate Dean for Assessment and Educational Development, to assure that WVSOM maintains a “cutting edge” evaluation program.

• Conducts quality assurance of institutional and programmatic data to ensure accuracy.   

• Actively involved in institutional meetings, which may include the WVSOM Curriculum Committee, Curriculum Assessment Sub-Committee, Continuous Quality Improvement Committee, or other WVSOM committees as elected, appointed or directed.
• Represents WVSOM in state, regional and national activities.
• Collaborates with the Associate Dean for Assessment and Educational Development and others on curriculum, assessment, research, and osteopathic medical education initiatives. Supports other members of the Office of Educational Development with evaluation and assessment projects, as requested/assigned. Performs other related duties as assigned.

Education and Experience: Successful candidate will have a Bachelor’s degree in Educational Research, Evaluation, Measurement, Social Sciences or other related field.   Relevant experience in educational assessment, survey development, medical education and an earned Master’s degree in a related field is desired.  A combination of education and recent and relevant experience may also be considered.  Experience with basic evaluation and survey programs such as Excel, SPSS, SurveyMonkey, Qualtrics or related is required.  Experience in qualitative thematic analysis preferred.

Position: This is a full-time staff position (state funded), within the Office of Assessment and Educational Development and is exempt for FLSA provisions regarding overtime.   Salary is commensurate with education and experience. The position does offer the ability for telework (full telework or hybrid).  The weekly schedule for this position will be established between the supervisor and the employee and approved given the needs of the department and the institution.  Not all activities of this position occur within the confines of an 8:00-4:30 schedule and will require regular evening and weekend scheduling. Some travel including overnight travel is required.

Applications are considered confidential. The search committee will begin its review of applications upon receipt. Final candidates are subject to employment and credential verification, reference and background checks. 

This position has been designated as Essential. This means that when WVSOM is faced with an institutional emergency, employees in such positions may be required to remain at their work location or to report to work to protect, recover and continue operations at WVSOM.

West Virginia School of Osteopathic Medicine is an equal opportunity employer and is committed to enhancing diversity among its faculty and staff.