Reporting to the Director of Institutional Effectiveness and Assessment (IEA)the position works closely with other IEA team members (e.g., Assessment Specialist and Institutional Effectiveness Specialist) to fulfill the unit’s mission and goals. The ideal candidate is a self-motivated, self-directed, organized, and detail-oriented team player with the ability to work effectively with conflicting demands and changing priorities with a positive attitude. Beyond IEA team, the position works in close collaborations with other units of the Office of Medical Education (OME; Phase IPhase II, and Phase III) and Students Affairs Wellbeing (SAW) team to support the curriculum assessment processes and ultimately student success.  

 

The position serves as the operational manager of Leo, which is HMSOM’s learning management system (LMS)Leo also serves as a questionnaire tool as all the evaluations related to sessions, courses, and faculty are administered via this platform. Oversee the development of relational database and adoption of an appropriate data visualization tool. Manage the curriculum inventory (CI) in Leo, which includes obtaining learning objectives from course and clerkship directors and mapping lower-level objectives to higher level objectives.  

 

Specific responsibilities include, but are not limited to: 

 

  • Work closely with HMH IT, users, vendors, and technicians to assess computing needs, and system requirements. 

 

  • Evaluate new educational technologies to meet current and emerging curricular needs.  

 

  • Provide technical assistance, coordination, and support related to academic assessment. 

 

  • Responsible for creating assessments in Leo (e.g., tRAT) and posting Phase I – III grades in Leo. 

 

  • Serve as a primary liaison with makers of Leo for technical support. 

 

  • Responsible for providing faculty, staff, and students training on how to use Leo. 

 

  • Collaborate with others in OME to oversee the LMS (Leo) and ensure that the system is operating optimally. 

 

  • Responsible for assigning evaluation forms (e.g., students’ evaluation of sessions, courses, and faculty, and faculty evaluation of students) in a timely manner in Leo. 

 

  • Collaborate with the Assessment Specialist in developing and maintaining a cumulative grade file.  

 

  • Generateanalyze, and submit an annual CI report to the AAMC CI database 

 

  • Serve on committees and sub-committees at the recommendation of the Director of IEA. 

 

 

Knowledge, Education, and Skills Required: 

 

  • Bachelor’s degree (major or minor) in data science, statistics, information management and technology, educational psychology, higher education, or related fields and five years of experience or a master’s degree in an appropriate area of specialization and two years of relevant experience 

 

  • A minimum of three years of experience working with a LMS (e.g., Blackboard, Canvas), preferably Leo. 

 

  • Experience working with assessment software (e.g., ExamSoft) and survey software (e.g., SurveyMonkey and Qualtrics).  

 

  • Ability to gather and analyze qualitative and quantitative data and create reports related to outcomes of curriculum and students’ feedback.   

 

  • Advanced working knowledge of Google Workspace, Excel, and SPSS.  

 

  • Extensive knowledge of organizing and implementing data dashboards and reports using a range of methods (e.g., Google Sheets, SQL, Tableau, and Power BI). 

 

  • Familiarity with survey design and administration in a higher education environment.  

 

  • Ability to work cohesively with multiple stakeholders (e.g., faculty, staff, and students) in a fast-paced and highly collaborative environment.  

 

  • Previous experience in administering and supporting web-based educational programs.  

 

  • Experience with health professions education, specifically medical education strongly preferred. 

 

  • Perform other duties as assigned by the Director of IEA and Senior Associate Dean of OME.