Society of Directors of Research in Medical Education


 General summary/purpose

 The Director of the Office of Assessment and Evaluation (OAE) at the Johns Hopkins University School of Medicine (JHUSOM) is responsible for the overall leadership and management of OAE. OAE supports development, implementation, analysis, and reporting activities related to the assessment of learners and the evaluation of programs for all JHUSOM educational programs, including those in Graduate Biomedical Education (GBE), Postdoctoral Education, Undergraduate Medical Education (UME), Graduate Medical Education (GME), and Continuing Medical Education (CME). OAE provides similar services to other JHUSOM entities that support education, such as the Institute for Excellence in Education (IEE), the Simulation Center, and the Professional Development and Career Office. As these activities often overlap with scholarly endeavors, OAE also provides consultation and assistance in research project design, statistical analysis, and manuscript preparation. The Director is responsible for establishing and maintaining strong partnerships with faculty members, program administrators, and other stakeholders to ensure that assessment and evaluation activities align with learner needs, program goals, accreditation standards, and evidence-based best practices.

 Specific duties & responsibilities

 The Director is responsible for strategic leadership, operational management, analysis, reporting collaboration, and outreach. Specific responsibilities include, but are not limited to:

  • Participate in strategic planning with the Vice Dean for Education to outline initiatives, objectives, and outcomes associated with JHUSOM learning assessment and program evaluation
  • Collaborate with faculty members, program administrators, and other stakeholders to design, launch, and maintain assessment and evaluation activities
  • Conduct quantitative and qualitative data analyses to support data-driven decision making and action planning
  • Recruit, hire, train, motivate, and supervise OAE team members
  • Manage the financial planning process and budget for OAE
  • Develop and manage relationships across JHU in order to advance assessment and evaluation efforts for academic health institutions
  • Provide support to faculty members in educational scholarship and research endeavors
  • Conduct annual program evaluation of OAE and distribute reports to key stakeholders
  • Represent JHUSOM nationally and internationally
  • Participate in accreditation- or funding-related self-studies and reviews, including those associated with the Liaison Committee on Medical Education (LCME), Accreditation Council for Graduate Medical Education (ACGME), Middle States Commission on Higher Education (MSCHE), and the National Institutes of Health, as needed
  • Serve as an active member of various committees, advisory boards, and managing boards, including the Educational Policy and Curriculum Committee, the MA/PhD Committee, the Graduate Medical Education Committee, the Educational Technology Committee, the Student Assessment and Program Evaluation Committee, the Postdoctoral Advisory Board, the IEE Managing Board, the Johns Hopkins University Council on Learning Assessment, and others

Minimum qualifications

  • PhD degree in Education, Educational Psychology, Quantitative Psychology, Social Sciences, or related field
  • Minimum of seven years related work experience in medical education or other health professions education, including at least three years in a supervisory capacity (experience outside of these professions will be considered for an otherwise strong candidate)

 Preferred qualifications

  • Experience in assessing learners and evaluating programs in medical and biomedical education
  • Knowledge of the assessment standards of LCME, ACGME, and other accrediting bodies
  • Experience providing consultation in research design, statistical analysis, and/or manuscript preparation related to educational research
  • Knowledge of classical test theory, item response theory, Rasch modeling, and generalizability theory/G studies
  • Working knowledge of New Innovations, Qualtrics, B-Line, and ExamSoft
  • Experience in strategic planning

 Special knowledge, skills, and abilities

  • Experience in assessing learners and evaluating educational programs
  • Experience in statistical analysis and use of related software (e.g., SAS, SPSS)
  • Knowledge of institutional data systems and reporting software
  • Experience in building and/or leading complex programs
  • Demonstrated ability to train and mentor others, including physicians
  • Ability to work independently and in a team environment
  • Excellent oral and written communication skills
  • Effective use of diplomacy, tact, and judgment
  • Knowledge of the curriculum development process

 Supervisory responsibility

Team of four staff members, including a Psychometrician, Senior Program Evaluation Specialist, Senior Research Data Analyst, and Administrative Coordinator

Budget authority

Manage the financial planning process and budget for OAE. Annual budget ~$600,000