2017 Session Descriptions
(with slides where available)

Plenary Session 1: Understanding Computer Hacking: The First Step toward Protecting Your Systems

Tom Stewart, Associate Director – Technology Consulting, Security and Privacy, Protiviti

Computer hackers pose a tremendous risk in the health care field, yet despite our awareness of the situation, the hackers continue to break in. In this plenary session, cyber security expert Tom Stewart will explain the current types of hacking efforts, and the motivations of the people behind these attacks. Mr. Stewart will highlight risks that hackers exploit and the things you can do personally to fend off the bad actors. He will present real world examples from many years of experience in the field across a multitude of industries and company sizes.

"DIY" Usability Testing: Add User Research to Your Web Process Without Breaking Your Budget

Tony Rose, Digital Wave Technologies
Lamar Goodenough, Digital Wave Technologies

User testing can be the most effective way to ensure that your website is informing, engaging, and empowering your users. But the idea of conducting large-scale user testing can be daunting to those of us who are already stretching their limited web budgets and resources. This session will introduce you a simple, "Do-It-Yourself" alternative approach to usability testing that you can incorporate into your web management process with minimal effort and expense.

Within the specific context of Board websites, the presenters will introduce you to the concepts and methodologies to conduct regular small group testing and apply the results to an ongoing quality improvement process. They will then administer a LIVE user test on a member Board website, and invite participants to discuss the results and how to determine appropriate follow-up actions toward continuous website improvement. The workshop will end with Q&A with testing administrators who have worked on multiple Board websites, and can address your questions based on their experiences.

Learning Objectives:

  • Observe an actual website user test live
  • Learn how to incorporate affordable user testing into web projects
  • Discuss successes and challenges of user research projects by ABMS member Boards

How to Make a Big Marketing Impact on a Small Marketing Budget

Adara Bowen, American Marketing Association
Christine Shiffer, American Board of Surgery

Whether you handle marketing on an ad hoc basis or have a dedicated marketing and communications team, you'll learn strategies for efficiently and effectively developing and executing outreach campaigns. We will discuss the range of skills needed for success, and how to fill in the gaps with outside resources.

Learning Objectives:

  • Learn to use integrated marketing tactics to amplify your outreach
  • Find out how to get the best from your internal and external resources
  • Discover ways to maximize your marketing capacity on any budget

Create a Safe Day, Every Day: The Building of a QI Culture at Nationwide Children's Hospital

Mary Ann Abrams, MD, MPH, Nationwide Children's Hospital
Andrew Bethune, MA, Nationwide Children's Hospital

This interactive session will reveal how Nationwide Children's Hospital's built— and sustains—a strong quality improvement (QI) culture that helped it become a national leader in pediatric quality and safety.

The hospital's Patient/Family-Centered Quality Strategic Plan provides an implementation framework for ensuring that every member of the health care team employs tools and actions designed to "Create a Safe Day, Every Day." With a goal of driving preventable harm to zero, QI permeates everything the hospital does.

Diverse teams use the Institute for Healthcare Improvement's Model for Improvement to guide more than 150 QI projects throughout the organization. Trainees are meaningfully engaged and mentored to critically examine their own practice, collect and analyze data about that practice, and make improvements based on those data.

The presenters will also share how Nationwide Children's QI culture has expanded beyond the hospital itself, leading to pioneering innovations like Ohio Children's Hospital Solutions for Patient Safety and the launch of the online peer-reviewed journal Pediatric Quality and Safety.

Learning Objectives:

  • Identify fundamental elements of a strong organizational quality improvement culture
  • Apply a strategic approach to building and sustaining quality improvement in your setting
  • Align and integrate quality improvement with individual and organizational priorities

Crafting and Adapting Tutorials for Smoother Test Taking

Deb Baldwin, BA, American Board of Pediatrics
Mike Adams, American Board of Pediatrics

In launching new formats for assessment—particularly those that involve new technologies—there can be a learning curve for test takers. The American Board of Pediatrics (ABP) has helped ease this transition with video tutorials. This session will discuss their experience.

Part 1: Crafting

When ABP piloted its online MOCA-Peds model early this year, it produced two video tutorials to walk candidates through the new experience, one for desktop/laptop users and one for mobile app users. The tutorials received more than 4,000 views and a significant rate of engagement. The presenters will describe how these tutorials were developed, shedding light on scriptwriting, audio tracking, shooting, and editing.

Part 2: Adapting

After introducing video item types for pediatric cardiology in 2010, ABP created video tutorials to help users navigate the new environment. The presenters will share how the tutorials were subsequently evaluated and adapted, including how usage affected test takers' performance and exam item speediness, as well as strategies for boosting user participation.

The session will wrap up with Q&A, inviting other Boards to share their own strategies for optimizing user experience and performance.

Learning Objectives:

  • Learn about the process and challenges in developing a new product tutorial
  • Consider tutorial adaptation for different item types or new technologies
  • Analyze item performance based on exam delivery adaptations

Intro to the ABMS Multi-Specialty Portfolio Program

Teena Nelson, MHA, ABMS Portfolio Program
Ann Williamson, RN, ABMS Portfolio Program
Jamaal Diggins, ABMS Portfolio Program

This informal session is intended for new and potential sponsors, as well as mentors and mentees within the Multi-Specialty Portfolio Program (Portfolio Program™). We will begin with a brief introduction to the Portfolio Program and then break off into small-group table discussions. You will have the opportunity to meet with sponsors engaged in the mentor/mentee pilot, and to pose questions about program benefits and requirements, the application process, how to get started as a new sponsor, use of the MOCAM system, and the pre-sponsor pilot. 

NOTE: Please submit questions/topics you would like to have addressed in this session to portfolioprogram@abms.org. Questions will be accepted through August 31.

Learning Objectives:

  • Identify benefits of Portfolio Program sponsorship to your organization
  • Recognize requirements for participation in the Portfolio Program
  • Recognize key implementation plans as a new sponsor
  • Create documents in the MOCAM system
  • Assess benefits of participation in the pre-sponsor pilot
  • Identify benefits of a mentor/mentee relationship

Back to Top

Special Effects: Using Video to Support Your Communications [see pdfs below]

Special Effects: Using Video to Support Your Communications - Spring slides [pdf]
Special Effects: Using Video to Support Your Communications - Elstein slides [pdf]

Greg Vass, Solid Line Media
Frances Spring, American Board of Emergency Medicine
David Elstein, American Board of Orthopaedic Surgery

Technology has completely re imagined how the corporate world communicates. Over the past few years video has emerged as a driving force in marketing and information sharing. In what ways can it be useful to your overall communication strategy? In this session we will learn about video tactics that some ABMS Member Boards are using to reach diplomates and the public.

Learning Objectives:

  • Learn how to create educational videos for diplomates
  • Explore which types of videos are effective for your audience
  • Discover how to make videos to fit any budget

A New Model for Measuring Clinical Judgment in Nursing

Joe Betts, PhD, Pearson VUE

This session will feature four presentations highlighting research on expanding the focus of a large-scale nursing licensure examination program to include the new construct of clinical judgment needed in practice.

  • The first presentation will share the R&D process, which merged a cognitive psychological decision-making model with the daily praxis outlined by the job task analysis to a definable clinical judgment assessment model
  • The second presentation will show how new technology enhanced item types were identified for measuring aspects of the clinical judgment model. The mapping process will be described and examples provided
  • The third presentation will outline analytic methods for evaluating construct validity as well as scoring models for evaluating the stated assessment model
  • The fourth presentation will share an analysis of items developed to measure the clinical judgment element of cue recognition using both a signal- detection and polytomous item response theory framework

Learning Objectives:

  • Gain insight into the process of defining the new construct of clinical judgment in nursing
  • Discuss new item types that measure the aspects of clinical judgment
  • Learn a variety of methods for measuring and analyzing item information

Prepare for the Inevitable: Strategies for Surviving a Data Breach

Cori Ashford, Weber Shandwick
Sasha Boghosian, Revive Health
Celeste Davis, Office for Civil Rights-Midwest Region, U.S. Department of Health and Human Services

Cyberattacks on hospitals and health systems are on the rise as the black market value of personal medical information nearly surpasses that of financial information. In fact, data breaches in 2016 affected more than 27 million patient records, according to health data protection firm Protenus.

Clearly, it's not a question of if but when a data breach will occur. Is your organization prepared? Safeguarding against a breach isn't enough. It is essential to prepare your organization's legal, compliance, and communications teams to work in lockstep in the event of a devastating exposure.

Featuring a panel of regulatory and communications experts, this session will discuss strategies for navigating a breach of critical private data, including development of communications plans, what to expect from an investigation, and how to keep employees vigilant in following IT security procedures.

The engaging and thoughtful dialogue will give you an extra dose of confidence in the increasingly uncertain landscape of health data protection. #PrepareToProtect

Learning Objectives:

  • Learn key strategies for defending against and preparing for cyberattacks and breaches of personal/private data
  • Review best practices and lessons learned from experts who have "been there"
  • Understand what to expect once a breach occurs

Introduction to Health Care Quality Improvement

Handout: Introduction to Health Care Quality Improvement

Stephen Davidow, MBA-HCM, CPHQ, APR, PCPI

This session is designed as a broad overview for health care professionals just getting started in quality improvement. It will cover key approaches in health care process improvement—including Lean, Six Sigma, and the Model for Improvement (Plan-Do-Study-Act)—as well as specific tools, such as value stream mapping and root cause analysis, and how to use them. The session will also discuss strategies for maintaining improvements, as well as methodologies used to prioritize projects to focus on what is most important in an organization.

Learning Objectives:

  • Understand the three major process improvement methodologies used in health care
  • Describe how key tools are used in moving from the current state to an improved future state
  • Implement strategies to sustain improvements over time

Back to Top

Addressing Burnout Among Family Physicians

Lars Peterson, MD, PhD, American Board of Family Medicine
Bo Fang, PhD, American Board of Family Medicine
Monee Rassolian, MD, Michigan State University, McLaren Flint Family Medicine Residency

Work-related burnout among physicians is on the rise, particularly for those on the front lines of patient care. Research suggests that over half of physicians will experience burnout, with family physicians among the highest rates at 60%.

Burnout is marked by emotional and physical exhaustion, decreased communication, apathy, and more. Its repercussions are widespread: For physicians themselves, it can lead to substance misuse, depression, and even suicide. For patients, it can mean higher rates of errors, reduced quality of care, and lower patient satisfaction. And for organizations, physician burnout can result in higher turnover and lower productivity.

In response to growing concerns over this issue, the American Board of Family Medicine (ABFM) began collecting data from their diplomates. Early findings indicate a much lower rate than previously reported, but still alarming with 1 in 4 physicians reporting signs of burnout.

In this session, ABFM representatives will share results of their research on burnout among family physicians, discuss what they have learned about wellness and satisfaction, and show how they are working with specialty societies to address these issues.

Learning Objectives:

  • Learn the components of burnout and how burnout is detrimental to the delivery of health care
  • Understand individual and practice characteristics associated with burnout among family physicians and how these findings may be used to promote wellness

Shake Up Your Education Program to Make Learning "Sticky"

Theresa Frederick, BA, Aurora Health Care
Deb Simpson, PhD, Aurora Health Care
Kristin Ouweneel, BA, Aurora Health Care

Serious, evidence-based education doesn't have to be confined to lectures and PowerPoints. In fact, more innovative delivery methods have been shown to improve understanding and increase retention of important concepts. Plus, they're more appealing to busy clinicians.

This session will focus on designing programs that engage learners in nontraditional ways. Using simple delivery techniques, the presenters will "break some rules and shake up the room" to help you develop ideas that are appropriate and effective for your audience, as well as low-cost or free.

This interactive workshop reflects a broader trend in medical education toward "sticky" course design: formats and techniques that are compelling, inspiring, and memorable.

After the session, you will be better able to plan and deliver education that physicians will find interesting and relevant to their practice, which ultimately will lead to higher-quality patient care.

Learning Objectives:

  • Learn to embrace innovation in education for better learning outcomes
  • Hear about specific nontraditional techniques for actively engaging today's learners
  • Discuss how to make education program changes that are sustainable and measurable

Exploring the Value of the ABMS Brand [see pdfs below]

Exploring the Value of the ABMS Brand - Mandelbaum slides [pdf]
Exploring the Value of the ABMS Brand - Brennan slides [pdf]

John Mandelbaum, JD, American Board of Medical Specialties
Tim Brennan, MD, MPH, Icahn School of Medicine at Mount Sinai

John Mandelbaum of ABMS will explore the value of the ABMS brand to Member Boards and their Diplomates through several lenses, including state advertising legislation; federal and private payer contracts; and requirements for state licensure, GME training, and private health care institution credentialing.

Tim Brennan of the Icahn School of Medicine at Mount Sinai will highlight the benefits that have been realized since Addiction Medicine has been recognized as a subspecialty across the entire ABMS Boards Community, including better access to quality care for patients and the expansion of training programs.

Learning Objectives:

  • Recognize the benefits of the ABMS brand in the external healthcare environment
  • Hear how licensing, advertising, and training requirements are dependent upon the ABMS brand
  • Connect the value of Board Certification to improving patient care

Certification's Impact on Practice and Performance: Research by Four Scholars [see pdfs below]

Certification's Impact on Practice and Performance: Research by Four Scholars - Babu slides [pdf]
Certification's Impact on Practice and Performance: Research by Four Scholars - Davis slides [pdf]
Certification's Impact on Practice and Performance: Research by Four Scholars - Mannava slides [pdf]
Certification's Impact on Practice and Performance: Research by Four Scholars - Xu slides [pdf]

Maya Babu, MD, MBA
Joshua Davis, MD, NASM-CPT, EM Resident, Penn State Hershey Medical Center
Sandeep Mannava, MD, PhD, Assistant Professor, Orthopedic Surgery, University of Rochester Medical Center
Tim Xu, MD, MPP, Associate, McKinsey & Company

Within an increasingly complex system of care, certification seeks to assure the public that medical specialists are competent to provide safe, high-quality, patient-centered care throughout their professional careers. Research related to certification and MOC is one of the activities that ABMS Visiting Scholars engage in during their year.

In this session, four of this year's scholars will share their research methods and findings on the correlation between board certification and surgical outcomes; the use of simulation in surgical training; surgeons' perspectives on the value of continuing certification; and identification of a common core among Boards' quality, safety, and communication expectations.

Participants will be invited to share their thoughts on the implications of the scholars' findings and future research directions.

Learning Objectives:

  • Learn the methods and results of ABMS Visiting Scholar research projects
  • Discuss the implications of those results for ABMS Member Board certification programs

Back to Top

Innovations in Assessment: ABP's Pilot Results and Lessons Learned

Linda A. Althouse, PhD, American Board of Pediatrics
Trevor Fleck, MPA, American Board of Pediatrics
Robert Furter, PhD, American Board of Pediatrics
Adam Turner, MPH, American Board of Pediatrics

With advances in technology, models for assessing medical knowledge and clinical judgment have become more flexible, continuous, and dynamic, allowing for the incorporation of learning into the assessment process.

This year, the American Board of Pediatrics piloted a new assessment system, representing the next generation of pediatric assessment and continuous professional development. If the MOCA-Peds pilot is successful, this new model will replace the every 10-year MOC pediatrics exam with a series of questions at regular intervals throughout a diplomate's career, delivered through a mobile device or web portal.

Learn from ABP's experience in this session. The presenters will give an overview of the pilot (MOCA-Peds model, pilot design, and demonstration of the platform), review preliminary survey feedback (perceived value, use of mobile app, study preparation), break down participant performance (response time data, performance statistics), and discuss future enhancements based on lessons learned.

Learning Objectives:

  • Hear about the MOCA-Peds model and 2017 pilot design, including implementation issues and business rules
  • Review preliminary data on pilot participation rates and characteristics, survey feedback, and performance
  • Discuss lessons learned from the pilot and planned enhancements

Improving Colon and Breast Cancer Screening Rates: A Public Health Improvement Initiative

Mary Ales, MBA, Interstate Postgraduate Medical Association
Bob Rauner MD, MPH, President at Partnership for a Healthy Lincoln

In this session, you will learn about this regional improvement project, sparked by a challenge from the Dean of the School of Public Health to improve the rates of colon and breast cancer screening. Through the leadership of Healthy Lincoln and the support of public and private payers, an improvement initiative was developed using the DMAIC framework. Fourteen independent clinics participated in a one-year project. A lead physician within each practice provided project oversight and coordinated team engagement. Each team developed their own improvement strategy based on their identified goals. The measures used aligned with Medicare Shared Savings Program ACO metrics.

Results showed an improvement in EHR reported breast cancer screening rates from 44% to 62% and colon cancer screening rates from 44% to 62% with nine clinics exceeding the 65% goal for both breast cancer and colon cancer screening rates as assessed through EHR data.

Assessment of the study's results is continuing. We will discuss key success factors including alignment with patient, community and ACO objectives.

Learning Objectives:

  • Assess the implementation of a community-based improvement initiative
  • Identify forces that led to the development of the initiative
  • Discuss strategies that can be applied to other QI initiatives

An Introduction to Workplace-based Assessment (Part I)

John Norcini, PhD, Foundation for Advancement of International Medical Education and Research

The goal of this session is to familiarize participants with some of the formative workplace-based assessments methods currently being used, with the mini-CEX as one example. The presenter will highlight the importance of formative assessment in learning, review some of the research on the methods, present a model for faculty development, and describe current research on the most effective feedback to give trainees.

Learning Objectives:

  • Understand the importance of workplace-based assessment and become familiar with popular methods
  • Discuss faculty development in workplace-based assessment and how to design a basic workshop for examiners
  • Learn the characteristics of effective diplomate feedback

Three Member Boards' Experiences with DANS Data [see pdfs below]

Three Member Boards' Experiences with DANS Data - Juul slides [pdf]
Three Member Boards' Experiences with DANS Data - Lipner slides [pdf]
Three Member Boards' Experiences with DANS Data - Sun slides [pdf]

Dorthea Juul, PhD, American Board of Psychiatry and Neurology
Rebecca Lipner, PhD, American Board of Internal Medicine
Huaping Sun, PhD, American Board of Anesthesiology

The Disciplinary Action Notification Service (DANS) notifies ABMS Member Boards of disciplinary actions taken on physicians' licenses. DANS data can affect a physician's certification status upon review by Member Board, but it can also be used in research studies regarding physician performance.

What exactly are the statistics on DANS data, and how are Member Boards using their annual DANS reports? This session offers insights.

  • Huaping Sun will describe the basis classification, action severity, and incidence rate of license actions for anesthesiologists and subgroups. She will also show how the Cox proportional hazards model can identify predictors of license actions and quantify the effect of each.
  • Furman McDonald will discuss the association between state medical board disciplinary actions and the severity of actions demonstrated in both initial certification and MOC in internal medicine, including results from a recent study.
  • Dorthea Juul will present data on five cohorts of psychiatry and neurology diplomates, including licensure actions, the bases for these actions, and a comparison across disciplines. Performance on certification exams will also be covered.

Learning Objectives:

  • Understand what a DANS report is and how it can affect a physician's certification status
  • See how DANS reports can be used as performance indicators
  • Review recent research data on ABA, ABIM, and ABPN diplomates related to licensure actions

Back to Top

Health Politics and Policies: The National Policy Landscape

G. William Hoagland, Bipartisan Policy Council

To paraphrase the U.S. president, "Health care is complicated." In this session, Bill Hoagland, the Bipartisan Policy Council's senior vice president for fiscal, health and economic policy, will discuss political and economic factors that make national health reform especially problematic. The discussion will examine the relationship between health policy and the nation's long-term fiscal position, as well as the implications for patients, providers, and medical professionals.

Learning Objectives:

  • Increase your understanding of the fiscal and political environment shaping health policy
  • Examine cost as a driving force in the policy debate
  • Discuss the need to demonstrate certification's contribution to quality as a value-add

Quality Improvement Roadmap

Thomas Thacher, MD, Mayo Clinic

As an ABMS Portfolio Program sponsor, Mayo Clinic has had years of experience and significant success with its quality improvement methodology and processes. In this case-based session, participants will be shown the steps of how Mayo Clinic defines a quality improvement project and how projects receive credit. Dr. Thacher will also describe the organization's methodology and how projects are scored against those criteria. Attendees will also learn how implementing this type of framework allows projects to easily be developed at the unit level, thus creating grassroots momentum for development of and engagement in quality improvement.

Learning Objectives:

  • Hear about the quality improvement methodology and processes used at the Mayo Clinic
  • Assess quality improvement projects against scoring methodology to determine if they are eligible for credit

Choosing Wisely: Making a Worthwhile Program Count for More [see pdfs below]

Choosing Wisely: Making a Worthwhile Program Count for More - Wolfson slides [pdf]
Choosing Wisely: Making a Worthwhile Program Count for More - Slate-Vitcavage slides [pdf]

Daniel Wolfson, PhD, ABIM Foundation
Kellie Slate-Vitcavage, MS, Maine Quality Counts

The ABIM Foundation's Daniel Wolfson will give an overview of the campaign, which encourages dialogue about the overuse of medical tests and procedures and supports physicians in helping patients make smart choices about their care. He'll share how the "Five Things Physicians and Patients Should Question" were developed, the theories behind the campaign, and examples of successful implementation strategies, as well as challenges and barriers.

The session will also feature Kellie Slate-Viscavage of Maine Quality Counts, a Choosing Wisely grantee. She'll show how her organization is working to increase public awareness and guide delivery system changes to reduce unnecessary tests and procedures. She'll also discuss how Maine Quality Counts is offering maintenance of certification (MOC) points for physicians who are interested in advancing Choosing Wisely and being certified by one of the participating ABMS specialty boards.

Learning Objectives:

  • Gain a better understanding of the Choosing Wisely campaign, including challenges it faces
  • Find out how the campaign is having real benefits for physicians and patients nationwide
  • Learn how to align Choosing Wisely with MOC and quality improvement programs

The Evolution of Data Collection: A Look at Two Approaches

Lars Peterson, MD, PhD, American Board of Family Medicine
Laurel K. Leslie, MD, MPH, American Board of Pediatrics
Robert L. Phillips, Jr., MD, MSPH, American Board of Family Medicine

A core function of certifying boards is to ensure that the content of training and certification exams align with the clinical practice of physicians in their specialty. Another function is planning for the workforce of the future, which requires studying both supply (entrances, progressions, and exits within the workforce) and demand (health care delivery systems, practice patterns, patient care needs). Valid and reliable data are central to these functions.

Different boards employ different strategies for collecting data on diplomates and have developed their methodologies over time to enhance the rigor and increase efficiency. To help others create a roadmap, this session profiles the approaches of the American Board of Family Medicine (ABFM) and the American Board of Pediatrics (ABP). It will cover:

  • The history, rationale, and similarities and differences of the ABFM and ABP data collection strategies
  • The evolution of the data collection methodology and advancing the rigor of the questions
  • How ABFM's data collection methodology has been used to help residency programs obtain feedback on recent graduates and meet program requirements through the National Graduate Survey
  • How strategic, regular reports from collection efforts can benefit organizational management and other stakeholders
  • Key findings of ABFM and ABP research efforts and the potential for multi- board research using these data

Learning Objectives:

  • Articulate the rationale for certifying boards to collect data from Diplomates on their clinical practice.
  • Describe the benefits of aligning Diplomate surveys among ABMS boards
  • Discuss how certifying boards can use data to advance the science of their specialty

Back to Top

Developing Health Systems Science as Medical Education's Third Pillar

Richard Hawkins, MD, American Medical Association
Mellie Pouwels, MA, American Medical Association
Michael Dekhtyar, American Medical Association 

As our health care system evolves, medical schools must ensure that students not only acquire basic and clinical scientific knowledge, but also understand how patients access and receive care.

To bridge the gap between education and practice, the American Medical Association's Accelerating Change in Medical Education (ACE) Consortium has developed an emerging discipline called health systems science. Areas of focus include improving health care quality and value, enhancing patient safety, delivering population-based medical care, engaging in community advocacy, and understanding health care policy and economics.

This session will examine the progress that schools comprising the ACE consortium have made in developing health systems science curricula, including both classroom-based and experiential learning. The presenters will also share consortium efforts to build an assessment infrastructure for health systems science, and to measure how this work translates to GME and clinical practice, and more.

Learning Objectives:

  • Understand how the domains of health systems science are integrated into UME curricula
  • Learn about how instructional methods, clinical experiences, and assessment in this discipline are adding value for all stakeholders
  • Explore how innovations in health systems science may be incorporated into GME and CME/MOC

A Town Hall Meeting: Engaging ABIM Physicians in Your Portfolio Program

David Price, MD, American Board of Medical Specialties
Richard Battaglia, MD, American Board of Internal Medicine

The ABMS Portfolio Program equips health care organizations to support their physicians' professional development and quality improvement efforts in a more universal and streamlined way. But the program's success relies on engagement and buy-in at many levels.

This hour-long town hall session will focus on how American Board of Internal Medicine (ABIM) physicians can make a difference in your Portfolio Program and other issues. The discussion will:

  • Identify successes and challenges in engaging ABIM Diplomates in Portfolio Program activities
  • Address concerns organizational leaders may have about becoming or continuing as a Portfolio Program sponsor
  • Generate strategies for engaging ABIM Diplomates and organizational leaders in a Portfolio Program

Learning Objectives:

  • Learn strategies for increasing ABIM Diplomate participation in your organization's Portfolio Program
  • Understand the reluctance by some organizational leaders to sponsor a Portfolio Program and how to address it
  • Hear how others are gaining program buy-in from organizational leaders

Mini-CEX Workplace-based Assessment (Part II)

John Norcini, PhD, Foundation for Advancement of International Medical Education and Research

As a follow-up to An Introduction to Workplace-based Assessment, this session will take a deeper dive into several workplace-based assessment methods, with a QI-specific focus on mini-CEX. Active participation will be encouraged throughout, and small group activities will focus on developing a faculty consensus on assessment standards and using the methods to provide effective feedback to trainees.

Learning Objectives:

  • Improve understanding of the challenges of workplace assessments
  • Effective strategies for implementing workplace assessments ‘back home'

How Patient-Reported Outcomes in MOC Can Advance Quality Improvement

David F. Martin, MD, American Board of Orthopaedic Surgery
Kevin Bozic, MD, University of Texas

PROMIS®, the NIH-funded database of validated patient-reported outcome measures, is a publicly available system of highly reliable, precise measures of patient-reported health status for physical, mental, and social well-being. This resource can be used to measure health symptoms and quality of life domains such as pain, fatigue, depression, and physical function—all relevant to several specialties and subspecialties.

This session will focus on the movement toward using patient-reported outcome data to improve physician practice through MOC. It will also discuss the commitment by many healthcare institutions to transform their organizations by implementing PROMIS measures across the entire enterprise.

Learning Objectives:

  • Learn about the growing national policy interest in patient-reported outcomes
  • Discuss how PROMIS supports patient engagement, clinical decision-making, and performance improvement
  • Recognize how the American Board of Orthopaedic Surgery is using patient- reported data in its MOC program

Back to Top

Plenary Session II: A Journey Towards Programmatic Assessment

Cees van der Vleuten, PhD, Maastricht University, The Netherlands, Professor and Director of the School of Health Professions Education

In the last 50 years the field of assessment of professional competence has seen remarkable progress. Developments in assessment technology have taken place across all areas of professional competence, ranging from cognitive to behavioral and emotional aspects of competency. This has been accompanied by extensive research.

In order to make assessment more meaningful for learning, however, we need to change our thinking around assessment. We need to move from assessment of learning to assessment for learning, from individual assessment methods to a systems approach of assessment, and from cross-sectional assessment to longitudinal approaches to assessment.

In this presentation, we will give an account of such a synthetic systems approach to assessment called programmatic assessment, and we will illustrate it with an existing assessment practice. You will come away with an understanding of how learning may drive assessment, the value of professional judgment, and the value of a qualitative discourse in assessment.

Advancing Professionalism across the Community (Part I) [see pdfs below]

Advancing Professionalism across the Community (Part I) - Shapiro slides [pdf]
Advancing Professionalism across the Community (Part I) - Lucey slides [pdf]

Jo Shapiro, MD, Brigham and Women's Hospital, Director, Center for Professionalism and Peer Support; ABMS EPCOM Chair
Catherine R. Lucey, MD, UCSF School of Medicine, Vice Dean for Education; ABMS Board of Directors
Reactor: Maxine Papadakis, MD, Professor Emeritus, University of California San Francisco

Experts from the Member Board, hospital, and academic communities share their perspectives on advancing and assessing medical professionalism and professional standing. This is followed by a panel discussion.

Learning Objectives:

  • Recognize the value and limitations of using instituiton-based assessments of professionalism and professional standing in Member Boards' Continuing Certfication programs
  • Identify 'lessons learned' from assessment of professionalism and professional standing in the academic medical setting and the relevance those methods may have for assessment in Continuing Certification programs

Physician Engagement in Quality Improvement: A Town Hall Discussion

Bruce Nitsche, MD, Virginia Mason
Roger Bush, MD, American Board of Internal Medicine and The Joint Commission

Lack of physician engagement is the elephant in the room in quality improvement work. Every health care organization has physician champions who "get it," but to truly integrate performance improvement into everyday practice and attain better patient outcomes, broader-based engagement is key.

This town hall session will be led by two seasoned quality improvement leaders and early ABMS Portfolio Program adopters. They'll share their own vast experience and invite audience participation for an interactive discussion aimed at helping organizations involve physicians more fully in quality improvement initiatives.

Learning Objectives:

  • Better understand the complexities of physician engagement in QI initiatives
  • Develop strategies to improve physician engagement in QI initiatives
  • Increase the number of physicians engaged in QI initiatives at Portfolio Program sponsor institutions

What Constitutes a Reportable QI Effort for MOC Part IV?

R. Van Harrison, PhD, University of Michigan

What constitutes a reportable quality improvement (QI) effort for MOC Part IV is fairly straightforward for an activity performed at one site by one group in one time sequence. However, when a QI effort involves multiple sites, groups, and/or time sequences, should activities be reported as one QI effort or separate QI efforts?

This session will describe principles developed by the University of Michigan to address these potentially complex situations.

The presenters will illustrate the application of these principles to actual QI efforts involving multiple health centers within a department, multiple health centers across multiple departments, sites in affiliated accountable care organization practices, multiple institutions in statewide and national voluntary collaboratives targeting specific medical conditions, research projects involving community practices, and other multiple site/group contexts.

Learning Objectives:

  • Identify functions of a report on a QI effort for individuals involved in leading, participating in, and reviewing a QI effort
  • Learn principles for determining whether QI initiatives across multiple sites/groups/timeframes are better reported as a single effort or multiple efforts

A Journey towards Programmatic Assessment — Point/Counterpoint

Cees van der Vleuten, PhD, Maastricht University, The Netherlands, Professor and Director of the School of Health Professions Education
Rebecca Lipner, PhD, American Board of Internal Medicine
Ann Harman, PhD, American Board of Anesthesiology
Benson Munger, PhD, ABEM / ABPM

This session is a follow-up to Dr. Cees van der Vleuten's plenary presentation "A Journey towards Programmatic Assessment." In point/counterpoint format, a panel of Member Board representatives will explore key messages from the plenary and discuss the applicability of more a formatively oriented "assessment for learning" approach to assessment designed to promote development of knowledge, judgment, and skills in the context of initial and continuing certification programs.

Learning Objectives:

  • Identify key characteristics of "assessments of learning" and "assessments for learning"
  • Describe similarities and differences between traditional high-stakes summative assessments used by ABMS Boards and a programmatic approach to assessment design and development
  • Discuss the relevance and applicability of programmatic assessment for initial and continuing certification programs

Behind the Logo: The Basics of Creating a Winning Brand

Carol McCarthy, Remedy Chicago

Branding is one of the most important aspects of any organization, yet the term is used in a variety of contexts with multiple meanings. While your logo and visual identity are critical aspects of your brand, there's much more to consider.

This session will clearly define branding, and using standards and best practices from industry experts, explore the key components needed to establish or enhance your organization's brand, including brand promise, value, attributes, benefits and features, equity, voice, image, and identity.

Learning Objectives:

  • Establish a clear, concise definition of brand
  • Outline the key elements necessary in establishing or refreshing a brand
  • Form the roadmap for creating a new or updated brand strategy

Back to Top

Embracing Change to Better Serve a Dynamic Constituency

Julie Renner, American Board of Emergency Medicine
Frances Spring, American Board of Emergency Medicine

Change is never easy for organizations, but it is imperative—particularly when accommodating the needs of diverse constituents. The American Board of Emergency Medicine (ABEM) and its Board of Directors have taken significant steps to facilitate and operationalize change to better serve their "customers." This session highlights the lessons learned and best practices that emerged in the process.

ABEM took a comprehensive look at the latest needs of the emergency medicine community, including residency programs, candidates, Diplomates, fellow ABMS Boards, and other emergency medicine organizations. Once changes were decided on, ABEM's Certification Services team—the organization's front line to customers— played an integral role in designing systems and processes to successfully execute them.

Certification Services delivers the day-to-day messaging, explains processes, and cements buy-in from constituents. This session will show how they:

  • Enhanced ABEM's communications portal for residency programs
  • Converted initial certification processes from paper to digital
  • Piloted phasing out a requirement for MOC Communication and Professionalism CP)
  • Transformed customer service using reassuring language and positivity to defuse challenging interactions

Learning Objectives:

  • Learn methods for operationalizing Board of Directors decisions
  • Explore best practices for system and process changes
  • Understand the ABEM approach to providing superior customer service

The Physician Workforce: Understanding Today, Planning for Tomorrow

Laurel K. Leslie, MD, MPH, American Board of Pediatrics
Robert Phillips, MD, MSPH, American Board of Family Medicine

Data collected about the physician workforce play a significant role in the development of Board processes. Boards employ surveys to track numbers of trainees and diplomates as well as define practice patterns. They collect patient-level data to determine patient care needs, capture health care delivery system changes, and make practice improvements.

Increasingly, modeling is being conducted to forecast the workforce of the future and inform Board strategic planning. This session will demonstrate how different research tools are applied toward this end. The presenters will:

  • Discuss why certifying Boards have chosen to study the workforce
  • Present different approaches currently in use: surveys (American Board of Pediatrics); surveys and claims or clinical data (American Board of Family Medicine); modeling (The Physicians Foundation, Health Resources and Services Administration)
  • Discuss the opportunities and risks involved in collecting and employing workforce data to ensure our specialties are adequately staffed, trained, and geographically dispersed to meet the health care needs of the public

Learning Objectives:

  • Describe the common methodologies used to understand the physician workforce
  • Discuss how Boards can collect and analyze workforce data and disseminate findings to inform training and practice improvement
  • Outline the opportunities and risks involved in using workforce data to support public accountability

Mind the Gap: Lessons from One Board's Focus on Global Health

Valerie Haig, American Board of Pediatrics
Sabrina Butteris, MD, University of Wisconsin School of Medicine and Public Health

Global health today encompasses more than delivery and development of health care across international borders. Even for U.S.-focused physicians, a globally relevant skill set is crucial in caring for an increasingly diverse population in nearly every setting. Despite the pressing need, however, training in this area has not been adequate.

As a worldwide leader in child health, the American Board of Pediatrics (ABP) set out to address this gap in global health competency for pediatricians. In 2013, the organization formed a Global Health Task Force to develop a global health agenda around training assessment, certification, quality improvement, and continued professional development. To achieve its goals, the task force produced a variety of publications and resources, MOC activities, and a leadership conference.

ABP has also focused on sharing resources and partnering with international colleagues. Its International In-Training Examination is now delivered in nine countries and available in Spanish and Italian.

This session will highlight ABP's experience and how it might be extrapolated to other medical specialties to improve the quality of training and assessment in a diverse and interconnected world.

Learning Objectives:

  • Appreciate the ever-broadening meaning of global health
  • Review examples of global health resources, self-assessments, and quality improvement activities
  • Learn how the work of ABP's Global Health Task Force might translate to your own Board

Back to Top

Advancing Professionalism across the Boards Community (Part II)

David F. Martin, MD, ABOS, Executive Medical Director
Christopher J. Ondrula, Esq., ABMS Strategic Business Affairs & Legal Advisor
Reactor: Carrie Bradford, MHA, RHIA, CPMSM, CPCS; Northshore University Health System, Senior Director, Professional Staff Services and Credentialing

Experts from the Member Boards, hospital, and medical school communities share their perspectives on advancing professionalism in the medical profession followed by a panel discussion.

Learning Objectives:

  • Recognize the value and limitations of peer review surveys for assessment of Professionalism and Professional Standing
  • Understand legal considerations in the environment within which Member Boards assess the professionalism and professional standing of diplomates
  • Identify ‘lessons learned' from assessment of Professionalism and Professional Standing in the academic medical setting and the relevance those methods may have for assessment in Continuing Certification programs

Modernizing CME Accreditation to Improve Learning and Patient Care

Kate Regnier, MA, MBA, Accreditation Council on Continuing Medical Education
Mindi McKenna, PhD, MBA, American Academy of Family Physicians
Alejandro Aparicio, MD, FACP, American Medical Association

In this session, you will have the unique opportunity to share feedback regarding design principles that are being considered in modernization of the country's oldest CME accreditation system. The goal is to ensure that CME accreditation standards optimally drive improvements in learning, assessment and patient care quality.

Technology now makes it feasible to facilitate personalized practice gap analysis, engagement in practice-relevant learning, and translation of new knowledge or skills in ways that align with the aim of improving population health, containing health care costs, enhancing patients' experience of care, and supporting physician well-being.

Payers are evolving their systems and transforming their organizations in order to drive value, not just volume. Likewise, CME accreditors and certifying and licensing boards are evolving systems to support the national quality strategy with minimal administrative burden.

You will hear about new accreditation standards under development meant to facilitate more meaningful engagement of physicians in assessing their practice gaps learning needs, and translating their learning into improvements in practice.

You may then provide feedback on the new credit system conceptual model, and offer suggestions for implementing those changes in ways that will be synergistic with the certifying boards and CME provider community.

Together, we will explore how credit system modernization can best complement innovations underway in specialty board certification.

Learning Objectives:

  • Understand changes underway in the accreditation of learning activities
  • Provide feedback on those changes
  • Identify opportunities for synergy among certifying boards and CME/CPD

Please Understand Us: How to Attract and Retain Millennials

Amelie Karam, Amelie Karam Speaking and Consulting  

It seems everyone is talking about millennials — and with good reason. By 2020, this generation (currently between the ages of about 20 and 36) will make up half of the workforce. By 2029, the last baby boomers will have turned 65, giving millennials even more prominence.

Better understanding and engaging these young professionals can go a long way in improving your work environment and culture. In fact, organizations that do not prepare risk missing out on the best and brightest millennial talent.

Amelie Karam has presented on this topic to audiences nationwide. A millennial herself, she offers unique insights into what leaders should be doing today to attract and retain this newest generation of professionals. Her engaging style and approach will leave you feeling enlightened and inspired.

Learning Objectives:

  • Learn how different generations can better communicate and work together to meet common goals
  • Better understand millennials and their needs, to improve both associate and patient satisfaction scores
  • Gain greater insight into today's multi-generational patient healthcare environment

Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects [see pdfs below]

Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects - Humiston slides [pdf]
Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects - Noonan slides [pdf]
Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects - Albertin slides [pdf]

Sharon Humiston, MD, MPH, FAAP, American Academy of Pediatrics
Laura Noonan, MD, Center for Advancing Pediatric Excellence at Levine Children's Hospital
Christina Albertin 

Pediatricians must participate in quality improvement (QI) projects as part of their MOC programs, but it's not always easy for them to identify an appropriate project. The project must be applicable to their primary care focus, meaningful to them as prevention leaders, and allow them to play a central, but manageable role.

This session focuses on a projects that ticks all of those boxes and also fills a growing public health need: increasing adolescent human papillomavirus (HPV) vaccination rates in pediatric offices and clinics.

The presenters will describe the methods and results of HPV vaccination QI projects undertaken by American Academy of Pediatrics chapters and the Academic Pediatric Association's research network, CORNET. They include experiential learning with some didactics, simulation, and then action. In addition to examples of actual QI process products (e.g., clinic flow maps used to help prioritize change ideas), you will see both quantitative and qualitative results.

The session will wrap up with lessons learned, resources, and opportunities for further collaboration.

Learning Objectives:

  • Formulate a change cycle that incorporates change ideas relevant to those previously published in the medical literature on vaccination, and specialty to HPV vaccination
  • Hear examples of approaches taken by AAP chapters to increase HPV vaccination coverage
  • Learn how faculty can help pediatrics residents connect with QI projects that are both meaningful and meet certification requirements

Tailoring QI Education Intervention Projects for Community Health Care

Muhammad Jaffar, MD, University of Arkansas for Medical Sciences
Wendy McCloud, MA, University of Arkansas for Medical Sciences

This session will highlight quality improvement education interventions that the University of Arkansas for Medical Sciences (UAMS) developed for two underserved Arkansas Delta Region hospitals.

The goal of the trainings, which were tailored to each facility, was to decrease mortality from preventable medical errors through advanced simulation scenarios, and to decrease health care costs by teaching prevention and/or early infection identification best practices to the health care professionals.

The presenters will describe these and other outcomes:

  • A collaboration between UAMS content experts and hospital leaders in reviewing and revising hospital policies and procedures
  • Follow-up procedures with each facility, including the creation of four accredited online learning modules to reinforce the training content
  • The close relationships fostered between UAMS and the two hospitals, which have led to the hospitals requesting additional training and best practices

Learning Objectives:

  • Review and revise hospital policies and procedures
  • Train hospital staff on current best practice techniques in hands-on learning sessions
  • Teach assessment and management techniques through simulation scenarios involving standardized patients

Back to Top

Accelerated Test Development: Strategies for Success

Robert Brucia, MEd, American Board of Pediatrics
Andrea Hunolt, American Board of Anesthesiology

In a rapidly changing environment, test development teams are under increasing pressure to work on expedited timelines. Having specific processes and strategies in place can help ease the burden this creates—and also ensure that quality is upheld.

The American Board of Pediatrics (ABP) and the American Board of Anesthesiology (ABA) have both been challenged by accelerated timelines as they have introduced non-proctored MOC assessment models, accessed by diplomates via personal computer or mobile device.

ABP's MOCA-Peds pilot and ABA's MOCA Minute® pilot required setting clear timelines and milestones, working more closely with subject matter experts, utilizing online platforms for editing and review, and creating large banks of items to draw on. These and other steps ensured that all items received the same rigorous review and scrutiny as traditional exams while compressing what would normally be a two-year development cycle down to several months.

Representatives of both organizations will share their experiences and recommendations in this session. You'll leave feeling better prepared to develop content for new products when time is of the essence.

Learning Objectives:

  • Know the important variables to consider when rapidly developing test content
  • Develop and implement training strategies for subject matter experts
  • Understand how to set realistic timelines and milestones

Leveraging Assessment to Improve Diagnosis

Hardeep Singh, MD, MPH, Michael E. DeBakey Veterans Affairs Medical Center and Baylor College of Medicine
David Swanson, PhD, American Board of Medical Specialties

Getting the diagnosis right is key in delivering quality health care. Yet, the diagnostic process is layered, complex and prone to error.

The landmark 2015 report Improving Diagnosis in Health Care focused national attention on the prevalence of diagnostic error, casting diagnosis as a process in which every patient and health care professional must be an active and engaged participant. Published by the Institute of Medicine (now the National Academy of Sciences, Engineering and Medicine), the report challenged medical educators, training programs, and the certification community to ensure that medical specialists have and maintain the competencies needed for effective performance in the diagnostic process across their career trajectory.

This session will consider ways the Boards community can help meet that challenge. You'll hear about opportunities to advance improvement in diagnosis through initial and continuing certification programs as well as innovations that are underway to better assess clinical reasoning; to recognize, acknowledge, and manage uncertainty; and to identify specialty-specific clinical concerns.

Learning Objectives:

  • Increase your familiarity with the causes of diagnostic error and mechanisms for improving diagnostic accuracy
  • Understand the relationship between uncertainty and error and how it impacts diagnostic process
  • Explore longitudinal assessment and other certification-related strategies for improving diagnostic accuracy and clinical reasoning

Update on International Activities: ECFMG, ACGME-I and ABMS-I [see pdfs below]

Update on International Activities: ECFMG, ACGME-I and ABMS-I - Pinsky slides [pdf]
Update on International Activities: ECFMG, ACGME-I and ABMS-I - Lewis slides [pdf]
Update on International Activities: ECFMG, ACGME-I and ABMS-I - Allbee slides [pdf]

William W. Pinsky, MD, ECFMG
Lorraine Lewis, EdD, ACGME-International
Mira Irons, MD, ABMS
Krista Allbee, ABMS-I

This session will provide information and advances related to the work each organization is doing internationally. The session will focus on the impact of US policy on international medical graduates seeking training or work in the US, accreditation of residency programs internationally, and providing certification internationally.

Learning Objectives:

  • Improve the understanding of current advances across the spectrum of undergraduate medical education, graduate medical education and board certification internationally.
  • Advance knowledge related to future international initiatives.
  • Identify potential opportunities for collaboration through international initiatives.

Back to Top

Streamlining Certification, QI, and Reporting to Reduce the Burden

Sarah Hajjar, MPA, PMP, American Board of Family Medicine
Elizabeth M. Bishop, PhD, MS, PMP, American Board of Family Medicine
John Johannides, PMP, American Board of Family Medicine

In 2012, the American Board of Family Medicine set out to simplify MOC for family physicians and make it more meaningful. The result is the PRIME Registry, which extracts patient data from electronic health records and turns it into actionable measures, helping to track the quality of patient care while also reducing the reporting burden for certification and performance improvement activities.

This session tracks ABFM's journey over the last five years toward this more comprehensive, streamlined approach. The presenters will describe the following steps and others, including best practices and lessons learned:

  • The pilot study that assessed the data collection methods and their outcomes
  • Vendor selection for a quality measurement platform
  • Identification of clinical quality measures
  • Naming of the registry
  • Measuring governance efforts

They will close with a look at future enhancements and refinements to the PRIME Registry and ABFM's overall certification process.

Learning Objectives:

  • Understand the ABFM's journey from pilot study to a fully functioning patient data registry
  • Learn how the PRIME Registry is used to help physicians identify gaps in performance and appropriate improvement activities
  • Hear how the registry aids physicians in the transition to value-based payment

Strategic Planning and KPIs

Carol Henriques, MBA, HighBar Consulting
Lori Gruber, American Board of Medical Specialties

Organizations that successfully implement a strategic plan find that their business culture is enhanced, projects are completed on time and on budget, and the proverbial "wheels" seem to turn a bit easier. As organizations review their strategic plans regularly, they then need to consider tracking key performance indicators (KPIs) to evaluate their success in meeting goals and objectives. This session will take a deeper dive in how to create a business strategy and how to implement the strategy from an operational to a tactical level for positive organizational impact by aligning all resource efforts back to strategic goal. It will also offer insights on how organizations should be utilizing KPIs to measure and evaluate performance and to provide insights on how KPIs can influence necessary adjustments to a strategic plan.

Learning Objectives:

  • How to create a strategic plan
  • How to implement the strategic plan from an operational to a tactical level
  • How to develop an measure KPI's to evaluate performance and advancement of the strategic plan
  • How to operationalize KPIs

Test Accommodations: Hot Topics, Technology Trends and a Legal Update

John Hosterman, PhD, Paradigm Testing
Michelle Goldberg, PhD, National Board of Medical Examiners

The landscape has changed considerably in the area of test accommodations. This session will give an overview of trends and best practices in three critical areas:

  1. Legal and regulatory issues, including recent key court decisions and Justice Department guidance
  2. Requests for adaptations that may adversely impact test validity or security
  3. Emerging issues with assistive technology, particularly for candidates with vision impairments

The panelists—experts in the areas of disability law, accommodations, and assistive technology—will provide the high-level updates that every testing organization needs to be aware of. They will emphasize a perspective that uses a moderate, reasonable approach, ensuring that candidates with disabilities have full access to the test, while also protecting the integrity of the test and security of test content.

Learning Objectives:

  • Hear updates on laws and legal trends that inform operational policies and practices
  • Discuss trends in adaptation requests—particularly those that may impact the validity or security of the test—and ways to mitigate concerns
  • Explore the latest tools and approaches in assistive technology and strategies for balancing accessibility needs with costs

Back to Top

Board and Specialty Society Collaboration: Opportunities and Challenges

Kevin Rode, American Board of Family Medicine
Elizabeth Campbell, American Academy of Family Physicians

When a Board and a specialty society work well together, it can significantly advance the missions of both organizations. But sometimes hurdles arise.

In this session, representatives from the American Board of Family Medicine and the American Academy of Family Physicians will describe their experience in collaborating on various initiatives. They'll give case examples touching on the following:


  • Staff-to-staff regular communications (dyad meetings)
  • In-person staff collaboration meeting annually
  • CME data service for exchanging CME credits
  • Activity completion service to share completion updates
  • Physician comparison data exchange


  • Data-sharing agreements
  • Different organization objectives and business models

The speakers will then lead attendees in a discussion about other opportunities and challenges in communication and collaboration between Boards and specialty societies.

Learning Objectives:

  • Identify opportunities for Boards and specialty societies to complete mutually beneficial projects
  • Discuss challenges in communication and identification of common goals given different missions, business models, and structures

Bring Your Data to Life with Infographics

Pilar Padilla, American Board of Internal Medicine
Eugene Woo, Venngage

Infographics are your most important tool for communicating a complex story quickly. They're accessible, attractive, and memorable—when done right. In this session, you will learn the steps for creating effective infographics, including a thoughtful strategy, clear narrative, cogent data, dynamic design, and lucid text. You'll discover proven processes and time-tested techniques for turning out irresistible infographics.

Learning Objectives:

  • Kickstart your knowledge of infographics
  • Learn to tell your data-driven story in a compelling, powerful, and straightforward way
  • Discover quick and repeatable visual tricks for ensuring infographics convey a clear message

Supervising Medical Student QI Activities: A New Option for MOC Credit

Jeffrey Tabas, MD, UCSF School of Medicine
Donald Moore, PhD, Vanderbilt School of Medicine

Almost all physicians need to provide evidence of participation in Improvement in Medical Practice activities for MOC Part IV credit. Now there's an additional way to achieve this.

Selected by the ABMS Portfolio Program, the University of California San Francisco (UCSF) and Vanderbilt University are piloting programs that grant MOC Part IV credit to faculty who meaningfully supervise medical student quality improvement (QI) projects designed to improve patient care.

At UCSF, students are assigned to a coach and participate in a longitudinal clinical microsystem clerkship during the first 18 months of medical school. In September 2016, 180 medical students began participating in QI projects under the supervision of 28 coaches.

At Vanderbilt, students enroll in a 12-week course, implementing a QI project in the clinical setting of a faculty member and presenting a poster on it. Between September 2015 and August 2016, 75 projects were completed with more than 100 students and 54 faculty coaches participating.

This session will review the results of these pilot initiatives to date and offer insights for how the program might be adopted more broadly—for the benefit of medical schools, physicians, and students alike.

Learning Objectives:

  • Hear about the implementation of the pilot program to award MOC credit for supervision of medical student QI activities
  • Discuss the components of meaningful faculty participation in such a program
  • Identify barriers to implementation

How Survey Research Can Engage the Diplomate Community [see pdfs below]

How Survey Research Can Engage the Diplomate Community - Reddy slides [pdf]
How Survey Research Can Engage the Diplomate Community - Jones & Rizzo slides [pdf]

Siddharta Reddy, MPH, American Board of Internal Medicine
Andrew T. Jones, PhD, American Board of Surgery
Anne G. Rizzo, MD, American Board of Surgery

Through a multi-pronged approach known as community engagement, the American Board of Internal Medicine (ABIM) and the American Board of Surgery (ABS) tapped diplomates to help transform their MOC programs. This session takes a look at each organization's process of using surveys and other research to inform program revisions—and the results they achieved.

When ABIM surveyed diplomates about desired attributes in an MOC program, they embedded a probability sample within their census to ensure a greater response rate and meaningful inferences. Using a cash incentive and email/phone reminders, they issued a second survey for further input. All respondents were then invited to be part of a Community Insights Network, a panel of nearly 3,000 diplomates reflecting the overall population. As predicted, a subsequent survey of this group garnered a significantly higher response rate.

ABS started by surveying a random sample of diplomates. Results showed that diplomates strongly preferred a practice-focused/modular approach to MOC. So ABS extensively analyzed surgeon practice patterns to develop modules for an MOC pilot program, which they will continue to evaluate and improve.

Learning Objectives:

  • Learn how to engage the diplomate community in MOC planning through different survey methods
  • Explore how survey data can advance evidence-based policy making
  • Compare two approaches to community engagement and what made each successful

Improved Physician Engagement and Patient Experience at Seattle Children's

Jennifer Scott, MHA, Seattle Children's Hospital
Erin Alberda, LAc, Seattle Children's Hospital

Seattle Children's Hospital has had significant success with its Multi-Specialty Portfolio Program by engaging physicians from across the organization through an MOC Part IV project called CONNECT, now in its third year. This session will describe the project and lessons learned.

Led by physicians, CONNECT aims to strengthen job satisfaction by teaching skills that improve relationships with patients and families. While MOC Part IV credit was initially offered to encourage physician participation, CONNECT participants began to see the value of using the MOC structure to reinforce learning objectives and sustain behavior change. Each improvement cycle generated new ideas from participants and facilitators, which helped refine and expand the project goals.

Qualitative feedback indicates that CONNECT is meaningful to physicians, with one commenting, "This project was actually relevant for my daily practice rather than just checking off required MOC needs!"

The success of this model has now spread to other initiatives at Seattle Children's, including patient safety and value improvement.

Learning Objectives:

  • Discuss ways to align organizational goals with a MOC program to improve physician engagement
  • Learn novel interventions to inspire-and sustain-physician behavior change
  • User of test-cycle (PDCA) approach to improving MOC projects

Back to Top

Aligning CME and MOC: A Case Study in Collaboration

Kate Regnier, MA, MBA, Accreditation Council on Continuing Medical Education
Melissa Lamaffar, American Board of Pediatrics
Diana Davidson, American Board of Anesthesiology
Jonathan Mimm, American Board of Internal Medicine

Collaboration with other specialty boards is one of the most effective ways to improve the continuing medical education (CME) process—both for physicians and providers. This session will demonstrate one such collaboration and its successful outcomes.

The Accreditation Council for Continuing Medical Education (ACCME), the American Board of Internal Medicine (ABIM), the American Board of Anesthesiology (ABA), and the American Board of Pediatrics (ABP) saw an opportunity to simplify the integration of maintenance of certification (MOC) and accredited CME. They worked together to allow educational activities to count for multiple requirements, create a data-sharing platform, and develop an online search tool for diplomates (cmefinder.com).

Learn how these boards simplified and aligned their processes, created more flexibility for physicians, and identified and implemented improvements.

Learning Objectives:

  • Hear a collaboration success story that streamlined requirements and processes for diplomates and CME providers
  • Assess your own approach and identify opportunities for better addressing the needs of diplomates and CME providers
  • Explore options for collaboration with ACCME and other specialty boards

Patient Advocacy—What It Means for Our Community and Those We Serve

Patience Leino, American Board of Pediatrics and Patient Advocate Representative
Tricia Lawrenson 

No matter what specific role we hold, our work in this industry is ultimately all about patients.

In this session, a representative of the American Board of Pediatrics will share ways to incorporate patient engagement into your work, how to become involved in patient advocacy, and the impact patient advocates can have on the health care experience overall.

A patient will also join the session to share her perspective, including his/her experience within the health care system and the difference a patient advocate has made in his/her care.

Learning Objectives:

  • Understand the role patient advocacy has within the Member Board community
  • Find out how you can get involved in patient advocacy
  • Learn how to incorporate patient advocacy into your individual role

Hiring from a Slate of One

Timothy Pappas, MA, Principal Pappas and Delaney, LLC

Noted national executive search professional, Tim Pappas, will provide insight into hiring people who have the ability to thrive in your organization. For the past 25+, Mr. Pappas has been helping organizations identify, interview, hire and retain top-notch executive talent both effectively and quickly, Mr. Pappas will focus on the essential internal discussions before a candidate is even interviewed. "Most mistakes in hiring are made before a candidate is even interviewed," says Mr. Pappas. He will develop concepts to truly ramp up the organizations' ability to land that seemingly elusive top talent. This interactive and entertaining presentation is sure to provide anyone attending with ideas to implement immediately.

Learning Objectives:

  • Identify, interview, hire and retain top-notch executive talent effectively and quickly
  • Utilize essential internal discussions before a candidate is interviewed
  • Learn concepts to ramp up your ability to land elusive top talent

ABIM and ABFM Reveal Benefits of MOC Prep in a 'Study of Studying'

Aimee Eden, PhD, MPH, American Board of Family Medicine
Elizabeth Hansen, BA, American Board of Family Medicine

How does preparing for an MOC exam impact physicians and their patients? Researchers at the American Board of Internal Medicine (ABIM) and the American Board of Family Medicine (ABFM) designed and executed a qualitative study to find out. This session will detail the results.

The research team hypothesized that the exam process may lead to useful learning that can benefit patients, even for physicians who do not see value in the MOC exam — both by exposing them to useful new information and by reinforcing/refreshing their existing knowledge. The ABIM-ABFM team interviewed a sample of 40 general internists and 40 family physicians who recently took an MOC exam and found that nearly all devoted significantly more time and resources to study for the exam than what they would normally do to stay current.

For most interviewees, knowledge gained through exam preparation appeared to improve care, in one or more of the following: improved diagnosis, better understanding of guidelines, and reduced need for referrals, less unnecessary testing, changes in prescribing, and/or improved communication with patients." We don't want to overstate the impact of studying.

Learning Objectives:

  • Learn about the ABIM-ABFM study design, including the recruitment process that ensured a representative sample
  • Identify common approaches physicians use to prepare for the MOC exam, as well as their costs
  • Hear examples of knowledge gains and practice changes that resulted from physicians preparing for the MOC exam

Back to Top

OSCEs: The Final Step in a Staged Primary Exam System

Anna Menzies, American Board of Anesthesiology
Ann Harman, PhD, American Board of Anesthesiology
Huaping Sun, PhD, American Board of Anesthesiology

In 2018, the American Board of Anesthesiology (ABA) will add an objective structured clinical examination (OSCE) component to the final stage of its primary certification series. The OSCEs will allow for competency-based assessment, including communication, professionalism, and technical skills related to patient care.

As the first U.S. medical specialty board to incorporate OSCEs into a high- stakes certification exam, the ABA has navigated largely uncharted waters in its planning and development process, experiencing some rough currents along the way. Initial OSCE blueprints were complicated and needed to be simplified to encompass fewer domains. A new group of content experts was assembled to develop scenarios based on the updated skill areas. Along the way, ABA gained valuable insight from other organizations that use OSCEs, including the National Board of Medical Examiners and organizations in the UK and Israel.

In this session, ABA staff involved in OSCE development, administration, and scoring will discuss their road to innovation, including lessons learned and final preparations for their upcoming launch.

Learning Objectives:

  • Understand what's involved in incorporating OSCEs into a high-stakes certifying exam
  • Explore various OSCE scenarios and how to incorporate standardized patients into the exam development process
  • Discuss the scoring process for a new assessment

Beyond Reporting: Designing Data Registries to Support Practice Improvement

Anthony Asher, MD, Levine Cancer Institute and Neuroscience Institute, Carolinas HealthCare System, and National Neurosurgery Quality and Outcomes Database
Robert Phillips, MD, MSPH, American Board of Family Medicine

When the Qualified Clinical Data Registry (QCDR) was introduced in 2014 as a reporting option under the Medicare Physician Quality Reporting System, it stimulated investment in registries for data collection and performance measurement. As it became easier to extract data from electronic records and incorporate measures that matter to patients and clinicians, registries quickly evolved to become the backbone of clinical quality and improvement activities within the specialties. They are also now essential for participation in Medicare's Quality Payment Program.

In this session, the presenters will describe how their specialties have designed registries to support professional improvement initiatives and align their Boards' MOC programs with federal and state quality incentive programs. They will discuss ways registries can be designed to target high-value, high- priority quality concerns; provide clinicians with meaningful, actionable information; and satisfy multiple reporting requirements while making MOC programs more professionally rewarding, convenient, and impactful.

Learning Objectives:

  • Identify ways that QCDRs can support individual performance improvement activities
  • Learn how QCDRs can transform programs for continuing certification and at the same time support physicians in satisfying quality incentive and reporting programs

Stakeholder Analysis: A Useful Tool for MOC Program Sponsors

Jeanne Kin, MHA, JD, University of Michigan

Each ABMS Multi-Specialty Portfolio Program exists in a unique organizational context with different levels of complexity and a diverse array of stakeholders. Stakeholder analysis (also known as stakeholder mapping) arms you with a systematic method for understanding the power, interests, and influence of everyone involved in your MOC program.

In this session, Jeanne Kin will demonstrate how a thoughtful stakeholder analysis or map can help:

  • Engage the right people in support of your MOC program
  • Gain the resources you need for your program to succeed
  • Communicate more effectively with key stakeholder groups
  • Better meet your customers' needs

The discussion will provide specific examples of stakeholder analysis and mapping tools applied in the setting of an MOC program. You will leave with a template for creating a stakeholder grid or map specific to your organizational context.

Learning Objectives:

  • Understand the purpose and process of conducting a stakeholder analysis
  • Use a few different stakeholder mapping tools and grids, customized to MOC programs
  • Apply a stakeholder analysis within your own environment

Communication Skills Key to Better HCAHPS Scores

Barbara Lewis, MBA, DocCom

Patient experience is increasingly tied to health care providers' bottom line. For example, hospitals receive incentive payments based on scores from patient satisfaction surveys known as Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS). Recent HCAHPS analytics indicate that the two communication dimensions on the survey have the biggest impact on the scores.

This has forced health systems to ensure that physicians are strong communicators, and that focus begins with interns, who arrive at residency program orientation with various levels of communication skills.

To test whether this could be improved, one residency program assigned learning modules on online communication skills to interns before orientation. Assessments before and after the interns completed the self-directed training indeed showed big improvements in their skills: empathic recognition scores increased from an average of 41 to an average of 96, and multiple-choice scores went up by as much as 75 percent.

With an increasing focus on patient-centered care, hospitals and residency programs are adopting online curricula, similar to the residency program's study, that allow clinicians to improve communication skills anywhere, anytime.

Learning Objectives:

  • Learn the evidence-based importance of communication skills
  • Find out how to assess the communication skills learning curriculum at your institution
  • Understand the relationship between HCAHPS survey scores and the survey's two communication dimensions

Evening Reception at The Field Museum

Join your colleagues at The Field Museum where you will discover artifacts from civilizations past, explore almost every corner of the globe, learn about new scientific discoveries, and walk away inspired! Every space at The Field Museum reveals new knowledge.

When you enter Stanley Field Hall, you’ll be standing on 300 million-year-old fossilized limestone and standing in awe of SUE, the largest, most complete and best preserved Tyrannosaurus rex fossil yet discovered. Under her watchful gaze, enjoy appetizers and beverages while networking with peers from all over the United States.

Shuttle buses will take you from The Westin Michigan Avenue to the front door of Chicago’s most exciting and unique museum overlooking beautiful Lake Michigan and Chicago’s breathtaking skyline.

Back to Top

Plenary Session IV: Do Patients Care About Board Certification? What Do They Want, Need, and Have the Right to Expect?

Pat Mastors, Director of Engagement & Board Chair, Patients' View Institute

These are uncertain times for those who receive medical care, those who practice medicine, and for long-revered bodies—inside and outside of health care —that regulate standards and assess competency. With so many policy and regulatory levers in flux, health care leaders are agonizing over where to invest, what to prioritize, and with whom to collaborate. How to choose the best path forward?

The True North during these turbulent times lies in venturing into the heart of health care: what is it that patients want, need, and have a right to reasonably expect? We fail to address this at our peril: health care consumers are more awake than ever to health care cost and value; outside-industry disruption is giving patients more choice and control; and consumer rating systems that track metrics patients care about seem to be sprouting like mushrooms. Where does Maintenance of Certification and quality assurance fit into this changing landscape? What does it all mean to patients? And how can we best ensure that our system of vetting physicians and other clinicians remains viable into the future? In this journey we will walk through the territory patients currently navigate, and discover the challenges and opportunities around us.

A Structured QI Curriculum That Works for Trainees and Faculty Alike

Rani Gereige, MD, MPH, Miami Children's Health System
Beatriz Cunill, MD, Miami Children's Health System

ACGME requirements specify that all GME trainees must complete a QI project. This can be a challenge for academic medical centers with multiple residency and fellowship programs. They must design a QI curriculum that is comprehensive enough to meet the needs of all of its learners while also allowing reasonable time for them to complete their projects—sometimes within just a year.

This session will highlight the experience of one institution in designing a QI curriculum that meets this challenge while also linking the GME requirement to MOC and CME for faculty. The presenters will share the success of their structured curriculum/process that can be customized based on the length of the training program.

Learning Objectives:

  • Learn about one sponsoring institution's QI curriculum for trainees and how it was linked to MOC and CME
  • See how a QI process improvement plan was applied to the QI curriculum to achieve the GME goals and meet the needs of the faculty

Evaluating the AAMC's Leadership Programs Using the Principles of Instructional Design

Nancy Moeller, PhD, Association of American Medical Colleges (AAMC)
Jacqueline Loweree, MA, AAMC

One of the challenges for professional associations is consistently providing high-quality and cutting-edge learning and leadership development programs for a diverse membership. A recent organizational push for greater quality and consistency across the learning and leadership development portfolio of the Association of American Medical Colleges (AAMC) prompted the evaluation team to assess the cumulative findings more holistically.

The findings were organized into components of an instructional design model, namely the ADDIE model (for Analysis, Design, Development, Implementation, and Evaluation) (1975; Centre for Educational Technology at Florida State University for the U.S. Army). This session will focus on the challenges involved with improving the learning and leadership development programs currently in the AAMC's portfolio, as well as how these challenges led to a more holistic effort to evaluate program effectiveness and fostered the continuous improvement discussions for all leadership development programs. Specific examples of how this holistic effort has actually been applied to improve the quality of several leadership development programs will also be shared.

Learning Objectives:

  • Discuss some of the challenges involved in supporting the learning needs of a multidisciplinary community of professionals
  • Learn how evaluators used the ADDIE model (commonly used for instruction design) to promote discussion and continuous improvement efforts for a number of AAMC learning and leadership development programs
  • Understand how a unique mixed-method systemic review of evaluation findings from different programs can improve the consistent provision of learning opportunities offered by the AAMC

Design of the Continuous Knowledge Self-Assessment

Thomas O'Neill, PhD, American Board of Family Medicine
Michael Peabody, PhD, American Board of Family Medicine
Aimee Eden, PhD, American Board of Family Medicine

In January 2017, the American Board of Family Medicine introduced the Continuous Knowledge Self-Assessment (CKSA) which is designed to provide physicians with ongoing feedback regarding their ability level in broad spectrum family medicine, the accuracy of their confidence in their knowledge and decision-making ability, and hopefully with an opportunity to identify gaps in their knowledge.

This session will discuss the CKSA's purpose, question delivery/data collection functioning, immediate feedback, and long-term plans for more sophisticated aggregated feedback. The presenters will also explain:

  • Discuss the difference between lifelong learning and self-assessment and how ABFM envisions using CKSA to help physicians select CME
  • How the CKSA provides indicators of physicians' metacognitive accuracy (including what metacognitive accuracy is and why it is important to physician education as well as safety in medical practice)
  • How the CKSA provides ability estimates of physicians' medical knowledge and clinical decision-making, which can be used to predict their probability of passing the certification examination—reducing anxiety for those who are prepared and motivating those who are not
  • In addition, the presenters will share how the new CKSA has been received by family physicians

Learning Objectives:

  • Better understand what metacognitive accuracy is and its relevance to physician education and practice
  • Understand how the CKSA can be used by physicians to continuously monitor their medical knowledge and clinical decision-making ability in a manner that permits comparisons to the certification examination's passing standard to be made

Obesity Medicine: Building Credibility and Seeking Certification in a Stigmatized Field

Dana Brittan, MBA, American Board of Obesity Medicine
Robert Kushner, MD, Northwestern University Feinberg School of Medicine, Center for Lifestyle Medicine
Kevin McAllister, MEd, National Board of Medical Examiners

Officially recognized as a disease by the American Medical Association in 2013, obesity now affects nearly 35 percent of U.S. adults, contributing to a host of health problems. According to a recent survey, most doctors want to help patients lose weight but admit they have little or no training in weight management and nutrition.

The American Board of Obesity Medicine is committed to using the certification process to increase patient access to physicians who are qualified to treat this complex disease. The organization aims to see an obesity medicine specialist in every U.S. community.

This session will demonstrate how ABOM has created a credible examination in partnership with the National Board of Medical Examiners. The discussion will cover selection of content experts, training in item writing, and the item development process — all a challenge in an emerging field of medicine.

The presenters will also discuss building consensus in what comprises evidence-based, standardized practice in obesity medicine, and highlight the rise in the number of physicians from numerous specialties achieving ABOM Diplomate status and showing interest in this fast-growing field.

Learning Objectives:

  • Discuss the development of a credible examination with high-quality items for an emerging field of medicine
  • Understand the challenge of creating credibility in a stigmatized specialty
  • Learn how ABOM engaged physicians from over 10 ABMS Member Boards

Back to Top

The Changing Context of Patient Care: Physician Practice in a Redesigned System

Adam L. Myers, MD, FACHE, CHCQM, CPHRM, Texas Health Physicians Group
John R. Combes, MD, Senior Advisor, The Southport Group

Facing enormous market and financial pressure, hospitals are moving to integrated payment and delivery models to better align clinical processes and health care operations. These new models are redefining their relationships with clinicians, making new demands on physicians, and emphasizing new skills, including teamwork, care coordination, inter-professional and patient communication, safety practices, and proficiency with information technology.

Anticipating this seismic shift, the American Hospital Association examined the ABMS/ACGME competencies framework in a 2013 report, judging the competencies of professionalism, interpersonal communication, practice-based learning and improvement, and system-based practice as the keys to success in the emerging delivery environment.

This session will explore the changing role of physicians in a redesigned healthcare system and the implications for medical specialty certification.

Learning Objectives:

  • Understand the changing context of medical specialty practice and the new competencies needed
  • Identify opportunities for physician leadership
  • Identify ways Boards can support physicians' participation in integrated delivery networks

Build Your Social Media Presence [see pdfs below]

Build Your Social Media Presence - Bruno slides [pdf]
Build Your Social Media Presence - DuBose slides [pdf]
Build Your Social Media Presence - Padilla slides [pdf]

Kristi Bruno, MA, American College of Chest Physicians
Ramona DuBose, American Board of Pediatrics
Pilar Padilla, American Board of Internal Medicine

No matter what your communications goals, social media has a place in your strategy. But simply posting content is not enough. Social media platforms continually tweak their algorithms to bring the best content to the top. Your challenge is to keep up with those changes and to stand out in a very noisy environment. We'll look at effective strategies using all the major social media tools—what you should (and should not) be doing to get your message in front of the right audience.

Learning Objectives:

  • Learn what you can expect to achieve through social media
  • Determine which social media channels to use for your strategic goals
  • Hear best practices for getting eyeballs on your posts

Committee on Continuing Certification (3C) Update and SIG Forum

This session will be closed to ABMS Member Board staff and will focus on the successes of the 3C Committee and their ongoing commitment to disseminating ‘best practices' of Continuing Certification Programs across the Boards' Community. Additionally this session will engage members of the Boards Community in a ‘Shared Information Group' format to allow for the exchange of lessons learned, and effective strategies to sustain continuous quality improvement efforts of the Member Boards Continuing Certification Programs.

Learning Objectives:

  • Improve communication and collaboration efforts across the Boards' Community
  • Advance the implementation of ‘best practices' across Member Boards Continuing Certification Programs

Back to Top

Independent Physicians to Large Collaboratives: Managing a Diverse MOC Portfolio

Patrick Dolan, MD, University of Chicago Medicine Comer Children's Hospital

Designing and coordinating MOC projects is complex by nature, but when it needs to happen across multiple sites and health systems, it can be daunting.

As a physician lead for MOC and Multi-Specialty Portfolio Programs for Advocate Physician Partners—covering an area from central Illinois to the Wisconsin border—Patrick Dolan learned a lot about complex MOC programs.

In this session, he will focus on three fundamental concerns:

  1. How to make projects for both employed and independent physicians, including the challenges of working with each of these groups, the motivation needed for each, and the benefits that each brings to the table;
  2. How to create multiple types of projects, from single physicians to large collaboratives, including criteria for each, the benefits and challenges of offering a diversified portfolio of projects, and how the ABMS Portfolio Program can help in the process;
  3. How to coordinate it all, given different levels of physician engagement and project types—and what measurements or interventions can be used to show improvement for both the physician and the hospital system?

Learning Objectives:

  • Discuss how to address the needs of both independent and employed physicians
  • Understand how to create programs that span from single physicians to large collaboratives
  • Hear about the many aspects of coordinating across different specialties, employee models, and project types

How Diplomate Feedback Can Boost Certification Satisfaction

Aimee Eden, PhD, MPH, American Board of Family Medicine
Mingling Dai, PhD, American Board of Family Medicine
Lars Peterson, MD, PhD, American Board of Family Medicine

Soliciting diplomate feedback is one of the most obvious ways to improve certification activities. But how is this best achieved?

In this session, the American Board of Family Medicine (ABFM) will showcase its successful approach to monitoring diplomates' certification experience and applying the results to make program enhancements. The presenters will cover:

  • The feedback survey instruments ABFM employs, designed to elicit both quantitative and qualitative data
  • Their ongoing process for revising, aligning, and standardizing the surveys to compare certification activities over time and across parts
  • Their analytic approach to different types of data and select results, including key findings from various self-assessment module feedback surveys, some compiled over as many as 10 years
  • How diplomate feedback has informed modifications of specific activities and how findings have been disseminated in internal reports and peer-reviewed research articles

Learning Objectives:

  • Learn about the survey instruments ABFM uses to collect feedback from diplomates about certification activities
  • Understand the analytic process applied to the survey data
  • Discuss how diplomate feedback has been used to inform changes in certification activities

Beyond the Angoff Method: Additional Options for Standard Setting

Sarah Schnabel, MEd, American Board of Ophthalmology
Huaping Sun, PhD, American Board of Anesthesiology

In high-stakes certification examinations, great care must be taken to credential only individuals who possess the knowledge, skills, and abilities for safe and effective medical practice. While every aspect of exam development and administration is critical, special attention should be given to sound standard setting practices, which lay the foundation for the whole process.

Standard setting establishes a performance standard or cut score for use on an examination. Most Boards are familiar with the Angoff method of standard setting and use it most often. However, other methods exist, and in some cases may be a better fit.

This session will provide an overview of the Angoff method (and its variants) and contrast it with the features and advantages of alternatives, including the bookmark method, the item-mapping method, the objective standard setting method, the Beuk method, and the Hofstee method.

The session will appeal to subject-matter experts who participate in standard setting exercises and psychometricians.

Learning Objectives:

  • Understand the standard setting methods used in licensure/certification, including the unique features and benefits of each
  • Weigh the considerations for selecting a standard setting method and implementing it

Back to Top

What is your Customer Thinking? Market Research Holds the Answers

Robert Cattoi, MS, American Board of Family Medicine
Brandon Parrott-Sheffer, MBA, Edelman Intelligence

Market research can provide valuable insights about your customers. In this session, you'll discover ways to use market research to improve your product development, customer service, and communication initiatives. We will cover establishing objectives; applying research techniques, including quantitative, qualitative, and focus groups; using research tools; performing data analysis and presenting results. Case studies will showcase successful research projects.

Learning Objectives:

  • Understand when and how to use market research
  • Learn how to develop your research project and match the right techniques to your objective
  • Pick up tips for analyzing results and taking action

Cost and Quality Measurement: Why? By Whom? What New Skills Will Physicians Need?

Lawrence P. Casalino, MD, PhD, Chief, Division of Health Policy and Economics, Department of Healthcare Policy and Research, Weill Cornell Medical College
John R. Combes, Senior Advisor, The Southport Group

The movement to integrated payment models, driven by the Medicare Access and CHIP Reauthorization Act of 2015, is well underway. Although most individual physicians are focused on the reporting requirements of the Medicare merit-based incentive payment system, hospitals, health care delivery systems, and physicians groups are embracing the financial opportunities—and risk—associated with alternative payment models, which reward increased efficiency and effectiveness.

Integrated payment models put physicians at the nexus of managing cost and quality at the patient level and will demand a full range of clinical competencies. To succeed under these models, physicians and their clinical teams will be called upon to coordinate care, eliminate redundancies and waste, increase patient engagement, and improve health outcomes.

This session will explore the convergence of cost and quality under these new payment and delivery models; the increased responsibilities for physicians; and the implications for continuing certification.

Learning Objectives:

  • Understand how integrated payment models alter the context of physician practice
  • Recognize changing expectations of physicians' role in managing patient care cost and quality
  • Consider opportunities for certification to support physicians in next generation delivery systems

Committee on Certification (COCERT) Update

This session will be closed to ABMS Member Boards staff and will focus on the major initiatives and successes of the COCERT Committee including an overview of the new Focused Practice designation. Additionally this session will engage members of the Boards Community in discussions regarding various issues related to Member Boards' Certification Programs.

Learning Objectives:

  • Improve communication and collaboration efforts across the Boards' Community
  • Advance the implementation of 'best practices' across Member Boards Continuing Certification Programs