Session Descriptions (with slides where available)
Tom Stewart, Associate Director – Technology Consulting, Security and Privacy, Protiviti
Computer hackers pose a tremendous risk in the health care field, yet despite our awareness of the situation, the hackers continue to break in. In this plenary session, cyber security expert Tom Stewart will explain the current types of hacking efforts, and the motivations of the people behind these attacks. Mr. Stewart will highlight risks that hackers exploit and the things you can do personally to fend off the bad actors. He will present real world examples from many years of experience in the field across a multitude of industries and company sizes.
User testing can be the most effective way to ensure that your website is informing, engaging, and empowering your users. But the idea of conducting large-scale user testing can be daunting to those of us who are already stretching their limited web budgets and resources. This session will introduce you a simple, "Do-It-Yourself" alternative approach to usability testing that you can incorporate into your web management process with minimal effort and expense.
Within the specific context of Board websites, the presenters will introduce you to the concepts and methodologies to conduct regular small group testing and apply the results to an ongoing quality improvement process. They will then administer a LIVE user test on a member Board website, and invite participants to discuss the results and how to determine appropriate follow-up actions toward continuous website improvement. The workshop will end with Q&A with testing administrators who have worked on multiple Board websites, and can address your questions based on their experiences.
- Observe an actual website user test live
- Learn how to incorporate affordable user testing into web projects
- Discuss successes and challenges of user research projects by ABMS member Boards
Whether you handle marketing on an ad hoc basis or have a dedicated marketing and communications team, you'll learn strategies for efficiently and effectively developing and executing outreach campaigns. We will discuss the range of skills needed for success, and how to fill in the gaps with outside resources.
- Learn to use integrated marketing tactics to amplify your outreach
- Find out how to get the best from your internal and external resources
- Discover ways to maximize your marketing capacity on any budget
This interactive session will reveal how Nationwide Children's Hospital's built— and sustains—a strong quality improvement (QI) culture that helped it become a national leader in pediatric quality and safety.
The hospital's Patient/Family-Centered Quality Strategic Plan provides an implementation framework for ensuring that every member of the health care team employs tools and actions designed to "Create a Safe Day, Every Day." With a goal of driving preventable harm to zero, QI permeates everything the hospital does.
Diverse teams use the Institute for Healthcare Improvement's Model for Improvement to guide more than 150 QI projects throughout the organization. Trainees are meaningfully engaged and mentored to critically examine their own practice, collect and analyze data about that practice, and make improvements based on those data.
The presenters will also share how Nationwide Children's QI culture has expanded beyond the hospital itself, leading to pioneering innovations like Ohio Children's Hospital Solutions for Patient Safety and the launch of the online peer-reviewed journal Pediatric Quality and Safety.
- Identify fundamental elements of a strong organizational quality improvement culture
- Apply a strategic approach to building and sustaining quality improvement in your setting
- Align and integrate quality improvement with individual and organizational priorities
In launching new formats for assessment—particularly those that involve new technologies—there can be a learning curve for test takers. The American Board of Pediatrics (ABP) has helped ease this transition with video tutorials. This session will discuss their experience.
Part 1: Crafting
When ABP piloted its online MOCA-Peds model early this year, it produced two video tutorials to walk candidates through the new experience, one for desktop/laptop users and one for mobile app users. The tutorials received more than 4,000 views and a significant rate of engagement. The presenters will describe how these tutorials were developed, shedding light on scriptwriting, audio tracking, shooting, and editing.
Part 2: Adapting
After introducing video item types for pediatric cardiology in 2010, ABP created video tutorials to help users navigate the new environment. The presenters will share how the tutorials were subsequently evaluated and adapted, including how usage affected test takers' performance and exam item speediness, as well as strategies for boosting user participation.
The session will wrap up with Q&A, inviting other Boards to share their own strategies for optimizing user experience and performance.
- Learn about the process and challenges in developing a new product tutorial
- Consider tutorial adaptation for different item types or new technologies
- Analyze item performance based on exam delivery adaptations
This informal session is intended for new and potential sponsors, as well as mentors and mentees within the Multi-Specialty Portfolio Program (Portfolio Program™). We will begin with a brief introduction to the Portfolio Program and then break off into small-group table discussions. You will have the opportunity to meet with sponsors engaged in the mentor/mentee pilot, and to pose questions about program benefits and requirements, the application process, how to get started as a new sponsor, use of the MOCAM system, and the pre-sponsor pilot.
NOTE: Please submit questions/topics you would like to have addressed in this session to firstname.lastname@example.org. Questions will be accepted through August 31.
- Identify benefits of Portfolio Program sponsorship to your organization
- Recognize requirements for participation in the Portfolio Program
- Recognize key implementation plans as a new sponsor
- Create documents in the MOCAM system
- Assess benefits of participation in the pre-sponsor pilot
- Identify benefits of a mentor/mentee relationship
Technology has completely re imagined how the corporate world communicates. Over the past few years video has emerged as a driving force in marketing and information sharing. In what ways can it be useful to your overall communication strategy? In this session we will learn about video tactics that some ABMS Member Boards are using to reach diplomates and the public.
- Learn how to create educational videos for diplomates
- Explore which types of videos are effective for your audience
- Discover how to make videos to fit any budget
Joe Betts, PhD, Pearson VUE
This session will feature four presentations highlighting research on expanding the focus of a large-scale nursing licensure examination program to include the new construct of clinical judgment needed in practice.
- The first presentation will share the R&D process, which merged a cognitive psychological decision-making model with the daily praxis outlined by the job task analysis to a definable clinical judgment assessment model
- The second presentation will show how new technology enhanced item types were identified for measuring aspects of the clinical judgment model. The mapping process will be described and examples provided
- The third presentation will outline analytic methods for evaluating construct validity as well as scoring models for evaluating the stated assessment model
- The fourth presentation will share an analysis of items developed to measure the clinical judgment element of cue recognition using both a signal- detection and polytomous item response theory framework
- Gain insight into the process of defining the new construct of clinical judgment in nursing
- Discuss new item types that measure the aspects of clinical judgment
- Learn a variety of methods for measuring and analyzing item information
Cyberattacks on hospitals and health systems are on the rise as the black market value of personal medical information nearly surpasses that of financial information. In fact, data breaches in 2016 affected more than 27 million patient records, according to health data protection firm Protenus.
Clearly, it's not a question of if but when a data breach will occur. Is your organization prepared? Safeguarding against a breach isn't enough. It is essential to prepare your organization's legal, compliance, and communications teams to work in lockstep in the event of a devastating exposure.
Featuring a panel of regulatory and communications experts, this session will discuss strategies for navigating a breach of critical private data, including development of communications plans, what to expect from an investigation, and how to keep employees vigilant in following IT security procedures.
The engaging and thoughtful dialogue will give you an extra dose of confidence in the increasingly uncertain landscape of health data protection. #PrepareToProtect
- Learn key strategies for defending against and preparing for cyberattacks and breaches of personal/private data
- Review best practices and lessons learned from experts who have "been there"
- Understand what to expect once a breach occurs
Stephen Davidow, MBA-HCM, CPHQ, APR, PCPI
This session is designed as a broad overview for health care professionals just getting started in quality improvement. It will cover key approaches in health care process improvement—including Lean, Six Sigma, and the Model for Improvement (Plan-Do-Study-Act)—as well as specific tools, such as value stream mapping and root cause analysis, and how to use them. The session will also discuss strategies for maintaining improvements, as well as methodologies used to prioritize projects to focus on what is most important in an organization.
- Understand the three major process improvement methodologies used in health care
- Describe how key tools are used in moving from the current state to an improved future state
- Implement strategies to sustain improvements over time
Work-related burnout among physicians is on the rise, particularly for those on the front lines of patient care. Research suggests that over half of physicians will experience burnout, with family physicians among the highest rates at 60%.
Burnout is marked by emotional and physical exhaustion, decreased communication, apathy, and more. Its repercussions are widespread: For physicians themselves, it can lead to substance misuse, depression, and even suicide. For patients, it can mean higher rates of errors, reduced quality of care, and lower patient satisfaction. And for organizations, physician burnout can result in higher turnover and lower productivity.
In response to growing concerns over this issue, the American Board of Family Medicine (ABFM) began collecting data from their diplomates. Early findings indicate a much lower rate than previously reported, but still alarming with 1 in 4 physicians reporting signs of burnout.
In this session, ABFM representatives will share results of their research on burnout among family physicians, discuss what they have learned about wellness and satisfaction, and show how they are working with specialty societies to address these issues.
- Learn the components of burnout and how burnout is detrimental to the delivery of health care
- Understand individual and practice characteristics associated with burnout among family physicians and how these findings may be used to promote wellness
Serious, evidence-based education doesn't have to be confined to lectures and PowerPoints. In fact, more innovative delivery methods have been shown to improve understanding and increase retention of important concepts. Plus, they're more appealing to busy clinicians.
This session will focus on designing programs that engage learners in nontraditional ways. Using simple delivery techniques, the presenters will "break some rules and shake up the room" to help you develop ideas that are appropriate and effective for your audience, as well as low-cost or free.
This interactive workshop reflects a broader trend in medical education toward "sticky" course design: formats and techniques that are compelling, inspiring, and memorable.
After the session, you will be better able to plan and deliver education that physicians will find interesting and relevant to their practice, which ultimately will lead to higher-quality patient care.
- Learn to embrace innovation in education for better learning outcomes
- Hear about specific nontraditional techniques for actively engaging today's learners
- Discuss how to make education program changes that are sustainable and measurable
Exploring the Value of the ABMS Brand - Mandelbaum slides [pdf]
Exploring the Value of the ABMS Brand - Brennan slides [pdf]
John Mandelbaum of ABMS will explore the value of the ABMS brand to Member Boards and their Diplomates through several lenses, including state advertising legislation; federal and private payer contracts; and requirements for state licensure, GME training, and private health care institution credentialing.
Tim Brennan of the Icahn School of Medicine at Mount Sinai will highlight the benefits that have been realized since Addiction Medicine has been recognized as a subspecialty across the entire ABMS Boards Community, including better access to quality care for patients and the expansion of training programs.
- Recognize the benefits of the ABMS brand in the external healthcare environment
- Hear how licensing, advertising, and training requirements are dependent upon the ABMS brand
- Connect the value of Board Certification to improving patient care
Certification's Impact on Practice and Performance: Research by Four Scholars - Babu slides [pdf]
Certification's Impact on Practice and Performance: Research by Four Scholars - Davis slides [pdf]
Certification's Impact on Practice and Performance: Research by Four Scholars - Mannava slides [pdf]
Certification's Impact on Practice and Performance: Research by Four Scholars - Xu slides [pdf]
Maya Babu, MD, MBA
Joshua Davis, MD, NASM-CPT, EM Resident, Penn State Hershey Medical Center
Sandeep Mannava, MD, PhD, Assistant Professor, Orthopedic Surgery, University of Rochester Medical Center
Tim Xu, MD, MPP, Associate, McKinsey & Company
Within an increasingly complex system of care, certification seeks to assure the public that medical specialists are competent to provide safe, high-quality, patient-centered care throughout their professional careers. Research related to certification and MOC is one of the activities that ABMS Visiting Scholars engage in during their year.
In this session, four of this year's scholars will share their research methods and findings on the correlation between board certification and surgical outcomes; the use of simulation in surgical training; surgeons' perspectives on the value of continuing certification; and identification of a common core among Boards' quality, safety, and communication expectations.
Participants will be invited to share their thoughts on the implications of the scholars' findings and future research directions.
- Learn the methods and results of ABMS Visiting Scholar research projects
- Discuss the implications of those results for ABMS Member Board certification programs
With advances in technology, models for assessing medical knowledge and clinical judgment have become more flexible, continuous, and dynamic, allowing for the incorporation of learning into the assessment process.
This year, the American Board of Pediatrics piloted a new assessment system, representing the next generation of pediatric assessment and continuous professional development. If the MOCA-Peds pilot is successful, this new model will replace the every 10-year MOC pediatrics exam with a series of questions at regular intervals throughout a diplomate's career, delivered through a mobile device or web portal.
Learn from ABP's experience in this session. The presenters will give an overview of the pilot (MOCA-Peds model, pilot design, and demonstration of the platform), review preliminary survey feedback (perceived value, use of mobile app, study preparation), break down participant performance (response time data, performance statistics), and discuss future enhancements based on lessons learned.
- Hear about the MOCA-Peds model and 2017 pilot design, including implementation issues and business rules
- Review preliminary data on pilot participation rates and characteristics, survey feedback, and performance
- Discuss lessons learned from the pilot and planned enhancements
In this session, you will learn about this regional improvement project, sparked by a challenge from the Dean of the School of Public Health to improve the rates of colon and breast cancer screening. Through the leadership of Healthy Lincoln and the support of public and private payers, an improvement initiative was developed using the DMAIC framework. Fourteen independent clinics participated in a one-year project. A lead physician within each practice provided project oversight and coordinated team engagement. Each team developed their own improvement strategy based on their identified goals. The measures used aligned with Medicare Shared Savings Program ACO metrics.
Results showed an improvement in EHR reported breast cancer screening rates from 44% to 62% and colon cancer screening rates from 44% to 62% with nine clinics exceeding the 65% goal for both breast cancer and colon cancer screening rates as assessed through EHR data.
Assessment of the study's results is continuing. We will discuss key success factors including alignment with patient, community and ACO objectives.
- Assess the implementation of a community-based improvement initiative
- Identify forces that led to the development of the initiative
- Discuss strategies that can be applied to other QI initiatives
John Norcini, PhD, Foundation for Advancement of International Medical Education and Research
The goal of this session is to familiarize participants with some of the formative workplace-based assessments methods currently being used, with the mini-CEX as one example. The presenter will highlight the importance of formative assessment in learning, review some of the research on the methods, present a model for faculty development, and describe current research on the most effective feedback to give trainees.
- Understand the importance of workplace-based assessment and become familiar with popular methods
- Discuss faculty development in workplace-based assessment and how to design a basic workshop for examiners
- Learn the characteristics of effective diplomate feedback
Three Member Boards' Experiences with DANS Data - Juul slides [pdf]
Three Member Boards' Experiences with DANS Data - Lipner slides [pdf]
Three Member Boards' Experiences with DANS Data - Sun slides [pdf]
The Disciplinary Action Notification Service (DANS) notifies ABMS Member Boards of disciplinary actions taken on physicians' licenses. DANS data can affect a physician's certification status upon review by Member Board, but it can also be used in research studies regarding physician performance.
What exactly are the statistics on DANS data, and how are Member Boards using their annual DANS reports? This session offers insights.
- Huaping Sun will describe the basis classification, action severity, and incidence rate of license actions for anesthesiologists and subgroups. She will also show how the Cox proportional hazards model can identify predictors of license actions and quantify the effect of each.
- Furman McDonald will discuss the association between state medical board disciplinary actions and the severity of actions demonstrated in both initial certification and MOC in internal medicine, including results from a recent study.
- Dorthea Juul will present data on five cohorts of psychiatry and neurology diplomates, including licensure actions, the bases for these actions, and a comparison across disciplines. Performance on certification exams will also be covered.
- Understand what a DANS report is and how it can affect a physician's certification status
- See how DANS reports can be used as performance indicators
- Review recent research data on ABA, ABIM, and ABPN diplomates related to licensure actions
G. William Hoagland, Bipartisan Policy Council
To paraphrase the U.S. president, "Health care is complicated." In this session, Bill Hoagland, the Bipartisan Policy Council's senior vice president for fiscal, health and economic policy, will discuss political and economic factors that make national health reform especially problematic. The discussion will examine the relationship between health policy and the nation's long-term fiscal position, as well as the implications for patients, providers, and medical professionals.
- Increase your understanding of the fiscal and political environment shaping health policy
- Examine cost as a driving force in the policy debate
- Discuss the need to demonstrate certification's contribution to quality as a value-add
Thomas Thacher, MD, Mayo Clinic
As an ABMS Portfolio Program sponsor, Mayo Clinic has had years of experience and significant success with its quality improvement methodology and processes. In this case-based session, participants will be shown the steps of how Mayo Clinic defines a quality improvement project and how projects receive credit. Dr. Thacher will also describe the organization's methodology and how projects are scored against those criteria. Attendees will also learn how implementing this type of framework allows projects to easily be developed at the unit level, thus creating grassroots momentum for development of and engagement in quality improvement.
- Hear about the quality improvement methodology and processes used at the Mayo Clinic
- Assess quality improvement projects against scoring methodology to determine if they are eligible for credit
The ABIM Foundation's Daniel Wolfson will give an overview of the campaign, which encourages dialogue about the overuse of medical tests and procedures and supports physicians in helping patients make smart choices about their care. He'll share how the "Five Things Physicians and Patients Should Question" were developed, the theories behind the campaign, and examples of successful implementation strategies, as well as challenges and barriers.
The session will also feature Kellie Slate-Viscavage of Maine Quality Counts, a Choosing Wisely grantee. She'll show how her organization is working to increase public awareness and guide delivery system changes to reduce unnecessary tests and procedures. She'll also discuss how Maine Quality Counts is offering maintenance of certification (MOC) points for physicians who are interested in advancing Choosing Wisely and being certified by one of the participating ABMS specialty boards.
- Gain a better understanding of the Choosing Wisely campaign, including challenges it faces
- Find out how the campaign is having real benefits for physicians and patients nationwide
- Learn how to align Choosing Wisely with MOC and quality improvement programs
A core function of certifying boards is to ensure that the content of training and certification exams align with the clinical practice of physicians in their specialty. Another function is planning for the workforce of the future, which requires studying both supply (entrances, progressions, and exits within the workforce) and demand (health care delivery systems, practice patterns, patient care needs). Valid and reliable data are central to these functions.
Different boards employ different strategies for collecting data on diplomates and have developed their methodologies over time to enhance the rigor and increase efficiency. To help others create a roadmap, this session profiles the approaches of the American Board of Family Medicine (ABFM) and the American Board of Pediatrics (ABP). It will cover:
- The history, rationale, and similarities and differences of the ABFM and ABP data collection strategies
- The evolution of the data collection methodology and advancing the rigor of the questions
- How ABFM's data collection methodology has been used to help residency programs obtain feedback on recent graduates and meet program requirements through the National Graduate Survey
- How strategic, regular reports from collection efforts can benefit organizational management and other stakeholders
- Key findings of ABFM and ABP research efforts and the potential for multi- board research using these data
- Articulate the rationale for certifying boards to collect data from Diplomates on their clinical practice.
- Describe the benefits of aligning Diplomate surveys among ABMS boards
- Discuss how certifying boards can use data to advance the science of their specialty
As our health care system evolves, medical schools must ensure that students not only acquire basic and clinical scientific knowledge, but also understand how patients access and receive care.
To bridge the gap between education and practice, the American Medical Association's Accelerating Change in Medical Education (ACE) Consortium has developed an emerging discipline called health systems science. Areas of focus include improving health care quality and value, enhancing patient safety, delivering population-based medical care, engaging in community advocacy, and understanding health care policy and economics.
This session will examine the progress that schools comprising the ACE consortium have made in developing health systems science curricula, including both classroom-based and experiential learning. The presenters will also share consortium efforts to build an assessment infrastructure for health systems science, and to measure how this work translates to GME and clinical practice, and more.
- Understand how the domains of health systems science are integrated into UME curricula
- Learn about how instructional methods, clinical experiences, and assessment in this discipline are adding value for all stakeholders
- Explore how innovations in health systems science may be incorporated into GME and CME/MOC
A Town Hall Meeting: Engaging ABIM Physicians in Your Portfolio Program
The ABMS Portfolio Program equips health care organizations to support their physicians' professional development and quality improvement efforts in a more universal and streamlined way. But the program's success relies on engagement and buy-in at many levels.
This hour-long town hall session will focus on how American Board of Internal Medicine (ABIM) physicians can make a difference in your Portfolio Program and other issues. The discussion will:
- Identify successes and challenges in engaging ABIM Diplomates in Portfolio Program activities
- Address concerns organizational leaders may have about becoming or continuing as a Portfolio Program sponsor
- Generate strategies for engaging ABIM Diplomates and organizational leaders in a Portfolio Program
- Learn strategies for increasing ABIM Diplomate participation in your organization's Portfolio Program
- Understand the reluctance by some organizational leaders to sponsor a Portfolio Program and how to address it
- Hear how others are gaining program buy-in from organizational leaders
John Norcini, PhD, Foundation for Advancement of International Medical Education and Research
As a follow-up to An Introduction to Workplace-based Assessment, this session will take a deeper dive into several workplace-based assessment methods, with a QI-specific focus on mini-CEX. Active participation will be encouraged throughout, and small group activities will focus on developing a faculty consensus on assessment standards and using the methods to provide effective feedback to trainees.
- Improve understanding of the challenges of workplace assessments
- Effective strategies for implementing workplace assessments ‘back home'
PROMIS®, the NIH-funded database of validated patient-reported outcome measures, is a publicly available system of highly reliable, precise measures of patient-reported health status for physical, mental, and social well-being. This resource can be used to measure health symptoms and quality of life domains such as pain, fatigue, depression, and physical function—all relevant to several specialties and subspecialties.
This session will focus on the movement toward using patient-reported outcome data to improve physician practice through MOC. It will also discuss the commitment by many healthcare institutions to transform their organizations by implementing PROMIS measures across the entire enterprise.
- Learn about the growing national policy interest in patient-reported outcomes
- Discuss how PROMIS supports patient engagement, clinical decision-making, and performance improvement
- Recognize how the American Board of Orthopaedic Surgery is using patient- reported data in its MOC program
Cees van der Vleuten, PhD, Maastricht University, The Netherlands, Professor and Director of the School of Health Professions Education
In the last 50 years the field of assessment of professional competence has seen remarkable progress. Developments in assessment technology have taken place across all areas of professional competence, ranging from cognitive to behavioral and emotional aspects of competency. This has been accompanied by extensive research.
In order to make assessment more meaningful for learning, however, we need to change our thinking around assessment. We need to move from assessment of learning to assessment for learning, from individual assessment methods to a systems approach of assessment, and from cross-sectional assessment to longitudinal approaches to assessment.
In this presentation, we will give an account of such a synthetic systems approach to assessment called programmatic assessment, and we will illustrate it with an existing assessment practice. You will come away with an understanding of how learning may drive assessment, the value of professional judgment, and the value of a qualitative discourse in assessment.
Jo Shapiro, MD, Brigham and Women's Hospital, Director, Center for Professionalism and Peer Support; ABMS EPCOM Chair
Catherine R. Lucey, MD, UCSF School of Medicine, Vice Dean for Education; ABMS Board of Directors
Reactor: Maxine Papadakis, MD, Professor Emeritus, University of California San Francisco
Experts from the Member Board, hospital, and academic communities share their perspectives on advancing and assessing medical professionalism and professional standing. This is followed by a panel discussion.
- Recognize the value and limitations of using instituiton-based assessments of professionalism and professional standing in Member Boards' Continuing Certfication programs
- Identify 'lessons learned' from assessment of professionalism and professional standing in the academic medical setting and the relevance those methods may have for assessment in Continuing Certification programs
Lack of physician engagement is the elephant in the room in quality improvement work. Every health care organization has physician champions who "get it," but to truly integrate performance improvement into everyday practice and attain better patient outcomes, broader-based engagement is key.
This town hall session will be led by two seasoned quality improvement leaders and early ABMS Portfolio Program adopters. They'll share their own vast experience and invite audience participation for an interactive discussion aimed at helping organizations involve physicians more fully in quality improvement initiatives.
- Better understand the complexities of physician engagement in QI initiatives
- Develop strategies to improve physician engagement in QI initiatives
- Increase the number of physicians engaged in QI initiatives at Portfolio Program sponsor institutions
R. Van Harrison, PhD, University of Michigan
What constitutes a reportable quality improvement (QI) effort for MOC Part IV is fairly straightforward for an activity performed at one site by one group in one time sequence. However, when a QI effort involves multiple sites, groups, and/or time sequences, should activities be reported as one QI effort or separate QI efforts?
This session will describe principles developed by the University of Michigan to address these potentially complex situations.
The presenters will illustrate the application of these principles to actual QI efforts involving multiple health centers within a department, multiple health centers across multiple departments, sites in affiliated accountable care organization practices, multiple institutions in statewide and national voluntary collaboratives targeting specific medical conditions, research projects involving community practices, and other multiple site/group contexts.
- Identify functions of a report on a QI effort for individuals involved in leading, participating in, and reviewing a QI effort
- Learn principles for determining whether QI initiatives across multiple sites/groups/timeframes are better reported as a single effort or multiple efforts
Cees van der Vleuten, PhD, Maastricht University, The Netherlands, Professor and Director of the School of Health Professions Education
Rebecca Lipner, PhD, American Board of Internal Medicine
Ann Harman, PhD, American Board of Anesthesiology
Benson Munger, PhD, ABEM / ABPM
This session is a follow-up to Dr. Cees van der Vleuten's plenary presentation "A Journey towards Programmatic Assessment." In point/counterpoint format, a panel of Member Board representatives will explore key messages from the plenary and discuss the applicability of more a formatively oriented "assessment for learning" approach to assessment designed to promote development of knowledge, judgment, and skills in the context of initial and continuing certification programs.
- Identify key characteristics of "assessments of learning" and "assessments for learning"
- Describe similarities and differences between traditional high-stakes summative assessments used by ABMS Boards and a programmatic approach to assessment design and development
- Discuss the relevance and applicability of programmatic assessment for initial and continuing certification programs
Carol McCarthy, Remedy Chicago
Branding is one of the most important aspects of any organization, yet the term is used in a variety of contexts with multiple meanings. While your logo and visual identity are critical aspects of your brand, there's much more to consider.
This session will clearly define branding, and using standards and best practices from industry experts, explore the key components needed to establish or enhance your organization's brand, including brand promise, value, attributes, benefits and features, equity, voice, image, and identity.
- Establish a clear, concise definition of brand
- Outline the key elements necessary in establishing or refreshing a brand
- Form the roadmap for creating a new or updated brand strategy
Change is never easy for organizations, but it is imperative—particularly when accommodating the needs of diverse constituents. The American Board of Emergency Medicine (ABEM) and its Board of Directors have taken significant steps to facilitate and operationalize change to better serve their "customers." This session highlights the lessons learned and best practices that emerged in the process.
ABEM took a comprehensive look at the latest needs of the emergency medicine community, including residency programs, candidates, Diplomates, fellow ABMS Boards, and other emergency medicine organizations. Once changes were decided on, ABEM's Certification Services team—the organization's front line to customers— played an integral role in designing systems and processes to successfully execute them.
Certification Services delivers the day-to-day messaging, explains processes, and cements buy-in from constituents. This session will show how they:
- Enhanced ABEM's communications portal for residency programs
- Converted initial certification processes from paper to digital
- Piloted phasing out a requirement for MOC Communication and Professionalism CP)
- Transformed customer service using reassuring language and positivity to defuse challenging interactions
- Learn methods for operationalizing Board of Directors decisions
- Explore best practices for system and process changes
- Understand the ABEM approach to providing superior customer service
Data collected about the physician workforce play a significant role in the development of Board processes. Boards employ surveys to track numbers of trainees and diplomates as well as define practice patterns. They collect patient-level data to determine patient care needs, capture health care delivery system changes, and make practice improvements.
Increasingly, modeling is being conducted to forecast the workforce of the future and inform Board strategic planning. This session will demonstrate how different research tools are applied toward this end. The presenters will:
- Discuss why certifying Boards have chosen to study the workforce
- Present different approaches currently in use: surveys (American Board of Pediatrics); surveys and claims or clinical data (American Board of Family Medicine); modeling (The Physicians Foundation, Health Resources and Services Administration)
- Discuss the opportunities and risks involved in collecting and employing workforce data to ensure our specialties are adequately staffed, trained, and geographically dispersed to meet the health care needs of the public
- Describe the common methodologies used to understand the physician workforce
- Discuss how Boards can collect and analyze workforce data and disseminate findings to inform training and practice improvement
- Outline the opportunities and risks involved in using workforce data to support public accountability
Global health today encompasses more than delivery and development of health care across international borders. Even for U.S.-focused physicians, a globally relevant skill set is crucial in caring for an increasingly diverse population in nearly every setting. Despite the pressing need, however, training in this area has not been adequate.
As a worldwide leader in child health, the American Board of Pediatrics (ABP) set out to address this gap in global health competency for pediatricians. In 2013, the organization formed a Global Health Task Force to develop a global health agenda around training assessment, certification, quality improvement, and continued professional development. To achieve its goals, the task force produced a variety of publications and resources, MOC activities, and a leadership conference.
ABP has also focused on sharing resources and partnering with international colleagues. Its International In-Training Examination is now delivered in nine countries and available in Spanish and Italian.
This session will highlight ABP's experience and how it might be extrapolated to other medical specialties to improve the quality of training and assessment in a diverse and interconnected world.
- Appreciate the ever-broadening meaning of global health
- Review examples of global health resources, self-assessments, and quality improvement activities
- Learn how the work of ABP's Global Health Task Force might translate to your own Board
David F. Martin, MD, ABOS, Executive Medical Director
Christopher J. Ondrula, Esq., ABMS Strategic Business Affairs & Legal Advisor
Reactor: Carrie Bradford, MHA, RHIA, CPMSM, CPCS; Northshore University Health System, Senior Director, Professional Staff Services and Credentialing
Experts from the Member Boards, hospital, and medical school communities share their perspectives on advancing professionalism in the medical profession followed by a panel discussion.
- Recognize the value and limitations of peer review surveys for assessment of Professionalism and Professional Standing
- Understand legal considerations in the environment within which Member Boards assess the professionalism and professional standing of diplomates
- Identify ‘lessons learned' from assessment of Professionalism and Professional Standing in the academic medical setting and the relevance those methods may have for assessment in Continuing Certification programs
In this session, you will have the unique opportunity to share feedback regarding design principles that are being considered in modernization of the country's oldest CME accreditation system. The goal is to ensure that CME accreditation standards optimally drive improvements in learning, assessment and patient care quality.
Technology now makes it feasible to facilitate personalized practice gap analysis, engagement in practice-relevant learning, and translation of new knowledge or skills in ways that align with the aim of improving population health, containing health care costs, enhancing patients' experience of care, and supporting physician well-being.
Payers are evolving their systems and transforming their organizations in order to drive value, not just volume. Likewise, CME accreditors and certifying and licensing boards are evolving systems to support the national quality strategy with minimal administrative burden.
You will hear about new accreditation standards under development meant to facilitate more meaningful engagement of physicians in assessing their practice gaps learning needs, and translating their learning into improvements in practice.
You may then provide feedback on the new credit system conceptual model, and offer suggestions for implementing those changes in ways that will be synergistic with the certifying boards and CME provider community.
Together, we will explore how credit system modernization can best complement innovations underway in specialty board certification.
- Understand changes underway in the accreditation of learning activities
- Provide feedback on those changes
- Identify opportunities for synergy among certifying boards and CME/CPD
Amelie Karam, Amelie Karam Speaking and Consulting
It seems everyone is talking about millennials — and with good reason. By 2020, this generation (currently between the ages of about 20 and 36) will make up half of the workforce. By 2029, the last baby boomers will have turned 65, giving millennials even more prominence.
Better understanding and engaging these young professionals can go a long way in improving your work environment and culture. In fact, organizations that do not prepare risk missing out on the best and brightest millennial talent.
Amelie Karam has presented on this topic to audiences nationwide. A millennial herself, she offers unique insights into what leaders should be doing today to attract and retain this newest generation of professionals. Her engaging style and approach will leave you feeling enlightened and inspired.
- Learn how different generations can better communicate and work together to meet common goals
- Better understand millennials and their needs, to improve both associate and patient satisfaction scores
- Gain greater insight into today's multi-generational patient healthcare environment
Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects - Humiston slides [pdf]
Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects - Noonan slides [pdf]
Teaching Pediatricians QI Skills through HPV- Cancer Prevention Projects - Albertin slides [pdf]
Pediatricians must participate in quality improvement (QI) projects as part of their MOC programs, but it's not always easy for them to identify an appropriate project. The project must be applicable to their primary care focus, meaningful to them as prevention leaders, and allow them to play a central, but manageable role.
This session focuses on a projects that ticks all of those boxes and also fills a growing public health need: increasing adolescent human papillomavirus (HPV) vaccination rates in pediatric offices and clinics.
The presenters will describe the methods and results of HPV vaccination QI projects undertaken by American Academy of Pediatrics chapters and the Academic Pediatric Association's research network, CORNET. They include experiential learning with some didactics, simulation, and then action. In addition to examples of actual QI process products (e.g., clinic flow maps used to help prioritize change ideas), you will see both quantitative and qualitative results.
The session will wrap up with lessons learned, resources, and opportunities for further collaboration.
- Formulate a change cycle that incorporates change ideas relevant to those previously published in the medical literature on vaccination, and specialty to HPV vaccination
- Hear examples of approaches taken by AAP chapters to increase HPV vaccination coverage
- Learn how faculty can help pediatrics residents connect with QI projects that are both meaningful and meet certification requirements
This session will highlight quality improvement education interventions that the University of Arkansas for Medical Sciences (UAMS) developed for two underserved Arkansas Delta Region hospitals.
The goal of the trainings, which were tailored to each facility, was to decrease mortality from preventable medical errors through advanced simulation scenarios, and to decrease health care costs by teaching prevention and/or early infection identification best practices to the health care professionals.
The presenters will describe these and other outcomes:
- A collaboration between UAMS content experts and hospital leaders in reviewing and revising hospital policies and procedures
- Follow-up procedures with each facility, including the creation of four accredited online learning modules to reinforce the training content
- The close relationships fostered between UAMS and the two hospitals, which have led to the hospitals requesting additional training and best practices
- Review and revise hospital policies and procedures
- Train hospital staff on current best practice techniques in hands-on learning sessions
- Teach assessment and management techniques through simulation scenarios involving standardized patients
In a rapidly changing environment, test development teams are under increasing pressure to work on expedited timelines. Having specific processes and strategies in place can help ease the burden this creates—and also ensure that quality is upheld.
The American Board of Pediatrics (ABP) and the American Board of Anesthesiology (ABA) have both been challenged by accelerated timelines as they have introduced non-proctored MOC assessment models, accessed by diplomates via personal computer or mobile device.
ABP's MOCA-Peds pilot and ABA's MOCA Minute® pilot required setting clear timelines and milestones, working more closely with subject matter experts, utilizing online platforms for editing and review, and creating large banks of items to draw on. These and other steps ensured that all items received the same rigorous review and scrutiny as traditional exams while compressing what would normally be a two-year development cycle down to several months.
Representatives of both organizations will share their experiences and recommendations in this session. You'll leave feeling better prepared to develop content for new products when time is of the essence.
- Know the important variables to consider when rapidly developing test content
- Develop and implement training strategies for subject matter experts
- Understand how to set realistic timelines and milestones
Getting the diagnosis right is key in delivering quality health care. Yet, the diagnostic process is layered, complex and prone to error.
The landmark 2015 report Improving Diagnosis in Health Care focused national attention on the prevalence of diagnostic error, casting diagnosis as a process in which every patient and health care professional must be an active and engaged participant. Published by the Institute of Medicine (now the National Academy of Sciences, Engineering and Medicine), the report challenged medical educators, training programs, and the certification community to ensure that medical specialists have and maintain the competencies needed for effective performance in the diagnostic process across their career trajectory.
This session will consider ways the Boards community can help meet that challenge. You'll hear about opportunities to advance improvement in diagnosis through initial and continuing certification programs as well as innovations that are underway to better assess clinical reasoning; to recognize, acknowledge, and manage uncertainty; and to identify specialty-specific clinical concerns.
- Increase your familiarity with the causes of diagnostic error and mechanisms for improving diagnostic accuracy
- Understand the relationship between uncertainty and error and how it impacts diagnostic process
- Explore longitudinal assessment and other certification-related strategies for improving diagnostic accuracy and clinical reasoning
Update on International Activities: ECFMG, ACGME-I and ABMS-I - Pinsky slides [pdf]
Update on International Activities: ECFMG, ACGME-I and ABMS-I - Lewis slides [pdf]
Update on International Activities: ECFMG, ACGME-I and ABMS-I - Allbee slides [pdf]
This session will provide information and advances related to the work each organization is doing internationally. The session will focus on the impact of US policy on international medical graduates seeking training or work in the US, accreditation of residency programs internationally, and providing certification internationally.
- Improve the understanding of current advances across the spectrum of undergraduate medical education, graduate medical education and board certification internationally.
- Advance knowledge related to future international initiatives.
- Identify potential opportunities for collaboration through international initiatives.
In 2012, the American Board of Family Medicine set out to simplify MOC for family physicians and make it more meaningful. The result is the PRIME Registry, which extracts patient data from electronic health records and turns it into actionable measures, helping to track the quality of patient care while also reducing the reporting burden for certification and performance improvement activities.
This session tracks ABFM's journey over the last five years toward this more comprehensive, streamlined approach. The presenters will describe the following steps and others, including best practices and lessons learned:
- The pilot study that assessed the data collection methods and their outcomes
- Vendor selection for a quality measurement platform
- Identification of clinical quality measures
- Naming of the registry
- Measuring governance efforts
They will close with a look at future enhancements and refinements to the PRIME Registry and ABFM's overall certification process.
- Understand the ABFM's journey from pilot study to a fully functioning patient data registry
- Learn how the PRIME Registry is used to help physicians identify gaps in performance and appropriate improvement activities
- Hear how the registry aids physicians in the transition to value-based payment
Organizations that successfully implement a strategic plan find that their business culture is enhanced, projects are completed on time and on budget, and the proverbial "wheels" seem to turn a bit easier. As organizations review their strategic plans regularly, they then need to consider tracking key performance indicators (KPIs) to evaluate their success in meeting goals and objectives. This session will take a deeper dive in how to create a business strategy and how to implement the strategy from an operational to a tactical level for positive organizational impact by aligning all resource efforts back to strategic goal. It will also offer insights on how organizations should be utilizing KPIs to measure and evaluate performance and to provide insights on how KPIs can influence necessary adjustments to a strategic plan.
- How to create a strategic plan
- How to implement the strategic plan from an operational to a tactical level
- How to develop an measure KPI's to evaluate performance and advancement of the strategic plan
- How to operationalize KPIs
The landscape has changed considerably in the area of test accommodations. This session will give an overview of trends and best practices in three critical areas:
- Legal and regulatory issues, including recent key court decisions and Justice Department guidance
- Requests for adaptations that may adversely impact test validity or security
- Emerging issues with assistive technology, particularly for candidates with vision impairments
The panelists—experts in the areas of disability law, accommodations, and assistive technology—will provide the high-level updates that every testing organization needs to be aware of. They will emphasize a perspective that uses a moderate, reasonable approach, ensuring that candidates with disabilities have full access to the test, while also protecting the integrity of the test and security of test content.
- Hear updates on laws and legal trends that inform operational policies and practices
- Discuss trends in adaptation requests—particularly those that may impact the validity or security of the test—and ways to mitigate concerns
- Explore the latest tools and approaches in assistive technology and strategies for balancing accessibility needs with costs
When a Board and a specialty society work well together, it can significantly advance the missions of both organizations. But sometimes hurdles arise.
In this session, representatives from the American Board of Family Medicine and the American Academy of Family Physicians will describe their experience in collaborating on various initiatives. They'll give case examples touching on the following:
- Staff-to-staff regular communications (dyad meetings)
- In-person staff collaboration meeting annually
- CME data service for exchanging CME credits
- Activity completion service to share completion updates
- Physician comparison data exchange
- Data-sharing agreements
- Different organization objectives and business models
The speakers will then lead attendees in a discussion about other opportunities and challenges in communication and collaboration between Boards and specialty societies.
- Identify opportunities for Boards and specialty societies to complete mutually beneficial projects
- Discuss challenges in communication and identification of common goals given different missions, business models, and structures
Infographics are your most important tool for communicating a complex story quickly. They're accessible, attractive, and memorable—when done right. In this session, you will learn the steps for creating effective infographics, including a thoughtful strategy, clear narrative, cogent data, dynamic design, and lucid text. You'll discover proven processes and time-tested techniques for turning out irresistible infographics.
- Kickstart your knowledge of infographics
- Learn to tell your data-driven story in a compelling, powerful, and straightforward way
- Discover quick and repeatable visual tricks for ensuring infographics convey a clear message
Almost all physicians need to provide evidence of participation in Improvement in Medical Practice activities for MOC Part IV credit. Now there's an additional way to achieve this.
Selected by the ABMS Portfolio Program, the University of California San Francisco (UCSF) and Vanderbilt University are piloting programs that grant MOC Part IV credit to faculty who meaningfully supervise medical student quality improvement (QI) projects designed to improve patient care.
At UCSF, students are assigned to a coach and participate in a longitudinal clinical microsystem clerkship during the first 18 months of medical school. In September 2016, 180 medical students began participating in QI projects under the supervision of 28 coaches.
At Vanderbilt, students enroll in a 12-week course, implementing a QI project in the clinical setting of a faculty member and presenting a poster on it. Between September 2015 and August 2016, 75 projects were completed with more than 100 students and 54 faculty coaches participating.
This session will review the results of these pilot initiatives to date and offer insights for how the program might be adopted more broadly—for the benefit of medical schools, physicians, and students alike.
- Hear about the implementation of the pilot program to award MOC credit for supervision of medical student QI activities
- Discuss the components of meaningful faculty participation in such a program
- Identify barriers to implementation
Through a multi-pronged approach known as community engagement, the American Board of Internal Medicine (ABIM) and the American Board of Surgery (ABS) tapped diplomates to help transform their MOC programs. This session takes a look at each organization's process of using surveys and other research to inform program revisions—and the results they achieved.
When ABIM surveyed diplomates about desired attributes in an MOC program, they embedded a probability sample within their census to ensure a greater response rate and meaningful inferences. Using a cash incentive and email/phone reminders, they issued a second survey for further input. All respondents were then invited to be part of a Community Insights Network, a panel of nearly 3,000 diplomates reflecting the overall population. As predicted, a subsequent survey of this group garnered a significantly higher response rate.
ABS started by surveying a random sample of diplomates. Results showed that diplomates strongly preferred a practice-focused/modular approach to MOC. So ABS extensively analyzed surgeon practice patterns to develop modules for an MOC pilot program, which they will continue to evaluate and improve.
- Learn how to engage the diplomate community in MOC planning through different survey methods
- Explore how survey data can advance evidence-based policy making
- Compare two approaches to community engagement and what made each successful
Seattle Children's Hospital has had significant success with its Multi-Specialty Portfolio Program by engaging physicians from across the organization through an MOC Part IV project called CONNECT, now in its third year. This session will describe the project and lessons learned.
Led by physicians, CONNECT aims to strengthen job satisfaction by teaching skills that improve relationships with patients and families. While MOC Part IV credit was initially offered to encourage physician participation, CONNECT participants began to see the value of using the MOC structure to reinforce learning objectives and sustain behavior change. Each improvement cycle generated new ideas from participants and facilitators, which helped refine and expand the project goals.
Qualitative feedback indicates that CONNECT is meaningful to physicians, with one commenting, "This project was actually relevant for my daily practice rather than just checking off required MOC needs!"
The success of this model has now spread to other initiatives at Seattle Children's, including patient safety and value improvement.
- Discuss ways to align organizational goals with a MOC program to improve physician engagement
- Learn novel interventions to inspire-and sustain-physician behavior change
- User of test-cycle (PDCA) approach to improving MOC projects
Kate Regnier, MA, MBA, Accreditation Council on Continuing Medical Education
Melissa Lamaffar, American Board of Pediatrics
Diana Davidson, American Board of Anesthesiology
Jonathan Mimm, American Board of Internal Medicine
Collaboration with other specialty boards is one of the most effective ways to improve the continuing medical education (CME) process—both for physicians and providers. This session will demonstrate one such collaboration and its successful outcomes.
The Accreditation Council for Continuing Medical Education (ACCME), the American Board of Internal Medicine (ABIM), the American Board of Anesthesiology (ABA), and the American Board of Pediatrics (ABP) saw an opportunity to simplify the integration of maintenance of certification (MOC) and accredited CME. They worked together to allow educational activities to count for multiple requirements, create a data-sharing platform, and develop an online search tool for diplomates (cmefinder.com).
Learn how these boards simplified and aligned their processes, created more flexibility for physicians, and identified and implemented improvements.
- Hear a collaboration success story that streamlined requirements and processes for diplomates and CME providers
- Assess your own approach and identify opportunities for better addressing the needs of diplomates and CME providers
- Explore options for collaboration with ACCME and other specialty boards
No matter what specific role we hold, our work in this industry is ultimately all about patients.
In this session, a representative of the American Board of Pediatrics will share ways to incorporate patient engagement into your work, how to become involved in patient advocacy, and the impact patient advocates can have on the health care experience overall.
A patient will also join the session to share her perspective, including his/her experience within the health care system and the difference a patient advocate has made in his/her care.
- Understand the role patient advocacy has within the Member Board community
- Find out how you can get involved in patient advocacy
- Learn how to incorporate patient advocacy into your individual role
Timothy Pappas, MA, Principal Pappas and Delaney, LLC
Noted national executive search professional, Tim Pappas, will provide insight into hiring people who have the ability to thrive in your organization. For the past 25+, Mr. Pappas has been helping organizations identify, interview, hire and retain top-notch executive talent both effectively and quickly, Mr. Pappas will focus on the essential internal discussions before a candidate is even interviewed. "Most mistakes in hiring are made before a candidate is even interviewed," says Mr. Pappas. He will develop concepts to truly ramp up the organizations' ability to land that seemingly elusive top talent. This interactive and entertaining presentation is sure to provide anyone attending with ideas to implement immediately.
- Identify, interview, hire and retain top-notch executive talent effectively and quickly
- Utilize essential internal discussions before a candidate is interviewed
- Learn concepts to ramp up your ability to land elusive top talent
How does preparing for an MOC exam impact physicians and their patients? Researchers at the American Board of Internal Medicine (ABIM) and the American Board of Family Medicine (ABFM) designed and executed a qualitative study to find out. This session will detail the results.
The research team hypothesized that the exam process may lead to useful learning that can benefit patients, even for physicians who do not see value in the MOC exam — both by exposing them to useful new information and by reinforcing/refreshing their existing knowledge. The ABIM-ABFM team interviewed a sample of 40 general internists and 40 family physicians who recently took an MOC exam and found that nearly all devoted significantly more time and resources to study for the exam than what they would normally do to stay current.
For most interviewees, knowledge gained through exam preparation appeared to improve care, in one or more of the following: improved diagnosis, better understanding of guidelines, and reduced need for referrals, less unnecessary testing, changes in prescribing, and/or improved communication with patients." We don't want to overstate the impact of studying.
- Learn about the ABIM-ABFM study design, including the recruitment process that ensured a representative sample
- Identify common approaches physicians use to prepare for the MOC exam, as well as their costs
- Hear examples of knowledge gains and practice changes that resulted from physicians preparing for the MOC exam
In 2018, the American Board of Anesthesiology (ABA) will add an objective structured clinical examination (OSCE) component to the final stage of its primary certification series. The OSCEs will allow for competency-based assessment, including communication, professionalism, and technical skills related to patient care.
As the first U.S. medical specialty board to incorporate OSCEs into a high- stakes certification exam, the ABA has navigated largely uncharted waters in its planning and development process, experiencing some rough currents along the way. Initial OSCE blueprints were complicated and needed to be simplified to encompass fewer domains. A new group of content experts was assembled to develop scenarios based on the updated skill areas. Along the way, ABA gained valuable insight from other organizations that use OSCEs, including the National Board of Medical Examiners and organizations in the UK and Israel.
In this session, ABA staff involved in OSCE development, administration, and scoring will discuss their road to innovation, including lessons learned and final preparations for their upcoming launch.
- Understand what's involved in incorporating OSCEs into a high-stakes certifying exam
- Explore various OSCE scenarios and how to incorporate standardized patients into the exam development process
- Discuss the scoring process for a new assessment
Anthony Asher, MD, Levine Cancer Institute and Neuroscience Institute, Carolinas HealthCare System, and National Neurosurgery Quality and Outcomes Database
Robert Phillips, MD, MSPH, American Board of Family Medicine
When the Qualified Clinical Data Registry (QCDR) was introduced in 2014 as a reporting option under the Medicare Physician Quality Reporting System, it stimulated investment in registries for data collection and performance measurement. As it became easier to extract data from electronic records and incorporate measures that matter to patients and clinicians, registries quickly evolved to become the backbone of clinical quality and improvement activities within the specialties. They are also now essential for participation in Medicare's Quality Payment Program.
In this session, the presenters will describe how their specialties have designed registries to support professional improvement initiatives and align their Boards' MOC programs with federal and state quality incentive programs. They will discuss ways registries can be designed to target high-value, high- priority quality concerns; provide clinicians with meaningful, actionable information; and satisfy multiple reporting requirements while making MOC programs more professionally rewarding, convenient, and impactful.
- Identify ways that QCDRs can support individual performance improvement activities
- Learn how QCDRs can transform programs for continuing certification and at the same time support physicians in satisfying quality incentive and reporting programs
Jeanne Kin, MHA, JD, University of Michigan
Each ABMS Multi-Specialty Portfolio Program exists in a unique organizational context with different levels of complexity and a diverse array of stakeholders. Stakeholder analysis (also known as stakeholder mapping) arms you with a systematic method for understanding the power, interests, and influence of everyone involved in your MOC program.
In this session, Jeanne Kin will demonstrate how a thoughtful stakeholder analysis or map can help:
- Engage the right people in support of your MOC program
- Gain the resources you need for your program to succeed
- Communicate more effectively with key stakeholder groups
- Better meet your customers' needs
The discussion will provide specific examples of stakeholder analysis and mapping tools applied in the setting of an MOC program. You will leave with a template for creating a stakeholder grid or map specific to your organizational context.
- Understand the purpose and process of conducting a stakeholder analysis
- Use a few different stakeholder mapping tools and grids, customized to MOC programs
- Apply a stakeholder analysis within your own environment
Barbara Lewis, MBA, DocCom
Patient experience is increasingly tied to health care providers' bottom line. For example, hospitals receive incentive payments based on scores from patient satisfaction surveys known as Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS). Recent HCAHPS analytics indicate that the two communication dimensions on the survey have the biggest impact on the scores.
This has forced health systems to ensure that physicians are strong communicators, and that focus begins with interns, who arrive at residency program orientation with various levels of communication skills.
To test whether this could be improved, one residency program assigned learning modules on online communication skills to interns before orientation. Assessments before and after the interns completed the self-directed training indeed showed big improvements in their skills: empathic recognition scores increased from an average of 41 to an average of 96, and multiple-choice scores went up by as much as 75 percent.
With an increasing focus on patient-centered care, hospitals and residency programs are adopting online curricula, similar to the residency program's study, that allow clinicians to improve communication skills anywhere, anytime.
- Learn the evidence-based importance of communication skills
- Find out how to assess the communication skills learning curriculum at your institution
- Understand the relationship between HCAHPS survey scores and the survey's two communication dimensions
Join your colleagues at The Field Museum where you will discover artifacts from civilizations past, explore almost every corner of the globe, learn about new scientific discoveries, and walk away inspired! Every space at The Field Museum reveals new knowledge.
When you enter Stanley Field Hall, you’ll be standing on 300 million-year-old fossilized limestone and standing in awe of SUE, the largest, most complete and best preserved Tyrannosaurus rex fossil yet discovered. Under her watchful gaze, enjoy appetizers and beverages while networking with peers from all over the United States.
Shuttle buses will take you from The Westin Michigan Avenue to the front door of Chicago’s most exciting and unique museum overlooking beautiful Lake Michigan and Chicago’s breathtaking skyline.
Plenary Session IV: Do Patients Care About Board Certification? What Do They Want, Need, and Have the Right to Expect?
Pat Mastors, Director of Engagement & Board Chair, Patients' View Institute
These are uncertain times for those who receive medical care, those who practice medicine, and for long-revered bodies—inside and outside of health care —that regulate standards and assess competency. With so many policy and regulatory levers in flux, health care leaders are agonizing over where to invest, what to prioritize, and with whom to collaborate. How to choose the best path forward?
The True North during these turbulent times lies in venturing into the heart of health care: what is it that patients want, need, and have a right to reasonably expect? We fail to address this at our peril: health care consumers are more awake than ever to health care cost and value; outside-industry disruption is giving patients more choice and control; and consumer rating systems that track metrics patients care about seem to be sprouting like mushrooms. Where does Maintenance of Certification and quality assurance fit into this changing landscape? What does it all mean to patients? And how can we best ensure that our system of vetting physicians and other clinicians remains viable into the future? In this journey we will walk through the territory patients currently navigate, and discover the challenges and opportunities around us.
ACGME requirements specify that all GME trainees must complete a QI project. This can be a challenge for academic medical centers with multiple residency and fellowship programs. They must design a QI curriculum that is comprehensive enough to meet the needs of all of its learners while also allowing reasonable time for them to complete their projects—sometimes within just a year.
This session will highlight the experience of one institution in designing a QI curriculum that meets this challenge while also linking the GME requirement to MOC and CME for faculty. The presenters will share the success of their structured curriculum/process that can be customized based on the length of the training program.
- Learn about one sponsoring institution's QI curriculum for trainees and how it was linked to MOC and CME
- See how a QI process improvement plan was applied to the QI curriculum to achieve the GME goals and meet the needs of the faculty
One of the challenges for professional associations is consistently providing high-quality and cutting-edge learning and leadership development programs for a diverse membership. A recent organizational push for greater quality and consistency across the learning and leadership development portfolio of the Association of American Medical Colleges (AAMC) prompted the evaluation team to assess the cumulative findings more holistically.
The findings were organized into components of an instructional design model, namely the ADDIE model (for Analysis, Design, Development, Implementation, and Evaluation) (1975; Centre for Educational Technology at Florida State University for the U.S. Army). This session will focus on the challenges involved with improving the learning and leadership development programs currently in the AAMC's portfolio, as well as how these challenges led to a more holistic effort to evaluate program effectiveness and fostered the continuous improvement discussions for all leadership development programs. Specific examples of how this holistic effort has actually been applied to improve the quality of several leadership development programs will also be shared.
- Discuss some of the challenges involved in supporting the learning needs of a multidisciplinary community of professionals
- Learn how evaluators used the ADDIE model (commonly used for instruction design) to promote discussion and continuous improvement efforts for a number of AAMC learning and leadership development programs
- Understand how a unique mixed-method systemic review of evaluation findings from different programs can improve the consistent provision of learning opportunities offered by the AAMC
In January 2017, the American Board of Family Medicine introduced the Continuous Knowledge Self-Assessment (CKSA) which is designed to provide physicians with ongoing feedback regarding their ability level in broad spectrum family medicine, the accuracy of their confidence in their knowledge and decision-making ability, and hopefully with an opportunity to identify gaps in their knowledge.
This session will discuss the CKSA's purpose, question delivery/data collection functioning, immediate feedback, and long-term plans for more sophisticated aggregated feedback. The presenters will also explain:
- Discuss the difference between lifelong learning and self-assessment and how ABFM envisions using CKSA to help physicians select CME
- How the CKSA provides indicators of physicians' metacognitive accuracy (including what metacognitive accuracy is and why it is important to physician education as well as safety in medical practice)
- How the CKSA provides ability estimates of physicians' medical knowledge and clinical decision-making, which can be used to predict their probability of passing the certification examination—reducing anxiety for those who are prepared and motivating those who are not
- In addition, the presenters will share how the new CKSA has been received by family physicians
- Better understand what metacognitive accuracy is and its relevance to physician education and practice
- Understand how the CKSA can be used by physicians to continuously monitor their medical knowledge and clinical decision-making ability in a manner that permits comparisons to the certification examination's passing standard to be made
Dana Brittan, MBA, American Board of Obesity Medicine
Robert Kushner, MD, Northwestern University Feinberg School of Medicine, Center for Lifestyle Medicine
Kevin McAllister, MEd, National Board of Medical Examiners
Officially recognized as a disease by the American Medical Association in 2013, obesity now affects nearly 35 percent of U.S. adults, contributing to a host of health problems. According to a recent survey, most doctors want to help patients lose weight but admit they have little or no training in weight management and nutrition.
The American Board of Obesity Medicine is committed to using the certification process to increase patient access to physicians who are qualified to treat this complex disease. The organization aims to see an obesity medicine specialist in every U.S. community.
This session will demonstrate how ABOM has created a credible examination in partnership with the National Board of Medical Examiners. The discussion will cover selection of content experts, training in item writing, and the item development process — all a challenge in an emerging field of medicine.
The presenters will also discuss building consensus in what comprises evidence-based, standardized practice in obesity medicine, and highlight the rise in the number of physicians from numerous specialties achieving ABOM Diplomate status and showing interest in this fast-growing field.
- Discuss the development of a credible examination with high-quality items for an emerging field of medicine
- Understand the challenge of creating credibility in a stigmatized specialty
- Learn how ABOM engaged physicians from over 10 ABMS Member Boards
Facing enormous market and financial pressure, hospitals are moving to integrated payment and delivery models to better align clinical processes and health care operations. These new models are redefining their relationships with clinicians, making new demands on physicians, and emphasizing new skills, including teamwork, care coordination, inter-professional and patient communication, safety practices, and proficiency with information technology.
Anticipating this seismic shift, the American Hospital Association examined the ABMS/ACGME competencies framework in a 2013 report, judging the competencies of professionalism, interpersonal communication, practice-based learning and improvement, and system-based practice as the keys to success in the emerging delivery environment.
This session will explore the changing role of physicians in a redesigned healthcare system and the implications for medical specialty certification.
- Understand the changing context of medical specialty practice and the new competencies needed
- Identify opportunities for physician leadership
- Identify ways Boards can support physicians' participation in integrated delivery networks
No matter what your communications goals, social media has a place in your strategy. But simply posting content is not enough. Social media platforms continually tweak their algorithms to bring the best content to the top. Your challenge is to keep up with those changes and to stand out in a very noisy environment. We'll look at effective strategies using all the major social media tools—what you should (and should not) be doing to get your message in front of the right audience.
- Learn what you can expect to achieve through social media
- Determine which social media channels to use for your strategic goals
- Hear best practices for getting eyeballs on your posts
This session will be closed to ABMS Member Board staff and will focus on the successes of the 3C Committee and their ongoing commitment to disseminating ‘best practices' of Continuing Certification Programs across the Boards' Community. Additionally this session will engage members of the Boards Community in a ‘Shared Information Group' format to allow for the exchange of lessons learned, and effective strategies to sustain continuous quality improvement efforts of the Member Boards Continuing Certification Programs.
- Improve communication and collaboration efforts across the Boards' Community
- Advance the implementation of ‘best practices' across Member Boards Continuing Certification Programs
Patrick Dolan, MD, University of Chicago Medicine Comer Children's Hospital
Designing and coordinating MOC projects is complex by nature, but when it needs to happen across multiple sites and health systems, it can be daunting.
As a physician lead for MOC and Multi-Specialty Portfolio Programs for Advocate Physician Partners—covering an area from central Illinois to the Wisconsin border—Patrick Dolan learned a lot about complex MOC programs.
In this session, he will focus on three fundamental concerns:
- How to make projects for both employed and independent physicians, including the challenges of working with each of these groups, the motivation needed for each, and the benefits that each brings to the table;
- How to create multiple types of projects, from single physicians to large collaboratives, including criteria for each, the benefits and challenges of offering a diversified portfolio of projects, and how the ABMS Portfolio Program can help in the process;
- How to coordinate it all, given different levels of physician engagement and project types—and what measurements or interventions can be used to show improvement for both the physician and the hospital system?
- Discuss how to address the needs of both independent and employed physicians
- Understand how to create programs that span from single physicians to large collaboratives
- Hear about the many aspects of coordinating across different specialties, employee models, and project types
Soliciting diplomate feedback is one of the most obvious ways to improve certification activities. But how is this best achieved?
In this session, the American Board of Family Medicine (ABFM) will showcase its successful approach to monitoring diplomates' certification experience and applying the results to make program enhancements. The presenters will cover:
- The feedback survey instruments ABFM employs, designed to elicit both quantitative and qualitative data
- Their ongoing process for revising, aligning, and standardizing the surveys to compare certification activities over time and across parts
- Their analytic approach to different types of data and select results, including key findings from various self-assessment module feedback surveys, some compiled over as many as 10 years
- How diplomate feedback has informed modifications of specific activities and how findings have been disseminated in internal reports and peer-reviewed research articles
- Learn about the survey instruments ABFM uses to collect feedback from diplomates about certification activities
- Understand the analytic process applied to the survey data
- Discuss how diplomate feedback has been used to inform changes in certification activities
In high-stakes certification examinations, great care must be taken to credential only individuals who possess the knowledge, skills, and abilities for safe and effective medical practice. While every aspect of exam development and administration is critical, special attention should be given to sound standard setting practices, which lay the foundation for the whole process.
Standard setting establishes a performance standard or cut score for use on an examination. Most Boards are familiar with the Angoff method of standard setting and use it most often. However, other methods exist, and in some cases may be a better fit.
This session will provide an overview of the Angoff method (and its variants) and contrast it with the features and advantages of alternatives, including the bookmark method, the item-mapping method, the objective standard setting method, the Beuk method, and the Hofstee method.
The session will appeal to subject-matter experts who participate in standard setting exercises and psychometricians.
- Understand the standard setting methods used in licensure/certification, including the unique features and benefits of each
- Weigh the considerations for selecting a standard setting method and implementing it
Market research can provide valuable insights about your customers. In this session, you'll discover ways to use market research to improve your product development, customer service, and communication initiatives. We will cover establishing objectives; applying research techniques, including quantitative, qualitative, and focus groups; using research tools; performing data analysis and presenting results. Case studies will showcase successful research projects.
- Understand when and how to use market research
- Learn how to develop your research project and match the right techniques to your objective
- Pick up tips for analyzing results and taking action
Lawrence P. Casalino, MD, PhD, Chief, Division of Health Policy and Economics, Department of Healthcare Policy and Research, Weill Cornell Medical College
John R. Combes, Senior Advisor, The Southport Group
The movement to integrated payment models, driven by the Medicare Access and CHIP Reauthorization Act of 2015, is well underway. Although most individual physicians are focused on the reporting requirements of the Medicare merit-based incentive payment system, hospitals, health care delivery systems, and physicians groups are embracing the financial opportunities—and risk—associated with alternative payment models, which reward increased efficiency and effectiveness.
Integrated payment models put physicians at the nexus of managing cost and quality at the patient level and will demand a full range of clinical competencies. To succeed under these models, physicians and their clinical teams will be called upon to coordinate care, eliminate redundancies and waste, increase patient engagement, and improve health outcomes.
This session will explore the convergence of cost and quality under these new payment and delivery models; the increased responsibilities for physicians; and the implications for continuing certification.
- Understand how integrated payment models alter the context of physician practice
- Recognize changing expectations of physicians' role in managing patient care cost and quality
- Consider opportunities for certification to support physicians in next generation delivery systems
This session will be closed to ABMS Member Boards staff and will focus on the major initiatives and successes of the COCERT Committee including an overview of the new Focused Practice designation. Additionally this session will engage members of the Boards Community in discussions regarding various issues related to Member Boards' Certification Programs.
- Improve communication and collaboration efforts across the Boards' Community
- Advance the implementation of 'best practices' across Member Boards Continuing Certification Programs