Undergraduate educational environment, perceived preparedness for postgraduate clinical training, and pass rate on the National Medical Licensure Examination in Japan

Background

We investigated the views of newly graduating physicians on their preparedness for postgraduate clinical training, and evaluated the relationship of preparedness with the educational environment and the pass rate on the National Medical Licensure Examination (NMLE).

Methods

Data were obtained from 2429 PGY-1 physicians-in-training (response rate, 36%) using a mailed cross-sectional survey. The Dundee Ready Education Environment Measure (DREEM) inventory was used to assess the learning environment at 80 Japanese medical schools. Preparedness was assessed based on 6 clinical areas related to the Association of American Medical Colleges Graduation Questionnaire.

Results

Only 17% of the physicians-in-training felt prepared in the area of general clinical skills, 29% in basic knowledge of diagnosis and management of common conditions, 48% in communication skills, 19% in skills associated with evidence-based medicine, 54% in professionalism, and 37% in basic skills required for a physical examination. There were substantial differences among the medical schools in the perceived preparedness of their graduates. Significant positive correlations were found between preparedness for all clinical areas and a better educational environment (all p < 0.01), but there were no significant associations between the pass rate on the NMLE and perceived preparedness for any clinical area, as well as pass rate and educational environment (all p > 0.05).

Conclusion

Different educational environments among universities may be partly responsible for the differences in perceived preparedness of medical students for postgraduate clinical training. This study also highlights the poor correlation between self-assessed preparedness for practice and the NMLE.     

A follow-up study of the characteristics of dean's letters.

PURPOSE: To assess the content and quality of dean's letters since the publication of guidelines recommended by the Association of American Medical Colleges (AAMC) in 1989. METHOD: In 1998, the dean's letter writers at all 124 U.S. medical schools were surveyed. The questionnaire incorporated items from two previous surveys (1981 and 1992). In addition, samples of dean's letters (n = 451) from all U.S. medical schools for the graduating class of 1998 were rated based on the AAMC's guidelines. RESULTS: The response rate of the 1998 survey (66%) was lower than those of the two previous surveys (87% for 1992 and 85% for 1981). Schools that prepared letters that followed the AAMC's guidelines were somewhat more likely to have responded. According to the letter writers in 1998, close to 300,000 letters (approximately 1,050,000 pages total) were sent to residency directors, at an estimated cost of $26,000 per school. A total of 65% of schools produced adequate dean's letters based on the 1989 AAMC's guidelines, compared with 55% in 1992. Many schools were organizing the dean's letter in more readable formats, and more schools provided information that allowed for a comparison of students within the same school. CONCLUSION: The improvements in dean's letters are encouraging, but ten years after the AAMC's guidelines, 35% of U.S. schools still produce unacceptable letters. With the addition of the electronic submission of information, it is time to review further improvements to the dean's letter.     

Comparing assessments of medical students' potentials as residents made by the residency directors and deans at two schools

The Association of American Medical Colleges' Committee on Dean's Letters advised in 1988 that the dean's letter should be a letter of evaluation rather than a letter of recommendation. The committee also recommended that the letter contain some form of comparative information to let the residency director know how individual students fared in comparison with their peers. This article reports the results of a 1989 study of the types of agreements between the letter writers and the residency directors of two schools. Three standard methods of providing comparative information were used in their ranking of 20 graduates from the class of 1987 at each school. Ordinal ranking from best to worst students revealed a surprisingly high degree of rank-order agreement, but only for 15 of the 16 participating residency directors. Clustering into fixed groups ("top third," etc.) gave high agreement for top students but weaker agreement for the middle and lower groupings. The advantages and disadvantages of these evaluation methods are discussed.     

Solutions and strategies from medical and nursing school leadership for the challenges facing the clinical research enterprise.

PURPOSE: For decades, the U.S. clinical research enterprise and its workforce have faced diminishing numbers and significant challenges. This study, conducted by the Institute of Medicine's Clinical Research Roundtable (CRR), sought to learn about the perceptions by medical and nursing school deans of these challenges or the efforts and strategies needed to address them. METHOD: The authors mailed structured questionnaires about clinical research and workforce issues to medical and nursing school deans in the continental United States in the fall of 2003, and on October 16 and 17, 2003, the CRR held a two-day workshop with deans and their representatives to discuss the survey findings and to propose solutions. RESULTS: Survey participation was 55 (45%) for medical school deans and 37 (46%) for nursing school deans. Various efforts exist at individual schools for recruitment, training, and retention of clinical researchers. Most of the responding medical (53; 96.7%) and nursing (28; 75.4%) school deans reported that demand for clinical researchers exceeded or sharply exceeded supply, and about half of these institutions had a formal mentor program for their students. The percentage of graduates with methodological training in clinical research varied widely, with a mode of 10% and 100% for medical and nursing schools, respectively. Most medical school deans (47; 85.5%) rated their basic research enterprises good to excellent, whereas only a third (19; 34.6%) rated their clinical research programs similarly. Likewise, nursing school deans rated their basic research programs more favorably (23; 62.2%) than they rated their clinical research enterprises (17; 46.0%). However, prioritization of changes needed to address the challenges facing clinical research and its workforce were similar for medical and nursing school deans. CONCLUSIONS: Clinical research is underdeveloped and underrepresented within the clinical research enterprise. There is a need to develop and execute uniform strategies to grow and expand the clinical research workforce. Workshop participants, including 14 deans or their representatives as panelists and CRR members, proposed solutions and strategies.     

Internal medicine-pediatrics residency training: current program trends and outcomes.

PURPOSE: Combined internal medicine-pediatrics (med-peds) residency programs have existed since 1967. Due to the rapid growth in the number and size of programs during the 1990s, most current med-peds physicians completed their residency in the last ten years, making older studies of med-peds programs obsolete. The authors sought to determine completion rates of med-peds residency programs and describe the initial career plans for five cohorts of graduating residents from combined med-peds training programs. METHOD: Program directors of all U.S. med-peds residency programs were asked to complete a Web-based survey and base their responses on the records of cohorts of residents completing their programs from 1998 through 2002. To allow sufficient time to complete both the American Board of Pediatrics (ABP) and American Board of Internal Medicine (ABIM) certification examinations, certification status was requested only for the cohort completing training in 1998. RESULTS: Responses were obtained from 92% (83/90) of the programs, reflecting 1,595 residents entering med-peds programs. Of these residents, 91% graduated from a med-peds program. Among the graduates, 82% were seeing both adults and children, 22% went on to subspecialty residencies, 21% began practice in rural or underserved areas, and 25% entered an academic position. ABIM and ABP pass rates for the 1998 cohort were 97% and 96%, respectively. Overall, 79% of the 1998 graduates are board certified in both specialties. CONCLUSIONS: Compared with previous studies, a greater proportion of residents who recently entered med-peds programs completed their dual training, and a larger percentage of graduates are seeing both adults and children. The proportion of residents entering subspecialty residencies has increased significantly, but the proportion of graduates in academic careers has remained stable.     

Participation of internal medicine department chairs in the internal medicine clerkship--results of a national survey.

PURPOSE: To characterize the involvement of internal medicine department chairs in the core third-year internal medicine clinical clerkship. METHOD: In 2003, the Clerkship Directors in Internal Medicine (CDIM) surveyed its membership. Along with demographics, clerkship directors were asked if the department's chair participated in the clerkship, the number of hours per month the clerkship director and chair discussed clerkship issues, and if published job expectations were discussed. RESULTS: The response rate was 62% (158/254): 103 responses (89 clerkship directors) represented unique medical schools, which formed the basis of the analysis. Eighty-two percent (84/103) reported the chair taught in the clerkship: 54% as teaching attending, 53% as ward attending, 13% as ambulatory attending, and 20% other (e.g., lectures, student rounds, morning report). Of them, 36% performed two activities; 14% three activities; and 2% four activities. Thirty-six percent of the clerkship directors discussed published expectations with their chair. They spent 1.7 (SD 2.2) hours per month with the chair discussing clerkship issues. However, 17% spent zero hours per month with the chair, and 29% spent zero hours per month with a dean's office representative. Chairs who taught spent more time each month with the clerkship director compared with chairs who did not teach (1.9 versus .82 hours, p = .01, Mann-Whitney). There was no association between the chairs' teaching and clerkship directors' demographics. CONCLUSIONS: Internal medicine department chairs are significantly involved in the clinical education of medical students, both administratively and through direct teaching. Chairs who teach spend more time discussing clerkship issues with the clerkship director. Chairs and clerkship directors should discuss expectations, and chairs should continue to visibly demonstrate their commitment to students' education.     

Residency directors' assessments of which selection criteria best predict the performances of foreign-born foreign medical graduates during internal medicine residencies.

In the summer of 1990, 102 directors of internal medicine residency programs from nine areas of the country with the largest numbers of foreign-born foreign medical graduates (FFMGs) were surveyed by mail to determine what criteria used to select FFMGs for residency positions best predicted performance. The directors felt that the most important predictors were performance on the Foreign Medical Graduate Examination in the Medical Sciences or the National Board of Medical Examiners examinations; performance during the interview; and postgraduate clinical experience in the United States. Recent graduation from medical school was felt to be a better predictor than postgraduate clinical experience in a foreign country. Seventy-three percent of the directors found letters of recommendation from a foreign country to be useless. The author suggests the results of this study may be useful to residency programs in evaluating FFMG applicants and to FFMGs in assessing their own credentials.     

Faculty training in general internal medicine: a survey of graduates from a research-intensive fellowship program.

PURPOSE: To determine the fellowship experiences and career activities of the graduates of a research-intensive general internal medicine fellowship program. METHOD: In 1997, the authors surveyed all graduates of the Harvard General Internal Medicine Fellowship Program, a research-intensive fellowship begun in 1979. RESULTS: Of 105 surveys delivered to graduates, 103 (98%) were returned. During the fellowship, 82 graduates (80%) presented research findings at regional or national meetings, 89 (86%) published peer-reviewed articles based on their fellowship work, 75 (73%) precepted residents or medical students in the ambulatory setting, and 67 (65%) taught medical students in the preclinical years. At the time of the survey, 100 graduates (97%) held academic appointments: 48 as clinician-investigators, 23 as clinician-administrators, 15 as clinician-educators, and 15 as clinicians. CONCLUSION: Graduates of this research-intensive fellowship pursued academic careers with research, teaching, administration, and clinical activities. Directors of similar fellowship programs should prepare their graduates for all these activities.     

The effect of Public Law 94--484 on pathology residency programs.

The Health Professions Educational Assistance Act of 1976 (Public Law 94--484) will affect graduate medical programs. The author surveyed directors of medical education in one major metropolitan area to study what the effects might be. With regard to pathology residency programs there are a number of important influences. For example, there will be fewer foreign medical graduates available to study in United States pathology programs. However, those who do come may be of higher quality. Also, owing to financial incentives to increase primary care, medical schools and hospitals may show less interest in the development of speciality programs such as pathology. The changing environment poses challenges to pathology directors to maintain or improve their programs.     

Nursing informatics knowledge and competencies: a national survey of nursing education programs in the United States

An online survey of deans/directors of 266 baccalaureate and higher nursing programs in the U.S. was developed by informatics expert nurses. Participants (1) identified nursing informatics (NI) competencies and knowledge of undergraduate and/or graduate students in their nursing programs; (2) determined faculty preparedness to teach NI and to use informatics tools; and (3) provided perceptions of NI requirements of local practicing nurses. Frequency data and qualitative responses were analyzed. Approximately half of undergraduate nursing programs were teaching information literacy skills and required students to enter with word-processing and email skills. Least visible informatics content at all levels included the use of information system data standards, the Nursing Information and Data Set Evaluation Center criteria, the unified medical language system (UMLS), and the nurse's role in the life cycle of an information system. Almost 50% of respondents perceived faculty as "novice" and "advanced beginners" in teaching and using NI applications. Participants reported no future plans to offer NI training in their region. Findings have major implications for nurse faculty, staff developers, and program administrators who are planning continuing education opportunities and designing nursing curricula that prepare nurses for use of the electronic health record and 21st century professional practice.     

Strengthening medical training programmes by focusing on professional transitions: a national bridging programme to prepare medical school graduates for their role as medical interns in Botswana

Background

The improvement of existing medical training programmes in resource-constrained settings is seen as key to addressing the challenge of retaining medical graduates trained at considerable cost both in-country and abroad. In Botswana, the establishment of the national Medical Internship Training Programme (MIT) in 2014 was a first step in efforts to promote retention through the expansion and standardization of internship training, but MIT faces a major challenge related to variability between incoming trainees due to factors such as their completion of undergraduate medical training in different settings. To address this challenge, in August 2016 we piloted a bridging programme for foreign and locally trained medical graduates that aimed to facilitate their transition into internship training. This study aimed to describe the programme and evaluate its impact on the participants’ self-rated perceptions of their knowledge, experience, clinical skills, and familiarity with Botswana’s healthcare system.

Methods

We conducted a national, intensive, two-week programme designed to facilitate the transition from medical student to intern and to prepare all incoming interns for their work in Botswana’s health system. Participants included all interns entering in August 2016. Formats included lectures, workshops, simulations, discussions, and reflection-oriented activities. The Kellogg Foundation Outcomes Logic Model was used to evaluate the programme, and participants self-rated their knowledge, skills, and attitudes across each of the programme objectives on paired questionnaires before and after participation.

Results

48/54 participants (89%) provided paired data. Participants reported a high degree of satisfaction with the programme (mean 4.2/5). Self-rated preparedness improved after participation (mean 3.2 versus 3.7, p?<?0.001), as did confidence across 18/19 knowledge/skill domains, suggesting that participants felt that the programme prepared them for their internship training. Exploratory analysis revealed that 20/25 participants (80%) reporting either no effect or a negative effect following participation had rated themselves “extremely” or “quite” prepared beforehand, suggesting the programme grounded expectations for interns who initially were overconfident. In contrast, no interns who had initially rated themselves “moderately” or “somewhat” prepared reported a decline in their self-rated sense of preparedness. Interns commented on the benefits of learning about roles/responsibilities, interacting with clinicians from Botswana’s healthcare sectors, and the sense of community the programme engendered.

Conclusions

This programme was feasible to implement and was well-received by participants. Overall, participants perceived an enhancement of their knowledge, skills, and expectations about their role in Botswana’s health system after completion of the programme. Our results are likely to be of interest to educators dedicated to training, professional transitions, and career pathways in similar settings in the region and beyond.

     

Performances of U.S. osteopathic and Canadian medical school graduates on the American Board of Internal Medicine Certifying Examinations, 1984-1988

The performances of Canadian medical school graduates and U.S. osteopathic medical school graduates who first took the American Board of Internal Medicine Certifying Examination between 1984 and 1988 were compared with the performances, during the same period, of U.S. and foreign medical school graduates. Approximately 100 Canadian graduates took the examination each year; by 1988 the number of osteopathic graduates taking it was 102, double the number participating in 1984. Nearly all the Canadian graduates attended university or university-affiliated residencies, whereas half of the osteopathic graduates attended non-university-affiliated programs. For their overall clinical competence and for the eight components of clinical competence, the Canadian graduates were rated highest, followed by the U.S., osteopathic, and foreign graduates. The Canadians' average examination scores were also highest. The authors discuss the relatively low level of performance of the osteopathic graduates, but conclude that these graduates appear to be an untapped source of talented physicians for internal medicine residencies. The limitations of studying self-selected groups of candidates are also discussed.     

Measuring outcomes of undergraduate medical education: residency directors' ratings of first-year residents.

PURPOSE: There is a growing recognition of the need to show the relationship between undergraduate medical education (UME) and achievements during residency. This study provides reliability and validity evidence for a residency rating scale as well as a method for gathering comparison information about first-year residents. METHOD: A 25-item rating scale measuring important areas of physician functioning was mailed to residency directors of 485 graduates of the 1998-2000 classes of the University of Kansas School of Medicine. The same rating scale was sent to residency directors for a comparison sample of 251 graduates of other U.S. medical schools who were residents at the University of Kansas Medical Center. Each item on the rating scale was rated on a five-point Likert scale. Principal-components analysis, correlational analyses, internal consistency reliability analysis, and mean comparisons were used to provide evidence of reliability and validity. RESULTS: A total of 382 (82%) usable rating scales were returned. A principal-components analysis extracted five factors that accounted for 86% of the variance. The final factors were (1) interpersonal communication, (2) clinical skills, (3) population-based health care, (4) record-keeping skills, and (5) critical appraisal skills. The internal consistency of the entire scale was.98, with coefficients for the five factors ranging from.92 to.97. The correlations between the five factors and measures of undergraduate performance ranged from.21 to.49. Group analyses revealed that residents with high GPAs and USMLE Step 1 and Step 2 scores tended to be rated higher than those with lower scores. CONCLUSIONS: The rating scale demonstrated adequate reliability and validity and showed that residency directors' ratings are a useful outcome measure for UME performance.     

Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board.

PURPOSE: To determine if medical students who demonstrate unprofessional behavior in medical school are more likely to have subsequent state board disciplinary action. METHOD: A case-control study was conducted of all University of California, San Francisco, School of Medicine graduates disciplined by the Medical Board of California from 1990-2000 (68). Control graduates (196) were matched by medical school graduation year and specialty choice. Predictor variables were male gender, undergraduate grade point average, Medical College Admission Test scores, medical school grades, National Board of Medical Examiner Part 1 scores, and negative excerpts describing unprofessional behavior from course evaluation forms, dean's letter of recommendation for residencies, and administrative correspondence. Negative excerpts were scored for severity (Good/Trace versus Concern/Problem/Extreme). The outcome variable was state board disciplinary action. RESULTS: The alumni graduated between 1943 and 1989. Ninety-five percent of the disciplinary actions were for deficiencies in professionalism. The prevalence of Concern/Problem/Extreme excerpts in the cases was 38% and 19% in controls. Logistic regression analysis showed that disciplined physicians were more likely to have Concern/Problem/Extreme excerpts in their medical school file (odds ratio, 2.15; 95% confidence interval, 1.15-4.02; p =.02). The remaining variables were not associated with disciplinary action. CONCLUSION: Problematic behavior in medical school is associated with subsequent disciplinary action by a state medical board. Professionalism is an essential competency that must be demonstrated for a student to graduate from medical school.     

Benchmarks of support in internal medicine residency training programs.

PURPOSE: To identify benchmarks of financial and staff support in internal medicine residency training programs and their correlation with indicators of quality. METHOD: A survey instrument to determine characteristics of support of residency training programs was mailed to each member program of the Association of Program Directors of Internal Medicine. Results were correlated with the three-year running average of the pass rates on the American Board of Internal Medicine certifying examination using bivariate and multivariate analyses. RESULTS: Of 394 surveys, 287 (73%) were completed: 74% of respondents were program directors and 20% were both chair and program director. The mean duration as program director was 7.5 years (median = 5), but it was significantly lower for women than for men (4.9 versus 8.1; p =.001). Respondents spent 62% of their time in educational and administrative duties, 30% in clinical activities, 5% in research, and 2% in other activities. Most chief residents were PGY4s, with 72% receiving compensation additional to base salary. On average, there was one associate program director for every 33 residents, one chief resident for every 27 residents, and one staff person for every 21 residents. Most programs provided trainees with incremental educational stipends, meals while oncall, travel and meeting expenses, and parking. Support from pharmaceutical companies was used for meals, books, and meeting expenses. Almost all programs provided meals for applicants, with 15% providing travel allowances and 37% providing lodging. The programs' board pass rates significantly correlated with the numbers of faculty fulltime equivalents (FTEs), the numbers of resident FTEs per office staff FTEs, and the numbers of categorical and preliminary applications received and ranked by the programs in 1998 and 1999. Regression analyses demonstrated three independent predictors of the programs' board pass rates: number of faculty (a positive predictor), percentage of clinical work performed by the program director (a negative predictor), and financial support from pharmaceutical companies (also a negative predictor). CONCLUSIONS: These results identify benchmarks of financial and staff support provided to internal medicine residency programs. Some of these benchmarks are correlated with board pass rate, an accepted indicator of quality in residency training. Program directors and chairs can use this information to identify areas that may benefit from enhanced financial and administrative support.     

Educational views and attitudes, and career goals of MD-PhD students at the University of Pennsylvania School of Medicine.

PURPOSE: Despite the documented contribution of graduates of MD-PhD programs to the medical profession, few data exist concerning the views, attitudes, and career goals of students before they graduate from such programs. METHOD: All 167 students enrolled in the University of Pennsylvania School of Medicine Combined Degree Program in the spring of 2002 were invited to participate in an IRB-approved online questionnaire consisting of 81 multiple-choice questions covering students' demographics, satisfaction with their educational experience, future goals and career aspirations, and attitudes and views concerning the physician-scientist model. RESULTS: The 96 MD-PhD students (57.5%) who completed the questionnaire represented a diverse group with individuals from every stage of training. The majority of students were satisfied with their overall educational experience (90.5%). Although students reported an interest in a wide range of clinical specialties, 84.4% indicated plans to pursue a career in research and 79.2% preferred a position at an academic medical center. However, a larger percentage of males (70.7%) than females (50.0%) listed research as their primary professional activity. The range of students' views and attitudes regarding the physician-scientist model suggests that additional education and discussion are warranted. CONCLUSION: The MD-PhD students surveyed at the University of Pennsylvania were satisfied with their education and most were planning research-oriented careers. Yet, the aspirations, views and concerns of individual MD-PhD students were varied. The authors believe this information in aggregate will prove useful to current and future students, combined degree programs, policymakers, and residency directors.     

Long-term retention of graduates from a program to increase the supply of rural family physicians.

PURPOSE: To determine the long-term retention of rural family physicians graduating from the Physician Shortage Area Program (PSAP) of Jefferson Medical College. METHOD: Of the 1,937 Jefferson graduates from the classes of 1978-1986, the authors identified those practicing rural family medicine when their practice location was first determined. The number and percent of PSAP and non-PSAP graduates practicing family medicine in the same rural area in 2002 were then identified, and compared to the number of those graduates practicing rural family medicine when they were first located in practice 11-16 years earlier. RESULTS: After 11-16 years, 68% (26/38) of the PSAP graduates were still practicing family medicine in the same rural area, compared with 46% (25/54) of their non-PSAP peers (p = .03). Survival analysis showed that PSAP graduates practice family medicine in the same rural locality longer than non-PSAP graduates (p = .04). CONCLUSIONS: These results are the first to show long-term rural primary care retention that is longer than the median duration. This outcome combined with previously published outcomes show that the PSAP represents the only program that has resulted in multifold increases in both recruitment (eight-fold) and long-term retention (at least 11-16 years). In light of recent national recommendations to increase the total enrollment in medical schools, allocating some of this growth to developing and expanding programs similar to the PSAP would make a substantial and long lasting impact on the rural physician workforce.     

Overt and relational victimization among children with frequent abdominal pain: links to social skills, academic functioning, and health service use

OBJECTIVES: Chronic abdominal pain is linked with school absenteeism and diminished social competence; yet, little is know about the extent to which negative peer encounters contribute to symptoms and functioning in youth with abdominal pain. This study compared children with frequent abdominal pain with a pain-free control group on measures of overt and relational victimization and examined the link between abdominal pain and school-related functioning. METHODS: Participants were 60 children with frequent abdominal pain and 60 gender- and age-matched peers. Child, peer, and teacher reports were used to assess abdominal pain, peer victimization, use of school medical services, social skills, and academic competence. RESULTS: Children with frequent abdominal pain experienced higher levels of victimization than their pain-free peers, with boys in the pain group rated highest in overt victimization. For children in the pain group, overt and relational victimization made incremental contributions to outcomes and moderated the link between pain- and school-related functioning. CONCLUSIONS: Overt and relational victimization may increase risk of concurrent adjustment problems among youth with frequent abdominal pain; thus, it may be useful to assess peer relationships when working with this population.