Student performance on the NBME Part II subtest and subject examination in obstetrics-gynecology

Clerkship directors in obstetrics-gynecology often use the National Board of Medical Examiners (NBME) norms to evaluate third-year medical students' performance on the NBME obstetrics-gynecology subject examination. A comparison of the scores of 342 students at the Medical College of Georgia School of Medicine showed that the students performed significantly better on the NBME subject examination than on the Part II subtest in obstetrics-gynecology. These results concur with the findings of the NBME, which advises directors wishing to adjust the criterion group norms to determine the average difference observed in a school's performance on the two examinations and to use that difference or some portion of it in their interpretation of percentile scores on the subject examination. Additional analyses revealed that a single, linear weight may inappropriately adjust these scores, that student performance on the Part II subtest depends on specialty choice (obstetrics-gynecology versus all others), and that time and sequence of the clerkship were unrelated to the students' performance on the two examinations.     

Preclinical curriculum characteristics and institutional performance on NBME. Part I

A study was conducted that analyzed the relationship between various characteristics of the preclinical curriculum and institutional performance on the Part I examination of the National Board of Medical Examiners (NBME) at a sample of 85 U.S. medical schools. Total scheduled hours per week was the single curriculum characteristic having a positive and significant relationship with institutional NBME examination performance. However, when the data were controlled by medical school selectivity in admissions and institutional policy on the taking of the examination, total scheduled hours per week failed to make a significant contribution to the prediction of performance. The results were viewed as failing to provide support and justification for intense preclinical curriculum loads on the basis that this would enhance NBME examination performance. The authors conclude that simple comparisons of schools on the basis of mean NBME examination performance are meaningless unless the entering abilities of students and school policies on the examination are taken into account. The authors also suggest that those schools that prescribe heavy and intense preclinical curriculum loads should reexamine those policies in light of recommendations of the Project Panel on the General Professional Education of the Physician and College Preparation for Medicine.     

Predicting academic performance at a predominantly black medical school

A study was conducted by the authors that examined the validity of the Medical College Admission Test (MCAT), undergraduate grade-point average (GPA), and "competitiveness" of undergraduate college in predicting the performance of students at a predominantly black college of medicine. The performance measures used in the analysis consisted of course grades in all four years of medical school and scores on both Part I and Part II of the National Board of Medical Examiners (NBME) examinations. The predictive validities of the MCAT scores and undergraduate GPAs were found to be similar to those revealed in earlier studies conducted at predominantly white schools. Two exceptions to these similarities were found. First, the MCAT scores at the black school had a somewhat lower validity in predicting NBME examination scores than was the case at the other schools. Second, of the six MCAT subtest scores, Skills Analysis: Reading had the highest correlation with first-year grades, in contrast to results at the other schools. No differences between men and women were found in the validity of MCAT scores and the GPA. The competitiveness of the undergraduate college attended was found to contribute significantly to the prediction of all measures of medical school performance.     

Performance on NBME Part I examination in relation to policies regarding use of test

From 1971 to 1983, a number of administrative decisions were made at the University of Oklahoma College of Medicine regarding the National Board of Medical Examiners (NBME) Part I examination. Students' performance on this examination was found to be associated with administrative decisions that required (a) a passing score for promotion, (b) the student to take the examination, and (c) the student to take an integrated basic sciences review course. A modest improvement in student performance was noted when passage of the examination was made mandatory. The introduction of a review course into the curriculum effected a major upward change in scores that has persisted despite the removal of all requirements to pass, or even take, the Part I NBME examination.     

Effects of curriculum and format changes in a medical pharmacology course, 1983 to 1987

During the past five years, the medical pharmacology course at the University of Arkansas College of Medicine has changed from a poorly attended course in which students depended on "canned notes" (from a note-taking and note-distribution system organized among themselves) and had bad rapport with faculty members to a course in which attendance is high, the canned-notes system has been abandoned, and faculty-student interactions are generally pleasant. These changes in student behavior occurred during a period in which the pharmacology faculty implemented changes that anticipated the recommendations of the Panel on the General Professional Education of the Physician and College Preparation for Medicine of the Association of American Medical Colleges. These changes included encouraging independent learning, reduced lecture time, and increased problem-solving. The students' performance on the Part I examination of the National Board of Medical Examiners did not change during this period of curriculum revision.     

Using ratings of resident competence to evaluate NBME examination passing standards

The passing standards of the National Board of Medical Examiners (NBME) examinations were empirically evaluated by analyzing the distributions of examination scores received by 1,994 graduates of one medical school in relation to the clinical competence ratings given to the graduates by their first-year residency directors. A significant association was found between the NBME examination scores and ratings in the cognitive areas of clinical competence. The graduates who scored 420 or less on the NBME Part I or the Part II examination received significantly lower medical knowledge ratings than did the total group of graduates. A similar analysis of NBME Part III examination scores was less clear-cut but also suggested that a score of 420 or less could identify those graduates at significant risk of receiving low knowledge ratings. When low ratings were used as an outcome measure, analysis showed that the NBME Part II examination was not sensitive in detecting such graduates. Based on these data, the authors do not propose changes in the passing standards for the NBME examinations but recommend that these standards continue to be reassessed and further measures be taken to strengthen the internal evaluation methods in medical schools.     

Policies of U.S. medical schools on the use of the NBME Part I and Part II examinations

The study reported here provides information on National Board of Medical Examiners (NBME) examination policies from all U.S. medical schools (n = 67) that require students to pass the examination. Most of these schools have similar policies on use of a 380 total score as the passing level for the NBME Part I examination, allowing three attempts to pass the examination, interrupting a student's progress into the clinical curriculum upon failure of the examination, officially providing time for preparation for taking the test, and requiring students to pass the Part II examination.     

The use of Part I National Board scores in the selection of residents in ophthalmology and otolaryngology

A survey of ophthalmology and otolaryngology residency program directors was conducted to determine the extent to which National Board of Medical Examiners (NBME) Part I scores are used in selection of residents in these highly competitive specialty fields. Results from 218 completed questionnaires representing nearly 90% of all US ophthalmology and otolaryngology/head and neck surgery programs were analyzed. More than three fourths indicated that Part I NBME scores were used in selecting residents; more than half of the programs used these scores as a means to determine whom to interview. The direct use of NBME scores in the residency application process is widespread; however, such use of NBME scores is not consistent with the purposes of the National Board. The preeminent role of the faculty in the evaluation of medical students and in the assessment of their clinical competence needs emphasis.     

Comparison of theoretically oriented and patient-oriented behavioral science courses

Effective teaching of medical behavioral science is an important challenge for psychiatrists. Two behavioral science courses taught at different times at the Yale University School of Medicine are described: a theoretically oriented course emphasizing symbolic function, primary source reading, and conceptual thinking and a patient-oriented course emphasizing the relevance of behavioral science to the practice of medicine, taught primarily by consultation-liaison psychiatrists. Students' evaluations of the two courses during the fifth year each course was taught were compared. The students' acceptance of the patient-oriented course was dramatically greater than that of the theoretically oriented course. The class mean scores on the behavioral science subtest of the Part I examination of the National Board of Medical Examiners during the last four years that the courses were taught were compared. The mean scores of the classes that had taken the patient-oriented course were significantly higher than those of the classes that had taken the theoretically oriented course. The mean score for the class that took the fifth year of the patient-oriented course was 52 points higher than the mean score for the class that took the fifth year of the theoretically oriented course. The authors concluded that the skills that consultation-liaison psychiatrists use every day in their work may be exactly those that are useful in teaching a successful behavioral science course for medical students.     

A model for predicting performance on the NBME Part I examination

Multiple regression analyses were employed to determine the relationships between achievement variables as predictors of the performance on Part I of the National Board of Medical Examiners examinations (NBME-I) of 366 medical students. The students' examination score averages in first- and second-year basic science courses were sequentially added to a composite Medical College Admission Test (MCAT) score to investigate the increases in prediction accuracy. Four prediction equations were cross validated on two subsequent medical school classes. While the multiple correlation between the predicted NBME-I score and the actual score significantly increased as first- and second-year course examination scores were added to the equations, the overall accuracy in predicting passing or failing did not substantially increase. The most useful equation employed a combination of the MCAT score and the first semester anatomy course examination score. The NBME-I predictions were given by letter to the 1984 and 1985 students approximately a year before they were to take the NBME-I examination so that students at risk of failure could undertake remedial study.     

Predictive validity of the MCAT for students with two sets of scores

Addressed in the study reported here is the question of which set of scores for those students who retake the Medical College Admission Test (MCAT) yields a better predictive validity. The sample was comprised of 304 students who retook the MCAT prior to entering Jefferson Medical College between 1978 and 1981. Five sets of MCAT scores were considered as predictors in the study: earlier, later, higher, and lower sets of MCAT scores and the average of the earlier and later scores for each MCAT subtest. Twenty-five criteria were used, including grades earned in the freshman and sophomore years and scores on the subtests of Part I and Part II of the examinations of the National Board of Medical Examiners. Correlational techniques, such as bivariate and multiple correlation analyses and canonical correlation followed by redundancy analysis were utilized. The magnitude of redundancy indices indicated that the set of MCAT scores in which the earlier and later scores were averaged was the best predictor, followed by the earlier, lower, higher, and later sets of MCAT scores. The implications of these findings for the admissions process and for validity studies are discussed.     

Reducing 'information overload' in the teaching of pharmacology: the '200 Drug List'

The author in this report describes the development and use of a restricted list of drugs in the medical pharmacology course at the Medical College of Georgia (MCG) School of Medicine. The "200 Drug List" was developed by the author by analyzing recent examinations given to students at the MCG and other places. The list contained 60 percent fewer drugs than had been taught in the course in prior years. Only those drugs on the list appeared on subsequent pharmacology examinations, regardless of the scope of the teaching program. Despite the limited number of drugs that the students were required to learn to satisfy the requirements of the teaching program, the average score for the class on the pharmacology subtest of the National Board of Medical Examiners Part I examination improved each year since the new approach was adopted. The 200 Drug List concept is viewed as an effective way to reduce the "information overload" for students without sacrificing the quality of an introductory course in pharmacology.     

An experiment in medical education. A critical analysis using traditional criteria

In 1984, in addition to its standard traditional curriculum, Rush Medical College (Chicago, Ill) developed a Socratic problem-based method of teaching basic science material called the alternative curriculum. As part of an evaluation of this new curriculum, students in the two curricula were compared using three traditional measurements: (1) test scores from the National Board of Medical Examiners, Part I; (2) test scores from the National Board of Medical Examiners, Part II; and (3) performance on an oral examination. Alternative curriculum students did not differ significantly from their traditional curriculum classmates on National Board of Medical Examiners, Part I and Part II total scores, although their subset scores on Part I did tend to be lower, reaching significance in one subset area. Differences in performance favoring the traditional curriculum were primarily seen in the early years of the program. Alternative curriculum students in the class matriculated in 1987 scored significantly higher in three of five categories on the oral examination.     

Predictors of success in an anesthesiology residency

The selection of residents in medical specialty programs is a difficult task facing all selection committees. The present authors examined factors that contribute to successful residency performance by 26 anesthesiology residents in order to assist the program's selection committee in developing selection criteria. The best predictor of a resident's academic average in the anesthesiology program was the number of years the resident had spent in other specialties. Comparison of the residents' scores on the Anesthesiology In-Training Examination (ITE) and their scores on Part I of the examinations of the National Board of Medical Examiners (NBME) showed a statistically significant negative correlation. The higher that residents scored on the NBME Part I examination, the lower they scored on the ITE. No significant correlations were found between the residents' ITE scores and undergraduate grade-point average or nonacademic variables such as the residents' age or parents' level of education. The residents' composite grade-point average (GPA) for the residency and their interview scores had a strong positive relationship significant at the 0.06 level.     

Undergraduate medical education

The number of applicants to US medical schools, which declined steadily between 1985 and 1988, increased slightly for the class entering in 1989. The profile of entering students showed a small decline from last year in the percentage of students with grade point averages categorized as "A" (3.5 or above on a 4-point scale) and slight declines in four of the six MCAT subtest scores. The percentage of both women and minority students in the entering class increased from the previous year. An interesting observation is the large percentage increase this year in students transferring to LCME medical schools from graduate and professional degree programs and from osteopathic medical schools. While the number of full-time faculty members in medical schools continues to increase, significant vacancy rates exist in some departments. More than 5% of full-time faculty positions are vacant in genetics, pathology, dermatology, family medicine, neurology, obstetrics-gynecology, orthopedics, otolaryngology, pediatrics, and surgery departments. Along with faculty vacancies, there has been a considerable turnover of medical school deans. The curriculum in most medical schools includes some innovative instructional formats, such as problem-based learning and computer-assisted instruction. However, current data do not allow a generalization about the extent to which these are being utilized. It seems that, at least in some institutions, multiple methods are being used to assess the clinical competence of medical students (observation by faculty members and residents, written and oral examinations, and multiple station examinations), including the use of standardized patients. About half of the medical schools require students to pass the NBME Part I examination and about one third require passage of Part II. The subject examinations provided by the NBME seem to be used widely, at least in the clinical disciplines. Within the past year, about 14% of medical schools have reported the presence of students or residents who have been diagnosed with human immunodeficiency virus infection, and 12% have had students or residents diagnosed with hepatitis B virus infection. It is critical that medical schools teach students how to prevent occupational exposure to these infections, as well as ensuring that adequate health insurance coverage be provided for these conditions.     

A comparison of medical students' performances in independent study and traditional programs

Medical students at Ohio State University may study the basic medical sciences in an independent study program or in a conventional lecture-discussion program. In a study involving more than 2,000 students over a 10-year period, students pursuing the independent study program and students in the more traditional program performed similarly on Part I of the National Board of Medical Examiners (NBME) examinations and in their required clerkships. However, differences were identified in some content areas and resulted in curricular changes.     

Effectiveness of an international health elective as measured by NBME Part II.

A total of 434 third- and fourth- year medical students from 80 U.S. medical schools participate between 1968 and 1974 in Yugoslav or Israeli international fellowship programs sponsored by the Association of American Medical Colleges and the U.S. Public Health Service. Subsequently, the scores of these fellowship student on Part II of the examinations of the National Board of Medical Examiners (NBME) were compared with the scores of rejected applicants and with the national average to determine the cognitive impact of the fellowship experience on the participants. The results show that the international fellows scored significantly higher than the rejected applicants and the national average in only the preventive medicine/public health portion of the examination. The conclusion is drawn that the fellowship programs enhanced the participants' knowledge of preventive medicine and public health.     

地方医学院校临床医学专业卓越医师培养计划的实施与探索

目的分析卓越医师培养计划在地方医学院校临床医学专业中的实施方法与效果。方法选取2012-2014级的559名在蚌埠医学院第一附属医院学习的教改班和普通班学生作为研究对象,教改班学生接受卓越医师培养计划,普通班接受常规教学培养计划,以国家医学考试中心组织的《医师资格考试临床类别分阶段考试实证研究第一阶段考试》成绩为依据,比较2个班的理论考试和技能考试成绩,并进行Pearson相关分析。结果2012级教改班与普通班的教学成绩相比差异无统计学意义（P>0.05）;2013级教改班的理论总分明显高于普通班（P < 0.01）,但两个班级的技能总分相比差异无统计学意义（P>0.05）;2014级教改班与普通班的教学成绩相比差异无统计学意义（P>0.05）;Pearson相关分析结果显示,2012级与2013级教改班和普通班技能与笔试不同模块成绩呈正相关关系（P < 0.05）;2014级教改班和普通班技能与笔试理论总分、基础医学和临床医学各模块得分呈正相关关系（P < 0.05）,但与医学人文和预防医学模块得分并无相关关系（P>0.05）。教改班的各理论知识评分和技能总分与普通班相比差异并无统计学意义（P>0.05）,教改班的理论知识总分明显高于普通班（P < 0.05）。结论卓越医师培养计划可以提高学生的综合成绩,应当在各医学院校内广泛应用和推广。     

对医学生课间实习全过程监控效果的分析及探讨

在首都医科大学第二临床医学院2001级,2002级七年制内科学课间实习教学中,制定考核评分指标,全程持续动态考核评估,客观地评估学生的学习态度、综合能力及临床知识与临床技能,并设立对照组,对两组学生参加首医大理论统考成绩及"五站"式技能统考成绩比较分析,实验组学生在查体与辅助检查方面的得分均高于对照组,且差异有统计学意义。在提高学生实践技能方面取得显著成效。