The Psychometric Properties of CollaboRATE: A Fast and Frugal Patient-Reported Measure of the Shared Decision-Making Process

BackgroundPatient-centered health care is a central component of current health policy agendas. Shared decision making (SDM) is considered to be the pinnacle of patient engagement and methods to promote this are becoming commonplace. However, the measurement of SDM continues to prove challenging. Reviews have highlighted the need for a patient-reported measure of SDM that is practical, valid, and reliable to assist implementation efforts. In consultation with patients, we developed CollaboRATE, a 3-item measure of the SDM process.ObjectiveThere is a need for scalable patient-reported measure of the SDM process. In the current project, we assessed the psychometric properties of CollaboRATE.MethodsA representative sample of the US population were recruited online and were randomly allocated to view 1 of 6 simulated doctor-patient encounters in January 2013. Three dimensions of SDM were manipulated in the encounters: (1) explanation of the health issue, (2) elicitation of patient preferences, and (3) integration of patient preferences. Participants then completed CollaboRATE (possible scores 0-100) in addition to 2 other patient-reported measures of SDM: the 9-item Shared Decision Decision Making Questionnaire (SDM-Q-9) and the Doctor Facilitation subscale of the Patient’s Perceived Involvement in Care Scale (PICS). A subsample of participants was resurveyed between 7 and 14 days after the initial survey. We assessed CollaboRATE’s discriminative, concurrent, and divergent validity, intrarater reliability, and sensitivity to change.ResultsThe final sample consisted of 1341 participants. CollaboRATE demonstrated discriminative validity, with a significant increase in CollaboRATE score as the number of core dimensions of SDM increased from zero (mean score: 46.0, 95% CI 42.4-49.6) to 3 (mean score 85.8, 95% CI 83.2-88.4). CollaboRATE also demonstrated concurrent validity with other measures of SDM, excellent intrarater reliability, and sensitivity to change; however, divergent validity was not demonstrated.ConclusionsThe fast and frugal nature of CollaboRATE lends itself to routine clinical use. Further assessment of CollaboRATE in real-world settings is required.     

Shared decision making in medicine: The influence of situational treatment factors

Objective

Although shared decision making (SDM) has become increasingly important in bioethical discussions and clinical practice, it is not clear in which treatment situations SDM is suitable. We address this question by investigating social norms on the appropriateness of SDM in different situations.

Methods

We conducted qualitative expert interviews with patients, general practitioners, and health administration and research professionals.

Results

SDM was considered to be most important in severe illness and chronic condition. Furthermore, SDM was indicated to be required if there is more than one therapeutic option, especially if it is not clear which option is best. Interviewees classified end-of-life decisions and decisions about prevention as those that primarily should be made by informed patients. On the other hand a paternalistic decision was considered most appropriate in emergency situations and when the patient does not want to participate in decision making.

Conclusion

This study demonstrates that multiple situational factors and their interactions must be considered regarding the scope of SDM in medical consultation.

Practice implications

Research addressing this question will help physicians adjust their consultation style and allow implementations of SDM and decision aids to be tailored more appropriately to complex treatment situations.     

Introducing case management for people with dementia in primary care: a mixed-methods study

Background

Case management may be a feasible solution to the problem of service fragmentation for people with dementia.

Aim

To adapt a US model of primary care-based case management for people with dementia and test it in general practice.

Design and setting

Mixed-methodology case studies of case management implementation in four general practices: one rural, one inner-city, and two urban practices. Practice nurses undertook the case manager role in the rural and inner-city practices, and were allocated one session per week for case management by their practices. A seconded social worker worked full time for the two urban practices.

Method

Participants were community-dwelling patients with dementia who were living at home with a family carer, and who were not receiving specialist care coordination. Case study methods included analysis of case loads and interviews with patients, carers, local NHS and other stakeholders, and case managers. Measures included numbers of patients with dementia and their carers, number of unmet needs identified, and actions taken to meet needs. Case manager records were compared with findings from interviews with patients and carers, and with other stakeholders.

Results

The number of eligible patients was smaller than expected. No practice achieved its recruitment target. Researchers identified more unmet needs than case managers. The practice nurse case managers reported lack of time and found research documentation burdensome. Patients and carers were positive about case management as a first point of contact with the practice, as a ‘safety net’, and for creating a one-to-one therapeutic relationship.

Conclusion

Further investigation is required before case management for people with dementia and their carers can be implemented in primary care.     

Accessing primary care: a simulated patient study

Background

Simulated patient, or so-called ‘mystery-shopper’, studies are a controversial, but potentially useful, approach to take when conducting health services research.

Aim

To investigate the construct validity of survey questions relating to access to primary care included in the English GP Patient Survey.

Design and setting

Observational study in 41 general practices in rural, urban, and inner-city settings in the UK.

Method

Between May 2010 and March 2011, researchers telephoned practices at monthly intervals, simulating patients requesting routine, but prompt, appointments. Seven measures of access and appointment availability, measured from the mystery-shopper contacts, were related to seven measures of practice performance from the GP Patient Survey.

Results

Practices with lower access scores in the GP Patient Survey had poorer access and appointment availability for five out of seven items measured directly, when compared with practices that had higher scores. Scores on items from the national survey that related to appointment availability were significantly associated with direct measures of appointment availability. Patient-satisfaction levels and the likelihood that patients would recommend their practice were related to the availability of appointments. Patients’ reports of ease of telephone access in the national survey were unrelated to three out of four measures of practice call handling, but were related to the time taken to resolve an appointment request, suggesting responders’ possible confusion in answering this question.

Conclusion

Items relating to the accessibility of care in a the English GP patient survey have construct validity. Patients’ satisfaction with their practice is not related to practice call handling, but is related to appointment availability.     

Factors influencing professional decision making on unplanned hospital admission: a qualitative study

Background

Unplanned admissions to hospital are a challenge for healthcare systems internationally. In the UK variation in unplanned admission rates across geographical areas, general practices and GPs remains largely unexplained.

Aim

To identify factors influencing professional decision making around unplanned hospital admission.

Design and setting

Qualitative study with a purposive sample of health and social care professionals from three primary care trusts, two acute hospitals, social services and an ambulance service in the South West of England.

Method

Semi-structured interviews were conducted with 19 professionals. Interviews were audio-recorded and transcribed. Data were analysed thematically drawing on the constant comparative method.

Results

The main factors influencing professional decision making around unplanned admissions were: lack of availability of seamless care on a 24/7 basis; ‘professional tribalism’ and poor information flow; service targets and performance management; commissioning culture and the impact of a ‘market approach’; and clinical governance structures, tolerance of risk and the role of peer support. A tension was perceived between the need to reduce unplanned admissions by tolerating more risk in primary care and a risk averse culture in secondary and emergency care.

Conclusion

Professional decision making that leads to unplanned admission to hospital is influenced by a range of organisational and individual health or social care professional factors. Finding ways to modify and ameliorate the effects of these systems and individual influences should be considered an important goal in the design of new interventions.     

Interpersonal continuity of care: a cross-sectional survey of primary care patients'' preferences and their experiences

BACKGROUND: Developments in primary care may make the provision of interpersonal continuity more difficult. AIM: To identify those patients who regard interpersonal continuity as important and determine what makes it difficult for them to obtain this. Design of study: Cross sectional survey. SETTING: Twenty-two practices and a walk-in centre in West London and Leicestershire, UK. METHOD: Administration of a questionnaire on preferences for and experiences of interpersonal and informational continuity. Interpersonal continuity was defined in three questions: choosing a particular person; choosing someone known and trusted; and choosing someone who knows the patient and medical condition. RESULTS: One thousand four hundred and thirty-seven (46.5%) patients responded. Consulting someone known and trusted was important to 766 (62.6%) responders, although 105 (13.7%) of these reported that they had not experienced it at their last consultation. Seven hundred and eighty-eight (65.2%) responders regarded being able to consult a particular person as important, but 168 (21.3%) of these were unable to. Being in work and consulting for a new problem were associated with failing to obtain interpersonal continuity. Ethnic group was associated with failing to see someone with time to listen when this was preferred. CONCLUSION: In view of the response rate, which was particularly low among young males, some caution is required in applying the findings. Most patients experience the aspects of care important to them, although interpersonal continuity is important to many and certain groups find difficulty in obtaining it. Practices should have flexible appointment systems to account for the difficulties some patients have in negotiating for the type of care they want.     

Anticipatory care planning and integration: a primary care pilot study aimed at reducing unplanned hospitalisation

Background

Anticipatory care for older patients who are frail involves both case identification and proactive intervention to reduce hospitalisation.

Aim

To identify a population who were at risk of admission to hospital and to provide an anticipatory care plan (ACP) for them and to ascertain whether using primary and secondary care data to identify this population and then applying an ACP can help to reduce hospital admission rates.

Design and setting

Cohort study of a service intervention in a general practice and a primary care team in Scotland.

Method

The ACP sets out patients’ wishes in the event of a sudden deterioration in health. If admitted, a proactive approach was taken to transfer and discharge patients into the community. Cohorts were selected using the Nairn Case Finder, which matched patients in two practices for age, sex, multiple morbidity indexes, and secondary care outpatient and inpatient activity; 96 patients in each practice were studied for admission rate, occupied bed days and survival.

Results

Survivors from the ACP cohort (n = 80) had 510 fewer days in hospital than in the 12 months pre-intervention: a significant reduction of 52.0% (P = 0.020). There were 37 fewer admissions of the survivors from that cohort post-intervention than in the preceding 12 months, with a significant reduction of 42.5% (P = 0.002). Mortality rates in the two cohorts were similar, but the number of patients who died in hospital and the hospital bed days used in the last 3 months of life were significantly lower for the decedents with an ACP than for the controls who had died (P = 0.007 and P = 0.045 respectively).

Conclusion

This approach produced statistically significant reductions in unplanned hospitalisation for a cohort of patients with multiple morbidities. It demonstrates the potential for providing better care for patients as well as better value for health and social care services. It is of particular benefit in managing end-of-life care.     

Zero end-digit preference in recorded blood pressure and its impact on classification of patients for pharmacologic management in primary care - PREDICT-CVD-6.

BACKGROUND: Most blood pressure recordings end with a zero end-digit despite guidelines recommending measurement to the nearest 2 mmHg. The impact of rounding on management of cardiovascular disease (CVD) risk is unknown. AIM: To document the use of rounding to zero end-digit and assess its potential impact on eligibility for pharmacologic management of CVD risk. DESIGN OF STUDY: Cross-sectional study. SETTING: A total of 23,676 patients having opportunistic CVD risk assessment in primary care practices in New Zealand. METHOD: To simulate rounding in practice, for patients with systolic blood pressures recorded without a zero end-digit, a second blood pressure measure was generated by arithmetically rounding to the nearest zero end-digit. A 10-year Framingham CVD risk score was estimated using actual and rounded blood pressures. Eligibility for pharmacologic treatment was then determined using the Joint British Societies' JBS2 and the British Hypertension Society BHS-IV guidelines based on actual and rounded blood pressure values. RESULTS: Zero end-digits were recorded in 64% of systolic and 62% of diastolic blood pressures. When eligibility for drug treatment was based only on a Framingham 10year CVD risk threshold of 20% or more, rounding misclassified one in 41 of all those patients subject to this error. Under the two guidelines which use different combinations of CVD risk and blood pressure thresholds, one in 19 would be misclassified under JBS2 and one in 12 under the BHS-IV guidelines mostly towards increased treatment. CONCLUSION: Zero end-digit preference significantly increases a patient's likelihood of being classified as eligible for drug treatment. Guidelines that base treatment decisions primarily on absolute CVD risk are less susceptible to these errors.     

Understanding the management of early-stage chronic kidney disease in primary care: a qualitative study

Background

Primary care is recognised to have an important role in the delivery of care for people with chronic kidney disease (CKD). However, there is evidence that CKD management is currently suboptimal, with a range of practitioner concerns about its management.

Aim

To explore processes underpinning the implementation of CKD management in primary care.

Design and setting

Qualitative study in general practices participating in a chronic kidney disease collaborative undertaken as part of the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) for Greater Manchester.

Method

Semi-structured interviews were conducted with GPs and practice nurses (n = 21). Normalisation Process Theory provided a framework for generation and analysis of the data.

Results

A predominant theme was anxiety about the disclosure of early-stage CKD with patients. The tensions experienced related to identifying and discussing CKD in older people and patients with stage 3A, embedding early-stage CKD within vascular care, and the distribution of work within the practice team. Participants provided accounts of work undertaken to resolve the difficulties encountered, with efforts having tended to focus on reassuring patients. Analysis also highlighted how anxiety surrounding disclosure influenced, and was shaped by, the organisation of care for people with CKD and associated long-term conditions.

Conclusion

Offering reassurance alone may be of limited benefit, and current management of early-stage CKD in primary care may miss opportunities to address susceptibility to kidney injury, improve self-management of vascular conditions, and improve the management of multimorbidity.     

Telephone consulting in primary care: a triangulated qualitative study of patients and providers

Background

Internationally, there is increasing use of telephone consultations, particularly for triaging requests for acute care. However, little is known about how this mode of consulting differs from face-to-face encounters.

Aim

To understand patient and healthcare-staff perspectives on how telephone consulting differs from face-to-face consulting in terms of content, quality, and safety, and how it can be most appropriately incorporated into routine health care.

Design of study

Focus groups triangulated by a national questionnaire.

Setting

Primary care in urban and rural Scotland.

Method

Fifteen focus groups (n = 91) were conducted with GPs, nurses, administrative staff, and patients, purposively sampled to attain a maximum-variation sample. Findings were triangulated by a national questionnaire.

Results

Telephone consulting evolved in urban areas mainly to manage demand, while in rural areas it developed to overcome geographical problems and maintain continuity of care for patients. While telephone consulting was generally seen to provide improved access, clinicians expressed strong concerns about safety potentially being compromised, largely as a result of lack of formal and informal examination. Concerns were, to an extent, allayed when clinicians and patients knew each other well.

Conclusion

Used appropriately, telephone consulting enhances access to health care, aids continuity, and saves time and travelling for patients. The current emphasis on use for acute triage, however, worried clinicians and patients. Given these findings, and until the safe use of telephone triage is fully understood and agreed upon by stakeholders, policymakers and clinicians should consider using the telephone primarily for managing follow-up appointments when diagnostic assessment has already been undertaken.     

Enhancing a primary care environment: a case study of effects on patients and staff in a single general practice

BACKGROUND: Few studies have examined the effect on patients and staff of the physical environment in primary care facilities. AIM: To explore changes in patient and staff satisfaction, patient anxiety, and patient-doctor communication when a GP surgery moves from old premises to enhanced purpose-built accommodation. DESIGN OF STUDY: Questionnaire surveys, interviews, and focus groups pre- and post move. SETTING: An urban general practice in Bristol. METHOD: Patient questionnaires assessed anxiety (Spielberger State-Trait Anxiety Inventory; STAI), satisfaction with the environment, and communication during the consultation. Staff questionnaires assessed satisfaction with the environment and job satisfaction. Qualitative methods explored patient and staff views in more depth. RESULTS: A total of 1118 pre-move and 954 post-move patient questionnaires showed significant increases in satisfaction scores for reception/waiting areas (mean 6.46, 95% confidence interval [CI]=5.97 to 6.95) and consulting rooms (mean 3.80, 95% CI=3.44 to 4.15) in the new premises. Patients' satisfaction with patient-doctor communication also increased (mean 0.88, 95% CI=0.30 to 1.46) and anxiety scores were significantly reduced before and after the consultation in the new premises compared with the old (STAI mean difference before consultation 0.72, 95% CI=0.37 to 1.08; mean after consultation 0.37, 95% CI=0.03 to 0.72). Patients highlighted the increased space and light, more modern appearance, greater comfort, and novel works of art in the new surgery. Staff workplace satisfaction increased significantly after moving and remained higher than in the old building. CONCLUSION: This large-scale study examining the effects of a UK primary care environment on patients and staff shows that an enhanced environment is associated with improvements in patients' perception of patient-doctor communication, reduction in anxiety, and increases in patient and staff satisfaction.     

Missed opportunities for diagnosis: lessons learned from diagnostic errors in primary care

Background

Because of the difficulties inherent in diagnosis in primary care, it is inevitable that diagnostic errors will occur. However, despite the important consequences associated with diagnostic errors and their estimated high prevalence, teaching and research on diagnostic error is a neglected area.

Aim

To ascertain the key learning points from GPs’ experiences of diagnostic errors and approaches to clinical decision making associated with these.

Design and setting

Secondary analysis of 36 qualitative interviews with GPs in Oxfordshire, UK.

Method

Two datasets of semi-structured interviews were combined. Questions focused on GPs’ experiences of diagnosis and diagnostic errors (or near misses) in routine primary care and out of hours. Interviews were audiorecorded, transcribed verbatim, and analysed thematically.

Results

Learning points include GPs’ reliance on ‘pattern recognition’ and the failure of this strategy to identify atypical presentations; the importance of considering all potentially serious conditions using a ‘restricted rule out’ approach; and identifying and acting on a sense of unease. Strategies to help manage uncertainty in primary care were also discussed.

Conclusion

Learning from previous examples of diagnostic errors is essential if these events are to be reduced in the future and this should be incorporated into GP training. At a practice level, learning points from experiences of diagnostic errors should be discussed more frequently; and more should be done to integrate these lessons nationally to understand and characterise diagnostic errors.     

Patient perspectives on test result communication in primary care: a qualitative study

Background

Although the number of blood tests ordered in primary care continues to increase, efficient systems for the communication of blood test results to patients are lacking. This is a concern in terms of both patient safety and patient satisfaction.

Aim

To gain an understanding of patient perspectives on organisational and technological aspects of current and prospective systems for communicating laboratory test results in primary care, and the influences that impact patients’ preferred methods for receiving results.

Design and setting

Qualitative study using patient focus groups in four primary care practices in Birmingham, UK.

Method

The primary care practices were purposively selected to ensure they varied in size, socioeconomic environment, and the default pathways they used to communicate test results. A total of 26 patients from the four practices who had had a recent blood test were recruited. Over a 6 month period in 2011, six, 1-hour focus groups were conducted at the four practices involved in the study.

Results

Patients expressed a preference for receiving results from the ordering GP or a clinically qualified member of staff. Suggestions for refining current systems included improved access to phlebotomy appointments, better management of patient telephone calls, and a clear, accessible protocol for the communication of results.

Conclusion

Despite the testing and result communication process being a core activity in primary care, it was found that practices could improve their service in a number of areas. Patients described frequent delays and inconsistency in both the level of information and the method of communication, as well as dissatisfaction with non-clinical staff relaying results. Patient preferences for result communication based on their experience of current systems have produced practical suggestions to improve processes.     

Development and validation of a patient measure of doctor-patient caring

Objective

Conceptualising the doctor-patient relationship as a ‘window mirror’ exposes care delivery from doctor to self, doctor to patient, patient to self, and patient to doctor. These directions have not been measured concurrently. We aimed to develop and validate a patient questionnaire informed by this model.

Methods

A modified-Delphi exercise was conducted to develop, and face and content validate, the questionnaire. Stage 2 surveyed 495 patients in general practice to assess the internal consistency and construct validity of the questionnaire.

Results

The questionnaire is face and content valid. Its internal reliability and construct validity appear good. Patients who care more about their doctor also care more about themselves. A patient or doctor who cares about the other person is associated with increased self-care by that person.

Conclusions

Further development and testing of the patient questionnaire is warranted to validate measurement of how patients perceive the caring they and their doctor give, and receive from, each other.

Practice implications

From the patient perspective the questionnaire may increase awareness of the importance of family doctors and patients caring about each other and themselves. It may inform and evaluate medical students, educational programmes and caring in doctor-patient relationships.     

Mindfulness-based stress reduction for GPs: results of a controlled mixed methods pilot study in Dutch primary care

Background

Burnout is highly prevalent in GPs and can have a negative influence on their wellbeing, performance, and patient care. Mindfulness-based stress reduction (MBSR) may be an effective intervention to decrease burnout symptoms and increase wellbeing.

Aim

To gain insight into the feasibility and effectiveness of MBSR on burnout, empathy, and (work-related) wellbeing in GPs.

Design and setting

A mixed methods pilot study, including a waiting list-controlled pre-/post-study and a qualitative study of the experiences of participating GPs in the Netherlands.

Method

Participants were sent questionnaires assessing burnout, work engagement, empathy, and mindfulness skills, before and at the end of the MBSR training/waiting period. Qualitative data on how GPs experienced the training were collected during a plenary session and with evaluation forms at the end of the course.

Results

Fifty Dutch GPs participated in this study. The MBSR group reported a greater decrease in depersonalisation than the control group (adjusted difference −1.42, 95% confidence interval [CI] = −2.72 to −0.21, P = 0.03). Dedication increased more significantly in the MBSR group than in the control group (adjusted difference 2.17, 95% CI = 0.51 to 3.83, P = 0.01). Mindfulness skills increased significantly in the MBSR group compared with the control group (adjusted difference 6.90, 95% CI = 1.42 to 12.37, P = 0.01). There was no significant change in empathy. The qualitative data indicated that the MBSR course increased their wellbeing and compassion towards themselves and others, including their patients.

Conclusion

The study shows that MBSR for GPs is feasible and might result in fewer burnout symptoms and increased work engagement and wellbeing. However, an adequately powered randomised controlled trial is needed to confirm the study’s findings.