A mixed method approach to clarify the construct validity of interprofessional collaboration: An empirical research illustration

The rapid development of empirical studies in the field of interprofessional collaboration (IPC) calls for a wide array of scientific approaches ranging from recruitment and motivation to measurement and design questions. Regardless of whether researchers choose qualitative or quantitative approaches, they must substantiate their findings. We argue that more attention should be given to reliability and validity issues to improve our understanding of IPC as a phenomenon and practice. A mixed methods approach is presented as a relevant design format for the study of IPC. This paper aims to argue that a combination of methodologies may be a feasible way to enhance our understanding of IPC, with a special focus on reliability and validity issues; illustrate the application of different methodologies in an IPC research project; and emphasize the distinction between validity and validation to mitigate possible obstacles in integrating qualitative and quantitative research in the study of IPC.     

A mixed method approach to clarify the construct validity of interprofessional collaboration: an empirical research illustration

The rapid development of empirical studies in the field of interprofessional collaboration (IPC) calls for a wide array of scientific approaches ranging from recruitment and motivation to measurement and design questions. Regardless of whether researchers choose qualitative or quantitative approaches, they must substantiate their findings. We argue that more attention should be given to reliability and validity issues to improve our understanding of IPC as a phenomenon and practice. A mixed methods approach is presented as a relevant design format for the study of IPC. This paper aims to argue that a combination of methodologies may be a feasible way to enhance our understanding of IPC, with a special focus on reliability and validity issues; illustrate the application of different methodologies in an IPC research project; and emphasize the distinction between validity and validation to mitigate possible obstacles in integrating qualitative and quantitative research in the study of IPC.     

Evaluation of qualitative research

It is necessary to subject published research to critical scrutiny, in order to evaluate the robustness of the findings. The criteria used in evaluation require to be appropriate for the research paradigm, i.e. quantitative or qualitative. Quantitative conceptualizations of reliability and validity are unsuitable for evaluation of qualitative research as they were not devised for this purpose. The use of quantitative criteria to evaluate qualitative research may create the impression that the latter is not academically rigorous. Evaluation criteria which are specific to qualitative research require identification and application, in order to provide a formalized and rigorous approach to critical appraisal. A formalized framework for evaluation will help to ensure that the contribution of qualitative studies, with specific reference to health services research, receives optimum recognition. The work of a number of writers is used in this paper to examine the features which distinguish qualitative research and the following are discussed: the need for researcher reflexivity; the use of the 'first person' in academic work; the context in which research takes place; the selection of research participants; the interpretation of participants' accounts; the active acknowledgement of 'lay' knowledge; researcher flexibility within the research process; the generalizability of findings. It is concluded that academically rigorous criteria, which are appropriate for evaluation of qualitative research, exist and are available for use by practitioners and researchers.     

How qualitative research can contribute to research in the intensive care unit

A qualitative research design can provide unique contributions to research in the intensive care unit. Qualitative research includes the entire process of research: the methodology (conceptualization of the research question, choosing the appropriate qualitative strategy, designing the protocol), methods (conducting the research using qualitative methods within the chosen qualitative strategy, analysis of the data, verification of the findings), and writing the narrative. The researcher is the instrument and the data are the participants' words and experiences that are collected and coded to present experiences, discover themes, or build theories. A number of strategies are available to conduct qualitative research and include grounded theory, phenomenology, case study, and ethnography. Qualitative methods can be used to understand complex phenomena that do not lend themselves to quantitative methods of formal hypothesis testing. Qualitative research may be used to gain insights about organizational and cultural issues within the intensive care unit and to improve our understanding of social interaction and processes of health care delivery. In this article, we outline the rationale for, and approaches to, using qualitative research to inform critical care issues. We provide an overview of qualitative methods available and how they can be used alone or in concert with quantitative methods. To illustrate how our understanding of social phenomena such as patient safety and behavior change has been enhanced we use recent qualitative studies in acute care medicine.     

So you want to do research? 4: An introduction to quantitative methods

This fourth article of a series of six focuses on some of the key aspects of quantitative research methods. Starting with a review of what quantitative research is, the distinguishing characteristics of experimental and non-experimental research strategies, the different approaches for collecting data including self-completion questionnaires, interviews and scales, together with their respective strength and weaknesses are discussed. The differences between probability and non-probability sampling and the different methods for selecting a sample are described. Aspects of quantitative data analysis are briefly reviewed and the concepts of reliability and validity are described in the context of ensuring rigour in the research design. Finally, some guidance on the reporting the findings from quantitative research is provided.     

Nursing research: science, visions and telling stories

Some aspects of qualitative and quantitative approaches to nursing research are described, with particular emphasis on the critical assessment of the qualitative approach While common objections to quantitative (statistical) studies are mentioned, the main thrust is against the lack of generalizability of much contemporary qualitative work Concepts of validity and reliability are additionally scrutinized in the context of their use by ethnographers Grounded theory is a primary focus since it harbours most of the departures — and terminology — of the non-quantitative schools It is surmised that much of what passes as qualitative research is really a creative activity akin to the writing of the poem or novel     

Analysing qualitative interview data: addressing issues of validity andreliability

Over the last 20 years qualitative research methods have increased in popularity in the field of nursing research, yet critical issues of validity and reliability are often overlooked in published research reports Thus, the aim of this paper is to describe the steps which the author followed to address issues of rigour in one qualitative research study The study was conducted to explore the health visitor's role in identifying and working with vulnerable families in the community in relation to child protection Thispaper will focus on how issues of validity and reliability were addressed in terms of qualitative interview data     

The good, the bad and the relative, Part one: Conceptions of goodness in qualitative research

This (part one) paper traces efforts to define 'goodness' in qualitative research within various fields, including nursing. At first closely aligned with the traditional tenets of quantitative research (reliability and validity), over time these are found to be increasingly problematic to uphold within a qualitative context. As alternative criteria more appropriate to qualitative approaches are developed, in many instances these also are wanting in that they continue to reflect a search for order and certainty that permeates the quantitative domain. In reviewing various sets of criteria of goodness, the concepts of reliability and validity in relation to qualitative research are conceived as being championed, translated, exiled, redeemed and surpassed. Part two of the paper addresses the topic of goodness of qualitative research within the philosophical 'problem of the criterion'. Discussion extends to how researchers might usefully juxtapose the rationality of a modern world with a mounting postmodern sensibility.     

The strengths and weaknesses of quantitative and qualitative research: what method for nursing?

The overall purpose of research for any profession is to discover the truth of the discipline This paper examines the controversy over the methods by which truth is obtained, by examining the differences and similarities between quantitative and qualitative research The historically negative bias against qualitative research is discussed, as well as the strengths and weaknesses of both approaches, with issues highlighted by reference to nursing research Consideration is given to issues of sampling, the relationship between the researcher and subject, methodologies and collated data, validity, reliability, and ethical dilemmas The author identifies that neither approach is superior to the other, qualitative research appears invaluable for the exploration of subjective experiences of patients and nurses, and quantitative methods facilitate the discovery of quantifiable information Combining the strengths of both approaches in triangulation, if time and money permit, is also proposed as a valuable means of discovering the truth about nursing It is argued that if nursing scholars limit themselves to one method of enquiry, restrictions will be placed on the development of nursing knowledge     

Reliability and validity in research

This article examines reliability and validity as ways to demonstrate the rigour and trustworthiness of quantitative and qualitative research. The authors discuss the basic principles of reliability and validity for readers who are new to research.     

Qualitative research in health care: I. The scope and validity of methods

It is increasingly argued that qualitative approaches have an important role in health care research. A wide range of methods are used to collect qualitative data, including in-depth interviews, focus groups and observational methods such as participant observation. The reliability and validity of qualitative studies can be addressed by a variety of techniques. Although there is less consensus about appropriate methods of analysing qualitative data, such analyses tend to be grounded in the data, and involve iterative procedures and the development and refinement of typologies, analogies and other forms of concept to make sense of data.     

Concept analysis: some limitations and possible solutions

Concepts are the basic building blocks of scientific knowledge or theoretical frameworks for any discipline. The strength of the theories that guide a discipline is dependent on the quality of the concept analysis. Thus, the utilisation of poorly understood concepts in research and theory development will result in questionable reliability and validity. Concept analysis is associated with the research design of philosophical inquiry. The purpose of philosophical inquiry is to perform research using intellectual analysis to clarify meaning. Traditionally, no empirical (qualitative or quantitative) investigations were used to clarify the meaning of concepts. The lack of empirical investigation to clarify concepts, results in certain limitations in the methodology of concept analysis. It seems that methodological innovations for enhancing concept analysis is urgently required. The purpose of this article is to describe the utilisation of qualitative and quantitative strategies with literature review in concept analysis as a possible solution to limitations. This article will firstly, describe the limitations in the traditional Wilsonian methods of concept analysis and will secondly demonstrate how the introduction of qualitative and quantitative methods with literature review can overcome some of the limitations. An example a research study on quality of life (Ferrans, 1997:110) will be used to demonstrate how qualitative and quantitative empirical methods with literature review can enhance the quality of concept analysis.     

The use of between-methods triangulation in cancer nursing research: a case study examining information sources for partners of women with breast cancer

This article describes between-methods triangulation-the combination of research strategies using different methods--and illustrates its use in cancer nursing research by outlining a case study, which identified the information sources for partners of women with breast cancer. By combining both qualitative and quantitative data, the study was found to possess good convergent validity. Between-methods triangulation also provided a more complete picture of the topic of inquiry than that supplied by either method alone. It is a useful strategy for identifying the information sources for partners of women with breast cancer and its use is encouraged in cancer nursing research.     

Establishing the credibility of qualitative research findings: the plot thickens

Qualitative research is increasingly recognized and valued and its unique place in nursing research is highlighted by many. Despite this, some nurse researchers continue to raise epistemological issues about the problems of objectivity and the validity of qualitative research findings. This paper explores the issues relating to the representativeness or credibility of qualitative research findings. It therefore critiques the existing distinct philosophical and methodological positions concerning the trustworthiness of qualitative research findings, which are described as follows: quantitative studies should be judged using the same criteria and terminology as quantitative studies; it is impossible, in a meaningful way, for any criteria to be used to judge qualitative studies; qualitative studies should be judged using criteria that are developed for and fit the qualitative paradigm; and the credibility of qualitative research findings could be established by testing out the emerging theory by means of conducting a deductive quantitative study. The authors conclude by providing some guidelines for establishing the credibility of qualitative research findings.     

Measurement issues related to data collection on the World Wide Web

As the World Wide Web has become more prominent as a mode of communication, it has opened up new possibilities for research data collection. This article identifies measurement issues that occur with Internet data collection that are relevant to qualitative and quantitative research approaches as they occurred in a triangulated Internet study of perimenopausal women with migraine headaches. Issues associated with quantitative data collection over the Internet include (a) selecting and designing Internet data collection protocols that adequately address study aims while also taking advantage of the Internet, (b) ensuring the reliability and validity of Internet data collected, (c) adapting quantitative paper-and-pencil data collection protocols for the Internet, (d) making Internet data collection practical for respondents and researchers, and (e) ensuring the quality of quantitative data collected. Qualitative data collection over the Internet needs to remain true to the philosophical stance of the qualitative approach selected. Researcher expertise in qualitative data collection must be combined with expertise in computer technology and information services if data are to be of ultimate quality The advantages and limitations of collecting qualitative data in real time or at a later time are explored, as well as approaches to enhance qualitative data collection over the Internet. It was concluded that like any research approach or method, Internet data collection requires considerable creativity, expertise, and planning to take advantage of the technology for the collection of reliable and valid research data.     

The use of qualitative research methodology in orthopaedics – tell it as it is

The article reviews the relatively weak position of qualitative research within health care in the UK. A comparison is made between quantitative and qualitative paradigms of research from the perspective of health care professionals. The tensions and paradoxes between nursing and medical research in orthopaedics are made explicit. Reliability and validity are taken as cornerstones of both types of research, with triangulation as the key to substantiating qualitative research approaches. We describe the evolution of research methodologies to a design we call Diagnostic Research. This is an eclectic design where hypothesis generation is derived from clinical practice using qualitative research methodologies. Subsequently these are tested robustly, using quantitative methods to establish their validity, and in turn become part of professional knowledge. Nursing research currently has a leaning towards qualitative approaches that are held in low esteem when brought into the health care research arena. This article proposes that qualitative research has a place in health care research and is probably the necessary precursor and support to much quantitative research. Even our medical colleagues are beginning to realise the importance of this complementary methodology.     

Qualitative methods in physical therapy research: a form of disciplined inquiry

Qualitative research methods have special relevance for physical therapy. Qualitative methods provide researchers with the tools to examine social settings and human behavior. The methods are well suited to studying the complex, multidimensional environments present in physical therapy practice and education. A thorough understanding of research methodology is a necessary prerequisite for disciplined research. This article presents an overview of the philosophy underlying qualitative research, a discussion of the application of qualitative methods, and a brief analysis of how to address reliability and validity concerns in qualitative research. Increased understanding of what qualitative research is and how it can be done should promote disciplined qualitative research in physical therapy.     

Reviewing studies with diverse designs: the development and evaluation of a new tool

Rationale, aims & objective Tools for the assessment of the quality of research studies tend to be specific to a particular research design (e.g. randomized controlled trials, or qualitative interviews). This makes it difficult to assess the quality of a body of research that addresses the same or a similar research question but using different approaches. The aim of this paper is to describe the development and preliminary evaluation of a quality assessment tool that can be applied to a methodologically diverse set of research articles. Methods The 16‐item quality assessment tool (QATSDD) was assessed to determine its reliability and validity when used by health services researchers in the disciplines of psychology, sociology and nursing. Qualitative feedback was also gathered from mixed‐methods health researchers regarding the comprehension, content, perceived value and usability of the tool. Results Reference to existing widely used quality assessment tools and experts in systematic review confirmed that the components of the tool represented the construct of ‘good research technique’ being assessed. Face validity was subsequently established through feedback from a sample of nine health researchers. Inter‐rater reliability was established through substantial agreement between three reviewers when applying the tool to a set of three research papers (κ = 71.5%), and good to substantial agreement between their scores at time 1 and after a 6‐week interval at time 2 confirmed test–retest reliability. Conclusions The QATSDD shows good reliability and validity for use in the quality assessment of a diversity of studies, and may be an extremely useful tool for reviewers to standardize and increase the rigour of their assessments in reviews of the published papers which include qualitative and quantitative work.