Teamwork and team performance in multidisciplinary cancer teams: development and evaluation of an observational assessment tool

Published on Oct 1, 2011in BMJ Quality & Safety7.043
· DOI :10.1136/bmjqs.2010.048660
Benjamin W. Lamb13
Estimated H-index: 13
Helen W. L. Wong8
Estimated H-index: 8
+ 2 AuthorsNick Sevdalis54
Estimated H-index: 54
Aim Team performance is important in multidisciplinary teams (MDTs), but no tools exist for assessment. Our objective was to construct a robust tool for scientific assessment of MDT performance. Materials and methods An observational tool was developed to assess performance in MDTs. Behaviours were scored on Likert scales, with objective anchors. Five MDT meetings (112 cases) were observed by a surgeon and a psychologist. The presentation of case history, radiological and pathological information, chair's effectiveness, and contributions to decision-making of surgeons, oncologists, radiologists, pathologists and clinical nurse specialists (CNSs) are analysed via descriptive statistics, a comparison of average scores (Mann–Whitney U) to test interobserver agreement and intraclass correlation coefficients (ICCs) to further assess interobserver agreement and learning curves. Results Contributions of surgeons, chair's effectiveness, presentation of case history and radiological information were rated above average (p≤0.001). Contributions of histopathologists and CNS were rated below average (p≤0.001), and others average. The interobserver agreement was high (ICC=0.70+) for presentation of radiological information, and contribution of oncologists, radiologists, pathologists and CNSs; adequate for case history presentation (ICC=0.68) and contribution of surgeons (ICC=0.69); moderate for chairperson (ICC=0.52); and poor for pathological information (ICC=0.31). Average differences were found only for case-history presentation (p≤0.001). ICCs improved significantly in assessment of case history, and Oncologists, and ICCs were consistently high for CNS, Radiologists, and Histopathologists. Conclusions Scientific observational metrics can be reliably used by medical and non-medical observers in cancer MDTs. Such robust assessment tools provide part of a toolkit for team evaluation and enhancement.
  • References (31)
  • Citations (52)
📖 Papers frequently viewed together
178 Citations
216 Citations
99 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Noah Ivers (Women's College Hospital)H-Index: 25
#2Gro JamtvedtH-Index: 25
Last. Andrew D OxmanH-Index: 93
view all 10 authors...
Background Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectivenes...
3,422 CitationsSource
#1B. W. Lamb (Imperial College London)H-Index: 7
#2Judith GreenH-Index: 41
Last. Nick Sevdalis (Imperial College London)H-Index: 54
view all 4 authors...
Decisions in surgical oncology are increasingly being made by multi-disciplinary teams (MDTs). Although MDTs have been widely accepted as the preferred model for cancer service delivery, the process of decision making has not been well described and there is little evidence pointing to the ideal structure of an MDT. Performance in surgery has been shown to depend on non-technical skills, such as decision making, as well as patient factors and the technical skills of the healthcare team. Applicat...
46 CitationsSource
#1Sonal Arora (Imperial College London)H-Index: 32
#2Benjamin W. Lamb (Imperial College London)H-Index: 13
Last. Nick Sevdalis (Imperial College London)H-Index: 54
view all 6 authors...
• Changes to working hours, new technologies and increased accountability have rendered the need for alternative training environments for urologists. • Simulation offers a promising arena for learning to take place in a safe, realistic setting. • Despite its benefits, the incorporation of simulation into urological training programmes remains minimal. • The current status and future directions of simulation for training in technical and non-technical skills are reviewed as they pertain to urolo...
30 CitationsSource
#1Louise Hull (Imperial College London)H-Index: 15
#2Sonal Arora (Imperial College London)H-Index: 32
Last. Nick Sevdalis (Imperial College London)H-Index: 54
view all 5 authors...
Background Effective teamwork is crucial for safe surgery. Failures in nontechnical and teamwork skills are frequently implicated in adverse events. The Observational Teamwork Assessment for Surgery (OTAS) tool assesses teamwork of the entire team in the operating room. Empirical testing of OTAS has yet to explore the content validity of the tool. Study Design This was a cross-sectional observational study. Data were collected in 30 procedures by 2 trained researchers. Five teamwork behaviors we...
142 CitationsSource
#1Nicole J. Look Hong (U of T: University of Toronto)H-Index: 3
#2Frances C. Wright (U of T: University of Toronto)H-Index: 29
Last. Lawrence Paszat (U of T: University of Toronto)H-Index: 43
view all 4 authors...
99 CitationsSource
#1Ami MishraH-Index: 1
#2Ken CatchpoleH-Index: 25
Last. Peter McCullochH-Index: 38
view all 5 authors...
7 CitationsSource
#1Rhona FlinH-Index: 61
#2Lucy MitchellH-Index: 9
Contents: Foreword, Charles Vincent Preface, George Youngson Introduction, Rhona Flin and Lucy Mitchell Part I Tools for Measuring Behaviour in the Operating Theatre: Development and evaluation of the NOTSS behaviour rating system for intraoperative surgery (2003-2008), Steven Yule, Rhona Flin, Nikki Maran, David Rowley, George Youngson, John Duncan and Simon Paterson-Brown Competence evaluation in orthopaedics - a 'bottom up' approach, David Pitts and David Rowley Implementing the assessment of...
63 Citations
#1Nick SevdalisH-Index: 54
#2Melinda LyonsH-Index: 2
Last. Charles VincentH-Index: 75
view all 6 authors...
Objective: To test the construct validity of the Observational Teamwork Assessment for Surgery (OTAS) tool. Summary Background Data: Poor teamwork in surgical teams has been implicated in adverse events to patients. The OTAS is a tool that assesses teamwork in real time for the entire surgical team. Existing empirical research on OTAS has yet to explore how expert versus novice tool users use the tool to assess teamwork in the operating room. Methods: Data were collected in 12 elective procedure...
125 CitationsSource
#1Judi L Kidger (UoB: University of Bristol)H-Index: 13
#2J Murdoch (UoB: University of Bristol)H-Index: 1
Last. Jane M Blazeby (UoB: University of Bristol)H-Index: 58
view all 4 authors...
Objective To explore the factors that influence treatment decision-making in a gynaecological cancer team (MDT). Design Qualitative study using interviews and observations. Setting Gynaecological cancer MDT meetings and participants’ offices. Sample A gynaecological cancer MDT and members of that team. Methods Observations of ten MDT meetings and semistructured interviews with 16 team members. Data analysis using the constant comparison technique of grounded theory and ethnography. Main outcome ...
60 CitationsSource
#1Jj WoodH-Index: 1
#2Chris Metcalfe (UoB: University of Bristol)H-Index: 43
Last. Jane M Blazeby (UoB: University of Bristol)H-Index: 58
view all 7 authors...
Objective It is mandatory for treatment decisions for patients with colorectal cancer to be made within the context of a multi-disciplinary team (MDT) meeting. It is currently uncertain, however, how to best evaluate the quality of MDT decision-making. This study examined MDT decision-making by studying whether MDT treatment decisions were implemented and investigated the reasons why some decisions changed after the meeting. Method Consecutive MDT treatment decisions were prospectively recorded....
55 CitationsSource
Cited By52
#1Emily Stone (St. Vincent's Health System)H-Index: 9
#2Nicole Rankin (USYD: University of Sydney)H-Index: 13
Last. Tim Shaw (USYD: University of Sydney)H-Index: 14
view all 9 authors...
Aim: Multidisciplinary team (MDT) meetings can facilitate optimal lung cancer care, yet details of structured data collection and feedback remain sparse. This study aimed to investigate data collection and the impact of feedback to lung cancer MDTs. Methods: A mixed-methods study using pre and post-test surveys, semistructured interviews, and observation to evaluate data collection and response to modeled data feedback in three Australian lung cancer MDTs at different locations and development s...
#1Rebecca Scott (St Mary's Hospital)H-Index: 1
Last. Richard J. EdmondsonH-Index: 23
view all 4 authors...
Introduction: Multidisciplinary team (MDT) meetings are widely used across the UK to provide expert decisions and improve cancer outcomes. However, little is known about the underlying mechanisms of MDT decision-making. We investigated how decisions are made regarding the management of advanced ovarian cancer in gynaecological oncology MDT meetings. Methods: A cross-sectional observational study was performed, focussing on 41/ 223 MDT case discussions across six hospitals. The validated MDT-MODe...
#1Bridget Kane (Karlstad University)H-Index: 9
#2Jing Su (Trinity College, Dublin)H-Index: 3
Last. Saturnino Luz (Edin.: University of Edinburgh)H-Index: 2
view all 3 authors...
While machine learning (ML) systems have produced great advances in several domains, their use in support of complex cooperative work remains a research challenge. A particularly challenging setting, and one that may benefit from ML support is the work of multidisciplinary medical teams (MDTs). This paper focuses on the activities performed during the multidisciplinary medical team meeting (MDTM), reviewing their main characteristics in light of a longitudinal analysis of several MDTs in a large...
#1Linn Rosell (Lund University)H-Index: 2
#2Jessica WihlH-Index: 1
Last. Mef Nilbert (UCPH: University of Copenhagen)H-Index: 38
view all 5 authors...
National virtual multidisciplinary team meetings have been established in Swedish cancer care in response to centralized treatment of rare cancers. Though national meetings grant access to a large multidisciplinary network, we hypothesized that video-based meetings may challenge participants’ contributions to the case discussions. We investigated participants’ views and used observational tools to assess contributions from various health professionals during the multidisciplinary team meetings. ...
#1Tayana Soukup ('KCL': King's College London)H-Index: 5
#2Tasha A K Gandamihardja (Broomfield Hospital)
Last. Nick Sevdalis ('KCL': King's College London)H-Index: 54
view all 5 authors...
Objective The objective of this study was to examine effectiveness of codesigned quality-improving interventions with a multidisciplinary team (MDT) with high workload and prolonged meetings to ascertain: (1) presence and impact of decision-making (DM) fatigue on team performance in the weekly MDT meeting and (2) impact of a short meeting break as a countermeasure of DM fatigue. Design and interventions This is a longitudinal multiphase study with a codesigned intervention bundle assessed within...
#1Christine Fahim (McMaster University)H-Index: 5
#2J Ratcliffe (McMaster University)
Last. Marko Simunovic (McMaster University)H-Index: 20
view all 5 authors...
BackgroundLamb et al. developed the metric for the observation of decision-making tool (MTB-MODe) to evaluate the quality of urologic multidisciplinary cancer conferences (MCCs) in the United Kingd...
#1T. A. K. Gandamihardja (Broomfield Hospital)H-Index: 1
#2Tayana Soukup ('KCL': King's College London)H-Index: 5
Last. Nick Sevdalis ('KCL': King's College London)H-Index: 54
view all 5 authors...
Background Multidisciplinary team (MDT)-driven cancer care is a mandatory UK national policy, widely used globally. However, few studies have examined how MDT members make decisions as a team. We report a single-centre prospective study on team working within breast cancer MDT.
1 CitationsSource
#1David B. LumentaH-Index: 11
#2Gerald SendlhoferH-Index: 6
Last. Gernot BrunnerH-Index: 17
view all 7 authors...
#1Sifra Bolle (UvA: University of Amsterdam)H-Index: 5
#2E. M. A. Smets (UvA: University of Amsterdam)H-Index: 34
Last. Julia C.M. van Weert (UvA: University of Amsterdam)H-Index: 27
view all 5 authors...
Abstract Objectives Multidisciplinary team meetings aim to facilitate efficient and accurate communication surrounding the complex process of treatment decision making for older patients with cancer. This process is even more complicated for older (≥70 years) patients as the lack of empirical evidence on treatment regimens in patients with age-related problems such as comorbidity and polypharmacy, necessitates a patient-centred approach.This study investigates the decision making process for old...
3 CitationsSource
#1Sherri Sheinfeld Gorin (UM: University of Michigan)H-Index: 2
#2David A. Haggstrom (IU: Indiana University)H-Index: 20
1 CitationsSource