Experimental measurement of preferences in health and healthcare using best-worst scaling: an overview

Published on Dec 1, 2016in Health Economics Review
· DOI :10.1186/s13561-015-0079-x
Axel C. Mühlbacher17
Estimated H-index: 17
Anika Kaczynski5
Estimated H-index: 5
+ 1 AuthorsF. Reed Johnson36
Estimated H-index: 36
(Duke University)
Best-worst scaling (BWS), also known as maximum-difference scaling, is a multiattribute approach to measuring preferences. BWS aims at the analysis of preferences regarding a set of attributes, their levels or alternatives. It is a stated-preference method based on the assumption that respondents are capable of making judgments regarding the best and the worst (or the most and least important, respectively) out of three or more elements of a choice-set. As is true of discrete choice experiments (DCE) generally, BWS avoids the known weaknesses of rating and ranking scales while holding the promise of generating additional information by making respondents choose twice, namely the best as well as the worst criteria. A systematic literature review found 53 BWS applications in health and healthcare. This article expounds possibilities of application, the underlying theoretical concepts and the implementation of BWS in its three variants: ‘object case’, ‘profile case’, ‘multiprofile case’. This paper contains a survey of BWS methods and revolves around study design, experimental design, and data analysis. Moreover the article discusses the strengths and weaknesses of the three types of BWS distinguished and offered an outlook. A companion paper focuses on special issues of theory and statistical inference confronting BWS in preference measurement.
  • References (98)
  • Citations (28)
📖 Papers frequently viewed together
434 Citations
46 Citations
604 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Kathleen BeusterienH-Index: 11
#2Michael KennellyH-Index: 12
Last. Sandip P. Vasavada (Cleveland Clinic)H-Index: 24
view all 6 authors...
Aims Refractory overactive bladder (OAB) treatments, including sacral neuromodulation (SNM), onabotulinumtoxin A (OnabotA), and percutaneous tibial nerve stimulation (PTNS), differ considerably. Best-Worst Scaling (BWS) was used to assess patient preferences for these treatments. Methods A cross-sectional Web survey, based on findings from qualitative interviews with 23 OAB patients and 7 clinical experts, was conducted with idiopathic OAB patients in the US and UK. The BWS exercise involved pri...
4 CitationsSource
#1Holly L. Peay (LEI: Leiden University)H-Index: 15
#2Ilene L. Hollin (Johns Hopkins University)H-Index: 10
Last. John F. P. Bridges (Johns Hopkins University)H-Index: 29
view all 3 authors...
Duchenne muscular dystrophy (DMD) is a progressive, fatal pediatric disorder with significant burden on parents. Assessing disease impact can inform clinical interventions. Best-worst scaling (BWS) was used to elicit parental priorities among 16 short-term, DMD-related worries identified through community engagement. Respondents viewed 16 subsets of worries, identified using a balanced, incomplete block design, and identified the most and least worrying items. Priorities were assessed using best...
15 CitationsSource
#1Julie Ratcliffe (Flinders University)H-Index: 40
#2Elisabeth Huynh (UniSA: University of South Australia)H-Index: 8
Last. Terry N. Flynn (Uppsala University)H-Index: 31
view all 6 authors...
The main objective of this study was to compare and contrast adolescent and adult values for the Child Health Utility‐9D (CHU9D), a new generic preference‐based measure of health‐related quality of life designed for application in the economic evaluation of treatment and preventive programmes for children and adolescents. Previous studies have indicated that there may be systematic differences in adolescent and adult values for identical health states. An online survey including a series of best...
16 CitationsSource
#1Axel C. MühlbacherH-Index: 17
#2Peter Zweifel (UZH: University of Zurich)H-Index: 28
Last. F. Reed Johnson (Duke University)H-Index: 36
view all 4 authors...
For optimal solutions in health care, decision makers inevitably must evaluate trade-offs, which call for multi-attribute valuation methods. Researchers have proposed using best-worst scaling (BWS) methods which seek to extract information from respondents by asking them to identify the best and worst items in each choice set. While a companion paper describes the different types of BWS, application and their advantages and downsides, this contribution expounds their relationships with microecon...
14 CitationsSource
#1Susan dosReis (UMB: University of Maryland, Baltimore)H-Index: 27
#2Xinyi Ng (UMB: University of Maryland, Baltimore)H-Index: 4
Last. John F. P. Bridges (Johns Hopkins University)H-Index: 29
view all 6 authors...
Background Management of attention-deficit/hyperactivity disorder (ADHD) is a trade-off between caregivers’ concerns about the benefits versus the risks of evidence-based treatment. Few studies have used choice-based methods to assess what treatment attributes matter most to caregivers.
13 CitationsSource
#1Wynne Morrison (UPenn: University of Pennsylvania)H-Index: 19
#2James W. Womer (TU: Temple University)H-Index: 7
Last. Chris Feudtner (UPenn: University of Pennsylvania)H-Index: 55
view all 7 authors...
Objective To conduct a national survey of pediatricians' access to and experience with clinical ethics consultation. Study design We surveyed a randomly selected sample of 3687 physician members of the American Academy of Pediatrics. We asked about their experiences with ethics consultation, the helpfulness of and barriers to consultation, and ethics education. Using a discrete choice experiment with maximum difference scaling, we evaluated which traits of ethics consultants were most valuable. ...
11 CitationsSource
#1Hashim HashimH-Index: 18
#2Kathleen BeusterienH-Index: 11
Last. Linda Cardozo (University of Cambridge)H-Index: 56
view all 5 authors...
Objective To evaluate patient preferences for refractory overactive bladder (OAB) treatments: sacral neuromodulation (SNM), onabotulinum toxin A (Botox®), and percutaneous tibial nerve stimulation (PTNS).
13 CitationsSource
#1Jui-Chen YangH-Index: 14
#2F. Reed Johnson (Duke University)H-Index: 36
Last. Ateesha F. Mohamed (Bayer AG: Bayer HealthCare Pharmaceuticals)H-Index: 16
view all 4 authors...
•A meta-simulation strategy analyzes what affects utility-difference precision.•Meta-data are obtained from 34 individual DCE patient-preference data sets.•Utility-difference precision is regressed on sample size and study characteristics.•Study-design features affect precision more than experimental-design efficiency.•An empirical sample-size power equation is derived for DCE health studies.
14 CitationsSource
#1Nathan N. O’Hara (UBC: University of British Columbia)H-Index: 7
#2Lilla Mc Roy (UBC: University of British Columbia)H-Index: 2
Last. Carlo A. Marra (St. John's University)H-Index: 47
view all 9 authors...
Objective Healthcare workers (HCWs) in South Africa are at a high risk of developing active tuberculosis (TB) due to their occupational exposures. This study aimed to systematically quantify and compare the preferred attributes of an active TB case finding program for HCWs in South Africa. Methods A Best–Worst Scaling choice experiment estimated HCW’s preferences using a random-effects conditional logit model. Latent class analysis (LCA) was used to explore heterogeneity in preferences. Results ...
10 CitationsSource
#1Gisselle Gallego (University of Western Sydney)H-Index: 16
#2Angela Dew (UNSW: University of New South Wales)H-Index: 16
Last. Craig Veitch (USYD: University of Sydney)H-Index: 18
view all 8 authors...
Introduction The uneven distribution of allied health professionals (AHPs) in rural and remote Australia and other countries is well documented. In Australia, like elsewhere, service delivery to rural and remote communities is complicated because relatively small numbers of clients are dispersed over large geographic areas. This uneven distribution of AHPs impacts significantly on the provision of services particularly in areas of special need such as mental health, aged care and disability serv...
9 CitationsSource
Cited By28
#1Wiesława Dominika Wranik (Warsaw School of Economics)H-Index: 1
#2Michał Jakubczyk (Warsaw School of Economics)H-Index: 10
Last. Krzysztof Drachal (University of Warsaw)H-Index: 2
view all 3 authors...
Abstract Objectives Our goal was to estimate the relative importance assigned to health technology assessment (HTA) criteria by stakeholders involved in the HTA process. HTA is an increasingly common framework used in the appraisal of drugs for public reimbursement. It identifies clinical, economic, social, and organizational criteria to be considered. The criteria can vary across jurisdictions and are typically appraised by multidisciplinary expert committees. Guidance on the relative weighing ...
#1Daniel G. Lannin (ISU: Illinois State University)H-Index: 10
#2Michael J. Barrowclough (ISU: Illinois State University)
Last. David L. Vogel (Iowa State University)H-Index: 39
view all 3 authors...
OBJECTIVE: This study utilized best-worst scaling and latent class analysis to assess mental health treatment preferences and identify subgroups of college student help seekers. METHOD: College students (N = 504; age: M = 20.3, 79.2% female) completed assessments of mental health treatment preferences, self-stigma, and distress. RESULTS: Students preferred utilizing friends and family, followed by professional mental health providers, self-help, keeping concerns to themselves, physicians, and la...
#1Annette Willemoes Holst-Kristensen (AAU: Aalborg University)
#2Kirsten Fonager (AAU: Aalborg University)H-Index: 22
Last. Kjeld Møller Pedersen (AAU: Aalborg University)H-Index: 23
view all 3 authors...
Purpose To investigate the test–retest reliability of Investigating Choice Experiments Capability measure for Adults (ICECAP-A) in the adult Danish population.
#1Assma Hajji (WU: Vienna University of Economics and Business)
#2Birgit Trukeschitz (WU: Vienna University of Economics and Business)H-Index: 6
Last. Hui Lu (AN: RAND Corporation)H-Index: 2
view all 7 authors...
Abstract Background The Adult Social Care Outcomes Toolkit (ASCOT) measures quality-of-life (QoL) outcomes of long-term care (LTC) service provision. Country-specific preference weights are required to calculate ASCOT scores. ASCOT has been translated into German, but lacks preference weights for German-speaking countries. Objectives This paper aims to establish Austrian preference weights for the German version of the ASCOT service user measure, using best-worst scaling (BWS). Methods Data were...
#1Hélène E. Aschmann (UZH: University of Zurich)H-Index: 2
#2Milo A. Puhan (UZH: University of Zurich)H-Index: 55
Last. Cynthia M. Boyd (JHUSOM: Johns Hopkins University School of Medicine)H-Index: 42
view all 18 authors...
Older people with hypertension and multiple chronic conditions (MCC) receive complex treatments and face challenging trade-offs. Patients’ preferences for different health outcomes can impact multiple treatment decisions. Since evidence about outcome preferences is especially scarce among people with MCC our aim was to elicit preferences of people with MCC for outcomes related to hypertension, and to determine how these outcomes should be weighed when benefits and harms are assessed for patient-...
#1Laurie BatchelderH-Index: 1
Last. Julien E. ForderH-Index: 23
view all 6 authors...
OBJECTIVES: There is an increasing interest in how well informal carers are supported within their caring role. When assessing support, it is important to consider informal carer’s quality of life. The Adult Social Care Outcomes Toolkit for Carers (ASCOT-C) was developed and validated to capture the effect of social care on the quality of life (QoL) of informal carers. One objective when developing the ASCOT was that it could be preference weighted for use in economic evaluation. Currently there...
1 CitationsSource
#1Hideo Aizaki (Hokkaido University)H-Index: 1
#2James Fogarty (UWA: University of Western Australia)H-Index: 10
Abstract Case 2 (profile case) best–worst scaling (BWS) is a question-based survey method for measuring preferences for attribute levels. Several existing R packages help to implement the construction of Case 2 BWS questions (profiles) and the discrete choice analysis of the responses to the questions. Structuring the dataset for Case 2 BWS analysis is, however, complicated: there are several model variants for the analysis, and independent variables are set according to the variants. This compl...
#1Matthew Reaney (University of Chichester)H-Index: 2
#2Elizabeth Nicole Bush (Eli Lilly and Company)H-Index: 4
Last. Adam Gater (Adelphi University)H-Index: 8
view all 9 authors...
Benefit-risk assessment is the cornerstone of decision making in medical care, playing a critical role in bringing treatments to market by informing decisions regarding drug development, licensing and reimbursement, and informing treatment decisions made by health care professionals and patients in clinical practice. In regulatory approval decision making, benefit and risk attributes are identified and defined based on available, aggregated clinical data from registration trials. In the context ...
#2Leah M. Ranney (UNC: University of North Carolina at Chapel Hill)H-Index: 13
Last. Adam O. GoldsteinH-Index: 30
view all 10 authors...
Objective To understand the importance of electronic nicotine delivery systems (ENDS) product attributes to adult consumers in the USA by age and gender. Design Cross-sectional survey with a discrete choice experiment (best–worst, case 2, scaling) of 19 choice tasks in which participants answered what would make them most want to use and least want to use an ENDS product. Setting and participants A national sample of adults (aged 18+ years) in the USA who had tried an ENDS product at least once....
1 CitationsSource
#1Kei Long CheungH-Index: 6
#2Susanne Mayer (Medical University of Vienna)H-Index: 6
Last. Mickaël Hiligsmann (PHRI: Public Health Research Institute)H-Index: 28
view all 7 authors...
AbstractAims: Different methods have been used to analyze “object case” best–worst scaling (BWS). This study aims to compare the most common statistical analysis methods for object case BWS (i.e. the count analysis, multinomial logit, mixed logit, latent class analysis, and hierarchical Bayes estimation) and to analyze their potential advantages and limitations based on an applied example.Methods: Data were analyzed using the five analysis methods. Ranking results were compared among the methods...
1 CitationsSource