Standard gamble, time trade-off and rating scale: Experimental results on the ranking properties of QALYs

doi:10.1016/S0167-6296(96)00509-7

Journal of Health Economics

Volume 16, Issue 2, April 1997, Pages 155-175

https://doi.org/10.1016/S0167-6296(96)00509-7 Get rights and content

Abstract

This paper compares the relative performance of quality adjusted life years (QALYs) based on quality weights elicited by rating scale (RS), time trade-off (TTO) and standard gamble (SG). The standard against which relative performance is assessed is individual preference elicited by direct ranking. The correlation between predicted and direct ranking is significantly higher for TTO-QALYs than for RS-QALYs and SG-QALYs. This holds both based on mean Spearman rank correlation coefficients calculated per individual and based on two social choice rules: the method of majority voting and the Borda rule. Undiscounted TTO-QALYs are more consistent with direct ranking than discounted TTO-QALYs.

References (38)

H. Bleichrodt
QALYs and HYEs: under what conditions are they equivalent?
J. Health Econ.
(1995)
J. Broome
QALYs
J. Public Econ.
(1993)
K. Buckingham
A note on HYE
J. Health Econ.
(1993)
A.J. Culyer et al.
QALYs versus HYEs
J. Health Econ.
(1993)
A.J Culyer et al.
QALYs versus HYEs: a reply to Gafni, Birch and Mehrez
J. Health Econ.
(1995)
A. Gafni et al.
Economics, health and health economics: HYEs versus QALYs
J. Health Econ.
(1993)
J.C. Hornberger et al.
Variability among methods to assess patients' well-being and consequent effect on a cost-effectiveness analysis
J. Clin. Epidemiol.
(1992)
M. Johannesson
Quality-adjusted life-years versus healthy-years equivalents: a comment
J. Health Econ.
(1995)
R.J. Labelle et al.
Implications of basing health-care resource allocations on cost-utility analysis in the presence of externalities
J. Health Econ.
(1992)
G. Loomes
The myth of the HYE
J. Health Econ.
(1995)

G.W. Torrance

Social preferences for health states

G.W. Torrance

Measurement of health state utilities for economic appraisal: a review

J. Health Econ.

(1986)

K. Arrow

Social Choice and Individual Values

C. Bakker et al.

Feasibility of utility assessment by rating scale and standard gamble in ankylosing spondylitis or fibromyalgia

J. Rheum.

(1994)

M.F. Drummond et al.

Methods for the economic evaluation of health care programmes

(1987)

W.R. Dubourg et al.

Imprecise preferences and the WTP-WTA disparity

J. Risk Uncertainty

(1994)

G.W. Fisher

Utility models for multiple objective decisions: do they accurately represent human preferences?

Decision Sci.

(1979)

P.C. Fishburn

Utility Theory for Decision Making

(1970)

A. Gafni et al.

Risk attitude and time preference in health

Management Sci.

(1984)

Cited by (132)

Quantifying the Burden of Hyperphagia in Prader-Willi Syndrome Using Quality-Adjusted Life-years
2021, Clinical Therapeutics
Prader-Willi syndrome (PWS) is a rare disease associated with cognitive impairment, hypotonia, hyperphagia (an insatiable hunger), and obesity. Therapies that target hyperphagia are in development, but understanding the value of these therapies to inform patient-focused drug development (PFDD) requires valid data on disease burden. We estimated disease burden by measuring and comparing quality-adjusted life-years (QALYs) for 3 PWS health states relevant to current PFDD initiatives.
Time trade-off (TTO) and a visual analog scale (VAS) were used to elicit PWS caregivers’ values for 3 fixed health states for a standardized patient described with (1) untreated PWS, (2) PWS with controlled obesity, and (3) PWS with controlled obesity and hyperphagia. We excluded participants who left at least 1 TTO or VAS question blank or incomplete (noncompleters) and respondents who reported the same answer for all TTO scenarios (nontraders). The remaining group of respondents (traders) were used for all primary analyses. We assessed validity and bias of QALY estimates by comparing differences in health state valuations, treatment priorities, and characteristics among respondents who did and did not complete the TTO.
A total of 458 respondents completed the survey, including 226 traders, 93 nontraders, and 139 noncompleters. Traders valued untreated PWS at 0.69 QALYs, PWS with controlled obesity at 0.79 QALYs, and controlled hyperphagia/obesity at 0.91 QALY (P < 0.01 for differences among health state values). Reported VAS ratings were similar for traders versus nontraders for untreated PWS (38.64 vs 38.95, P = 0.89) and PWS with controlled obesity (57.36 vs 55.14, P = 0.35) but varied for PWS with controlled obesity and hyperphagia (70.70 vs 64.46, P = 0.02). Exclusion of noncompleters did not introduce obvious bias because traders and noncompleters were similar in treatment priorities and characteristics. The exclusion of nontraders did not meaningfully alter mean or distribution of valuations.
This study found that avoiding hyperphagia decreases the burden of PWS and that these results are robust, even once imposing strict inclusion criteria. Use of fixed health states to estimate QALYs addresses many of the complexities of measuring disease burden in rare and pediatric conditions, indicating the potential value of this approach to inform premarket decision makers in identifying outcome importance.
Living up to expectations: Experimental tests of subjective life expectancy as reference point in time trade-off and standard gamble
2020, Journal of Health Economics
Earlier work suggested that subjective life expectancy (SLE) functions as reference point in time trade-off (TTO), but has not tested or modelled this explicitly. In this paper we construct a model based on prospect theory to investigate these predictions more thoroughly. We report the first experimental test of reference-dependence with respect to SLE for TTO and extend this approach to standard gamble (SG). In two experiments, subjects’ SLEs were used to construct different versions of 10-year TTO and SG tasks, with the gauge duration either described as occurring above or below life expectation. Our analyses suggest that both TTO and SG weights were affected by SLE as predicted by prospect theory with SLE as reference point. Subjects gave up fewer years in TTO and were less risk-tolerant in SG below SLE, implying that weights derived from these health state valuation methods for durations below SLE will be biased upwards.
Valuing Health States in Russia: A First Feasibility Study
2019, Value in Health Regional Issues
Citation Excerpt :
A recent Korean study24 found large differences in the utility scores between SG/TTO and VAS and much narrower differences between SG and TTO. In our research we find no substantive difference between SG and TTO scores, which contrasts with much of the literature and is plausibly because of our use of the TTO variant that excludes health states worse than death.12,24,25 It is, however, also likely that the homogenous and highly educated nature of our sample served to diminish the difference between SG and TTO and that, among the general population less familiar with risk concepts, a gap would emerge more in line with other studies.
The aim of this study was to explore the feasibility of different health-related quality-of-life valuation methods in a new setting. Based on a small feasibility study of 100 young Russians, we trialed different methodologies and identified key differences that have implications for the development of health technology assessment in Russia.
In face-to-face interviews, respondents completed a series of health self-assessments based on a modified version of the EQ-5D-3L, visual analogue scale, time tradeoff, standard gamble, and best–worst scaling methodologies, covering actual and hypothetical health states.
We found that (1) the visual analogue scale produced lower health valuations and fewer logical inconsistencies than either time trade-off or standard gamble methodologies; (2) initial health states can be decisive in determining values assigned to health improvements; (3) respondents evaluate abstract health states more positively than their own actual health states; (4) there is evidence consistent with the hypothesis that actual and hypothetical health state valuation, using EQ-5D-3L, is an artifact of understanding rather than preference and that the incorporation of additional levels may therefore be no panacea if the dimensions themselves overlook important attributes; and (5) the country context is important in determining how respondents relate to the survey tools and how those survey tools are translated and delivered.
Russia is commencing its health technology assessment journey and should proceed cautiously as it moves toward the valuation of health benefits. These results suggest a useful framework for a more in-depth development of health valuation methodologies in Russia.
Research trends in contemporary health economics: a scientometric analysis on collective content of specialty journals
2024, Health Economics Review
A systematic review on the direct approach to elicit the demand-side cost-effectiveness threshold: Implications for low- and middle-income countries
2024, PLoS ONE
Quality of life of the Canadian population using the VR-12: population norms for health utility values, summary component scores and domain scores
2024, Quality of Life Research

View all citing articles on Scopus

View full text

Scientific articleStandard gamble, time trade-off and rating scale: Experimental results on the ranking properties of QALYs

Abstract

J. Health Econ.

J. Public Econ.

J. Health Econ.

J. Health Econ.

J. Health Econ.

J. Health Econ.

J. Clin. Epidemiol.

J. Health Econ.

J. Health Econ.

J. Health Econ.

J. Health Econ.

Social Choice and Individual Values

Feasibility of utility assessment by rating scale and standard gamble in ankylosing spondylitis or fibromyalgia

J. Rheum.

Methods for the economic evaluation of health care programmes

Imprecise preferences and the WTP-WTA disparity

J. Risk Uncertainty

Utility models for multiple objective decisions: do they accurately represent human preferences?

Decision Sci.

Utility Theory for Decision Making

Risk attitude and time preference in health

Management Sci.

Scientific article
Standard gamble, time trade-off and rating scale: Experimental results on the ranking properties of QALYs