Advertisement

Abstract

We are all faced with uncertainty about the future, but we can get the measure of some uncertainties in terms of probabilities. Probabilities are notoriously difficult to communicate effectively to lay audiences, and in this review we examine current practice for communicating uncertainties visually, using examples drawn from sport, weather, climate, health, economics, and politics. Despite the burgeoning interest in infographics, there is limited experimental evidence on how different types of visualizations are processed and understood, although the effectiveness of some graphics clearly depends on the relative numeracy of an audience. Fortunately, it is increasingly easy to present data in the form of interactive visualizations and in multiple types of representation that can be adjusted to user needs and capabilities. Nonetheless, communicating deeper uncertainties resulting from incomplete or disputed knowledge—or from essential indeterminacy about the future—remains a challenge.

Get full access to this article

View all available purchase options and get full access to this article.

Already a subscriber or AAAS Member? Log In

Supplementary Material

File (spiegelhalter.som.pdf)

References and Notes

1
G. F. Gigerenzer, The Intelligence of the Unconscious (Viking, New York, 2007).
2
Slovic P., Peters E., Finucane M. L., Macgregor D. G., Affect, risk, and decision making. Health Psychol. 24 (suppl.), S35 (2005).
3
B. de Finetti, Theory of Probability (Wiley, London, 1974).
4
F. Nightingale, Notes on Matters Affecting the Health, Efficiency and Hospital Administration of the British Army, Founded Chiefly on the Experience of the Late War (Harrison, London, 1858).
5
Works of O. Neurath and M. Neurath, Isotype Institute (available at www.fulltable.com/iso/).
6
D. Kahneman, P. Slovic, A. Tversky, Judgment Under Uncertainty: Heuristics and Biases (Cambridge Univ. Press, Cambridge, 2006).
7
Peters E., Hibbard J., Slovic P., Dieckmann N., Numeracy skill and the communication, comprehension, and use of risk-benefit information. Health Aff. 26, 741 (2007).
8
Fagerlin A., Ubel P. A., Smith D. M., Zikmund-Fisher B. J., Making numbers matter: Present and future research in risk communication. Am. J. Health Behav. 31 (suppl. 1), S47 (2007).
9
D. E. Nelson, B. W. Hesse, R. T. Croyle, Making Data Talk: Communicating Public Health Data to the Public, Policy Makers, and the Press (Oxford Univ. Press, New York, ed. 1, 2009).
10
C. Skubisz, T. Reimer, U. Hoffrage, in Communication Yearbook 33 (Routledge, London, 2009), pp. 177–211.
11
Ancker J. S., Senathirajah Y., Kukafka R., Starren J. B., Design features of graphs in health risk communication: A systematic review. J. Am. Med. Inform. Assoc. 13, 608 (2006).
12
Lipkus I. M., Hollands J. G., The visual communication of risk. J. Natl. Cancer Inst. Monogr. 1999, 149 (1999).
13
Lipkus I. M., Numeric, verbal, and visual formats of conveying health risks: Suggested best practices and future recommendations. Med. Decis. Making 27, 696 (2007).
14
Bostrom A., Anselin L., Farris J., Visualizing seismic risk and uncertainty: A review of related research. Ann. N.Y. Acad. Sci. 1128, 29 (2008).
15
Visschers V. H. M., Meertens R. M., Passchier W. W. F., de Vries N. N. K., Probability information in risk communication: A review of the research literature. Risk Anal. 29, 267 (2009).
16
Wallsten T. S., Budescu D. V., Rapoport A., Zwick R., Forsyth B., Measuring the vague meaning of probabilistic terms. J. Exp. Psychol. Gen. 155, 348 (1986).
17
Intergovernmental Panel on Climate Change Working Group 1, IPCC Fourth Assessment Report: The Physical Science Basis (IPCC, 2007; www.ipcc.ch/ipccreports/ar4-wg1.htm).
18
Galesic M., Garcia-Retamero R., Statistical numeracy for health: A cross-cultural comparison with probabilistic national samples. Arch. Intern. Med. 170, 462 (2010).
19
Gigerenzer G., Gaissmaier W., Kurz-Milcke E., Schwartz L. M., Woloshin S., Helping doctors and patients make sense of health statistics. Psychol. Sci. Public Interest 8, 53 (2007).
20
McNeil B. J., Pauker S. G., Sox H. C., Tversky A., On the elicitation of preferences for alternative therapies. N. Engl. J. Med. 306, 1259 (1982).
21
Morss R., Demuth J., Lazo J., Communicating uncertainty in weather forecasts: A survey of the U.S. public. Weather Forecast. 23, 974 (2008).
22
Kurz-Milcke E., Gigerenzer G., Martignon L., Transparency in risk communication: Graphical and analog tools. Ann. N.Y. Acad. Sci. 1128, 18 (2008).
23
Reyna V. F., Brainerd C. J., Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learn. Individ. Differ. 18, 89 (2008).
24
Denes-Raj V., Epstein S., Conflict between intuitive and rational processing: When people behave against their better judgment. J. Pers. Soc. Psychol. 66, 819 (1994).
25
Garcia-Retamero R., Galesic M., Gigerenzer G., Do icon arrays help reduce denominator neglect? Med. Decis. Making 30, 672 (2010).
26
Neace W. P., Michaud S., Bolling L., Deer K., Zecevic L., Frequency formats, probability formats, or problem structure? A test of the nested-sets hypothesis in an extensional reasoning task. Judgm. Decis. Mak. 3, 140 (2008).
27
Joslyn S. L., Nichols R. M., Probability or frequency? Expressing forecast uncertainty in public weather forecasts. Meteorol. Appl. 16, 309 (2009).
28
E. Tufte, The Visual Display of Quantitative Information (Graphics Press, Cheshire, CT, 2001).
29
Smerecnik C. M. R., et al., Understanding the positive effects of graphical risk information on comprehension: Measuring attention directed to written, tabular, and graphical risk information. Risk Anal. 30, 1387 (2010).
30
Woloshin S., Schwartz L. M., Ellner A., Making sense of risk information on the web. BMJ 327, 695 (2003).
31
NASA Space Shuttle Safety and Mission Assurance Office, NASA Review of Shuttle Risks (available at http://hw.libsyn.com/p/3/0/a/30aafb8c2337eb80/NASAShuttleRiskReview-excerpt.pdf).
32
Zikmund-Fisher B. J., Fagerlin A., Ubel P. A., Improving understanding of adjuvant therapy options by using simpler risk graphics. Cancer 113, 3382 (2008).
33
Galesic M., Garcia-Retamero R., Gigerenzer G., Using icon arrays to communicate medical risks: Overcoming low numeracy. Health Psychol. 28, 210 (2009).
34
Ancker J. S., Weber E. U., Kukafka R., Effect of arrangement of stick figures on estimates of proportion in risk graphics. Med. Decis. Making 31, 143 (2011).
35
Breast Screening—Performance of Mammography: Cancer Research UK (available at http://info.cancerresearchuk.org/cancerstats/types/breast/screening/mammography/).
36
Dolan J. G., Iadarola S., Risk communication formats for low probability events: An exploratory study of patient preferences. BMC Med. Inform. Decis. Mak. 8, 14 (2008).
37
Keller C., Siegrist M., Visschers V., Effect of risk ladder format on risk perception in high- and low-numerate individuals. Risk Anal. 29, 1255 (2009).
38
Sokolov A. P., et al., Probabilistic forecast for twenty-first-century climate based on uncertainties in emissions (without policy) and climate parameters. J. Clim. 22, 5175 (2009).
39
Sanyal J., Zhang S., Bhattacharya G., Amburn P., Moorhead R. J., A user study to compare four uncertainty visualization methods for 1D and 2D datasets. IEEE Trans. Vis. Comput. Graph. 15, 1209 (2009).
40
K. Broad et al., Misinterpretations of the “Cone of Uncertainty” in Florida During the 2004 Hurricane Season (2010) (available at http://journals.ametsoc.org/doi/abs/10.1175/BAMS-88-5-651).
41
MacEachren A. M., et al., Visualizing geospatial information uncertainty: What we know and what we need to know. Cartogr. Geogr. Inform. Sci. 32, 139 (2005).
42
Leitner M., Buttenfield B. P., Guidelines for the display of attribute certainty. Cartogr. Geogr. Inform. Sci. 27, 3 (2000).
43
Bank of England, Bank of England Inflation Report 2007 (available at www.bankofengland.co.uk/publications/inflationreport/2007.htm).
44
Cleveland W. S., McGill R., Graphical perception and graphical methods for analyzing scientific data. Science 229, 828 (1985).
45
Ibrekk H., Morgan M. G., Graphical communication of uncertain quantities to nontechnical people. Risk Anal. 7, 519 (1987).
47
B. Fry, Writing (available at http://benfry.com/writing/).
48
D. McCandless, Information is Beautiful (Collins, London, 2010).
49
H. Rosling, Gapminder: Unveiling the beauty of statistics for a fact based world view (available at www.gapminder.org/).
50
Strecher V. J., Greenwood T., Wang C., Dumont D., Interactive multimedia and risk communication. J. Natl. Cancer Inst. Monogr. 1999, 134 (1999).
51
Ancker J. S., Weber E. U., Kukafka R., Effects of game-like interactive graphics on risk perceptions and decisions. Med. Decis. Making 31, 130 (2011).
52
American Council on Science and Health, Riskometer and RiskRings (available at http://riskometer.org/).
53
Bostrom A., Löfstedt R. E., Communicating risk: Wireless and hardwired. Risk Anal. 23, 241 (2003).
54
Politi M. C., Han P. K. J., Col N. F., Communicating the uncertainty of harms and benefits of medical interventions. Med. Decis. Making 27, 681 (2007).
55
Han P. K. J., et al., Communication of uncertainty regarding individualized cancer risk estimates: Effects and influential factors. Med. Decis. Making 31, 354 (2011).
56
L. Rogers, S. S. N. Siu, D. Luesley, A. Bryant, H. O. Dickinson, in Cochrane Database of Systematic Reviews, The Cochrane Collaboration, L. Rogers, Eds. (Wiley, Chichester, UK, 2009).
57
Guyatt G. H., et al.GRADE Working Group, GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ 336, 924 (2008).
58
M. G. Morgan, B. Fischhoff, A. Bostrom, C. J. Atman, Risk Communication: A Mental Models Approach (Cambridge Univ. Press, Cambridge, ed. 1, 2001).
59
Kahan D., Fixing the communications failure. Nature 463, 296 (2010).
60
Stirling A., Keep it complex. Nature 468, 1029 (2010).
61
G. Morgan et al., Best Practice Approaches for Characterizing, Communicating, and Incorporating Scientific Uncertainty in Decisionmaking (U.S. Climate Change Science Program, 2009; www.climatescience.gov/Library/sap/sap5-2/final-report/default.htm).
62
IPCC, Cross-Working Group Meeting on Consistent Treatment of Uncertainties, Guidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties (2010) (available at www.ipcc-wg2.gov/meetings/CGCs/Uncertainties-GN_IPCCbrochure_lo.pdf).
63
G. Williams, Women and Work (Nicholson & Watson, London, 1945).
64
Kick Off—Football Stats—Match Previews (available at www.kickoff.co.uk/).
65
Harvard School of Public Health Disease Risk Index (available at www.diseaseriskindex.harvard.edu/update/).
66
Adjuvant! Online (available at http://adjuvantonline.com/index.jsp).
67
Genetic Testing for Carrier Status, Disease Risk and Drug Response—23andMe (available at www.23andme.com/health/risks/).
68
MIT Global Change Program | Greenhouse Gamble (available at http://globalchange.mit.edu/resources/gamble/).
69
Met Office, Invent—Weather: Text view—Location: Peterborough (available at www.metoffice.gov.uk/public/pws/invent/weathertext/index.html?310120).
70
Definition of the NHC Track Forecast Cone (available at www.nhc.noaa.gov/aboutcone.shtml).
71
UK Climate Projections—What is UKCP09: Probability (available at http://ukclimateprojections.defra.gov.uk/content/view/1205/618/).
72
Full permission statement for Fig. 3C: Reprinted with permission. © 2008 American Society of Clinical Oncology. Full permission statement for Fig. 3D: © 23andMe, Inc. 2008-2011. All rights reserved; distributed pursuant to a Limited License from 23andMe. Full permission statement for Fig. 5C: Copyright Cochrane Collaboration, reproduced with permission. Full permission statement for Fig. 5F: © Crown Copyright 2009. The UK Climate Projections (UKCP09) have been made available by the Department for Environment, Food and Rural Affairs (Defra) and the Department of Climate Change (DECC) under licence from the Met Office, UK Climate Impacts Programme, British Atmospheric Data Centre, Newcastle University, University of East Anglia, Environment Agency, Tyndall Centre and Proudman Oceanographic Laboratory. These organizations give no warranties, express or implied, as to the accuracy of the UKCP09 and do not accept any liability for loss or damage that may arise from reliance upon the UKCP09; any use of the UKCP09 is undertaken entirely at the users risk.

Information & Authors

Information

Published In

View large Science cover image
Science
Volume 333 | Issue 6048
9 September 2011

Submission history

Published in print: 9 September 2011

Permissions

Request permissions for this article.

Acknowledgments

Acknowledgments: Supported by an endowment from the Winton Charitable Foundation (D.S., M.P.).

Authors

Affiliations

David Spiegelhalter* [email protected]
Centre for Mathematical Sciences, University of Cambridge, Cambridge CB3 0WB, UK.
Mike Pearson
Centre for Mathematical Sciences, University of Cambridge, Cambridge CB3 0WB, UK.
Ian Short
Department of Mathematics and Statistics, The Open University, Milton Keynes MK7 6AA, UK.

Notes

*
To whom correspondence should be addressed. E-mail: [email protected]

Metrics & Citations

Metrics

Article Usage
Altmetrics

Citations

Export citation

Select the format you want to export the citation of this publication.

View Options

Check Access

Log in to view the full text

AAAS ID LOGIN

AAAS login provides access to Science for AAAS Members, and access to other journals in the Science family to users who have purchased individual subscriptions.

Log in via OpenAthens.
Log in via Shibboleth.
More options

Register for free to read this article

As a service to the community, this article is available for free. Login or register for free to read this article.

Purchase this issue in print

Buy a single issue of Science for just $15 USD.

View options

PDF format

Download this article as a PDF file

Download PDF

Media

Figures

Multimedia

Tables

Share

Share

Share article link

Share on social media

(0)eLetters

eLetters is an online forum for ongoing peer review. Submission of eLetters are open to all. eLetters are not edited, proofread, or indexed. Please read our Terms of Service before submitting your own eLetter.

Log In to Submit a Response

No eLetters have been published for this article yet.