Objective: To examine media stories on research presented at scientific meetings to see if they reported basic study facts and cautions, and whether they were clear about the preliminary stage of the research.
Design and setting: Three physicians with clinical epidemiology training analysed front-page newspaper stories (n = 32), other newspaper stories (n = 142), and television/radio stories (n = 13) identified in LexisNexis and ProQuest searches for research reports from five scientific meetings in 2002–2003 (American Heart Association, 14th Annual International AIDS Conference, American Society of Clinical Oncology, Society for Neuroscience, and the Radiological Society of North America).
Main outcome measures: Media reporting of basic study facts (size, design, quantification of results); cautions about study designs with intrinsic limitations (animal/laboratory studies, studies with < 30 people, uncontrolled studies, controlled but not randomised studies) or downsides (adverse effects in intervention studies); warnings about the preliminary stage of the research presented at scientific meetings.
Results: 34% of the 187 stories did not mention study size, 18% did not mention study design (another 35% were so ambiguous that expert readers had to guess the design), and 40% did not quantify the main result. Only 6% of news stories about animal studies mentioned their limited relevance to human health; 21% of stories about small studies noted problems with the precision of the finding; 10% of stories about uncontrolled studies noted it was not possible to know if the outcome really related to the exposure; and 19% of stories about controlled but not randomised studies raised the possibility of confounding. Only 29% of the 142 news stories on intervention studies noted the possibility of any potential downside. Twelve stories mentioned a corresponding “in press” medical journal article; two of the remaining 175 noted that findings were unpublished, might not have undergone peer review, or might change.
Conclusions: News stories about scientific meeting research presentations often omit basic study facts and cautions. Consequently, the public may be misled about the validity and relevance of the science presented.
- 1. Fontanarosa P, Flanagin A. Prepublication release of medical research. JAMA 2000; 284: 2927-2929.
- 2. Schwartz L, Woloshin S, Baczek L. Media coverage of scientific meetings: too much, too soon? JAMA 2002; 287: 2859-2863.
- 3. Van Der Weyden M, Armstrong R. Australia’s media reporting of health and medical matters: a question of quality. Med J Aust 2005; 183: 188-189. <MJA full text>
- 4. Giordano S, Duan Z, Kuo Y-F, et al. Impact of a scientific presentation on community treatment patterns for primary breast cancer. J Natl Cancer Inst 2006; 98: 382-388.
- 5. Toma M, McAlister F, Bialy L, et al. Transition from meeting abstract to full-length journal article for randomized controlled trials. JAMA 2006; 295: 1281-1287.
- 6. Landis R, Koch G. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174.
- 7. Forrow L, Taylor W, Arnold R. Absolutely relative: how research results are summarized can affect treatment decisions. Am J Med 1992; 92: 121-124.
- 8. Malenka D, Baron J, Johansen S, et al. The framing effect of relative and absolute risk. J Gen Intern Med 1993; 8: 543-548.
- 9. Naylor C, Chen E, Strauss B. Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness? Ann Intern Med 1992; 117: 916-921.
- 10. Kirkey S. Exercising the body stimulates brain: study. Working out increases blood flow. US researchers find monkeys on treadmill became more alert and more interested. Gazette (Montreal) 2003; 9 Nov: A5.
- 11. Science Briefs: Still depressed? Go work out. San Diego Union-Tribune 2003; 12 Nov: F-2. Available at: http://archives.signonsandiego.com/index.html (accessed May 2006).
- 12. Canadian Broadcasting Corporation News. Experiment uses patients’ cells to heal heart. 2003; 11 Nov. Available at: http://www.cbc.ca/story/science/national/2003/11/10/heart_stem031110.html (accessed May 2006).
- 13. Knox R. Harvard researchers present sobering report on AIDS [radio news transcript]. National Public Radio 2002; 10 Jul. Available at: http://www.npr.org/transcripts/ (accessed May 2006).
- 14. Hall CT. Devices that read human thought now possible, study says. San Francisco Chronicle 2003; 10 Nov: A5. Available at: http://sfgate.com/cgi-bin/article.cgi?f=/c/a/2003/11/10/MNGK82U4MV1.DTL&hw (accessed May 2006).
- 15. Altman LK. Drug-coated stent is found safe and effective for arteries. New York Times 2003; 11 Nov: A19. Available at: http://query.nytimes.com/gst/fullpage.html?sec=health&res=9F0CE7DB1E39F932A25752C1A9659C8B63 (accessed May 2006).
- 16. Turpin A. Glaxo AIDS drug boost. Scotsman (Edinburgh) 2002; 10 Jul: 2. Available at: http://business.scotsman.com/technology.cfm?id=742352002 (accessed May 2006).
- 17. Dembner A. Cardiac arrest deadlier at night. Boston Globe 2003; 18 Nov: C1. Available at: http://www.boston.com (accessed May 2006).
- 18. Wahlberg D. Study: cholesterol drugs cut cancer risk. Atlanta Journal-Constitution 2003; 2 Jun: A3. Available at: http://nl.newsbank.com/sites/ajc/ (accessed May 2006).
- 19. Women smokers at double the risk of lung cancer. Times (London) 2003; 2 Dec: 1. Available at: http://www.newsint-archive.co.uk/pages/main.asp (accessed May 2006).
- 20. Connor S. HIV vaccine could be on the market in five years. Independent (London) 2002; 9 Jul: 5. Available at: http://news.independent.co.uk/world/science_technology/article183435.ece (accessed May 2006).
- 21. Pollack A, Altman L. Large trial finds AIDS vaccine fails to stop infection. New York Times 2003; 24 Feb: A1. Available at: http://query.nytimes.com/gst/fullpage.html?sec=health&res=9502E4D61E3DF937A15751C0A9659C8B63 (accessed May 2006).
- 22. Woloshin S, Schwartz L. What’s the rush? The dissemination and adoption of preliminary research results. J Natl Cancer Inst 2006; 98: 372-373.
- 23. Moynihan R, Bero L, Ross-Degnan D, et al. Coverage by the media of the benefits and risks of medications. N Engl J Med 2000; 342: 1645-1650.
- 24. Cassells A, Hughs M, Cole C, et al. Drugs in the news: an analysis of Canadian newspaper coverage of new prescription drugs. Can Med Assoc J 2003; 168: 1133-1137.
Publication of your online response is subject to the Medical Journal of Australia's editorial discretion. You will be notified by email within five working days should your response be accepted.