MJA
MJA InSight
MJA Careers
Viewpoint

Counting on citations: a flawed way to measure quality

Garry Walter, Karen Fisher, Sidney Bloch and Glenn Hunt
Med J Aust 2003; 178 (6): 280-281.

The journal Impact Factor and citation counts are misconstrued and misused as measures of scientific quality. Articles must be read in order to judge their quality. We have introduced a system, which may be easily replicated, to identify the best articles published in a journal.

Garry Walter, PhD, FRANZCP, Director; and Editor1
Karen Fisher, MB BS, Research Officer, Central Sydney Area Health Service2
Sidney Bloch, PhD, FRANZCP, Professor; and Editor3
Glenn Hunt, MSc, PhD, Senior Research Fellow, University of Sydney4
1 Rivendell Unit, Child Adolescent and Family Psychiatric Services, Thomas Walker Hospital, Concord West, NSW.
2 Department of Psychiatry, University of Melbourne, Fitzroy, VIC.
3 Department of Psychological Medicine, Research Unit, Rozelle Hospital, Rozelle, NSW.
Article References: 
Reference Text: 
Seglen PO. Why the impact factor of journals should not be used for evaluating research. BMJ 1997; 314: 498-502.
Reference Order: 
1
PubMed ID: 
9056804
Reference Text: 
Hecht F, Hecht BK, Sandberg AA. The Journal Impact Factor: a misnamed, misleading, misused measure. Cancer Genet Cytogenet 1998; 104: 77-81.
Reference Order: 
2
PubMed ID: 
9666797
Reference Text: 
Coleman R. Impact Factors: use and abuse in biomedical research. Anat Rec 1999; 257: 54-57.
Reference Order: 
3
PubMed ID: 
10321432
Reference Text: 
Bloch S, Walter G. The Impact Factor: time for change. Aust N Z J Psychiatry 2001; 35: 563-568.
Reference Order: 
4
PubMed ID: 
11551269
Reference Text: 
Garfield E. Journal Impact Factor: a brief review. CMAJ 1999; 161: 979-980.
Reference Order: 
5
PubMed ID: 
10551195
Reference Text: 
Institute of Scientific Information. ISI Web of Knowledge. Available at: http://www.isinet.com (accessed Jul 2002).
Reference Order: 
6
PubMed ID: 
Reference Text: 
Hansson S. Impact factor as a misleading tool in evaluation of medical journals [letter]. Lancet 1995; 346: 906.
Reference Order: 
7
PubMed ID: 
Reference Text: 
Seglen PO. Citation and journal impact factors: questionable indicators of research quality. Allergy 1997; 52: 1050-1056.
Reference Order: 
8
PubMed ID: 
9404555
Reference Text: 
Seglen PO. Citation and journal impact factors are not suitable for evaluation of research. Acta Orthop Scand 1998; 69: 224-229.
Reference Order: 
9
PubMed ID: 
9703393
Reference Text: 
Opthof T. Sense and nonsense about the Impact Factor. Cardiovasc Res 1997; 33: 1-7.
Reference Order: 
10
PubMed ID: 
9059521
Reference Text: 
Institute of Scientific Information. Web of Science. Available at: http://wos.isiglobalnet2.com (accessed Dec 2001).
Reference Order: 
11
PubMed ID: 
Reference Text: 
Prestige factor. Available at: http://www.prestigefactor.com (accessed Nov 2001).
Reference Order: 
12
PubMed ID: 
Reference Text: 
Journal of Medical Ethics online. Available at: http://www.jmedethics.com (accessed Dec 2002).
Reference Order: 
13
PubMed ID: 
Reference Text: 
Medical Science Monitor online. Available at: http://www.medscimonit.com (accessed Dec 2002).
Reference Order: 
14
PubMed ID: 
Reference Text: 
Citation data: the wrong impact? [editorial]. Nat Neurosci 1998; 1: 641-642.
Reference Order: 
15
PubMed ID: 
10196574
Reference Text: 
Adam D. The counting house. Nature 2002; 415: 726-729.
Reference Order: 
16
PubMed ID: 
11845174
Reference Text: 
Deutsche Forschungsgemeinschaft. Recommendations of the Commission on Professional Self Regulation in Science. Proposals for safeguarding good scientific practice. January 1998. Available at: http://www.dfg.de/aktuelles_presse/reden_stellungnahmen/download/self_regulation_98.pdf (p.8) (accessed Sep 2002).
Reference Order: 
17
PubMed ID: 
Reference Text: 
Faculty of 1000. Available at: http://www.facultyof1000.com (accessed Jul 2002).
Reference Order: 
18
PubMed ID: 
Reference Text: 
Recommended reading? [editorial]. Nat Med 2002; 8: 1.
Reference Order: 
19
PubMed ID: 
11786879

The full contents of this page are only available to subscribers.