Cover Page

How to Read a Paper

The Basics of Evidence‐Based Medicine and Healthcare


SIXTH EDITION

Trisha Greenhalgh

Professor of Primary Care Health Sciences

University of Oxford

Oxford, UK






image

In November 1995, my friend Ruth Holland, book reviews editor of the British Medical Journal, suggested that I write a book to demystify the important but often inaccessible subject of evidence‐based medicine. She provided invaluable comments on the original draft of the manuscript, but was tragically killed in a train crash on 8th August 1996. This book is dedicated to her memory.

Foreword to the first edition by Professor Sir David Weatherall

Not surprisingly, the wide publicity given to what is now called evidence‐based medicine has been greeted with mixed reactions by those who are involved in the provision of patient care. The bulk of the medical profession appears to be slightly hurt by the concept, suggesting as it does that until recently all medical practice was what Lewis Thomas has described as a frivolous and irresponsible kind of human experimentation, based on nothing but trial and error, and usually resulting in precisely that sequence. On the other hand, politicians and those who administrate our health services have greeted the notion with enormous glee. They had suspected all along that doctors were totally uncritical and now they had it on paper. Evidence‐based medicine came as a gift from the gods because, at least as they perceived it, its implied efficiency must inevitably result in cost saving.

The concept of controlled clinical trials and evidence‐based medicine is not new, however. It is recorded that Frederick II, Emperor of the Romans and King of Sicily and Jerusalem, who lived from 1192 to 1250 AD, and who was interested in the effects of exercise on digestion, took two knights and gave them identical meals. One was then sent out hunting and the other ordered to bed. At the end of several hours he killed both and examined the contents of their alimentary canals; digestion had proceeded further in the stomach of the sleeping knight. In the 17th century Jan Baptista van Helmont, a physician and philosopher, became sceptical of the practice of blood‐letting. Hence he proposed what was almost certainly the first clinical trial involving large numbers, randomisation and statistical analysis. This involved taking 200–500 poor people, dividing them into two groups by casting lots, and protecting one from phlebotomy while allowing the other to be treated with as much blood‐letting as his colleagues thought appropriate. The number of funerals in each group would be used to assess the efficacy of blood‐letting. History does not record why this splendid experiment was never carried out.

If modern scientific medicine can be said to have had a beginning it was in Paris in the mid‐19th century and where it had its roots in the work and teachings of Pierre Charles Alexandre Louis. Louis introduced statistical analysis to the evaluation of medical treatment and, incidentally, showed that blood‐letting was a valueless form of treatment, although this did not change the habits of the physicians of the time, or for many years to come. Despite this pioneering work, few clinicians on either side of the Atlantic urged that trials of clinical outcome should be adopted, although the principles of numerically based experimental design were enunciated in the 1920s by the geneticist Ronald Fisher. The field only started to make a major impact on clinical practice after the Second World War following the seminal work of Sir Austin Bradford Hill and the British epidemiologists who followed him, notably Richard Doll and Archie Cochrane.

But although the idea of evidence‐based medicine is not new, modern disciples like David Sackett and his colleagues are doing a great service to clinical practice, not just by popularising the idea, but by bringing home to clinicians the notion that it is not a dry academic subject but more a way of thinking that should permeate every aspect of medical practice. While much of it is based on mega‐trials and meta‐analyses, it should also be used to influence almost everything that a doctor does. After all, the medical profession has been brain‐washed for years by examiners in medical schools and Royal Colleges to believe that there is only one way of examining a patient. Our bedside rituals could do with as much critical evaluation as our operations and drug regimes; the same goes for almost every aspect of doctoring.

As clinical practice becomes busier, and time for reading and reflection becomes even more precious, the ability effectively to peruse the medical literature and, in the future, to become familiar with a knowledge of best practice from modern communication systems, will be essential skills for doctors. In this lively book, Trisha Greenhalgh provides an excellent approach to how to make best use of medical literature and the benefits of evidence‐based medicine. It should have equal appeal for first year medical students and grey‐haired consultants, and deserves to be read widely.

With increasing years, the privilege of being invited to write a foreword to a book by one’s ex‐students becomes less of a rarity. Trisha Greenhalgh was the kind of medical student who never let her teachers get away with a loose thought and this inquiring attitude seems to have flowered over the years; this is a splendid and timely book and I wish it all the success it deserves. After all, the concept of evidence‐based medicine is nothing more than the state of mind that every clinical teacher hopes to develop in their students; Dr Greenhalgh’s sceptical but constructive approach to medical literature suggests that such a happy outcome is possible at least once in the lifetime of a professor of medicine.

DJ Weatherall
Oxford
September 1996

Preface to the sixth edition

When I wrote this book in 1996, evidence‐based medicine was a bit of an unknown quantity. A handful of academics (including me) were already enthusiastic and had begun running ‘training the trainers’ courses to disseminate what we saw as a highly logical and systematic approach to clinical practice. Others – certainly the majority of clinicians – were convinced that this was a passing fad that was of limited importance and would never catch on. I wrote How to Read a Paper for two reasons. First, students on my own courses were asking for a simple introduction to the principles presented in what was then known as ‘Dave Sackett's big red book’ (Sackett DL, Haynes RB, Guyatt GH, Tugwell P. Clinical Epidemiology: A Basic Science for Clinical Medicine. London, Little, Brown & Co., 1991) – an outstanding and inspirational volume that was already in its fourth reprint, but which some novices apparently found a hard read. Second, it was clear to me that many of the critics of evidence‐based medicine didn’t really understand what they were dismissing – and that until they did, serious debate on the clinical, pedagogical and even political place of evidence‐based medicine as a discipline could not begin.

I am of course delighted that How to Read a Paper has become a standard reader in many medical and nursing schools, and that so far it has been translated into 20 languages including French, German, Italian, Spanish, Portuguese, Chinese, Polish, Japanese, Czech and Russian. I am also delighted that what was so recently a fringe subject in academia has been well and truly mainstreamed in clinical service. In the UK, for example, it is now a contractual requirement for all doctors, nurses and pharmacists to practise (and for managers to manage) according to best research evidence.

In the 23 years since the first edition of this book was published, evidence‐based medicine (and, more broadly, evidence‐based healthcare) has waxed and waned in popularity. Hundreds of textbooks and tens of thousands of journal articles now offer different angles on the ‘basics of EBM’ covered briefly in the chapters that follow. An increasing number of these sources point out genuine limitations of evidence‐based healthcare in certain contexts. Others look at evidence‐based medicine and healthcare as a social movement – a ‘bandwagon’ that took off at a particular time (the 1990s) and place (North America) and spread quickly with all sorts of knock‐on effects for particular interest groups.

When preparing this sixth edition, I began with no fewer than 11 reviews of the previous edition, mostly from students who are the book’s main target audience. They wanted updated references, more worked examples, more (and better) pictures and some questions to aid reflection at the end of each chapter. I’ve added all these, along with a new chapter on population genetics and big data. I did not change much else, because there is clearly still room on the bookshelves for a no‐frills introductory text. Since the publication of the fifth edition, I have written a new book on How to Implement Evidence‐Based Healthcare, so I have removed the (now somewhat outdated) chapter on implementation that was included in the fourth and fifth editions.

As ever, I would welcome any feedback that will help make the text more accurate, readable and practical.

Trisha Greenhalgh
November 2018

Preface to the first edition: do you need to read this book?

This book is intended for anyone, whether medically qualified or not, who wishes to find their way into the medical and healthcare literature, assess the scientific validity and practical relevance of the articles they find, and, where appropriate, put the results into practice. These skills constitute the basics of evidence‐based medicine (if you’re thinking about what doctors do) or evidence‐based healthcare (if you’re looking at the care of patients more widely).

I hope this book will improve your confidence in reading and interpreting papers relating to clinical decision‐making. I hope, in addition, to convey a further message, which is this. Many of the descriptions given by cynics of what evidence‐based healthcare is (the glorification of things that can be measured without regard for the usefulness or accuracy of what is measured, the uncritical acceptance of published numerical data, the preparation of all‐encompassing guidelines by self‐appointed ‘experts’ who are out of touch with real medicine, the debasement of clinical freedom through the imposition of rigid and dogmatic clinical protocols, and the over‐reliance on simplistic, inappropriate and often incorrect economic analyses) are actually criticisms of what the evidence‐based healthcare movement is fighting against, rather than of what it represents.

Do not, however, think of me as an evangelist for the gospel according to evidence‐based healthcare. I believe that the science of finding, evaluating and implementing the results of clinical research can, and often does, make patient care more objective, more logical and more cost‐effective. If I didn’t believe that, I wouldn’t spend so much of my time teaching it and trying, as a doctor, to practise it. Nevertheless, I believe that when applied in a vacuum (that is, in the absence of common sense and without regard to the individual circumstances and priorities of the person being offered treatment or to the complex nature of clinical practice and policy‐making), ‘evidence‐based’ decision‐making is a reductionist process with a real potential for harm.

Finally, you should note that I am neither an epidemiologist nor a statistician, but a person who reads papers and who has developed a pragmatic (and at times unconventional) system for testing their merits. If you wish to pursue the epidemiological or statistical themes covered in this book, I would encourage you to move on to a more definitive text, references for which you will find at the end of each chapter.

Trisha Greenhalgh
November 1996

Acknowledgements

I am not by any standards an expert on all of the subjects covered in this book (in particular, I am very bad at sums), and I am grateful to the people listed here for help along the way. I am, however, the final author of every chapter, and responsibility for any inaccuracies is mine alone.

  1. To Professor Sir Andy Haines and Professor Dave Sackett who introduced me to the subject of evidence‐based medicine and encouraged me to write about it.
  2. To the late Dr Anna Donald, who broadened my outlook through valuable discussions on the implications and uncertainties of this evolving discipline.
  3. To Jeanette Buckingham of the University of Alberta, Canada, for invaluable input to Chapter 2.
  4. To various expert advisers and proofreaders who had direct input to this new edition or who advised me on previous editions. In particular, ten people (five experts in genetic studies and five novices in that topic) gave feedback on the new Chapter 15.
  5. To the many readers, too numerous to mention individually, who took time to write in and point out both typographical and factual errors in previous editions. As a result of their contributions, I have learnt a great deal (especially about statistics) and the book has been improved in many ways. Some of the earliest critics of How to Read a Paper have subsequently worked with me on my teaching courses in evidence‐based practice; several have co‐authored other papers or book chapters with me, and one or two have become personal friends.
  6. To the authors and publishers of articles who gave permission for me to reproduce figures or tables. Details are given in the text.
  7. To my followers on Twitter who proposed numerous ideas, constructive criticisms and responses to my suggestions when I was preparing the fifth edition of this book. By the way, you should try Twitter as a source of evidence‐based information. Follow me on @trishgreenhalgh – and while you’re at it you could try the Cochrane Collaboration on @cochrancollab, Ben Goldacre on @bengoldacre, Carl Heneghan from the Oxford Centre for Evidence Based Medicine on @cebmblog and the UK National Institute for Health and Care Excellence on @nicecomms.

Thanks also to my husband, Dr Fraser Macfarlane, for his unfailing support for my academic work and writing. Our sons Rob and Al had not long been born when the first edition of this book was being written. It is a source of great pride to me that both are now pursuing scientific careers (Rob in marine biology, Al in medicine) and have begun to publish their own scientific papers.