Annabel referred to an article at Trust the Evidence, the excellent blog of the Centre for Evidence-Based Medicine (CEBM) in Oxford, UK.
In the article “Is swine flu the most over-published and over-hyped disease ever?” Carl Heneghan first showed the results of a quick PubMed search using the terms ‘swine flu’ and ‘H1N1’: this yielded 4,475 articles on the subject, with approximately one third (1,437 articles) published in the last 7 months (search: November 27th). Of these 107, largely news articles, were published in the BMJ, followed by the Lancet and NEJM at 35 each.
Top News stories on H1N1 generated appr. 2000 to 4000 news articles each (in Google). Items included outbreak of a new form of ‘swine flu’ which prompted the United States and the World Health Organization to declare a public health emergency (April), Southern Hemisphere being mostly spared in the swine flu epidemic (May), Tamiflu, i.e. the effects of Tamiflu in children in the BMJ (co-authored by Carl) in August and the availability of the vaccine H1N1 vaccine clinics to offer seasonal flu shots in November.
Finally he ends with: “Do you know what the killer fact is in all of this? There isn’t one randomized trial out there on swine flu or H1N1 – outrageous.”
My first thoughts were: “is H1N1 really so over-published compared to other (infectious) diseases?”, “Is it really surprising that there are no RCTs yet? The H1N1-pandemics just started a few months ago!” and even “are RCT’s really the study designs we urgently need right now?”
Now the severity of the H1N1 flu seems less than feared, it is easy to be wise. Isn’t is logic that there are a lot of “exploratory studies” first: characterization of the virus, establishing the spread of H1N1 around the world, establishing mortality and morbidity, and patterns of vulnerability among the population? It is also understandable that a lot of news articles are published, in the BMJ or in online newspapers. We want to be informed. In the Netherlands we now have a small outbreak of Q-fever, partly because the official approach was slow and underestimated the public health implications of Q-fever. So the public was really underinformed. That is worse than being “overexposed”.
News often spreads like wildfire, that is no news. When I google “US Preventive Services Task Force” (who issued the controversial US breast cancer screening guidelines last month) 2,364 hits still pop up in Google News (over the last month). All papers and other news sources echo the news. 2,000 hits are easily reached.
4,475 PubMed articles on ‘swine flu’ and ‘H1N1’ isn’t really that much. When I quickly search PubMed for the rather “new” disease Q-fever I get 3,752 hits, a search for HPV (Alphapapillomavirus OR papilloma infections OR HPV OR human papilloma virus) gives 19,543 hits (1,330 over the last 9 months), and a quick search for (aids) AND “last 9 months”[edat] yields 4,073 hits!
The number of hits alone doesn’t mean much, certainly not if news, editorials and comments are included. But lets go to the second comment, that there is “not ONE RCT on H1N1.”
Again, is it reasonable to expect ONE RCT published and included in PubMed over a 9 month period? Any serious study takes time from concept to initiation, patient-enrollment, sufficient follow-up, collection of data, writing and submitting the article, peer review, publication, inclusion in PubMed and assignment of MeSH-terms (including the publication type “Randomized Controlled Trial”).
Furthermore RCTs are not always the most feasible or appropriate study designs for answering certain questions. For instance for questions related to harm, etiology, epidemiology, spreading of virus, characteristics, diagnosis and prognosis. RCTs may be most suitable to evaluate the efficacy of treatment or prevention interventions. Thus in case of H1N1 the efficacy of vaccines and of neuraminidase inhibitors to prevent or treat H1N1 flu. However, it may not always be ethical to do so (see below).
I’ve repeated the search, and using prefab “My NCBI filters” for RCTs discussed before I get the following results:
Using the Randomized Controlled Trials limits in PubMed I do get 7 hits, and using broader filters, like the Therapy/Narrow Filter under Clinical Queries I even find 2 more RCTs that have not yet been indexed by PubMed. With the Cochrane Highly sensitive Filter even more hits are obtained, most of which are “noise”, inherent to the use of a broad filter.
The found RCTs are safety/immunogenicity/stability studies of subunit or split vaccines to H1N1, H3N2, and B influenza strains. This means they are not restricted to H1N1, but this is true for the entire set of H1N1 publications. 40 of the 1443 hits are even animal studies. Thus the total number of articles dealing with H1N1 only -and in humans- is far less than 1443.
By the way, one of the 15 H1N1-hits in PubMed obtained with the SR-filter (see Fig) is a meta-analysis of RCTs in the BMJ, co-authored by Heneghan. It is not about H1N1, but contains the sentence: “Their (neuraminidase inhibitors) effects on the incidence of serious complications, and on the current A/H1N1 influenza strain remain to be determined.”
More important, if studies have been undertaken in this field they are probably not yet published. Thus, the place to look is a clinical trials register, like Clinical trials.gov (http://clinicaltrials.gov/), The International Clinical Registry Platform Search Portal at the WHO (www.who.int/trialsearch) , national or pharmaceutical industry trials registers.
Again, most trials concern the safety and efficacy of H1N1 vaccines and include the testing of vaccines on subgroups, like pregnant women, children with asthma and people with AIDS. 30 trials are phase III.
Narrowing the search to H1N1 OR swine flu | neuraminidase inhibitors OR oseltamivir OR zanamivir (treatment filled in in the filed “Interventions”) yields 8 studies. One of the studies is a phase III trial.
This yield doesn’t seem bad per se. However, numbers of trials don’t mean a lot and a more pertinent issue is, whether the most important and urgent questions are investigated.
Three issues are important with respect to interventions:
- Are H1N1 vaccines safe and immunogenic? in subpopulations?
- Do H1N1 vaccines lower morbidity and mortality due to the H1N1 flu?
- Are neuraminidase inhibitors effective in preventing or treating H1N1 flu?
Older Cochrane Reviews on the seasonal influenza flu (and updates) cast doubt on the efficacy of  vaccines (see the [poor*] Atlantic news article) ànd  neuraminidase inhibitors in children (Cochrane 2007 and BMJ 2009) ànd adults (Cochrane 2006, update 2008 and BMJ 2009) against symptoms or complications of the seasonal flu. The possibility has even been raised that seasonal flu shots are linked to swine flu risk.
(…) the H1N1 influenza has had an unexpectedly devastating impact among pregnant women. According to the CDC, there have been approximately 700 reported cases of H1N1 in pregnant women since April.** Of these, 100 women have required admission to an intensive care unit and 28 have died. In other words, 1 out of every 25 pregnant women who contracted H1N1 died of it. By any standard, that is an appalling death rate. (……)
To put it in perspective, the chance of a pregnant woman dying from H1N1 is greater than the chance of a heart patient dying during triple bypass surgery. That is not a trivial risk.
The H1N1 flu has taken an extraordinary toll among pregnant women. A new vaccine is now available. Because of the nature of the emergency, there has not been time to do any long term studies of the vaccine. Yet pregnant women will need to make a decision as soon as possible on whether to be vaccinated. (Emphasis mine)…. Given the dramatic threat and the fact that we know of no unusual complications of vaccination, the decision seems clear. Every pregnant woman should get vaccinated as soon as possible.
“Pregnant women are at particular risk during the imminent H1N1v influenza pandemic. The new H1N1v virus requires urgent political and medical decisions on vaccination strategies in order to minimize severe disease and death from this pandemic. However, there is a lack of evidence to build such decisions upon. A vaccine will be provided in the fourth quarter of 2009, but there is little knowledge on the immunogenicity. Particularly its clinical effectiveness and duration of immunity in pregnant women and their newborn infants is unknown. Therefore, it will be important to study the optimal vaccination regimens with respect to dosing and use of adjuvant to decide future health policies on vaccination of pregnant women. We have a unique possibility to study these aspects of H1N1v infection in pregnant women in our ongoing unselected, prospective, birth-cohort study recruiting 800 pregnant mothers between Q1- 2009 and Q4-2010. Pregnant women from East-Denmark are being enrolled during the 2nd trimester and their infant will undergo a close clinical follow-up. The H1N1v pandemic is expected to reach Denmark Q4-2009. The timing of this enrollment and the imminent pandemic allows for an “experiment of nature” whereby the first half of the mothers completes pregnancy before the H1N1v pandemic. The other half of this cohort will be pregnant while H1N1v is prevalent in the community and will require H1N1v vaccination.The aim of this randomized, controlled, trial is to compare and evaluate the dose-related immune protection conferred by vaccine and adjuvant (Novartis vaccine Focetria) in pregnant women and non-pregnant women. In addition the protocol will assess the passive immunity conferred to the newborn from these vaccine regimes. The study will provide evidence-based guidance for health policies on vaccination for the population of pregnant women during future H1N1v pandemics.”
If Heneghan would have directed his arrows at certain interventions in certain circumstances in certain people he might have had a good point, but now his arrows don’t hit any target. Revere from Effect Measure and Orac from Orac Knows might well have diagnosed him as someone who suffers from “methodolatry,” which is, as Revere puts it, the “profane worship of the randomized clinical trial as the only valid method of investigation.”
Related articles by Zemanta
- Seasonal flu vaccine programs being questioned (ctv.ca)
- WHO: H1N1 is now world’s dominant flu virus (cnn.com)
- Quick Take: Novartis Vaccine Chief Andrin Oswald on Swine Flu and Vaccine Business (xconomy.com)
- FDA To America: Please, Don’t Be Idiots (boingboing.net)
- WHO says Tamiflu still works against H1N1, despite cases (ctv.ca)
- Swine Flu May Have Hit One Peak; More To Come (nlm.nih.gov)
- Allergists Urge People with Asthma Get Swine and Seasonal Flu Shots Following CDC Vaccine Advisory Committee Recommendations (prweb.com)
- Public Health, News, Epidemiology: H1N1 News and a Feed from CDC (creakysites.wordpress.com)
- Studies link seasonal flu shots to swine flu risk (thestar.com)
- Britain: Swine flu less deadly than first thought (seattletimes.nwsource.com)
- Flu vaccination: Do The Atlantic, Shannon Brownlee, and Jeanne Lenzer matter? (scienceblogs.com)