Does the NHI/FDA Paper Confirm XMRV in CFS? Well, Ditch the MR and Scratch the X… and… you’ve got MLV.

30 08 2010

ResearchBlogging.orgThe long awaited paper that would ‘solve’ the controversies about the presence of Xenotropic Murine Leukemia Virus-related virus (XMRV) in patients with chronic fatigue syndrome (CFS) was finally published in PNAS last week [1]. The study, a joint effort of the NIH and the FDA, was withheld, on request of the authors [2], because it contradicted the results of another study performed by the CDC. Both studies were put on hold.

The CDC study was published in Retrovirology online July 1 [3]. It was the fourth study in succession [4,5,6] and the first US study, that failed to demonstrate XMRV since researchers of the US Whittemore Peterson Institute (WPI) had published their controversial paper regarding the presence of XMRV in CFS [7].

The WPI-study had several flaws, but so had the negative papers: these had tested a less rigorously defined CFS-population, had used old and/or too few samples (discussed in two previous posts here and here).
In a way,  negative studies, failing to reproduce a finding, are less convincing then positive studies.  Thus everyone was eagerly looking forward to the release of the PNAS-paper, especially because the grapevine whispered this study was  to confirm the original WPI findings.

Indeed after publication, both Harvey Alter, the team leader of the NIH/FDA study, and Judy Mikovitz of the WPI emphasized that the PNAS paper essentially confirmed the presence of XMRV in CFS.

But that isn’t true. Not one single XMRV-sequence was found. Instead related MLV-sequences were detected.

Before I go into further details, please have a look at the previous posts if you are not familiar with the technical details , like the PCR-technique. Here (and in a separate spreadsheet) I also describe the experimental differences between the studies.

Now what did Lo et al exactly do? What were their findings? And in what respect do their findings agree or disagree with the WPI-paper?

Like WPI, Lo et al used nested PCR to enable detect XMRV. Nested means that there are two rounds of amplification. Outer primers are used to amplify the DNA between the two primers used (primers are a kind of very specific anchors fitting a small approximately 20 basepair long piece of DNA). Then a second round is performed with primers fitting a short sequence within the amplified sequence or amplicon.

The first amplified gag product is ~730 basepairs long, the second ~410 or ~380 basepairs, depending on the primer sets used:  Lo et al used the same set of outer primers as WPI to amplify the gag gene, but the inner gag primers were either those of WPI (410 bp)  or a in-house-designed primer set (380 bp).

Using the nested PCR approach Lo et al found gag-gene sequences in peripheral blood mononuclear cells (PBMC)  in 86.5% of all tested CFS-patients (32/37)  and in 96% (!) of the rigorously evaluated CFS-patients (24/25) compared with only 6.8% of the healthy volunteer blood donors (3/44). Half of the patients with gag detected in their PBMC, also had detectable gag in their serum (thus not in the cells). Vice versa, all but one patient with gag-sequences in the plasma also had gag-positive PBMC. Thus these findings are consistent.

The gels  (Figs 1 and 2) showing the PCR-products in PBMC don’t look pretty, because there are many aspecific bands amplified from human PBMC. These aspecific bands are lacking when plasma is tested (which lacks PBMC). To get the idea. The researchers are trying to amplify a 730 bp long sequence, using primers that are 23 -25 basepairs long, that need to find the needle in the haystack (only 1 in 1000 to 10,000 PBMC may be infected, 1 PBMC contains appr 6*10^9 basepairs). Only the order of A, C, G and T varies! Thus there is a lot of competition of sequences that have a near-fit, but are more preponderant than the true gag-sequences fitting the primers).

Therefore, detecting a band with the expected size does not suffice to demonstrate the presence of a particular viral sequence. Lo et al verified whether it were true gag-sequences, by sequencing each band with the appropriate size. All the sequenced amplicons appeared true gag-sequences. What makes there finding particularly strong is that the sequences were not always identical. This was one of the objections against the WPI-findings: they only found the same sequence in all patients (apart from some sequencing errors).

Another convincing finding is that the viral sequences could be demonstrated in samples that were taken 2-15 years apart. The more recent sequences had evolved and gained one or more mutations. Exactly what one would expect from a retrovirus. Such findings also make contamination unlikely. The lack of PCR-amplifiable mouse mitochondrial DNA also makes contamination a less likely event (although personally I would be more afraid of contamination by viral amplicons used as a positive control). The negative controls (samples without DNA) were also negative in all cases. The researchers also took all necessary physical precautions to prevent contamination (i.e. the blood samples were prepared at another lab than did the testing, both labs never sequenced similar sequences before).
(people often think of conspiracy wherever the possibility of contamination is mentioned, but this is a real pitfall when amplifying low frequency targets. It took me two years to exclude contamination in my experiments)

To me the data look quite convincing, although we’re still far from concluding that the virus is integrated in the human genome and infectious. And, of course, mere presence of a viral sequence in CFS patients, does not demonstrate a causal relationship. The authors recognize this and try to tackle this in future experiments.

Although the study seems well done, it doesn’t alleviate the confusion raised.

The reason, as said, is that the NIH/FDA researchers didn’t find a single XMRV sequence  in any of the samples!

Instead a variety of related MLV retrovirus sequences were detected.

Sure the two retroviruses belong to a similar “family”. The gag gene sequences share 96.6% homology.

However there are essential differences.

One is that XMRV is a  Xenotropic virus, hence the X: which means it can no longer enter mouse cells (MR= murine (mouse) related) but can infect cells of other species, including humans. (to be more precise it has both xenotropic and polytropic characteristics). According to the phylogenetic tree Lo et al  constructed,  the viral sequences they found are more diverse and best matches the so-called polytropic MLV viruses (able to infect both mouse and non-mouse cells infected). (see the PNAS commentary by Valerie Courgnaud et al for an explanation)

The main question, this paper raises is why they didn’t find XMRV, like WPI did.

Sure, Mikovitz —who is “delighted” by the results—now hurries to say that in the meantime, her group has found more diversity in the virus as well [8]. Or as a critical CFS patient writes on his blog:

In my opinion, the second study is neither a confirmation for, nor a replication of the first. The second study only confirms that WPI is on to something and that there might be an association between a type of retroviruses and ME/CFS.
For 10 months all we’ve heard was “it’s XMRV”. If you didn’t find
XMRV you were doing something wrong: wrong selection criteria, wrong methods, or wrong attitude. Now comes this new paper which doesn’t find XMRV either and it’s heralded as the long awaited replication and confirmation study. Well, it isn’t! Nice piece of spin by Annette Whittemore and Judy Mikovits from the WPI as you can see in the videos below (… ). WPI may count their blessings that the NIH/FDA/Harvard team looked at other MLVs and found them or otherwise it could have been game over. Well, probably not, but how many negative studies can you take?

Assuming the NIH/FDA findings are true, then the key question is not why most experiments were completely negative (there may many reasons why, for one thing they only tested XMRV), but why Lo didn’t find any XMRV amongst the positive CFS patients, and WPI didn’t find any MLV in their positive patient samples.

Two US cohorts of CFS patients with mutually exclusive presence of either XMRV or MLV, whereas the rest of the world finds nothing?? I don’t believe it. One would at least expect overlap.

My guess is that it must be something in the conditions used. Perhaps the set of primers.

As said, Lo used the same external primers as WPI, but varied the internal primers. Sometimes they used those of WPI (GAG-I-F/GAG-I-R ; F=forward, R=reverse) yielding a ~410 basepair product, sometimes their own primers (NP116/NP117), yielding a ~380 basepair product. In the Materials and Methods section  Lo et al write The NP116/NP117 was an in-house–designed primer set based on the highly conserved sequences found in different MLV-like viruses and XMRVs”.
In the supplement they are more specific:

…. (GAG-I-F/GAG-I-R (intended to be more XMRV specific) or the primer set NP116/NP117 (highly conserved sequences for XMRV and MLV).

Is it possible that the conditions that WPI used were not so suitable for finding MLV?

Lets look at Fig. S1 (partly depicted below), showing the multiple sequence alignment of 746 gag nucleotides (nt) amplified from 21 CFS patient samples (3 types) and one blood donor (BD22) [first 4 rows] and their comparison with known MLV (middle rows) and XMRV (last rows) sequences. There is nothing remarkable with the area of the reverse primer (not shown). The external forward primer (–>) fits all sequences (dots mean identical nucleotides). Just next to this primer are 15 nt deletions specific for XMRV (—-), but that isn’t hurdle for the external primers. The internal primers (–>) overlap, but the WPI-internal primer starts earlier, in the region with heterogeneity: here there are two mismatches between MLV- and XMRV-like viruses. In this region the CFS type MLV (nt 196) starts with TTTCA, whereas XMRV sequences all have TCTCG. And yes, the WPI-primers starts as follows: TCTCG. Thus there is a complete match with XMRV, but a 2 bp mismatch with MLV. Such a mismatch might easily explain why WPI (not using very optimal PCR conditions) didn’t find any low frequency MLV-sequences. The specific inner primer designed by the group of Lo and Alter, do fit both sequences, so differences in this region don’t explain the failure of Lo et al to detect XMRV. Perhaps MLV is more abundant and easier to detect?

But wait a minute. BD22, a variant detected in normal donor blood does have the XMRV variant sequence in this particular (very small) region. This sequence and the two other sequenced normal donor MLV variants differ form the patient variants, although -according to Lo- both patient and healthy donor variants differ more from XMRV then from each other (Figs 4 and 2s). Using the eyeball test I do see many similarities between XMRV and BD22 though (not only in the above region).

The media pay no attention to these differences between patient and healthy control viral sequences, and the different primer sets used. Did no one actually read the paper?

Whether theses differences are relevant, depends on whether identical conditions were used for each type of sample. It worries me that Lo says he sometimes uses the WPI inner primer sets and sometimes the other specific set. When is sometimes? It is striking that Fig 1 shows the results from CFS patients done with the specific primers and Fig 2 the results from normal donor blood done with the WPI-primers. Why? Is this the reason they picked up a sequence that fit the WPI-primers (starting with TCTCG)?

I don’t like it. I want to know how many times tested samples were positive or negative with either primer set. I not only want to see the PCR results of CFS-plasma (positive in half of the PBMC+ cases), but also of the control plasma. And I want a mix of the patient, normal samples, positive and negative controls on one gel. Everyone doing PCR knows that the signal can differ per PCR and per gel. Furthermore, the second PCR round gives way too much aspecific bands, whereas usually you get rid of those under optimal conditions.

Another confusing finding is a statement at the FDA site:

Additionally, the CDC laboratory provided 82 samples from their published negative study to FDA, who tested the samples blindly.  Initial analysis shows that the FDA test results are generally consistent with CDC, with no XMRV-positive results in the CFS samples CDC provided (34 samples were tested, 31 were negative, 3 were indeterminate).

What does this mean? Which inner primers did the FDA use? With the WPI inner primers MLV sequences might just not be found (although there might be other reasons as well, as the less stringent patient criteria).

And what to think of the earlier WPI findings? They did find “XMRV” sequences while no one else did.

I have always been skeptic (see here and here), because:

  • no mention of sensitivity in their paper
  • No mention of a positive control. The negative controls were just vials without added DNA.
  • No variation in the sequences detected, a statement that they retracted after the present NIH/FDA publication. What a coincidence.
  • Although the PCR is near the detection limit, only first round products are shown. These are stronger then you would expect them to be after one round.
  • The latter two points are suggestive of contamination. No extra test were undertaken to exclude this.
  • Surprisingly in an open letters/news items (Feb 18), they disclose that culturing PBMC’s is necessary to obtain a positive signal.  They refer to the original Science paper, but this paper doesn’t mention the need for culturing at all.
  • In an other open letter* Annette Whittemore, director of the WPI,writes to Dr McClure, virologist of tone of the negative papers that WPI researchers had detected XMRV in patient samples from both Dr. Kerr’s and Dr. van Kuppeveld’s cohorts. So if we must believe Annette, the negative samples weren’t negative
  • At this stage of controversy, the test is sold as “a reliable diagnostic tool“ by a firm with strong ties to WPI. In one such mail Mikovits says: “First of all the current diagnostic testing will define with essentially 100% accuracy! XMRV infected patients”.

Their PR machine, ever changing “findings” and anti-scientific attitude are worrying. Read more about at erv here.

What we can conclude from this all. I don’t know. I presume that WPI did find “something”, but weren’t cautious, critical and accurate enough in their drive to move forward (hence their often changing statements). I presume that the four negative findings relate to the nature of their samples or the use of the WPI inner primers or both. I assume that the NIH/CDC findings are real, although the actual positive rates might vary depending on conditions used (I would love to see all actual data).

Virologist “erv”is less positive, about the quality of the findings and their implications. In one of her comments (17) she responds:

No. An exogenous mouse ERV in humans makes no sense. But thats what their tree says. Mouse ERV is even more incredible than XMRV. Might be able to figure this out more if they upload their sequences to genbank. I realize they tried very hard not to contaminate their samples with mouse cells. That doesnt mean mouse DNA isnt in any of their store-bought reagents. There are H2O lanes in the mitochondral gels, but not the MLV gels (Fig 1, Fig 2). Why? Positive and negative controls go on every gel, end of story. First lesson every rotating student in our lab learns.

Finding mere virus-like sequences in CFS-patients is not enough. We need more data, more carefully gathered and presented. Not only in CFS patients and controls, but in cohorts of patients with different diseases and controls under controlled conditions. This will tell something about the specificity of the finding for CFS. We also need more information about XMRV infectivity and serology.

We also need to find out what being normal healthy and MLV+ means.

The research on XMRV/MLV seems to progress with one step forward, two steps back.

With the CFS patients, I truly hope that we are walking in the right direction.

Note

The title from this post was taken from: http://www.veteranstoday.com/2010/08/20/xmrv-renamed-to-hgrv/

References

  1. Lo SC, Pripuzova N, Li B, Komaroff AL, Hung GC, Wang R, & Alter HJ (2010). Detection of MLV-related virus gene sequences in blood of patients with chronic fatigue syndrome and healthy blood donors. Proceedings of the National Academy of Sciences of the United States of America PMID: 20798047
  2. Schekman R (2010). Patients, patience, and the publication process. Proceedings of the National Academy of Sciences of the United States of America PMID: 20798042
  3. Switzer WM, Jia H, Hohn O, Zheng H, Tang S, Shankar A, Bannert N, Simmons G, Hendry RM, Falkenberg VR, Reeves WC, & Heneine W (2010). Absence of evidence of xenotropic murine leukemia virus-related virus infection in persons with chronic fatigue syndrome and healthy controls in the United States. Retrovirology, 7 PMID: 20594299
  4. Erlwein, O., Kaye, S., McClure, M., Weber, J., Wills, G., Collier, D., Wessely, S., & Cleare, A. (2010). Failure to Detect the Novel Retrovirus XMRV in Chronic Fatigue Syndrome PLoS ONE, 5 (1) DOI: 10.1371/journal.pone.0008519
  5. Groom, H., Boucherit, V., Makinson, K., Randal, E., Baptista, S., Hagan, S., Gow, J., Mattes, F., Breuer, J., Kerr, J., Stoye, J., & Bishop, K. (2010). Absence of xenotropic murine leukaemia virus-related virus in UK patients with chronic fatigue syndrome Retrovirology, 7 (1) DOI: 10.1186/1742-4690-7-10
  6. van Kuppeveld, F., Jong, A., Lanke, K., Verhaegh, G., Melchers, W., Swanink, C., Bleijenberg, G., Netea, M., Galama, J., & van der Meer, J. (2010). Prevalence of xenotropic murine leukaemia virus-related virus in patients with chronic fatigue syndrome in the Netherlands: retrospective analysis of samples from an established cohort BMJ, 340 (feb25 1) DOI: 10.1136/bmj.c1018
  7. Lombardi VC, Ruscetti FW, Das Gupta J, Pfost MA, Hagen KS, Peterson DL, Ruscetti SK, Bagni RK, Petrow-Sadowski C, Gold B, Dean M, Silverman RH, & Mikovits JA (2009). Detection of an infectious retrovirus, XMRV, in blood cells of patients with chronic fatigue syndrome. Science (New York, N.Y.), 326 (5952), 585-9 PMID: 19815723
  8. Enserink M (2010). Chronic fatigue syndrome. New XMRV paper looks good, skeptics admit–yet doubts linger. Science (New York, N.Y.), 329 (5995) PMID: 20798285

———
Related Articles





Three Studies Now Refute the Presence of XMRV in Chronic Fatigue Syndrome (CFS)

27 04 2010

ResearchBlogging.org.“Removing the doubt is part of the cure” (RedLabs)

Two months ago I wrote about two contradictory studies on the presence of the novel XMRV retrovirus in blood of patients with Chronic Fatigue Syndrome (CFS).

The first study, published in autumn last year by investigators of the Whittemore Peterson Institute (WPI) in the USA [1], claimed to find XMRV virus in peripheral blood mononuclear cells (PBMC) of patients with CFS. They used PCR and several other techniques.

A second study, performed in the UK [2] failed to show any XMRV-virus in peripheral blood of CFS patients.

Now there are two other negative studies, one from the UK [3] and one from the Netherlands [4].

Does this mean that XMRV is NOT present in CFS patients?

No, different results may still be due do to different experimental conditions and patient characteristics.

The discrepancies between the studies discussed in the previous post remain, but there are new insights, that I would like to share.*

1. Conflict of Interest, bias

Most CFS patients seem “to go for” WPI, because WPI, established by the family of a chronic fatigue patient, has a commitment to CFS. CFS patients feel that many psychiatrists, including authors of the negative papers [2-4] dismiss CFS as something “between the ears”.  This explains the negative attitude against these “psych-healers” on ME-forums (i.e. the Belgium forum MECVS.net and http://www.forums.aboutmecfs.org/). MECVS even has a section “faulty/wrong” papers, i.e. about the “failure” of psychiatrists to demonstrate  XMRV!

Since a viral (biological) cause would not fit in the philosophy of these psychiatrists, they might just not do their best to find the virus. Or even worse…

Dr. Mikovits, co-author of the first paper [1] and Director of Research at WPI, even responded to the first UK study as follows (ERV and Prohealth):

“You can’t claim to replicate a study if you don’t do a single thing that we did in our study,” …
“They skewed their experimental design in order to not find XMRV in the blood.” (emphasis mine)

Mikovits also suggested that insurance companies in the UK are behind attempts to sully their findings (ERV).

These kind of personal attacks are “not done” in Science. And certainly not via this route.

Furthermore, WPI has its own bias.

For one thing WPI is dependent on CFS and other neuro-immune patients for its existence.

WPI has generated numerous press releases and doesn’t seem to use the normal scientific channels. Mikovits presented a 1 hr Q&A session about XMRV and CFS (in a stage where nothing has been proven yet). She will also present data about XMRV at an autism meeting. There is a lot of PR going on.

Furthermore there is an intimate link  between WPI and VIP Dx, both housed in Reno. Vip DX is licensed by WPI to provide the XMRV-test. Vipdx.com links to the same site as redlabsusa.com, for Vip Dx is the new name of the former RedLabs.

Interestingly Lombardi (the first author of the paper) co-founded Redlabs USA Inc. and  served as the Director of Operations at Redlabs, Harvey Whittemore owns 100% of VIP Dx, and was the company President until this year and  Mikovits is the Vice President of VIP Dx. (ME-forum). They didn’t disclose this in the Science paper.

TEST_RQN_Feb_2010

Vip/Dx offers a plethora of tests, and is the only RedLab -branch that performs the WPI-PCR test, now replaced by the “sensitive” culture test (see below). At this stage of controversy, the test is sold as “a reliable diagnostic tool“(according to prohealth). Surely their motto “Removing the doubt is part of the cure” appeals to patients. But how can doubt be removed if the association of XMRV with CFS has not been confirmed, the diagnostic tests offered have yet not been truly validated (see below), as long as a causal relationship between XMRV and CFS has not been proven and/or when XMRV does not seem that specific for CFS: it has also been found in people with prostate cancer, autism,  atypical multiple sclerosis, fibromyalgia, lymphoma)(WSJ).

Meanwhile CFS/ME websites are abuzz with queries about how to obtain tests -also in Europe- …and antiretroviral drugs. Sites like Prohealth seem to advocate for WPI. There is even a commercial XMRV site (who runs it is unclear)

Project leader Mikovits, and the WPI as a whole, seem to have many contacts with CSF patients, also by mail. In one such mail she says (emphasis and [exclamations] mine):

“First of all the current diagnostic testing will define with essentially 100% accuracy! XMRV infected patients”. [Bligh me!]….
We are testing the hypothesis that XMRV is to CFS as HIV is to AIDS. There are many people with HIV who don’t have AIDS (because they are getting treatment). But by definition if you have ME you must have XMRV. [doh?]
[....] There is so much that we don’t know about the virus. Recall that the first isolation of HIV was from a single AIDS patient published in late 1982 and it was not until 2 years later that it was associated with AIDS with the kind of evidence that we put into that first paper. Only a few short years later there were effective therapies. [...]. Please don’t hesitate to email me directly if you or anyone in the group has questions/concerns. To be clear..I do think even if you tested negative now that you are likely still infected with XMRV or its closest cousin..

Kind regards, Judy

These tests costs patients money, because even Medicare will only reimburse 15% of the PCR-test till now. VIP Dx does donate anything above costs to XMRV research, but isn’t this an indirect way to support the WPI-research? Why do patients have to pay for tests that have not proven to be diagnostic? The test is only in the experimental phase.

I ask you: would such an attitude be tolerated from a regular pharmaceutical company?

Patients

Another discrepancy between the WPI and the other studies is that only the WPI use the Fukuda and Canadian criteria to diagnose CFS patients. The Canadian  criteria are much more rigid than those used in the European studies. This could explain why WPI has more positives than the other studies, but it can’t fully explain that WPI shows 96% positives (their recent claim) against 0% in the other studies. For at least some of the European patients should fulfill the more rigid criteria.

Regional Differences

Patients of the positive and negative studies also differ with respect to the region they come from (US and Europe). Indeed, XMRV has previously been detected in prostate cancer cells from American patients, but not from German and Irish patients.

However, the latter two reasons may not be crucial if the statement in the open letter* from Annette Whittemore, director of the WPI, to Dr McClure**, the virologist of the second paper [2], is true:

We would also like to report that WPI researchers have previously detected XMRV in patient samples from both Dr. Kerr’s and Dr. van Kuppeveld’s cohorts prior to the completion of their own studies, as they requested. We have email communication that confirms both doctors were aware of these findings before publishing their negative papers.(……)
One might begin to suspect that the discrepancy between our findings of XMRV in our patient population and patients outside of the United States, from several separate laboratories, are in part due to technical aspects of the testing procedures.

Assuming that this is true we will now concentrate on the differences in the PCR -procedures and results.

PCR

All publications have used PCR to test the presence of XMRV in blood: XMRV is present in such low amounts that you can’t detect the RNA without amplifying it first.

PCR allows the detection of a single or few copies of target DNA/RNA per milligram DNA input, theoretically 1 target DNA copy in 105 to 106 cells. (RNA is first reverse transcribed to DNA). If the target is not frequent, the amplified DNA is only visible after Southern blotting (a radioactive probe “with a perfect fit to” the amplified sequence) or after a second PCR round (so called nested PCR). In this second round a set of primers is used internal to the first set of primers. So a weak signal is converted in a strong and visible one.

All groups have applied nested PCR. The last two studies have also used a sensitive real time PCR, which is more of a quantitative assay and less prone to contamination.

Twenty years ago, I had similar experiences as the WPI. I saw very vague PCR bands that had all characteristics of a tumor-specific sequence in  normal individuals, which was contrary to prevailing beliefs and hard to prove. This had all to do with a target frequency near to the detection limit and with the high chance of contamination with positive controls. I had to enrich tonsils and purified B cells to get a signal and sequence the found PCR products to prove we had no contamination. Data were soon confirmed by others. By the way our finding of a tumor specific sequence in normal individuals didn’t mean that everyone develops lymphoma (oh analogy)

Now if you want to proof you’re right when you discovered something new you better do it good.

Whether a PCR assay at or near the detection limit of PCR is successful depends on:

  • the sensitivity of the PCR
    • Every scientific paper should show the detection limit of the PCR: what can the PCR detect? Is 1 virus particle enough or need there be 100 copies of the virus before it is detected? Preferably the positive control should be diluted in negative cells. This is called spiking. Testing a positive control diluted in water doesn’t reflect the true sensitivity. It is much easier for primers to find one single small piece of target DNA in water than to find that piece of DNA swimming in a pool of DNA from 105 cells. 
  • the specificity of the PCR.
    • You can get aspecific bands if the primers recognize other than the intended sequences. Suppose you have one target sequence competing with a lot of similar sequences, then even a less perfect match in the normal genome has every chance to get amplified. Therefore you should have a negative control of cells not containing the virus (i.e. placental DNA), not only water. This resembles the PCR conditions of your test samples.
  • Contamination
    • this should be prevented by rigorous spatial separation of  sample preparation, PCR reaction assembly, PCR execution, and post-PCR analysis. There should be many negative controls. Control samples should be processed the same way as the experimental samples and should preferably be handled blinded.
  • The quality and properties of your sample.
    • If XMRV is mainly present in PBMC, separation of PBMC by Ficoll separation (from other cells and serum) could make the difference between a positive and a negative signal. Furthermore,  whole blood and other body fluids often contain inhibitors, that may lead to a much lower sensitivity. Purification steps are recommended and presence of inhibitors should be checked by spiking and amplification of control sequences.

Below the results per article. I have also made an overview of the results in a Google spreadsheet.

WPI
The PCR conditions are badly reported in the WPI paper, published in Science[1]. As a matter of fact I wonder how it ever came trough the review.

  • Unlike XMRV-positive prostate cancer cells, XMRV infection status did not not correlate with the RNASEL genotype.
  • The sensitivity of the PCR is not shown (nor discussed).
  • No positive control is mentioned. The negative controls were just vials without added DNA.
  • Although the PCR is near the detection limit, only first round products are shown (without confirmation of the identity of the product). The positive bands are really strong, whereas you expect them to be weak (near the detection limit after two rounds). This is suggestive of contamination.
  • PBMC have been used as a source and that is fine, but one of WPI’s open letters/news items (Feb 18), in response to the first UK study, says the following:
    • point 7. Perhaps the most important issue to focus on is the low level of XMRV in the blood. XMRV is present in such a small percentage of white blood cells that it is highly unlikely that either UK study’s PCR method could detect it using the methods described. Careful reading of the Science paper shows that increasing the amount of the virus by growing the white blood cells is usually required rather than using white blood cells directly purified from the body. When using PCR alone, the Science authors found that four samples needed to be taken at different times from the same patient in order for XMRV to be detected by PCR in freshly isolated white blood cells.(emphasis mine)
  • But carefully reading the methods,  mentioned in the “supporting material” I only read:
    • The PBMC (approximately 2 x 107 cells) were centrifuged at 500x g for 7 min and either stored as unactivated cells in 90% FBS and 10% DMSO at -80 ºC for further culture and analysis or resuspended in TRIzol (…) and stored at -80 ºC for DNA and RNA extraction and analysis. (emphasis mine)

    Either …. or. Seems clear to me that the PBMC were not cultured for PCR, at least not in the experiments described in the science paper.

    How can one accuse other scientists of not “duplicating” the results if the methods are so poorly described and the authors don’t adhere to it themselves??

  • Strikingly only those PCR-reactions are shown, performed by the Cleveland Clinic (using one round), not the actual PCR-data performed by WPI. That is really odd.
  • It is also not clear whether the results obtained by the various tests were consistent.
    Suzanne D. Vernon, PhD, Scientific Director of the CFIDS Association of America (charitable organization dedicated to CFS) has digged deeper into the topic. This is what she wrote [9]:
    Of the 101 CFS subjects reported in the paper, results for the various assays are shown for only 32 CFS subjects. Of the 32 CFS subjects whose results for any of the tests are displayed, 12 CFS subjects were positive for XMRV on more than one assay. The other 20 CFS subjects were documented as positive by just one testing method. Using information from a public presentation at the federal CFS Advisory Committee, four of the 12 CFS subjects (WPI 1118, 1150, 1199 and 1125) included in the Science paper were also reported to have cancer – either lymphoma, mantle cell lymphoma or myelodysplasia. The presentation reported that 17 WPI repository CFS subjects with cancer had tested positive for XMRV. So how well are these CFS cases characterized, really?

The Erlwein study was published within 3 months after the first article. It is simpler in design and was reviewed in less then 3 days. They used whole blood instead of PBMC and performed nested PCR using another set of primers. This doesn’t matter a lot, if the PCR is sensitive. However, the sensitivity of the assay is not shown and the PCR bands of the positive control look very weak, even after the second round (think they mad a mistake in the legend as well: lane 9 is not a positive control but a base pair ladder, I presume). It also looked like they used a “molecular plasmid control in water”, but in the comments on the PLoS ONE paper, one of the authors states that the positive control WAS spiked into patient DNA.(Qetzel commenting to Pipeline Corante) Using this PCR none of the 186 CSF samples was positive.

Groom and van Kuppeveld studies
The two other studies use an excellent PCR approach[3,4]. Both used PBMC, van Kuppeveld used older cryoperserved PBMC. They first tried the primers of Lombardi using a similar nested PCR, but since the sensitivity was low they changed to a real time PCR with other optimized primers. They determined the sensitivity of the PCR by serially diluting a plasmid into PBMC DNA from a healthy donor. The limit of sensitivity equates to 16 and 10 XMRV-gene copies in the UK and the Dutch study respectively. They have appropriate negative controls and controls for the integrity of the material (GAPDH, spiking normal control cDNAs in negative DNA to exclude sample mediated PCR inhibition[1], phocine distemper virus[2]), therefore also excluding that cryopreserved PBMC were not suitable for amplification.

The results look excellent, but none of the PCR-samples were positive using these sensitive techniques. A limitation of the Dutch study is the that numbers of patients and controls were small (32 CSF, 43 controls)

Summary and Conclusion

In a recent publication in Science, Lombardi and co-authors from the WPI reported the detection of XMRV-related, a novel retrovirus that was first identified in prostate cancer samples.

Their main finding, presence of XMRV in peripheral blood cells could not be replicated by 3 other studies, even under sensitive PCR conditions.

The original Science study has severe flaws, discussed above. For one thing WPI doesn’t seem to adhere to the PCR to test XMRV any longer.

It is still possible that XMRV is present in amounts at or near the detection limit. But it is equally possible that the finding is an artifact (the paper being so inaccurate and incomplete). And even if XMRV was reproducible present in CFS patients, causality is still not proven and it is way too far to offer patients “diagnostic tests” and retroviral treatment.

Perhaps the most worrisome part of it all is the non-scientific attitude of WPI-employees towards colleague-scientists, their continuous communication via press releases. And the way they try to directly reach patients, who -i can’t blame them-, are fed up with people not taking them serious and who are longing for a better diagnosis and most of all a better treatment. But this is not the way.

Credits

*Many thanks to Tate (CSF-patient) for alerting me to the last Dutch publication, Q&A’s of WPI and the findings of Mrs Vernon.
- Ficoll blood separation. Photo [CC] http://www.flickr.com/photos/42299655@N00/3013136882/
- Nested PCR: ivpresearch.org

References

  1. Lombardi VC, Ruscetti FW, Das Gupta J, Pfost MA, Hagen KS, Peterson DL, Ruscetti SK, Bagni RK, Petrow-Sadowski C, Gold B, Dean M, Silverman RH, & Mikovits JA (2009). Detection of an infectious retrovirus, XMRV, in blood cells of patients with chronic fatigue syndrome. Science (New York, N.Y.), 326 (5952), 585-9 PMID: 19815723
  2. Erlwein, O., Kaye, S., McClure, M., Weber, J., Wills, G., Collier, D., Wessely, S., & Cleare, A. (2010). Failure to Detect the Novel Retrovirus XMRV in Chronic Fatigue Syndrome PLoS ONE, 5 (1) DOI: 10.1371/journal.pone.0008519
  3. Groom, H., Boucherit, V., Makinson, K., Randal, E., Baptista, S., Hagan, S., Gow, J., Mattes, F., Breuer, J., Kerr, J., Stoye, J., & Bishop, K. (2010). Absence of xenotropic murine leukaemia virus-related virus in UK patients with chronic fatigue syndrome Retrovirology, 7 (1) DOI: 10.1186/1742-4690-7-10
  4. van Kuppeveld, F., Jong, A., Lanke, K., Verhaegh, G., Melchers, W., Swanink, C., Bleijenberg, G., Netea, M., Galama, J., & van der Meer, J. (2010). Prevalence of xenotropic murine leukaemia virus-related virus in patients with chronic fatigue syndrome in the Netherlands: retrospective analysis of samples from an established cohort BMJ, 340 (feb25 1) DOI: 10.1136/bmj.c1018
  5. McClure, M., & Wessely, S. (2010). Chronic fatigue syndrome and human retrovirus XMRV BMJ, 340 (feb25 1) DOI: 10.1136/bmj.c1099
  6. http://scienceblogs.com/erv/2010/01/xmrv_and_chronic_fatigue_syndr_5.php
  7. http://scienceblogs.com/erv/2010/01/xmrv_and_chronic_fatigue_syndr_6.php
  8. http://scienceblogs.com/erv/2010/03/xmrv_and_chronic_fatigue_syndr_11.php
  9. http://www.cfids.org/xmrv/022510study.asp
Sensitivity of PCR screening for XMRV in PBMC DNA. VP62 plasmid was serially diluted 1:10 into PBMC DNA from a healthy donor and tested by Taqman PCR with env 6173 primers and probe. The final amount of VP62 DNA in the reaction was A, 2.3 × 10-2 ng, B, 2.3 × 10-3 ng, C, 2.3 × 10-4 ng, D, 2.3 × 10-5 ng, E, 2.3 × 10-6 ng, F, 2.3 × 10-7 ng or G, 2.3 × 10-8 ng. The limit of sensitivity was 2.3 × 10-7 ng (shown by trace F) which equates to 16 molecules of VP62 XMRV clone.







Follow

Get every new post delivered to your Inbox.

Join 610 other followers