First off, I have deliberately not read the entries on Fourteen Studies by fellow bloggers on SBM. I wanted to go through the information on the site myself. So if some of the information is repetitive, sorry.

Second, in the interest of openness and transparency, I will state my conflicts of interest up front: none. I have not talked to a drug rep in at least 20 years. Outside of a trip to San Francisco as a fellow, paid for by the company who was funding a drug study my boss was participating in, I have accepted no gifts or money of any kind from big (or little) pharma since I was a medical student. Nothing. I don’t even eat the pizza at conferences (1).

Third, I am a hospital based adult Infectious Disease doctor. I make zero money from vaccines. In fact, I only make money if people get sick with infections. For my bottom line, giving vaccines to prevent disease is counter productive to my bottom line.

Why 14 studies?

Fouteen Studies is child (8) of Generation Rescue, one of the autism organizations that, among other things, promotes a link between vaccines and autism. The web site opens with Amanda Peet, my favorite actress (2), who generated a brouhaha when she suggested that vaccines were safe. As the top of the home page of quotes:

“Fourteen studies have been conducted (both here in the US and abroad), and these tests are reproducible; no matter where they are administered, or who is funding them, the conclusion is the same: there is no association between autism and vaccines.”

Fourteen Studies refers to Ms. Peet as “Spokesperson for Sanofi Aventis, a vaccine manufacturer.” They imply she is a shill for big pharma. As best I can tell she is a spokesman for, a site by Every Child by Two.

Every Child By Two (ECBT) was founded by former First Lady Rosalynn Carter and former First Lady of Arkansas Betty Bumpers in 1991 as a result of the measles epidemic that killed nearly 150 people.

I am convinced. Whenever I think of Rosalyn Carter, I think evil incarnate. Don’t you?

Ms. Peet is a spokesman for Vaccinate Your Baby, which gets support from the vaccine maker sanofi pasteur.

Every Child By Two’s Vaccinate Your Baby campaign is made possible through an unrestricted, educational grant from sanofi pasteur (9).


Amanda Peet is generously volunteering her time to support this cause and does not receive compensation for her time and effort.

Anyone besides me think this is cheesy? But this site is more about implying financial impropriety and bias, than evaluation of science. Anyone mind if I continue the theme of being a financial shill?

The papers discussed at Fourteen Studies like the website, have some openness and transparency. Both at least let you know where the funding comes from (4).

Generation Rescue, like the Age of Autism website, is rife with advertisements yet nowhere can I find a statement of any financial conflicts of interest they might have. It is a small thing, but in the interest of openness and transparency, it would be nice to know how much they take in from advertisements, on line sales and speaking fees. Generation Rescue is a tax exempt charity, but I cannot find their financial statement on line. It would help put their position into context, at least as far as financial bias goes. Maybe its nothing.  Maybe it is a dollar a year, like what Apple pays Steve Jobs. Jobs appears to be doing OK. Maybe they make a good living from the proceeds.

Fourteen Studies often in its criticisms links to other sites that also do not mention any potential financial conflicts of interest. Which they probably don’t have. We all blog out of the intrinsic goodness of out hearts, after all. But when someone asks “Amanda Peet, How Much Are They Paying You?” on a web page with 12 sponsors and advertisers of autism treatments, the moral high ground slumps into the Marianas Trench.

(A later in the day addendum.  I found the 990’s. The founders of GR are paid nothing.  They spend the 400K a year they take in mostly on market research and advertising. No research. A breakdown of the source of income is not available).

What they do at the Fourteen Studies is rate each study (and there are more than 14 studies) with the following criteria, each worth up to 10 points: “Asked the Right Question,” “Conflict of Interest,” “Ability to Generalize,” and “Post-Publication Criticism.” 40 points would be the highest possible score. The highest score two studies received was a 5. Several received negative numbers suggesting either that those doing the scoring either did not know how to apply their own criteria, do not know how to correctly add together 4 positive numbers, or that the whole scoring system is bogus.

They say “We ranked all of the studies on a forty point scale.” Who the ‘we’ is who are doing the scoring is not mentioned. In each of the studies evaluated on the website, you know who did the work. Not fourteen studies. Transparency and accountability do not appear to be the strong suit of this site.

The first click to take you to the 14 studies gives a list of the studies and the only flaw they mention is the conflict of interest in each study. I have written before on this blog about the perils of funding and the results of clinical trials. It is not a trivial issue, but is, in and of itself, not a reason to dismiss a study. In the end the study has to rise and fall on the merits of its science and its reproducibility. Key concept. Reproducibility. The more a study is reproduced, the more reliable its underlying premise and the results.

The page does give the impression that there is a widespread, well funded, conspiracy between researchers, industry and government to suppress the truth about the side effects of vaccines.

Which is not true. As we all know that the REAL widespread, well funded, conspiracy between researchers, industry and government is suppress the truth about the Kennedy assassination. And man made global warming. And the Trilateral Commission. And the Holocaust. And UFO’s. And Big Foot. And Homeopathy. And Fluoridation. And the Loch Ness Monster. And and and and…

High quality studies take time and money to complete and are not easy to do. Someone has to do them, and the only people with the resources to fund biomedical research are the government and industry. Funding bias is a two edged sword, so if we look at the studies in peer reviewed, high impact journals funded by Generation Rescue we find, well, I can’t find any published studies Generation Rescue has funded. But if they do fund a published study that shows a link between autism and vaccines, by their own standards it will be suspect. Unless they are good guys, and so, as good guys, are resistant to funding bias. Of course, everyone thinks they are the good guy. Except me. I am totally prone to be influenced (1).

There is a page on the website called “Our Studies,” but they are not “their studies” because Generation Rescue is responsible for the studies, but because they support Generation Rescue’s position. That is the approach of Fourteen Studies: A good study is one that supports a vaccine/autism connection and a bad study is on that contradicts the connection. If, in the end, reality does not support your position and you do not change your opinion based on reality, then all you are left with is being a crank. I suspect that Generation Rescue is destined for crankdom.

None of “their studies”, save the Lancet MMR article by Wakefield, are high impact journals. Two studies were funded by Cure Autism Now Foundation. Does that invalidate them? Two are partially funded by the NIH? I thought the government were the Bad Guys. One (besides Wakefield’s) is by researchers who testify as experts on the damage caused by vaccines. Many do not mention conflicts of interest at all. Thanks to an apparent disregard for copyright/intellectual property (5), you can download all the references yourself from the fourteen studies website. Not that I would encourage you to do that. I got my copies through my hospital’s library.

In residency (and sometime beyond if you practice in a teaching hospital as I do) you have to suffer though, I mean, participate in Journal Club. In Journal Club an article is chosen and then carefully analyzed line by line. You look carefully for the strengths and weaknesses of the paper to learn how to read a paper critically. The one take home from years of participating in Journal Club is that all studies have flaws. All of them. Our studies and their studies are have flaws and bias. That is why most studies need to be repeated and all studies need to be taken in context. Clinical trials are messy and an individual study is rarely definitive.

Lets do a modified Journal Club with the 14 (actually 19) studies. These are all downloadable from Fourteen Studies, again, not that I suggest you violate copyright laws.

1) “Safety of Thimerosal-Containing Vaccines: A Two-Phased Study of Computerized Health Maintenance Organization Database”
Pediatrics, Thomas Verstraeten, MD (November 2003)
They gave it a 3. Their main issue with the paper was the politics and bias behind it. What about the science?

In this study they looked at HMO records of 124,170 infants for associations between neurodevelopemental disorders and thimerosal exposure. They then reevaluated the same disorders on another 16,717 children in another HMO. They found different associations between neurodevelopemental disorders and thimerosal exposures at the two HMO’s. And when it came to autism and attention deficit disorder, there were no increased risks that they could determine.

The discussion is a sober and reasonable evaluation of the potential confounding issues in the study that make it difficult to make a definitive statement that thimerosal does not cause autism. It is also one of those studies that makes your brain hurt trying to wrap your brain around it. In the conclusion they say “Although the lack of consistency between the 2 phases argues against a thimerosal effect, we believe that additional investigation is required.” It is typical of the calm, considered discussions found in all fourteen studies of the limitations of the study in question.

It is an article that demonstrates how difficult it is to tease out risk from a single exposure in a large population using epidemiology studies. The website suggests what is needed is a study that compares autism rates in vaccinated vrs unvaccinated children. Given the benefits of vaccines, such a study could never be ethically done. To deliberately randomize children to not getting vaccines would be immoral to do and impossible to get past an IRB.

That study will be possible in the future, thanks to the anti-vaccine and alternative vaccine schedule proponents. We will be able to compare disease, death and autism rates in vaccinated and unvaccinated populations. I predict that the unvaccinated group may have a slightly higher autism rate. If autism is mostly genetic, families where vaccines are not given due to prior autism cases will have more cases of autism when compared to vaccinated groups.

Where fourteen studies sees ethical malfeasance, I see a typical epidemiologic study. Messy, but helpful. It is one brick in the wall.

2) “Thimerosal and the Occurrence of Autism: Negative Ecological Evidence from Danish Population-Based Data”
Pediatrics, Kreesten M. Madsen, MD (September 2003)
According to fourteen studies, who gave it a 1, “Written by a Danish vaccine company, the study made a mockery of the data, a problem the authors themselves warned of. And, the CDC engineered the entire study. This one goes beyond useless, it was fraudulent to run the numbers this way, and they knew it.”

In this study they look at autism rates in Denmark during the use of thimerosal and after it was removed from the vaccines. The rates of autism diagnosis were stable during the thimerosal era and increased once thimerosal was removed. Suggesting that thimerosal is not associated with the development of autism (and maybe protective? (6)).

The mockery and fraud? I can’t mockery or fraud in the study. They recognise the confounding factors that both the criteria for diagnosis and the ability to find cases changed during the study period and may be a confounding variable.

I thought a nice study, and, for a retrospective epidemiologic study, fairly clean.

3) “Continuing Increases in Autism Reported to California’s Developmental Services System”
Archives of General Psychiatry, Robert Schechter, MD (January 2008) They gave it a 1.

“The entire study is based on the false premise that children’s vaccines no longer contain mercury. ” Not true. The premise was that mercury exposure declined over time.

This study looked at the prevalence of autism from 1995 to 2007. From 1999 to 2001, when most of the thimerosal was removed from the vaccine schedule, From 1995 to 2007 autism rates rose. Again, demonstrating that thimerosol is protective?

Another relatively clean and compelling epidemiologic study. The “Bad” studies that show an no association between vaccines and autism are all messy, as life is messy. They are several logs better than “Our” studies. The best study, a randomized, prospective, blinded trial can never ethically be done.

4) “Neuropsychological Performance 10 Years After Immunization in Infancy With Thimerosal-Containing Vaccines” Pediatrics, Alberto Eugenio Tozzi, Patrizia Bisiacchi (February 2009). A negative 2. It is concerning that the those at Fourteen studies can take a 0 to 10 scale and, after adding 4 positive numbers, get a negative number. Next thing you know, they will say a study that demonstrates no association between a vaccine and autism actually shows such an association (11). They gave it a negative two due to “such extreme fraud”

In medicine, there is a dose response curve. More drug, more effect, less drug, less effect. The assumption, reasonable outside of the world of homeopathy, is that if groups of kids who get less thimerosal (62.5 mcg) are compared to kids who had more thimerosal, (137.5 mcg), there should be a less toxicity in the group that received less thimerosal.

Not so in this study. There was (mostly) no difference in the two groups.

“Nearly 70% of the invited subjects participated in the neuropsychological assessment (N = 1403). Among the 24 neuropsychological outcomes that were evaluated, only 2 were significantly associated with thimerosal exposure. Girls with higher thimerosal intake had lower mean scores in the finger-tapping test with the dominant hand and in the Boston Naming Test.”

And the association could have been due to chance as often happens in studies that look at multiple endpoints. Natural noise in biologic outcomes results in the occasional outlier looking significant. It is why studies need to be reproduced.

The Italians had only one autism case in the study, so, while interesting on the potential for other neurotoxicities from thimerosal, it does not directly address the issue of autism. But extreme fraud? Nope. I can’t find any. I half expect Fourteen studies to say “The CDC is infested with Vaccinationists. I have here in my hand a list of 205—a list of names that were made known to the Secretary of Health as being members of the Vaccinationist Party and who nevertheless are still working and shaping policy in the CDC (9).”

5) “Autism and Thimerosal-Containing Vaccines: Lack of Consistent Evidence for an Association”
American Journal of Preventive Medicine, Paul Stehr-Green, DrPh, MPH (August 2003). A zero score.

In this study they “compared the prevalence/incidence of autism in California, Sweden, and Denmark with average exposures to Thimerosal- containing vaccines.”
They found that as the use of thimerosal declined, the rates of autism rose in all three areas. The Swedes have much less autism than the US, whether real or diagnosed, I cannot say, but the results are as compelling as epidemiologic data gets. And there is a pattern in the studies.

6) “Thimerosal Exposure in Infants and Developmental Disorders: A Prospective Cohort Study in the United Kingdom Does Not Support a Causal Association” Pediatrics, John Heron and Nick Andrews, PhD (September 2004). This study received a -4, the worst score and worst addition in the group. Why the low score?

They looked at 14,000 kids, when they received a vaccine, then calculated the amount of thimerosal they received, and were “compared with a number of measures of childhood cognitive and behavioral development covering the period from 6 to 91 months of age.” They did not specifically look at autism.

Annoying for Fourteen studies, and perhaps the real reason it received a -4, is the explicitly stated result that the exposure of thimerosal was beneficial:

“Contrary to expectation, it was common for the unadjusted results to suggest a beneficial effect of thimerosal exposure. For example, exposure at 3 months was inversely associated with hyperactivity and conduct problems at 47 months; motor development at 6 months and at 30 months; difficulties with sounds at 81 months; and speech therapy, special needs, and “statementing” at 91 months.”

So mercury is good for you? I doubt it. It demonstrates the difficulties in retrospective epidemiologic studies, that occasionally the data has what are probably not real results. To be believed, it need to be reproduced.
How about adverse effects from thimerosall? No.

“We could find no convincing evidence that early exposure to thimerosal had any deleterious effect on neurologic or psychological outcome when given according to an accelerated schedule.”

Anyone besides me noticing a pattern here? Epidemiologic studies, all coming at a problem from a different angle, all with the same result. Of course, the same result is what you would expect from a high level conspiracy.

7) “Early Thimerosal Exposure and Neuropsychological Outcomes at 7 to 10 Years”
New England Journal of Medicine, Thompson WW et al. (September 27, 2007). Highest score with a 5 out of 40. No one, not even Fourteen studies, would dis the NEJM. It is not that different from study 4 that received a -2.

They looked at “1047 children between the ages of 7 and 10 years and administered standardized tests assessing 42 neuropsychological outcomes. (We did not assess autism-spectrum disorders) ” and how much thimerosal they received in vaccines. They found that mercury exposure in vaccines was probably not a neurotoxin.

“The weight of the evidence in this study does not support a causal association between early exposure to mercury from thimerosal containing vaccines and immune globulins administered prenatally or during infancy and neuropsychological functioning at the age of 7 to 10 years. The overall pattern of results suggests that the significant associations may have been chance findings stemming from the large number of statistical tests that we performed. “

8) “Association Between Thimerosal-Containing Vaccine and Autism”
Journal of the American Medical Association, Anders Hviid, MSc (October 2003). A score of 1.

The study looked at all children born in Denmark from 1990 and 1996 and found no difference in the rates of autism in kids vaccinated with vaccines that contained thimerosal and those that were vaccinated with vaccines that did not contain thimerosal.

As best they could tell, no relation between thimerosal and autism. They also found that as the use of thimerosal declined, the rates of autism increased.

The data was reanalyzed by Safe Minds on the assumption that cases of autism were lost and if that was factored in, autism rates declined when thimerosal was removed. The authors disagreed with this approach, and, in an exchange in the letters sections of JAMA (curiously not mentioned at 14 studies) said they checked with the source of the data, that the numbers used were not prevalence measurements, and that cases were not lost, invalidating the analysis of Safe Minds (3).

9) “Mercury concentrations and metabolism in infants receiving vaccines containing thimerosal: A descriptive study”
The Lancet, Michael Pichichero, MD (November 2002). Rated zero.

An interesting study that looked at mercury levels in children who received thimerosal containing vaccines and compared it to mercury blood levels in children who received thimerosal free vaccines. The mercury in the blood of the vaccine children was about twice that of controls, but well with in what is considered safe. And 12 of the samples in the vaccine group had no detectable mercury. It does not address the issue as to whether near homeopathic blood levels of mercury are associated with autism, but is an interesting basic science. I would, as mentioned above, expect a dose response effect of mercury and, if the levels after vaccine are low to undetectable after vaccine, I would be skeptical, on the basis of basic pharmakotoxicity, that mercury is a cause of autism.

Fourteen studies take? “One of the sillier studies ever performed, and the lead author is a vaccine patent-holder, no less. Absurd that this study appears on lists of studies exploring the relationship of vaccines to autism, as it doesn’t even address the topic. More absurd is the author’s complete misunderstanding of how mercury is excreted from the body.”

I can’t see why this is silly. If you are to understand how ethylmercury is toxic, in part you need to understand its pharmakokinetics, how it is excreted and where it goes in the body. Which is what this study investigated and reported.  Based on the critics, I imagine they would only be satisfied if brain biopsies were done to measure mercury level in the CNS.  If you think the return of polio is ok, probably a brain biopsy would not be so bad (12).

10)  “Thimerosal and Autism?” Pediatrics, Karen Nelson, MD (March 2003). Rated zero.

A nice review that concludes, based on 60, yes 60 (when I count postive numbers, I get a postive number), which, in my world of numbers, is greater than 14, papers that there is no link between thimerosal and autism.

11) “Lack of Association Between Rh Status, Rh Immune Globulin in Pregnancy and Autism”
American Journal of Medical Genetics, Judith H. Miles and T. Nicole Takahashi (May 2007). Another zero.

Looks at whether Rh Immune Globulin, which contains thimerosal, is associated with autism. It isn’t. While not a vaccine, it is a mercury exposure, and does concern the issue as to whether or not thimerosal is toxic.

That’s the 11 articles that address thimerosal and autism. A very compelling series of articles that, when taken as a whole, are convincing that there is no relation between mercury and autism. I had read the articles piecemeal before, but, like evolution, when read in total, are an excellent argument that thimerosal is not associated with autism.

Lets move on to the 7 articles concerning MMR and autism

Wakefield had a study published in Lancet titled ” Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children,” that has had some issues.

This study demonstrated that “Onset of behavioral symptoms [autism] was associated, by the parents, with measles, mumps, and rubella vaccination [MMR] in eight of the 12 children, with measles infection in one child, and otitis media in another…We identified associated gastrointestinal disease and developmental regression in a group of previously normal children, which was generally associated in time with possible environmental triggers.”

The response of fourteen studies is that “This relatively straightforward conclusion, that the MMR may in fact be related to autism, set off a worldwide controversy and a mini-industry of bogus scientific reports trying to refute the idea that MMR and autism are related. You will see many of the studies below.”

If true, the Wakefield needs to be reproduced, if not true, that also needs to be determined. The first study that looked at high dose steroids and sepsis showed benefit. Multiple subsequent studies (or should I say a mini-industry of bogus scientific reports trying to refute the idea that steroids were helpful) showed harm and no benefit. A typical and annoying feature of the medical literature is differing results. It is why it is important to consider both biologic plausibility and the results of the preponderance of studies.

The following studies, unlike the Wakefield study, are bogus. Hm.

12) “Lack of Association Between Measles Virus Vaccine and Autism with Enteropathy: A Case-Control Study”
PLoS One, Mady Hornig, Thomas Briese T, et al. (September 2008). Rated 1.

The secret to believable medical information is reproducibility. Cold fusion died because no one can reproduce it. So an association between MMR and autism will have to be reproduced to be compelling.

They tried, in part, to repeat the Wakefield study, They did not get the same results. “However, it made one critical distinction from the Wakefield approach: it didn’t recruit for the subset of children with autism who regressed after MMR vaccination.” Evidently, neither did Wakefield.

“The sample was an age-matched group of US children undergoing clinically-indicated ileocolonoscopy. Ileal and cecal tissues from 25 children with autism and GI disturbances and 13 children with GI disturbances alone (controls) were evaluated by real-time reverse transcription (RT)-PCR for presence of MV RNA in three laboratories blinded to diagnosis, including one wherein the original findings suggesting a link between MV and ASD were reported. The temporal order of onset of GI episodes and autism relative to timing of MMR administration was examined. We found no differences between case and control groups in the presence of MV RNA in ileum and cecum. Results were consistent across the three laboratory sites. GI symptom and autism onset were unrelated to MMR timing.”

This study had the advantage over the Wakefield study in that the data was not made up or falsified.

13) “MMR Vaccination and Pervasive Developmental Disorders: A Case-Control Study” The Lancet, Liam Smeeth, MRCGP, Eric Fombonne, MD (September 11, 2004). Rated a 2.

In medicine, if you want to see if there is a risk of disease in a population, you do a case control study. The two groups differ in (hopefully) one variable. In this study they compared “1294 cases and 4469 controls were included. 1010 cases (78·1%) had MMR vaccination recorded before diagnosis, compared with 3671 controls (82·1%) before the age at which their matched case was diagnosed.”

They could find no association between the MMR and autism. Fourteen studies argues that the MMR causes regression of autism, which was not the point of the study, and therefore the study is no good because it looked at the ‘wrong’ question. It is an easy and typical criticism throughout Fourteen studies: the study looked for and found no association using a given methodology. The study is no good because it didn’t look at the information Fourteen studies thought it should. Given that most studies try for a narrow focus, there will always be a component not evaluated. A common straw man argument throughout the website.

Within the context of the study, it is reasonable to conclude that the MMR is not associated with developing autism.

14) “Pervasive Developmental Disorders in Montreal, Quebec, Canada: Prevalence and Links With Immunizations”
Pediatrics, Eric Fombonne, MD (July 2006). Another issue with addition, it is rated -2.

The negative number may come from the finding that “The prevalence of pervasive developmental disorder in thimerosal free birth cohorts was significantly higher than that in thimerosal-exposed cohorts (82.7 of 10 000 vs 59.5 of 10 000).” Curious we now have several studies that showed thimerosal to be protective. Ouch.

To add insult to injury, they also found

“Pervasive developmental disorder rates significantly increased when measles-mumps-rubella vaccination uptake rates significantly decreased. In addition, pervasive developmental disorder prevalence increased at the same rate before and after the introduction in 1996 of the second measles-mumps-rubella dose, suggesting no increased risk of pervasive developmental disorder associated with a 2–measles-mumps-rubella dosing schedule before age 2 years.”

Now I feel like Truedeau. The vaccination information THEY don’t you to know: MMR and thimerosal are protective for developing autism.

They derived this information looking at 27,000 kids, 180 of whom had a pervasive developmental disorder, including autism and comparing rates of autism (which went up) with thimerosal and MMR use (both of which went down).

15) “No Evidence for a New Variant of Measles-Mumps-Rubella-Induced Autism”
Pediatrics, Eric Fombonne, FRCPsych (October 2001). A one rating.

Their insightful analysis of the article starts “What is it with Eric Fombonne and Pediatrics? ” I do not think they approve of Fombonne. Next they will accuse him for something he didn’t do (11).  Not a sign of compelling science analysis and they do not give a reason for the 1 rating, the link takes one to another site for analysis. Suggesting again a mini-industry of bogus scientific ratings trying to refute the idea that MMR and autism are not related.

This study, with small numbers, compared 96 children with MMR and autism to data from other studies of children with autism before and after an MMR. Not the most compelling of methodological design (more cases are always better, especially if looking for very rare events) and looked to support 6 hypothesis:

“1. Childhood disintegrative disorder might have become more frequent;
2. The mean and distribution of age at which parents become concerned has changed and is closer to the mean immunization age than in children who were not exposed to MMR;
3. Regression in the development of children with autism has become more common;
4. The age of onset of symptoms for autistic children with regression clusters around the immunization date and is different from that of autistic children without regression;
5. Children with regressive autism may have distinct symptom and severity profiles; and
6. Regressive autism is associated with gastrointestinal symptoms, and children with regressive autism may exhibit increased frequency of inflammatory bowel disorders. “

Their data comparisons did not support any of the above. Not the most convincing data set, but in the context of the above studies, ok conclusions.

16) “No effect of MMR withdrawal on the incidence of autism: a total population study”
Journal of Child Psychology and Psychiatry, Hideo Honda, Michael Rutter. A five.

Highest score in the group. Why?

We gave this study our highest score because it appears to actually show that MMR contributes to higher autism rates.
The key phrase in the whole site. Data that supports their position is good, data that doesn’t is bad. What makes a study good is not its methodology or its rigor, but if it supports vaccines casing autism. Bass Ackwards thinking.
The position that vaccines cause autism is determined, then you look for data that supports the position. When you read the studies, they do not support the position that the MMR is associated with autism.

It is doubly odd in that the paper’s conclusion is that

“The MMR vaccination rate in the city of Yokohama declined significantly in the birth cohorts of years 1988 through 1992, and not a single vaccination was administered in 1993 or thereafter. In contrast, cumulative incidence of ASD up to age seven increased significantly in the birth cohorts of years 1988 through 1996 and most notably rose dramatically beginning with the birth cohort of 1993.”
Remember reference 4? Foreshadowing.

In Yokohama they gave ZERO MMR’s after 1993. Zip. The result?

Kind of hard to argue that MMR leads to autism when autism rates continue to increase after no more MMR is given. One explanation link as to why black is really white leads to ‘404 not found error,’ the other links to a web page where, as best I can gather, they argue that the MMR withdrawal lead to a decrease in autism because there was actually an increase in autism due to increase in the use of Japanese encephalitis and single measles vaccines. Which demonstrates that the increased autism rates that followed MMR removal were a decline in autism rates. I may have that wrong. Read it and let me know. Maybe the 404 site explained it better.

17) “Measles Vaccination and Antibody Response in Autism Spectrum Disorders”
Archives of Disease in Childhood, Gillian Baird (February 2008). Rated a one, they must have become distracted in the MMR section as they do not give a breakdown of how the score was derived for the last five studies.

They looked at antibody to measles as a result of MMR in autism cases and controls and found no correlation. This one study adds little to the data. It supports the lack of correlation between MMR and autism, but the last study is far more compelling.

18) “Neurologic Disorders After Measles-Mumps-Rubella Vaccination”
Pediatrics, Annamari Makela, MD (November 2002). Another zero without reason.
This study looked at 535, 544 children for neurologic events after MMR. It was more to look at encephalitis and meningitis, which were not increased as a result of the vaccine. Autism was not also seen, but, as legitimately pointed out (the one and only legitimate sentence in the whole web site) “it used “hospitalizations” as a criteria for finding children with autism.” Not a good way to find autism cases, I agree.

The last paper in the group,
Association of Autistic Spectrum Disorder and the Measles, Mumps, and Rubella Vaccine”
Archives of Pediatrics & Adolescent Medicine, Eric Fombonne, FRCPsych (July 2003) is a structured review of 28 papers that fails to demonstrate a relationship between the MMR and autism.

This is really odd. Their ‘headline’ is “Fombonne again.”
But the authors of this reference are Kumanan Wilson, MD, MSc, FRCP(C); Ed Mills, DPH; Cory Ross, MSc, DPH, CHE; Jessie McGowan BMus, MLIS; Alex Jadad MD, DPhil, FRCP(C). I cut and pasted it from the reference.

For posterity’s sake, here is a screenshot before they change it:

Are they even reading the damn articles?
The full title of the article is “Association of Autistic Spectrum Disorder and the Measles, Mumps, and Rubella Vaccine
A Systematic Review of Current Epidemiological Evidence.”

The key words, left out by Fourteen studies, are ” Systematic review.” For those who do not have to read the medical literature (bold added by me),

“Systematic reviews are scientific investigations in themselves, with pre-planned methods and an assembly of original studies as their “subjects.” They synthesize the results of multiple primary investigations by using strategies that limit bias and random error. These strategies include a comprehensive search of all potentially relevant articles and the use of explicit, reproducible criteria in the selection of articles for review. Primary research designs and study characteristics are appraised, data are synthesized, and results are interpreted.”

“A systematic review involves the application of scientific strategies, in ways that limit bias, to the assembly, critical appraisal, and synthesis of all relevant studies that address a specific clinical question. (7)”

A well done Systematic review is more that a review, it is a valuable, if less than perfect, way to evaluate a literature that tries to correct for bias and for variation in study methodologies.

Finally, if you want another excellent (free) review, try Vaccines and Autism: A Tale of Shifting Hypothesis.

I read over 100 or so journal articles a month just for my Infectious Disease podcast. Plus those I read for patient care, for general interest, for the blogs. They are of variable quality, from the ground breaking to the incomprehensible. The ‘bad’ references on the fourteen studies site are by and large pretty good, especially given the methodologic, logistic and ethical problems in doing large epidemiologic studies.

In medicine, as in all of science, no single study is definitive. Epidemiologic studies in medicine are particularly messy, and researchers never do a perfect study. I am always impressed with the ingenuity and hard work on the part of epidemiologists to get good information out of complicated and incomplete data sets. You have to read all the studies in context of biologic plausibility, the flaws in a given study, reproducibility, and, yes, the financial bias of the researcher.

I would like to thank the Fourteen studies for their website. Anyone who takes the time to read all the articles will come away convinced of the safety of both thimerosal and the MMR vaccine, especially in contrast to the quality of ‘our’ studies that purport a causation. The moving target of the cause of autism appears to be shifting to aluminum and too much too soon. I’m skeptical on biologic plausibility grounds. I am as certain as I can be (i.e. I am one, preferable more, high quality studies in a high impact journal from changing my mind) that the vaccines, both separately and together, are many logs safer than the diseases they prevent.

Now I get to read the other blog entries on the topic. About time.



*I love the movie 28 Days Later and its sequel. Something about fast, mindless, infected zombies running amok, producing more mindless zombies with the resultant body count appeals to me. I didn’t care for Shawn of the Dead, which didn’t work as either a comedy or a zombie movie for me. But do read World War Z if you are a zombie fan.

(1) Not that I do not want to sell my soul. I do. I just set the price higher than most want to pay.

(2) In the spirit of transparency, I will admit she isn’t. A review of the Internet Movie Database suggests I have never seen her perform, but most movies I see are with my 11 year old and are animated.

(3) JAMA letters Vol 291, No 2, page 181

(4) Not enough for my taste, but I am a crank on the topic. I think everyone should have to list, in dollar amounts, all direct and indirect (travel, food etc) support they receive if they give CME accredited lectures or publish in journals

(5) I can’t download the Lancet references with paying first. I doubt the publishers will complain as it would look like they are in cahoots with Big Pharma to suppress information.

(6) I don’t really think that. It is what the data would suggest, but I can’t really see the plausibility.


(8) A child evidently vaccinated against reality.

(9) They do not capitalize their title, very hip edgy. For a drug company. To be really Web 2.0 it needs a random capital and a vowel removal: snoFi psTeur.

(10) Modified from Joseph McCarthy, US Senator.

(11) A literary device called foreshadowing.

(12) “I do believe sadly it’s going to take some diseases coming back to realize that we need to change and develop vaccines that are safe. If the vaccine companies are not listening to us, it’s their f___ing fault that the diseases are coming back. They’re making a product that’s s___. If you give us a safe vaccine, we’ll use it. It shouldn’t be polio versus autism.”,8599,1888718,00.html



  • Mark Crislip, MD has been a practicing Infectious Disease specialist in Portland, Oregon, from 1990 to 2023. He has been voted a US News and World Report best US doctor, best ID doctor in Portland Magazine multiple times, has multiple teaching awards and, most importantly,  the ‘Attending Most Likely To Tell It Like It Is’ by the medical residents at his hospital. His multi-media empire can be found at

    View all posts

Posted by Mark Crislip

Mark Crislip, MD has been a practicing Infectious Disease specialist in Portland, Oregon, from 1990 to 2023. He has been voted a US News and World Report best US doctor, best ID doctor in Portland Magazine multiple times, has multiple teaching awards and, most importantly,  the ‘Attending Most Likely To Tell It Like It Is’ by the medical residents at his hospital. His multi-media empire can be found at