This is a three-part story of heroism, intrigue, and ultimately treachery in the world of drug approval.
PART 1
Alex Tabarrok points me this weekend to a righteous rant about the FDA from psychiatrist Scott Alexander at Astral Codex Ten. After blasting them for several COVID-related decisions, he tells us about another example of FDA folly:
I worry that people are going to come away from this with some conclusion like “wow, the FDA seemed really unprepared to handle COVID.” No. It’s not that specific. Every single thing the FDA does is like this. Every single hour of every single day the FDA does things exactly this stupid and destructive, and the only reason you never hear about the others is because they’re about some disease with a name like Schmoe’s Syndrome and a few hundred cases nationwide instead of something big and media-worthy like coronavirus. I am a doctor and sometimes I have to deal with the Schmoe’s Syndromes of the world and every f@$king time there is some story about the FDA doing something exactly this awful and counterproductive. A while back I learned about cholestasis in infant Short Bowel Syndrome, a rare condition with only a few hundred cases nationwide. Babies cannot digest food effectively, but you can save their lives by using an IV line to direct nutrients directly into their veins. But you need to use the right nutrient fluid. The FDA approved one version of the nutrient fluid, but it caused some problems, especially liver damage. Drawing on European research, some scientists suggested that a version with fish oil would cause less liver damage — but the fish oil version wasn’t FDA-approved. A bunch of babies kept getting liver damage, and everyone knew how to stop it, but if anyone did the FDA would take away their licenses and shut them down. Around 2010, Boston Children’s Hospital found some loophole that let them add fish oil to their nutrient fluid on site, and infants with short bowel syndrome at that one hospital stopped getting liver damage, and the FDA grudgingly agreed to permit it but banned them from distributing their formulation or letting it cross state lines - so for a while if you wanted your baby to get decent treatment for this condition you had to have them spend their infancy in one specific hospital in Massachusetts. Around 2015 the FDA said that if your doctor applied for a special exemption, they would let you import the fish-oil nutritional fluid from Europe, but you were only able to apply after your baby was getting liver damage, and the FDA might just say no. Finally in 2018 the FDA got around to approving the corrected nutritional fluid and now babies with short bowel syndrome do fine, after twenty years of easily preventable state-mandated damage and death. And it’s not just this and coronavirus, I CANNOT STRESS ENOUGH HOW TYPICAL THIS IS OF EVERYTHING THE FDA DOES ALL THE TIME.
PART 2
Something about this didn't seem quite right to me, so I looked around for more details. Luckily, it turns out that Kathleen Gura, who was intimately involved in this case, got an award for her work and delivered an acceptance speech that provided lots of detail about how it all happened.¹ Here are the basics:
2002: Gura had a cancer patient that was having trouble with conventional nutrition delivered via tube. She called around for ideas, and everyone gave her the same advice—the patient just has to suck it up—except for one doctor, who had recently heard about a fish-oil based lipid emulsion from Sweden called Omegaven. Gura got emergency approval from the FDA to try it and then got some shipped over. It worked great.
2002: Gura was also involved with a team looking for ways to treat infant short bowel syndrome, which causes liver failure in some patients. Everyone suspected a toxin of some kind, but Gura convinced one doctor to do some mouse trials with Omegaven. It worked, but no one believed it. "Everyone knows it's not the lipids," she was told.
2004: Gura continued her mouse studies on the side but was unable to get funding for more serious research. Even the Swedish manufacturer had no interest in sponsoring additional research. However, one day a doctor expressed interest in using Omegaven on a child who had no other options. It worked.
2005: A few more babies were treated with Omegaven and had good results. The FDA suggested Gura apply for regular (non-emergency) investigational drug approval. She did and it was approved.
2006: Even so nobody was interested in publishing her results. After a dozen rejections, her paper was eventually published in Pediatrics.
2007: Gura started up a media war to persuade the manufacturer of Omegaven to release it in the US. They didn't want to, but succumbed after getting beaten up over it.
2007-12: Gura faced considerable opposition to her ideas, partly because she had never run a double-blind study. But she continued treating a few patients each year with Omegaven, and by 2012 it was on its way to becoming standard of care used by lots of hospitals around the country on an emergency basis. In 2012 the Swedish manufacturer finally submitted a New Drug Application to the FDA, but they asked for approval of Omegaven only as a treatment for liver disease. However, thanks to FDA guidance the NDA was changed to allow Omegaven to be used as a nutritional fluid that would prevent liver disease.
2014: A team in Hong Kong published the results of a double-blind study. It had been shut down early because the Omegaven group was so obviously doing better, but it was enough to convince the FDA that a randomized, controlled trial was not necessary. The FDA would instead accept pair-matched historical controls.
2018: Omegaven gets final approval from the FDA.
PART 3
Gura's narrative is wildly different from Alexander's. She mentions problems with testing; with funding; with publications; with the Swedish company itself; and with the medical community, which didn't accept her results. But the FDA was helpful. They provided emergency IDAs. They suggested she get a regular IDA. They caught a problem with the New Drug Application that would have severely limited Omegaven's usefulness. They accepted the results of the aborted Hong Kong study. And the time it took for FDA approval was not 16 years, but six years, since the manufacturer didn't even submit an application until 2012.
After I had written all this, I went back to Alexander's site and noticed that he had added an update. Several people wanted to know more about the Omegaven affair, so he provided a link to a post he had written about it. It starts like this:
I plucked that from the anti-FDA blogosphere, where it had been floating around for a while in various incarnations. I tried to check it before publishing, but only enough to confirm the basic outline.
Indeed. After getting the questions, he did some more research and it turns out that he relied for this research on exactly the same document I did: Kathleen Gura's speech. After a long summary he says, "There still have not really been any great large-scale studies proving that Omegaven works better than older nutrient fluids, though my impression is that everyone who uses it believes it does." That's not exactly great evidence for his thesis that Omegaven was a miracle drug caught in bureaucratic FDA hell.
Then Alexander admits some specific errors in his initial story but says, "Still, I think the basic structure was right — the new fluid was better than the old fluid, this was pretty clear in terms of miraculous recoveries, and it took 14 years between the first patient saved and full FDA approval."
This is headshakingly dense. As a hit on the FDA, his post wasn't right at all—not its basic structure and not anything else about it. He even admits that although Gura criticizes plenty of other actors, the FDA isn't one of them:
The FDA, in comparison, comes out looking pretty good. They approved the first few original single-patient exemptions to import Omegaven from Europe. They (eventually, after a lot of work) approved the Investigational New Drug application that let Boston Children’s Hospital keep using it (I’m still unclear whether any other hospitals got INDs for this). They even contributed a little funding to get one small study done. It wasn’t enough, but the FDA is not primarily a funding body, actual funding bodies dropped the ball on this one, and so it’s really impressive that the FDA went above and beyond to try to move Omegaven through the pipeline. Dr. Gura seems to have been left with the impression that the FDA was one of her few allies during this fight, which I think is fair.
I mentioned in a section of my recent post, “Sympathy For The Devil”, that I think the FDA as an agency is often quite good. They’re smart, caring people, and they usually carry out their mandate well — so well that the few exceptions, like aducanumab, are highly newsworthy. I have no objection to Dr. Gura’s mostly-positive portrayal of them.
This bears no resemblance—none—to the diatribe in Part 1:
Every single hour of every single day the FDA does things exactly this stupid and destructive....I am a doctor and sometimes I have to deal with the Schmoe’s Syndromes of the world and every f@$king time there is some story about the FDA doing something exactly this awful and counterproductive.
I have no idea how you can write "they usually carry out their mandate well" in one place and then, in your main post, just go ahead and repeat your original belief—backed by an example you know is wrong—that the FDA does stupid and destructive things on practically a daily basis.
This is why I'm automatically skeptical of anything on the web that's excessively critical of the FDA. It's not that I think the FDA is above reproach. It's because of the existence of the "anti-FDA blogosphere" that Alexander mentions. There is indeed an active clique of FDA critics in the blogosphere, mostly of a libertarian bent, who are willing to accept and pass around the most egregious stories imaginable of FDA incompetence. Occasionally they're true, but most often they're very highly exaggerated, like this one. Other times they're little more than urban legends.
The FDA has plenty of problems, and their critics have performed a useful service by pushing them to improve. That said, the FDA doesn't screw up every hour of every day on practically every useful drug ever presented to them. Even taking normal human frustration into account, that's inexcusable.
¹Note that throughout the text I'm using Gura as shorthand for "Gura and other people who were involved in getting Omegaven approved."
Thanks for the thoughtful commentary. I've published a response to this piece at https://astralcodexten.substack.com/p/contra-drum-on-the-fish-oil-story
Your 'response', such as it is, is not responsive to Kevin's specific points. Indeed, I notice that while Kevin includes direct quotes of what you said to back up his claims, you ... don't tend to do this. No, you prefer to substitute direct quotes of what was said with your 'interpretation' of what he said.
Also, you have the very ugly trait -- common to libertarians -- of never copping to an error on the grounds that doing so just gives your opponent more ammunition.
TL;DR: You are one of those types who insists on his privilege to insult us time after time after time. And since you don't seem to believe in scholarship or due diligence, well, who cares what you think? Take your libertoonian crap behaviour elsewhere.
extraordinary
I know, right? Do libertarians actually think they're fooling anybody when they resort to these sorts of rhetorical tactics? Or are they just telling each other campfire stories about what happened to some guy as told to them by another guy and how this completely 100% vindicates their world view: Libertarianism Uber Alles!!!!!
I'm guessing the latter, since justifiably no one pays them any account. Hence the sloppiness of their technique.
I include three quotes from Kevin:
"This is headshakingly dense. As a hit on the FDA, his post wasn't right at all — not its basic structure and not anything else about it. He even admits that although Gura criticizes plenty of other actors, the FDA isn't one of them...I have no idea how you can write "they usually carry out their mandate well" in one place and then, in your main post, just go ahead and repeat your original belief—backed by an example you know is wrong—that the FDA does stupid and destructive things on practically a daily basis. This is why I'm automatically skeptical of anything on the web that's excessively critical of the FDA. "
And:
"This is why I'm automatically skeptical of anything on the web that's excessively critical of the FDA. It's not that I think the FDA is above reproach. It's because of the existence of the "anti-FDA blogosphere" that Alexander mentions. There is indeed an active clique of FDA critics in the blogosphere, mostly of a libertarian bent, who are willing to accept and pass around the most egregious stories imaginable of FDA incompetence. Occasionally they're true, but most often they're very highly exaggerated, like this one. Other times they're little more than urban legends."
And:
"The FDA has plenty of problems, and their critics have performed a useful service by pushing them to improve. That said, the FDA doesn't screw up every hour of every day on practically every useful drug ever presented to them. Even taking normal human frustration into account, that's inexcusable."
Compared to Kevin including four quotes from me. I don't think that's a huge or inexcusable difference. Most of Kevin's article is a description of Dr. Gura's paper, which I already described at length elsewhere (Kevin acknowledges I already described it at length elsewhere, and links my description in this post). I think this is a fair amount of quoting Kevin's argument here. If Kevin believes I misrepresented him at any point, he's welcome to tell me so and I'll include a link to his claim.
Sigh. Learn. To. Read:
You do know what 'specific' means, don't you? Let me show you how it's done:
See that bolded part? Of course you did. But you didn't address this specific point. In fact, you doubled down saying that while you got the factual details supporting your thesis that Omegaven was a miracle drug, or the twin claim that it was it caught up in a bureaucratic FDA hell, you were still 'right', and that Omegaven really was a miracle drug and really was caught in bureaucratic FDA hell. There's too much wrong here to completely unpack, but since it's such a tired, hurtin' libertarian rhetorical ploy I'll mention it in particular: Bub, you don't get to unilaterally redefine the meanings of what are after all common words. No, federal, state, local, and private mandates to wear a mask isn't a loss of 'freedom', nor are they examples of maltreatment by the State on the order of Nazi concentration camps.
Now if you want to play nicely like the other kids and want them to have a favorable opinion of you and your words, I'd suggest you immediately clean up your act, starting with an apology for your very rude, very uncivil behaviour and then correcting those deficiencies in your arguments that I and several others have mentioned.
But -- Holy Crap! -- you think that freak Eliezer Yudkowsky is someone to listen to with respect. So, no, that's not going to happen, and you're going keep referring to Omegaven as a 'miracle drug' regardless of all the conversation that just transpired that showed it be somewhat less than that. IOW, yet another silly libertarian who refuses to budge from his talking points while all the while claiming they just want 'an honest discussion' ... and thinks that doing so is perfectly okay as a tactic.
You should also spend time research things. I'm a follower of both Kevin Drum and Scott Alexander.
Scott is not a libertarian per se. Like all of us here, his preference is for government to be the 'right' size (whatever that is) and, above all, efficient, efficacious, competent and compassionate.
He supports UBI as the main tool to deal with automation/AI emergence for example.
I must've missed something. Where exactly in this conversation did anyone say "federal, state, local, and private mandates to wear a mask are a loss of 'freedom', and examples of maltreatment by the State on the order of Nazi concentration camps"? Or are you replying to things you imagine the other person thinks?
In any case, since you mentioned masks I'd like to point out that in the beginning of the pandemic Scott Alexander was trying to convince people to wear masks indoors and did an extensive review of the literature (see https://slatestarcodex.com/2020/03/23/face-masks-much-more-than-you-wanted-to-know/), while the CDC was recommending against it (https://twitter.com/cdcgov/status/1233134710638825473).
Scott, you will NEVER make these people happy.
Their characteristics include
- inability to reason except backwards from the conclusion they have already formed
- inability to understand hypotheticals
- ongoing bad faith
- truly astonishing levels of ignorance
Kevin is none of these. But the loudest subset of his commenters is pure, undistilled woke.
The irony. It still burns.
Ok, so apart from the venom, which points is it that Scott doesn't engage in?
The blow-by-blow so far seems to be
1. Scott makes some points about how the FDA does awful things, and in the process makes some factual errors.
2. Kevin Drum (sorry; I'm not sure if he's a doctor or not, and I haven't read nearly enough of this blog to feel comfortable just saying "Kevin") responds by pointing out the factual errors and asserting that, the FDA has lots of problems, but that it's probably better than Scott asserts.
3. Scott responds to the response by accepting the criticism of his factual points, but re-asserting that the FDA does awful things, then explains more of his reasoning about why the factual criticism isn't fatal to this assertion.
I'm a bit confused about what you were expecting. Is there something Scott could have written that you wouldn't feel the need to respond with the accusation that he "never cop[s] to an error"?
Indeed, Scott is scrupulous in maintaining an "error page", documenting his past mistakes as a way to improve/sharpen his rational reasoning...
I have to say, I start giving a lot of side-eye to anybody who criticizes a scientific organization (which the FDA is) with talk about "common sense" and "the average guy on the street." Whoever said "common sense is merely the collection of prejudices acquired by age 18" was dead-on, and the average guy on the street knows f**k-all about science and medicine.
I also note the total lack of any specific proposals. If you want to abolish the FDA, what will replace it? If you want to reform the FDA, exactly what reforms do you propose?
Do you believe it's wrong that the FDA hasn't formally approved COVID vaccines yet?
If so, I think that's an example of you (an average guy on the street) knowing better than the FDA.
Do you believe that ketamine treats depression? If so, then that's an example of you (an average guy on the street) knowing better than the FDA (who still haven't formally approved it, no, esketamine doesn't count)
I realize that it sounds implausible that this can happen, but see my post at https://astralcodexten.substack.com/p/webmd-and-the-tragedy-of-legible for a discussion of why it's possible
Actually, I want to revise this response, because I don't think it gets at the key issue.
The claim isn't that the man on the street is smarter than some individual scientist or administrator at the FDA. It's that the kind of normal knowledge that normal people have is better than the kind of institutional knowledge the FDA uses.
By analogy, consider criminal trials. Sometimes everybody knows some guy (eg Al Capone) is a crime boss. But the justice system can't arrest or punish him, because the common knowledge doesn't work the same way as institutional knowledge (eg it's hard to bring Capone to trial and prove beyond a reasonable doubt that he committed a specific crime). So even though we all know he should be in prison, and even though justice system officials like police/prosecutors/detectives are smarter and more expert than we are, the justice system itself is unable to put him in prison, and its decision (keep him free) is stupider than our common sense one (lock him up).
In this case, there's a really good reason we make the justice system very conservative - we want to have a very strong bias against locking up innocent people, "better ten guilty men go free than one innocent person get convicted." We also want to make it harder for the government/police to lock up people just because they don't like them. All of this is correct.
The problem is the FDA uses similar logic - "better ten effective drugs get rejected, than one ineffective one get approved". And contra the criminal justice system, where imprisoning an innocent person is a huge rights violation, the FDA is erring on the side of denying people rights, and making us unable to respond to pandemics and diseases. When everyone knows a certain treatment would save lots of babies / prevent COVID, and the FDA bans them from getting it, that imposes a lot of cost without a counterbalancing need on the other side.
To return to my original point, just as detectives are smarter than you, but the justice system can still fail to implement plans that every common person knows are correct, so FDA doctors are smarter than you, but the FDA can still fail to implement plans that every common person knows are correct. I think the justice system should stay super-over-cautious but the FDA should loosen up.
Clap - Clap - Clap - Wild Applause!
Great Post Kevin.