4 comments

  • levocardia3 hours ago
    Accepting Bayesian methods for RCTs is great news and leading biostatisticians like Frank Harrell have been pushing for this change for many years. What I'm most interested to see: will this actually be implemented in practice, or will it be incredibly rare and niche, like Bayesian methods are currently in most biomedical fields?
    • nextos2 hours ago
      Regulators are generally really conservative. Spiegelhalter et al. already wrote a fantastic textbook on Bayesian methods for trial analysis back in 2004. It is a great synthesis, and used by statisticians from other fields. I have seen it quoted in e.g. DeepMind presentations.<p>Bayesian methods enable using prior information and fancy adaptive trial designs, which have the potential to make drug development much cheaper. It&#x27;s also easier to factor in utility functions and look at cost:benefit. But things move slowly.<p>They are used in some trials, but not the norm, and require rowing against the stream. This is actually a great niche for a startup. Leveraging prior knowledge to make target discovery, pre-clinical, and clinical trials more adaptive and efficient.<p>Journals are also conservative. But Bayesian methods are not that niche anymore. Even mainstream journals such as <i>Nature</i> or <i>Nature Genetics</i> include Bayesian-specific items in their standard submission checklists [1]. For example, they require you to indicate prior choice and MCMC parameters.<p>[1] <a href="https:&#x2F;&#x2F;www.nature.com&#x2F;documents&#x2F;nr-reporting-summary-flat.pdf" rel="nofollow">https:&#x2F;&#x2F;www.nature.com&#x2F;documents&#x2F;nr-reporting-summary-flat.p...</a>
      • aspenmartin2 hours ago
        Bayesian methods are incredibly canonical in most fields I’ve been involved with (cosmology is one of the most beautiful paradises for someone looking for maybe the coolest club of Bayesian applications). I’m surprised there are still holdouts, especially in fields where the stakes are so high. There are also plenty of blog articles and classroom lessons about how frequentist trial designs kill people: if you are not allowed to deviate from your experiment design but you already have enough evidence to form a strong belief about which treatment is better, is that unethical? Maybe the reality is a bit less simplistic but ive seen many instantiations of that argument around.
    • randycupertino44 minutes ago
      BOIN (Bayesian Optimal Interval) trial design is already very common in Phase I studies across therapeutic areas.<p>Biggest benefit I see from this guidance is support for rare disease trials, where patients are harder to find. Also regulatory bodies will be taking a closer look at stratification groups when it comes time for approval, so sponsors need to keep a super close eye on ensuring even enrollment and preventing misstrats.
    • brendanashworth2 hours ago
      If choosing a Bayesian approach in a clinical trial can reduce the number of recruited subjects, I would imagine the pharma industry is strongly incentivized to adopt it.
      • nerdponx2 hours ago
        Moreover you can manipulate your results by disingenuous prior choices, and the smaller sample you have the stronger this effect is. I am not sold on the FDA&#x27;s ability to objectively and carefully review Bayesian research designs, especially given the current administration&#x27;s wanton disregard for the public good.
        • ChadNauseam44 minutes ago
          I would think there is less opportunity to manipulate your results with bayesian methods than with frequentist ones. Because the frequentist methods don&#x27;t just require an alternate hypothesis, they depend on the exact set of outcomes possible given your experimental design. You can modify your experimental design afterwards and invisibly make your p-value be whatever you want
    • strangattractor3 hours ago
      Please watch <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;shorts&#x2F;2TWu_4gd-ik" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;shorts&#x2F;2TWu_4gd-ik</a><p>Been used since the 90s.
      • nerdponx2 hours ago
        The application of Bayesian <i>probabilistic reasoning</i> in general (as described in this video) is not the same thing as &quot;Bayesian statistics&quot; specifically, which usually to modeling and posterior inference using both a likelihood model and a prior model. It&#x27;s a very different approach to statistical inference both in theory and in practice. This creator himself is either ignorant of this distinction or is trying to mislead his viewers in order to dunk on the FDA. It&#x27;s obvious from the video comments that many people have indeed been misled as to what Bayesian statistics is and what the implications of its might be in the context of clinical trials.
        • levocardia16 minutes ago
          Indeed, even more broadly online &quot;Bayesian&quot; seems to have taken on the form of &quot;I know Bayes&#x27; Rule and think about base rates&quot; as opposed to &quot;Do you prefer jags or stan for MCMC?&quot;
  • hnthrowawayacct2 hours ago
    It&#x27;s an FDA guidance doc so you can expect to see this affecting new filings or supplemental filings for upcoming FDA submissions and clinical trial designs. This is good news, statistical plans are always a point of contention during trial design and the submission process. This guidance lays a line in the sand and will remove some of the reviewer-to-reviewer variance present in the current FDA staff.
    • randycupertino39 minutes ago
      &gt; This guidance lays a line in the sand and will remove some of the reviewer-to-reviewer variance present in the current FDA staff.<p><a href="https:&#x2F;&#x2F;www.statnews.com&#x2F;2026&#x2F;01&#x2F;13&#x2F;richard-pazdur-jpm-fda-chaos-at-agency-stat-event&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.statnews.com&#x2F;2026&#x2F;01&#x2F;13&#x2F;richard-pazdur-jpm-fda-c...</a><p>Recent comments during JPM don&#x27;t have me hopeful for smooth sailing at the FDA any time soon.<p>&gt; He said he was also deeply troubled by agency staff “being trampled on.” He referred to one individual who was “writing inflammatory emails using the F bomb,” telling center directors and deputy center directors that “they will go after them, that they were going to lose their jobs if they did not play ball.”<p>&gt; He would also not name this person. STAT has reported that employees have been fearful under Vinay Prasad, director of the Center for Biologics Evaluation and Research.<p>&gt; “It’s terrible to see 25 years of work dismantled,” said Pazdur, who founded the FDA’s oncology center. He later added, “I did not leave because I wanted to leave.”<p>&gt; “I think I have been consistently critical of parts of the FDA regardless of administration, but what’s emerged over the past few months is just reflective of complete and total disarray and a complete lack of functional leadership,” said Brian Skorney, an analyst at the investment bank Baird.
    • mft_2 hours ago
      &gt; This guidance lays a line in the sand and will remove some of the reviewer-to-reviewer variance present in the current FDA staff.<p>That would be nice, but my experience is there can be quite significant variability between reviewers in different teams&#x2F;groups, even on topics you&#x27;d think were well-established for many years, and for which there is existing FDA guidance.
  • esafak3 hours ago
    Anything noteworthy here? I noticed they did not mention causal inference.
    • levocardia15 minutes ago
      This is generally happening in the context of RCTs where valid causal inferences are (almost always) guaranteed via the study design, regardless of whether your analysis is frequentist or Bayesian.
  • OneEyeCyborg2 hours ago
    [dead]