The story of how the data have been analyzed seems to include no small amount of drama. Pfizer, seeing an opportunity to both help battle a pandemic and demonstrate its research prowess, made decisions that were always likely to make its study the first of a Covid-19 vaccine to produce data — including its decision to have an independent group of researchers, known as a data safety and monitoring board, take an early look at the data in the 44,000-volunteer study before its completion.
The first analysis was to occur after 32 volunteers — both those who received the vaccine and those on placebo — had contracted Covid-19. If fewer than six volunteers in the group who received the vaccine had developed Covid-19, the companies would make an announcement that the vaccine appeared to be effective. The study would continue until at least 164 cases of Covid-19 — individuals with at least one symptom and a positive test result — had been reported.
That study design, as well as those of other drug makers, came under fire from experts who worried that, even if it was statistically valid, these interim analyses would not provide enough data when a vaccine could be given to billions of people.
In their announcement of the results, Pfizer and BioNTech revealed a surprise. The companies said they had decided not to conduct the 32-case analysis “after a discussion with the FDA.” Instead, they planned to conduct the analysis after 62 cases. But by the time the plan had been formalized, there had been 94 cases of Covid-19 in the study. It’s not known how many were in the vaccine arm, but it would have to be nine or fewer.
Gruber said that Pfizer and BioNTech had decided in late October that they wanted to drop the 32-case interim analysis. At that time, the companies decided to stop having their lab confirm cases of Covid-19 in the study, instead leaving samples in storage. The FDA was aware of this decision. Discussions between the agency and the companies concluded, and testing began this past Wednesday. When the samples were tested, there were 94 cases of Covid in the trial. The DSMB met on Sunday.
This means that the statistical strength of the result is likely far stronger than was initially expected. It also means that if Pfizer had held to the original plan, the data would likely have been available in October, as its CEO, Albert Bourla, had initially predicted.