Investigators scoured more than 3,000 channels of video and telemetry data covering a very brief timeline of events – there were just 93 milliseconds from the first sign of anomalous data to the loss of the second stage, followed by loss of the vehicle. Because the failure occurred on the ground, investigators were also able to review umbilical data, ground-based video, and physical debris. To validate investigation analysis and findings, SpaceX conducted a wide range of tests at its facilities in Hawthorne, California and McGregor, Texas.”
The update provided more specifics on the failure mode of the COPV in the LOX tank, which caused the destruction of the entire rocket and payload – along with causing major damage to the SLC-40 pad at Cape Canaveral. The recovery of several COPV “bottles” from the debris has proved to be a major help in the investigation.
“The accident investigation team worked systematically through an extensive fault tree analysis and concluded that one of the three composite overwrapped pressure vessels (COPVs) inside the second stage liquid oxygen (LOX) tank failed. Specifically, the investigation team concluded the failure was likely due to the accumulation of oxygen between the COPV liner and overwrap in a void or a buckle in the liner, leading to ignition and the subsequent failure of the COPV,” added SpaceX.
“Each stage of Falcon 9 uses COPVs to store cold helium which is used to maintain tank pressure, and each COPV consists of an aluminum inner liner with a carbon overwrap. The recovered COPVs showed buckles in their liners. Although buckles were not shown to burst a COPV on their own, investigators concluded that super chilled LOX can pool in these buckles under the overwrap.
“When pressurized, oxygen pooled in this buckle can become trapped; in turn, breaking fibers or friction can ignite the oxygen in the overwrap, causing the COPV to fail. In addition, investigators determined that the loading temperature of the helium was cold enough to create solid oxygen (SOX), which exacerbates the possibility of oxygen becoming trapped as well as the likelihood of friction ignition.”
As part of the corrective process, SpaceX has opted to avoid its press towards super chilled LOX for the interim until they are confident they can redesign the COPVs to cope with the colder chill process.
“The investigation team identified several credible causes for the COPV failure, all of which involve accumulation of super chilled LOX or SOX in buckles under the overwrap. The corrective actions address all credible causes and focus on changes which avoid the conditions that led to these credible causes.
“In the short term, this entails changing the COPV configuration to allow warmer temperature helium to be loaded, as well as returning helium loading operations to a prior flight proven configuration based on operations used in over 700 successful COPV loads. In the long term, SpaceX will implement design changes to the COPVs to prevent buckles altogether, which will allow for faster loading operations. ”