Abstract
Messenger RNA-based medicines hold immense potential, as evidenced by theirrapid deployment as COVID-19 vaccines. However, worldwide distribution of mRNAmolecules has been limited by their thermostability, which is fundamentallylimited by the intrinsic instability of RNA molecules to a chemical degradationreaction called in-line hydrolysis. Predicting the degradation of an RNAmolecule is a key task in designing more stable RNA-based therapeutics. Here,we describe a crowdsourced machine learning competition ("StanfordOpenVaccine") on Kaggle, involving single-nucleotide resolution measurements on6043 102-130-nucleotide diverse RNA constructs that were themselves solicitedthrough crowdsourcing on the RNA design platform Eterna. The entire experimentwas completed in less than 6 months. Winning models demonstrated test seterrors that were better by 50% than the previous state-of-the-art DegScoremodel. Furthermore, these models generalized to blindly predicting orthogonaldegradation data on much longer mRNA molecules (504-1588 nucleotides) withimproved accuracy over DegScore and other models. Top teams integrated naturallanguage processing architectures and data augmentation techniques withpredictions from previous dynamic programming models for RNA secondarystructure. These results indicate that such models are capable of representingin-line hydrolysis with excellent accuracy, supporting their use for designingstabilized messenger RNAs. The integration of two crowdsourcing platforms, onefor data set creation and another for machine learning, may be fruitful forother urgent problems that demand scientific discovery on rapid timescales.