Space is becoming more crowded in Low Earth Orbit due to increased spaceactivity. Such a dense space environment increases the risk of collisionsbetween space objects endangering the whole space population. Therefore, theneed to consider collision avoidance as part of routine operations is evidentto satellite operators. Current procedures rely on the analysis of multiplecollision warnings by human analysts. However, with the continuous growth ofthe space population, this manual approach may become unfeasible, highlightingthe importance of automation in risk assessment. In 2019, ESA launched acompetition to study the feasibility of applying machine learning in collisionrisk estimation and released a dataset that contained sequences of ConjunctionData Messages (CDMs) in support of real close encounters. The competitionresults showed that the naive forecast and its variants are strong predictorsfor this problem, which suggests that the CDMs may follow the Markov property.The proposed work investigates this theory by benchmarking Hidden Markov Models(HMM) in predicting the risk of collision between two resident space objects byusing one feature of the entire dataset: the sequence of the probability in theCDMs. In addition, Bayesian statistics are used to infer a joint distributionfor the parameters of the models, which allows the development of robust andreliable probabilistic predictive models that can incorporate physical or priorknowledge about the problem within a rigorous theoretical framework andprovides prediction uncertainties that nicely reflect the accuracy of thepredicted risk. This work shows that the implemented HMM outperforms the naivesolution in some metrics, which further adds to the idea that the collisionwarnings may be Markovian and suggests that this is a powerful method to befurther explored.