Abstract
Trust in AI is undermined by the fact that there is no science that predicts-- or that can explain to the public -- when an LLM's output (e.g. ChatGPT) islikely to tip mid-response to become wrong, misleading, irrelevant ordangerous. With deaths and trauma already being blamed on LLMs, thisuncertainty is even pushing people to treat their 'pet' LLM more politely to'dissuade' it (or its future Artificial General Intelligence offspring) fromsuddenly turning on them. Here we address this acute need by deriving fromfirst principles an exact formula for when a Jekyll-and-Hyde tipping pointoccurs at LLMs' most basic level. Requiring only secondary school mathematics,it shows the cause to be the AI's attention spreading so thin it suddenlysnaps. This exact formula provides quantitative predictions for how thetipping-point can be delayed or prevented by changing the prompt and the AI'straining. Tailored generalizations will provide policymakers and the publicwith a firm platform for discussing any of AI's broader uses and risks, e.g. asa personal counselor, medical advisor, decision-maker for when to use force ina conflict situation. It also meets the need for clear and transparent answersto questions like ''should I be polite to my LLM?''