Large language models (LLMs) exhibit unexpected difficulties with basic arithmetic, relying on a strategy termed 'heuristic hodgepodge' that combines various learned patterns rather than systematic reasoning. A recent study highlights these limitations and suggests that new training approaches are necessary for enhancing mathematical capabilities in AI.