What can LLMs never do?

LLMs face limitations in playing certain games like Conway's Game of Life and struggle with reasoning tasks that require longer series of steps. They also exhibit the Reversal Curse, where their training data does not enable them to answer reverse-structured questions. However, with proper prompting and intermediate access to memory and computation, they can be trained to predict cellular automata to some extent.