autoresearch is an open-source framework by Andrej Karpathy that uses AI agents to autonomously run LLM pretraining experiments overnight on a single GPU. The agent modifies a single training file (train.py), runs 5-minute experiments, evaluates results via validation bits-per-byte (val_bpb), and iterates. The setup is Show more