We will start with a brief technical overview of Large Language Models and then discuss their impact on the theoretical sciences. We will summarize the results of a recent study, "TheoPhysEval" (https://arxiv.org/abs/2610.16733), where we evaluated AI agents on unsolved physics problems. The talk is aimed at initiating a broader discussion on how physics pedagogy and research must evolve in light of recent technological advances.