METR reports that AI models are improving so quickly that current public data cannot rule out a drastic acceleration in AI research within the next few years. On well-defined coding and computational tasks, models already beat experienced professionals most of the time, though not top expert groups. METR also warns that common easy-to-run tests may overstate real-world performance, since developers train models in very similar test environments.
No score is assigned. Sources and their independence are shown in the citation chain below.