NeurIPS 2026 · Evaluations and Datasets Track

CogArena

A benchmark for testing AI agents on behavioral experiments.

An agent drives a browser through CogArena's jsPsych tasks, and the resulting trial data are scored for completion, accuracy, and behavioral signatures.
Fig. 1 CogArena tests AI agents on behavioral experiments through a web browser. Agents must interpret visual stimuli and provide responses, just like a participant in an experiment might.

Try it yourself

Experience the same experiments that AI agents take. Your responses are not scored.

Leaderboard

Agent performance ranked by composite score, averaged over repeated runs of each task.

#ModelCompositeL1L2L3
Loading…
Full leaderboard →

Citation

Fernandez, K., Chen, C., Zhou, J., Sadowski, B., Miceli, A. C., & Krajbich, I. (2026). CogArena: Benchmarking multimodal agents on interactive behavioral experiments. NeurIPS 2026, Evaluations and Datasets Track. arXiv:2610.36484

BibTeX
@inproceedings{cogarena2026,
  title         = {{CogArena}: Benchmarking Multimodal Agents on Interactive Behavioral Experiments},
  author        = {Fernandez, Kiant{\'e} and Chen, Caitlin and Zhou, Jialu and Sadowski, Bartek and Miceli, Anthony C. and Krajbich, Ian},
  booktitle     = {Advances in Neural Information Processing Systems (NeurIPS 2026), Evaluations and Datasets Track},
  year          = {2026},
  eprint        = {2610.36484},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  url           = {https://arxiv.org/abs/2610.36484}
}