{"679919":{"#nid":"679919","#data":{"type":"external_news","title":"How to evaluate the cognitive abilities of LLMs","body":[{"value":"\u003Cp\u003ELanguage models have become an essential part of the burgeoning field of artificial intelligence (AI) psychology. In an article published in\u0026nbsp;\u003Cem\u003ENature Human Behaviour\u003C\/em\u003E,\u0026nbsp;\u003Ca href=\u0022https:\/\/psychology.gatech.edu\/\u0022\u003ESchool of Psychology\u003C\/a\u003E Assistant Professor\u0026nbsp;\u003Ca href=\u0022https:\/\/psychology.gatech.edu\/people\/anna-ivanova\u0022\u003EAnna Ivanova\u003C\/a\u003E discusses 14 methodological considerations that can be used to design more robust, generalizable studies that evaluate the cognitive abilities of language-based AI systems, as well as to accurately interpret the results of these studies.\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp dir=\u0022ltr\u0022\u003ELanguage models have become an essential part of the burgeoning field of artificial intelligence (AI) psychology. In an article published in\u0026nbsp;\u003Cem\u003ENature Human Behaviour\u003C\/em\u003E,\u0026nbsp;\u003Ca href=\u0022https:\/\/psychology.gatech.edu\/\u0022\u003ESchool of Psychology\u003C\/a\u003E Assistant Professor\u0026nbsp;\u003Ca href=\u0022https:\/\/psychology.gatech.edu\/people\/anna-ivanova\u0022\u003EAnna Ivanova\u003C\/a\u003E discusses 14 methodological considerations that can be used to design more robust, generalizable studies that evaluate the cognitive abilities of language-based AI systems, as well as to accurately interpret the results of these studies.\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":"","uid":"36583","created_gmt":"2025-01-24 15:18:33","changed_gmt":"2025-01-27 13:37:19","author":"lvidal7","boilerplate_text":"","field_publication":"","publication":"Nature Human Behaviour","field_article_url":"","publication_url":"https:\/\/www.nature.com\/articles\/s41562-024-02096-z","dateline":{"date":"2025-01-15T00:00:00-05:00","iso_date":"2025-01-15T00:00:00-05:00","tz":"America\/New_York"},"extras":[],"groups":[{"id":"1278","name":"College of Sciences"},{"id":"443951","name":"School of Psychology"}],"categories":[{"id":"135","name":"Research"},{"id":"134","name":"Student and Faculty"}],"keywords":[{"id":"4896","name":"College of Sciences"},{"id":"167710","name":"School of Psychology"},{"id":"192863","name":"go-ai"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}