{"id":43119,"date":"2026-05-19T15:35:07","date_gmt":"2026-05-19T19:35:07","guid":{"rendered":"https:\/\/www.eng.ufl.edu\/news\/?p=43119"},"modified":"2026-05-19T15:35:08","modified_gmt":"2026-05-19T19:35:08","slug":"watching-the-detectors-researchers-probe-efficacy-and-danger-of-ai-detection-tools","status":"publish","type":"post","link":"https:\/\/www.eng.ufl.edu\/news\/research-innovation\/watching-the-detectors-researchers-probe-efficacy-and-danger-of-ai-detection-tools\/","title":{"rendered":"Watching the detectors: Researchers probe efficacy \u2013 and danger \u2013 of AI detection tools"},"content":{"rendered":"\n<ul class=\"wp-block-list has-light-gray-background-color has-background\">\n<li>A UF engineering professor says commercially available tools used to detect AI-generated text in scientific literature are ineffective. <\/li>\n\n\n\n<li>Recent media reports indicate a growing problem concerning AI-generated text, or AIGT, in scholarly publications.\u00a0 <\/li>\n\n\n\n<li>UF\u2019s Patrick Traynor, Ph.D., and colleagues examined the efficacy of AIGT detectors and found they are &#8220;poorly suited for deployment in academic or high-stakes contexts.\u201d\u00a0\u00a0<\/li>\n<\/ul>\n\n\n\n<p>Patrick Traynor, Ph.D., has questions.&nbsp;&nbsp;<\/p>\n\n\n\n<p>When the professor and interim chair of the University of Florida <a href=\"https:\/\/cise.ufl.edu\/\" target=\"_blank\" rel=\"noreferrer noopener\">Department of Computer &amp; Information Science &amp; Engineering<\/a> saw reports in the media positing that scientific literature is increasingly being generated by artificial intelligence, he wondered, \u201cHow do they know?\u201d&nbsp;&nbsp;<\/p>\n\n\n\n<p>Traynor knows the detectors that determine the presence of AI-generated text, known as AIGT, in publications are themselves AI systems. They use the same large language models, called LLMs, that less than honest researchers could be using to generate their text. &nbsp;<\/p>\n\n\n\n<p>How good could they be?&nbsp;<\/p>\n\n\n\n<p>Spoiler alert: They\u2019re not very good.&nbsp;<\/p>\n\n\n\n<p>In a paper to be presented at this week\u2019s <a href=\"https:\/\/sp2026.ieee-security.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">2026 IEEE Symposium on Security and Privacy<\/a>, Traynor and his co-authors assert that current AIGT detectors are not effective or robust tools for determining the presence of AI-generated text. The results, the researchers said, indicate that commercially available AIGT detectors are \u201cpoorly suited for deployment in academic or high-stakes contexts.\u201d&nbsp;&nbsp;<\/p>\n\n\n\n<p><a href=\"https:\/\/news.ufl.edu\/2026\/05\/traynor-ai-detector-study\/\">Read full story at news.ufl.edu<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>UF engineering professor Patrick Traynor, Ph.D. says commercially available tools used to detect AI-generated text in scientific literature are ineffective.<\/p>\n","protected":false},"author":9,"featured_media":43123,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"single-templates\/single-full-width-image.php","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"featured_post":"off","footnotes":"","_links_to":"","_links_to_target":""},"categories":[57,61],"tags":[301],"class_list":["post-43119","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-stories","category-research-innovation","tag-patrick-traynor"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/posts\/43119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/comments?post=43119"}],"version-history":[{"count":1,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/posts\/43119\/revisions"}],"predecessor-version":[{"id":43121,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/posts\/43119\/revisions\/43121"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/media\/43123"}],"wp:attachment":[{"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/media?parent=43119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/categories?post=43119"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.eng.ufl.edu\/news\/wp-json\/wp\/v2\/tags?post=43119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}