AI-Text Detection Tools Are Easily Fooled

[{"selector":"#anim-6484fd35-d921-49fd-a6e9-101fb84113b2","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-9feb8f07-750f-4b33-9d34-0b4eb71bc4eb","keyframes":{"transform":["translate3d(0px, -565.62812%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-9363a313-a513-493c-b92d-5d354ba04132 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] – Within weeks of ChatGPT's launch, concerns arose about students using the chatbot to produce essays quickly.

[{"selector":"#anim-f8783aab-9fa2-4a13-9fa3-9a8d139494a8 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-a6d0ac9b-5295-4afb-8fb5-8c735b4a620b","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a967cc8b-468e-4b9e-835f-54edc1cad7e8","keyframes":{"transform":["translate3d(0px, -489.23618%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] – Startups responded to these concerns by developing products that claim to identify whether text was written by a human or an AI.

[{"selector":"#anim-751be32b-e12b-469d-90db-4bd08f4f0d30 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-9eb76025-0407-41a8-8aca-5ed1bb8630c0","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-83a5080e-9ba6-4f0d-b68b-6328ec63eac3","keyframes":{"transform":["translate3d(0px, -565.62812%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] – New research, yet to be peer-reviewed, reveals that these tools can be easily tricked and fail to detect AI-generated text.

[{"selector":"#anim-cd620419-78e1-47f1-8af3-216331d9be42 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-a75cffc0-d388-4629-82a9-fe504c52d6da","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8f6b0224-ab46-4113-a491-db3494c16118","keyframes":{"transform":["translate3d(0px, -437.48154%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] – Debora Weber-Wulff, a professor at HTW Berlin, collaborated with researchers from various universities to evaluate 14 detection tools, including Turnitin, GPT Zero, and Compilatio.

[{"selector":"#anim-71941f6d-cd83-489b-a881-db8a363256b8 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-3222ac16-0e66-4d4f-a663-7b5a196c8216","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-89cffda5-5bdc-4c58-b8d8-a27ff3e9edea","keyframes":{"transform":["translate3d(0px, -495.48619%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] – The majority of these tools rely on identifying AI-generated text characteristics, such as repetition, to determine the likelihood of text being AI-generated.

[{"selector":"#anim-8d5fc7a7-ba70-42c4-9cb7-11a4dca92168 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-01a3fb23-cb5a-4007-92a6-f17a410f0f30","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e445ca62-f8bf-42cd-9995-3e107c86b208","keyframes":{"transform":["translate3d(0px, -495.48619%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] – However, the study found that the tested tools struggled to detect ChatGPT-generated text that had been slightly rearranged by humans and obfuscated using a paraphrasing tool.

[{"selector":"#anim-f6b009cb-fbb4-4a9c-b57f-1b4f0f3163df [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-50.00000005846693%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-e83b40d3-4c8b-4296-931a-9d2665f820f1","keyframes":{"opacity":[0,1]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-10443dd3-ee61-4cfc-ab3f-6fc302dad3d2","keyframes":{"transform":["translate3d(0px, -573.10476%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":2600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] – This suggests that students can bypass the detectors by making slight modifications to the AI-generated essays.