News and views about philosophy, the academic profession, academic freedom, intellectual culture, and other topics. The world’s most popular philosophy blog, since 2003.
My experience on Pangram is that it does not (seem to) give many false positives, but that it does allow…
Professor Halbach raises three concerns. One is about the availability of PDFs of OUP monographs. Another is about version discrepancies…
I should clarify that this was the conclusion of university counsel as a matter of policy as well. But of…
I have no expertise in this, but i have been looking for such a program for student papers. My understanding…
I just tried Pangram out as a test. I uploaded two chunks of text that were almost entirely AI-generated using…
Pangram’s outputs match my judgment about whether something is AI more reliably than any other tool’s. It is the most…
Not selling PDF versions of books, or shifting to HTML-only versions for web access, will do absolutely nothing to prevent…
A reader calls my attention to this article about Pangram. Curious to hear from readers about their experiences with AI-writing detection programs, whether Pangram, or others.
Pangram’s outputs match my judgment about whether something is AI more reliably than any other tool’s. It is the most widely respected “is this AI?” tool I know of, and my first choice when I want a second opinion (or to evaluate something I haven’t read).
My job is primarily working with AI, so I pay a lot of attention to this area, but I have no special expertise in making or evaluating this specific kind of tool. Others might know more.
I just tried Pangram out as a test. I uploaded two chunks of text that were almost entirely AI-generated using ChatGPT 5.4 (279 words and 506 words) and it rendered a “100% human-written” judgment.
I uploaded another chunk of text that was written with a relatively careless prompt (basically “Write a 500-word essay on the relationship between partisanship and ideology in the United States”). I pasted the result into Pangram and got a “100% AI-generated” judgment. I tried going back to ChatGPT to ask for a revision in a more human register, but the subsequent two checks were also flagged as 100% AI-generated.
One difference might be that the two initial versions were generated based on text I had already written. I loaded text from my papers, asked ChatGPT to rewrite them around a new idea, and pasted the output. So, perhaps the “complete revision” of human text still retains some human signature. It is promising that text generated from scratch gets flagged.
I have no expertise in this, but i have been looking for such a program for student papers. My understanding based on my research (including conversations with experts on this) is that to date there is no reliable software currently available to detect this with sufficient accuracy to use as evidence for honor code violations. FWIW.
I should clarify that this was the conclusion of university counsel as a matter of policy as well. But of course especially in this space, this conclusion needs to be monitored and reevalauted as technologies evolve.
My experience on Pangram is that it does not (seem to) give many false positives, but that it does allow through a good number of false negatives. Given the hoops we at my place of employment have to jump through to deal with these cases, that is probably a good thing, but it’s less than completely satisfying.
Leave a Reply