Sep 18Is science getting slower?TL;DR: peer-review times appear to have been growing for a long time. The effects of COVID-lockdowns on peer-review are surprising. A few months ago, I was invited to referee a research paper. So, I guess the editor thought that I was one of the 2 best people in the entire…Peer Review Journals4 min readPeer Review Journals4 min read
Jun 15Where to draw the line? Precision and recallThe Papermill Alarm draws a line between papers which have the characteristics of papermill-products and those that don’t. Given data like that shown below, where red dots represent papermill-products and green dots represent normal papers, where should we draw that line? Limit the spread There’s well-known (and fun!) thought experiment in statistics that…Peer Review Journals4 min readPeer Review Journals4 min read
Apr 12Cast a wide netTL;DR: There’s been a recent major upgrade to the private Papermill Alarm. It looks like we can predict the inclusion of journals on the Chinese Academy of Sciences (CAS) lists. You know how data scientists make predictions? I’ll let you in on a secret: no they don’t. No one can…5 min read5 min read
Mar 24The definition of plagiarismThis is Ralph. How tall is Ralph? It seems simple, you could just hold a ruler up to the screen. But when you look at the ruler and use it to measure Ralph, are you actually measuring Ralph, or are you measuring the ruler and using that as a proxy…AI4 min readAI4 min read
Jan 24We need a chat about ChatGPTThere’s a quote attributed to Ernest Rutherford: “That which is not measurable is not science. That which is not physics is stamp collecting”. I think his point was that a lot of scientific work is just documenting things. In Rutherford’s day, there was a lot of exciting new creative work…Artificial Intelligence5 min readArtificial Intelligence5 min read
Nov 28, 2022Video: APIs for Papermill detection (ConTech API Series)Recently, I gave a presentation on the APIs for Papermill Detection offered by Clear Skies Ltd. I also touch on a newer service called the Clear Skies Standard Report. More on that in future posts… :) Here’s the video: Would you like to know more? There are a few more presentations coming up: I’ll be…Research Integrity1 min readResearch Integrity1 min read
Oct 31, 2022(The?) 3 kinds of papermillsTL;DR: Join me at ConTech Live to hear about a recent project with Open Credo to see if we could detect unusual co-authorships in a dataset created by Anna Abalkina. Sign up here! Papermilling has a few definitions which you see here and there. Sometimes it’s “organised manipulation of the…Academic Publishing3 min readAcademic Publishing3 min read
Oct 17, 2022How to use the Papermill Alarm APIAlso… what is an API? — The Papermill Alarm API, is a service which you can send some article metadata to and which will return an alert telling you if the paper looks like past papermill-products. Anyone can use it, but it definitely helps to have the support of an IT or data professional. (By the…Research Integrity4 min readResearch Integrity4 min read
Sep 12, 2022Papermills in peer-reviewDissecting a joke is a bit like dissecting a frog. No one needs to know what’s inside and the frog dies. — Jimmy Carr Last week, a paper I wrote on the subject of peer-review fraud was published in the journal Scientometrics (free link here, preprint here). It was an…Academic Publishing5 min readAcademic Publishing5 min read
Aug 23, 2022The Papermill Alarm: Patterns in PubMedThis post is about The Papermill Alarm: an API for detecting potential papermill-products. There’s a field of study called ‘stylometry’ where we look at the statistical properties of someone’s writing and use that to model their ‘style’. People write in idiosyncratic ways. So, for example, I often start sentences with…Academic Publishing4 min readAcademic Publishing4 min read