AI models can write convincing fraudulent peer reviews that evade current detection tools, posing a new risk for research integrity.
Key Details
- 1Chinese researchers used the AI model Claude to review 20 actual cancer research manuscripts.
- 2The AI produced highly persuasive rejection letters and requests to cite irrelevant articles.
- 3AI-detection tools misidentified over 80% of the AI-generated reviews as human-written.
- 4Malicious use could enable unfair rejections and citation manipulation within academic publishing.
- 5AI could also help authors craft strong rebuttals to unfair reviews.
- 6Authors call for guidelines and oversight to preserve scientific integrity.
Why It Matters
Radiology and imaging AI research are heavily dependent on fair and trustworthy peer review processes. The inability to reliably detect AI-generated, fraudulent reviews threatens the credibility of published research and the overall progress of the field.
Source
EurekAlert
Related News
•EurekAlert
AI Accelerates Radiopharmaceuticals, Boosts Personalized Dosimetry in Cancer
Machine learning is driving advancements in radiopharmaceutical drug discovery and optimizing patient-specific dosimetry for precision cancer therapy.
•EurekAlert
Physicians Overly Trust Erroneous AI, Ignore Contradictory Evidence
Physicians tend to trust incorrect AI advice, even when evidence contradicts it, suggesting risks in clinical decision-making with AI tools.
•EurekAlert
Concerns Raised Over Unverified Datasets in AI Health Prediction Models
A new study finds widely used AI health prediction models are built on datasets with unverifiable origins, raising safety and validity concerns.