Ensuring integrity in dental education: Developing a novel AI model for consistent and traceable image analysis in preclinical endodontic procedures.
Authors
Affiliations (4)
Affiliations (4)
- Program in Endodontics, Marquette University School of Dentistry, Milwaukee, Wisconsin, USA.
- Delta Dental Research Laboratory, Marquette University School of Dentistry, Milwaukee, Wisconsin, USA.
- Program in Periodontics, Marquette University School of Dentistry, Milwaukee, Wisconsin, USA.
- Educational Development and Assessment, Marquette University School of Dentistry, Milwaukee, Wisconsin, USA.
Abstract
Academic integrity is crucial in dental education, especially during practical exams assessing competencies. Traditional oversight may not detect sophisticated academic dishonesty methods like radiograph substitution or tampering. This study aimed to develop and evaluate a novel artificial intelligence (AI) model utilizing a Siamese neural network to detect inconsistencies in radiographic images taken for root canal treatment (RCT) procedures in preclinical endodontic courses, thereby enhancing educational integrity. A Siamese neural network was designed to compare radiographs from different RCT procedures. The model was trained on 3390 radiographs, with data augmentation applied to improve generalizability. The dataset was split into training, validation, and testing subsets. Performance metrics included accuracy, precision, sensitivity (recall), and F1-score. Cross-validation and hyperparameter tuning optimized the model. Our AI model achieved an accuracy of 89.31%, a precision of 76.82%, a sensitivity of 84.82%, and an F1-score of 80.50%. The optimal similarity threshold was 0.48, where maximum accuracy was observed. The confusion matrix indicated a high rate of correct classifications, and cross-validation confirmed the model's robustness with a standard deviation of 1.95% across folds. The AI-driven Siamese neural network effectively detects radiographic inconsistencies in RCT preclinical procedures. Implementing this novel model will serve as an objective tool to uphold academic integrity in dental education, enhance the fairness and reliability of assessments, promote a culture of honesty amongst students, and reduce the administrative burden on educators.