Disease probability-enhanced follow-up chest X-ray radiology report summary generation.
Authors
Affiliations (7)
Affiliations (7)
- Department of Imaging and Interventional Radiology, The Chinese University of Hong Kong, HKSAR, China.
- The CU Lab for AI in Radiology (CLAIR), The Chinese University of Hong Kong, HKSAR, China.
- Hospital Authority, HKSAR, China.
- Department of Imaging and Interventional Radiology, The Chinese University of Hong Kong, HKSAR, China. [email protected].
- The CU Lab for AI in Radiology (CLAIR), The Chinese University of Hong Kong, HKSAR, China. [email protected].
- Department of Psychiatry, The Chinese University of Hong Kong, HKSAR, China. [email protected].
- Gerald Choa Neuroscience Institute, The Chinese University of Hong Kong, HKSAR, China. [email protected].
Abstract
A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at a given examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination. Majority of the efforts on automatic generation of radiology report pertain to reporting the former, but not the latter, type of findings. To the best of the authors' knowledge, there is only one work dedicated to generating summary of the latter findings, i.e., follow-up radiology report summary. In this study, we propose a transformer-based framework to tackle this task. Motivated by our observations on the significance of medical lexicon on the fidelity of report summary generation, we introduce two mechanisms to bestow clinical insight to our model, namely disease probability soft guidance and masked entity modeling loss. The former mechanism employs a pretrained abnormality classifier to guide the presence level of specific abnormalities, while the latter directs the model's attention toward medical lexicon. Extensive experiments were conducted to demonstrate that the performance of our model exceeded the state-of-the-art.