Incorporating Medical Knowledge to Transformer-based Language Models for Medical Dialogue Generation

Naseem, Usman, Bandi, Ajay, Raza, Shaina, Rashid, Junaid, and Chakravarthi, Bharathi Raja (2022) Incorporating Medical Knowledge to Transformer-based Language Models for Medical Dialogue Generation. In: Proceedings of the Proceedings of the 21st Workshop on Biomedical Language Processing. pp. 110-115. From: BioNLP 22: 21st Workshop on Biomedical Language Processing, 26 May 2022, Dublin, IRL.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: https://doi.org/10.18653/v1/2022.bionlp-...
5


Abstract

Medical dialogue systems have the potential to assist doctors in expanding access to medical care, improving the quality of patient experiences, and lowering medical expenses. The computational methods are still in their early stages and are not ready for widespread application despite their great potential. Existing transformer-based language models have shown promising results but lack domain-specific knowledge. However, to diagnose like doctors, an automatic medical diagnosis necessitates more stringent requirements for the rationality of the dialogue in the context of relevant knowledge. In this study, we propose a new method that addresses the challenges of medical dialogue generation by incorporating medical knowledge into transformer-based language models. We present a method that leverages an external medical knowledge graph and injects triples as domain knowledge into the utterances. Automatic and human evaluation on a publicly available dataset demonstrates that incorporating medical knowledge outperforms several state-of-the-art baseline methods.

Item ID: 79254
Item Type: Conference Item (Research - E1)
ISBN: 9781955917278
Copyright Information: © 2022 Association for Computational Linguistics
Date Deposited: 07 Sep 2023 00:19
FoR Codes: 46 INFORMATION AND COMPUTING SCIENCES > 4602 Artificial intelligence > 460208 Natural language processing @ 100%
SEO Codes: 22 INFORMATION AND COMMUNICATION SERVICES > 2204 Information systems, technologies and services > 220402 Applied computing @ 100%
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page