Knowledge Guided Named Entity Recognition
Published in arXiv preprint arXiv:1911.03869, 2019
Recommended citation: @article{banerjee2019knowledge, title={Knowledge Guided Named Entity Recognition}, author={Banerjee, Pratyay and Pal, Kuntal Kumar and Devarakonda, Murthy and Baral, Chitta}, journal={arXiv preprint arXiv:1911.03869}, year={2019} } https://arxiv.org/pdf/1911.03869
Abstract
In this work, we try to perform Named Entity Recognition (NER) with external knowledge. We formulate the NER task as a multi-answer question answering (MAQA) task and provide different knowledge contexts, such as entity types, questions, definitions, and definitions with examples. Moreover, the formulation of the task as a MAQA task helps to reduce other errors. This formulation (a) enables systems to jointly learn from varied NER datasets, enabling systems to learn more NER specific features,(b) can use knowledge-text attention to identify words having higher similarity to’entity type’mentioned in the knowledge, improving performance,(c) reduces confusion in systems by reducing the classes to be predicted, limited to only three (B, I, O),(d) Makes detection of Nested Entities easier. We perform extensive experiments of this Knowledge Guided NER (KGNER) formulation on 15 Biomedical NER datasets, and through these experiments, we see external knowledge helps. We will release the code for dataset conversion and our trained models for replicating experiments.