License: 
Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.LDK.2021.41
URN: urn:nbn:de:0030-drops-145779
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2021/14577/
Hong, Suk Joon ;
Bennett, Brandon
Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning
Abstract
The Winograd Schema Challenge (WSC) is a commonsense reasoning task that requires background knowledge. In this paper, we contribute to tackling WSC in four ways. Firstly, we suggest a keyword method to define a restricted domain where distinctive high-level semantic patterns can be found. A thanking domain was defined by keywords, and the data set in this domain is used in our experiments. Secondly, we develop a high-level knowledge-based reasoning method using semantic roles which is based on the method of Sharma [Sharma, 2019]. Thirdly, we propose an ensemble method to combine knowledge-based reasoning and machine learning which shows the best performance in our experiments. As a machine learning method, we used Bidirectional Encoder Representations from Transformers (BERT) [Jacob Devlin et al., 2018; Vid Kocijan et al., 2019]. Lastly, in terms of evaluation, we suggest a "robust" accuracy measurement by modifying that of Trichelair et al. [Trichelair et al., 2018]. As with their switching method, we evaluate a model by considering its performance on trivial variants of each sentence in the test set.
BibTeX - Entry
@InProceedings{hong_et_al:OASIcs.LDK.2021.41,
author = {Hong, Suk Joon and Bennett, Brandon},
title = {{Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning}},
booktitle = {3rd Conference on Language, Data and Knowledge (LDK 2021)},
pages = {41:1--41:13},
series = {Open Access Series in Informatics (OASIcs)},
ISBN = {978-3-95977-199-3},
ISSN = {2190-6807},
year = {2021},
volume = {93},
editor = {Gromann, Dagmar and S\'{e}rasset, Gilles and Declerck, Thierry and McCrae, John P. and Gracia, Jorge and Bosque-Gil, Julia and Bobillo, Fernando and Heinisch, Barbara},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops.dagstuhl.de/opus/volltexte/2021/14577},
URN = {urn:nbn:de:0030-drops-145779},
doi = {10.4230/OASIcs.LDK.2021.41},
annote = {Keywords: Commonsense Reasoning, Winograd Schema Challenge, Knowledge-based Reasoning, Machine Learning, Semantics}
}
