TY - JOUR
T1 - Detecting syntactic differences automatically using the Minimum Description Length principle
AU - Kroon, Martin
AU - Barbiers, Sjef
AU - Odijk, Jan
AU - van der Pas, Stéphanie
N1 - Publisher Copyright:
© 2020 Martin Kroon, Sjef Barbiers, Jan Odijk, Stéphanie van der Pas.
PY - 2020/12/12
Y1 - 2020/12/12
N2 - In this paper we present a systematic approach to detect and rank hypotheses about possible syntactic differences for further investigation by leveraging parallel data and using the Minimum Description Length (MDL) principle. We deploy the SQS-algorithm ('Summarising event seQuenceS'; Tatti and Vreeken 2012) - an MDL-based algorithm - to mine 'typical' sequences of Part of Speech (POS) tags for each language under investigation. We create a shortlist of potential syntactic differences based on the number of parallel sentences with a mismatch in pattern occurrence. We applied our method to parallel corpora of English, Dutch and Czech sentences from the Europarl v7 corpus (Koehn 2005). The approach proved useful in both retrieving POS building blocks of a language as well as pointing to meaningful syntactic differences between languages. Despite a clear sensitivity to tagging accuracy, our results and approach are promising.
AB - In this paper we present a systematic approach to detect and rank hypotheses about possible syntactic differences for further investigation by leveraging parallel data and using the Minimum Description Length (MDL) principle. We deploy the SQS-algorithm ('Summarising event seQuenceS'; Tatti and Vreeken 2012) - an MDL-based algorithm - to mine 'typical' sequences of Part of Speech (POS) tags for each language under investigation. We create a shortlist of potential syntactic differences based on the number of parallel sentences with a mismatch in pattern occurrence. We applied our method to parallel corpora of English, Dutch and Czech sentences from the Europarl v7 corpus (Koehn 2005). The approach proved useful in both retrieving POS building blocks of a language as well as pointing to meaningful syntactic differences between languages. Despite a clear sensitivity to tagging accuracy, our results and approach are promising.
UR - http://www.scopus.com/inward/record.url?scp=85120987771&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:85120987771
SN - 2211-4009
VL - 10
SP - 109
EP - 127
JO - Computational Linguistics in the Netherlands Journal
JF - Computational Linguistics in the Netherlands Journal
T2 - 30th Meeting of Computational Linguistics in the Netherlands, CLIN 2020
Y2 - 30 January 2020
ER -