Publications

CONFERENCE (INTERNATIONAL) Text similarity function based on word embeddings for short text analysis

Adrián Jiménez Pascual (Tokyo Univ.), Sumio Fujita

18th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing 2017)

April 18, 2017

We present the Contextual Specificity Similarity (CSS) measure, a new document similarity measure based on word embeddings and inverse document frequency. The idea behind the CSS measure is to score higher the documents that include words with close embeddings and frequency of usage. This paper provides a comparison with several methods of text classification, which will evince the accuracy and utility of CSS in k-nearest neighbour classification tasks for short texts. We experimentally confirmed that CSS performed excellent in the short text classification task as have been intended, outperforming traditional methods as well as WMD, the most recently proposed method.

Paper : Text similarity function based on word embeddings for short text analysis (external link)