SIG-FIN-018-07

第18回研究会

Cross-lingual news article comparison using bi-graph clustering and Siamese-LSTM†

Authors†

Enda Liu (The University of Tokyo), Kiyoshi Izumi (The University of Tokyo), Kota Tsubouchi (Yahoo! JAPAN), Tatsuo Yamashita (Yahoo! JAPAN)

Abstract†

Calculating similarity score for monolingual text is a popular task since it could be used for various text mining system. However seldom research is focusing on multilingual text resources. On the other hand, machine learning based algorithms such as CBOW word embedding and clustering are widely used in extracting features of text. In this research, we develop and train a model that could calculate the similarity of the two finance news reports, by utilizing CBOW, spherical clustering, bi-graph extraction as well as the Siamese-LSTM deep learning model. It performs well even though the training news data are closely related in the financial domain and also helps us to analyze the relationship among news reports written in different languages.

Key Words†

text mining, cross-lingual text similarity, natural language processing, machine learning, recurrent neural network, clustering

Paper†

SIG-FIN-018-07.pdf