Improved word similarity computation for Chinese using sub-word information

Jin, Peng, Carroll, John, Wu, Yunfang and McCarthy, Diana (2011) Improved word similarity computation for Chinese using sub-word information. In: 2011 Seventh International Conference on Computational Intelligence and Security (CIS), 3-4 Dec. 2011, Hainan.

Full text not available from this repository.

Abstract

In the Chinese language, words consist of characters each of which is composed of one or more components. Almost every individual Chinese character has a specific meaning, and the meaning of a word is usually highly related to the characters that comprise it. Likewise, sub-character components often make a predictable contribution to the meaning of a character, and in general characters that have the same components have similar or related meanings. It is easy to automatically decompose words into characters and their components. In this paper, we improve on a corpus-based approach to computing word similarity in Chinese by extending it according to the characters and components shared between words. In an evaluation on 30,000 word types (noun, verb and adjective), we obtain a 39% relative improvement compared with a state-of-the-art baseline.

Item Type: Conference or Workshop Item (Paper)
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: T Technology
Related URLs:
Depositing User: Juan Loera Gonzalez
Date Deposited: 23 Apr 2012 10:56
Last Modified: 23 Apr 2012 10:56
URI: http://sro.sussex.ac.uk/id/eprint/38677
📧 Request an update