Title of Paper:Research on continuous sign language sentence recognition algorithm based on weighted key-frame

Hits:

Affiliation of Author(s):信息化处（信息化技术中心）

Journal:J. Adv. Comput. Intell. Intelligent Informatics

Abstract:At present, most of the dynamic sign language recognition is only for sign language words, the continuous sign language sentence recognition research and the corresponding results are less, because the segmentation of such sentence is very difficult. In this paper, a sign language sentence recognition algorithm is proposed based on weighted key-frames. Key-frames can be regarded as the basic unit of sign word, therefore, according to key frames we can get related vocabularies, and thus we can further organize these vocabularies into meaningful sentences. Such work can avoid the hard point of dividing sign language sentence directly. With the help of Kinect, i.e. motion-control device, a kind of self-adaptive algorithm of key-frame extraction based on the trajectory of sign language is brought out in the paper. After that, the key-frame is given weight according to its semantic contribution. Finally, the recognition algorithm is designed based on these weighted key-frames and thus get the continuous sign language sentence. Experiments show that the algorithm designed in this paper can realize real-time recognition of continuous sign language sentences. © 2018 Fuji Technology Press. All Rights Reserved.

ISSN No.:1343-0130

Translation or Not:no

Date of Publication:2018-07-01

Co-author:Xu, Xin-Xin,Hu, Zuo-Jin

Correspondence Author:Xu, Xin-Xin,黄元元,Huang Yuanyuan