Interaction method and interaction device based on lip language

基于唇语的交互方法以及交互装置

Abstract

本发明公开了一种基于唇语的交互方法以及交互装置,所述交互方法包括:获取目标人体对象的深度图像、红外图像以及彩色图像;分别从深度图像、红外图像以及彩色图像中获取目标人体对象的唇部区域图像;从唇部区域图像提取唇部特征,并将从深度图像、红外图像以及所述彩色图像中提取的唇部特征融合处理后进行唇语识别;将唇语识别的结果转化成对应的操作指令,并根据操作指令进行交互。通过上述方式,相对于传统直接通过彩色相机获取图像信息的方式,不容易受到环境如光线强弱的影响,能够有效提高图像识别的命中率,提高唇语识别的命中率,进一步地提高了唇语识别的命中率,最终可有效改善交互的执行率和操作准确率。
The invention discloses an interaction method and an interaction device based on a lip language. The interaction method comprises the following steps of obtaining the depth image, the infrared image and the color image of a target human body object; obtaining the lip part area images of the target human body object from the depth image, the infrared image and the color image respectively; extracting lip part characteristics from the lip part area images, carrying out fusion treatment on lip part characteristics extracted from the depth image, the infrared image and the color image, and then carrying out lip language recognition; converting the result of the lip language recognition into a corresponding operating command, and carrying out interaction according to the operating command. Through the way, relative to a way of conventionally directly obtaining image information through a color camera, the interaction method and the interaction device are difficultly influenced by an environment such as the intensity of a light ray; the hit rate of image recognition can be effectively improved; the hit rate of the lip language recognition is improved; the hit rate of the lip language recognition is further improved; finally, the execution rate and the operation accuracy of the interaction can be effectively ameliorated.

Claims

Description

Topics

Download Full PDF Version (Non-Commercial Use)

Patent Citations (0)

    Publication numberPublication dateAssigneeTitle

NO-Patent Citations (0)

    Title

Cited By (0)

    Publication numberPublication dateAssigneeTitle