Adaptive lip language interaction method and interaction apparatus

An interactive method and adaptive technology, applied in the field of image processing, can solve problems such as low interactive success rate, low recognition rate, and affecting image accuracy

Inactive Publication Date: 2017-03-15
SHENZHEN ORBBEC CO LTD
View PDF9 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the prior art, lip language recognition is generally based on a color camera to obtain the user's facial information. This method is easily affected by the environment. For examp

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Adaptive lip language interaction method and interaction apparatus
  • Adaptive lip language interaction method and interaction apparatus
  • Adaptive lip language interaction method and interaction apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] refer to figure 1 , figure 1 It is a schematic flow chart of an embodiment of the self-adaptive lip language interaction method of the present invention. Such as figure 1 As shown, the interaction method of this embodiment includes the following steps:

[0052]101: Acquire a depth image of a target human object and an infrared image or a color image of the target human object.

[0053] Lip language recognition is mainly a process of extracting the characteristic information of the lips of the target human subject, and using the characteristic information to recognize the instruction or voice to be expressed by the target human subject.

[0054] Interaction through lip recognition is widely used because of its simple and convenient operation.

[0055] Since the depth image of the target human object contains more accurate and rich image information of the target human object, and is less affected by light, in this embodiment, the depth image of the target human objec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an adaptive lip language interaction method and interaction apparatus. The adaptive lip language interaction method comprises the following steps: obtaining a depth image of a target human body object and an infrared image or a color image of the target human body object; obtaining lip area images of the target human body object respectively from the depth image and the infrared image or the color image; extracting lip features from the lip area images, and performing lip language identification after fusion processing is performed on the lip features extracted from the depth image and the infrared image or from the depth image and the color image; and converting a lip language identification result into a corresponding operation instruction, and according to the operation instruction, performing interaction. Such a mode is not easily affected by environment such as light intensity, the hit rate of image identification can be effectively improved, the hit rate of lip language identification is further improved, and the execution efficiency and the operation accuracy of the interaction can be finally effectively improved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to an adaptive lip language interaction method and an interaction device. Background technique [0002] In the field of artificial intelligence and image processing, many functions can be realized by using the image information of the target, such as analyzing the user's expression or action information, etc. Image acquisition and recognition has always been a hot research topic, involving many aspects of users' daily life and scientific research. [0003] For example, the technology of recognizing the user's face, such as lip language recognition, can improve the accuracy of somatosensory interaction and voice recognition, thereby further bringing a more comfortable interactive experience. [0004] However, in the prior art, lip language recognition is generally based on a color camera to obtain the user's facial information. This method is easily affected by the environm...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/25G06K9/00
CPCG10L15/25G06V40/171G06V40/20
Inventor 黄源浩刘龙肖振中许星
Owner SHENZHEN ORBBEC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap