Eye interaction method and system for video conference

An interactive method and video conferencing technology, which is applied in the field of eye interaction method and system, can solve the problems of non-adaptive position change, large amount of calculation for 3D point cloud creation, and direct eye-to-eye images, etc., so as to achieve a large reduction The effect of high calculation volume, high real-time performance and convenient operation

Active Publication Date: 2013-04-10
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

And the virtual fusion point of multiple images is fixed at one position, ignoring the relative positional relationship between the person and the camera, and it is not adaptive to the position change of the person. When the head of the person deviates far from this fixed...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eye interaction method and system for video conference
  • Eye interaction method and system for video conference
  • Eye interaction method and system for video conference

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] The technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments to further understand the purpose, solution and effect of the present invention, but it is not intended to limit the scope of protection of the appended claims of the present invention.

[0067] For the convenience of understanding, before describing the method of the present invention in detail, a possible application scenario of the method of the present invention is given first. During the remote video, both parties need to communicate with each other through eye contact, hoping that the other party will have the effect of looking directly at themselves. First, the user needs to place the color camera and depth camera on the desktop. The data acquired by the depth camera is aligned with the color camera image. Then, the method goes through a preprocessing stage to present the corrected effect.

[0068] In view of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an eye interaction method and an eye interaction system for a video conference; the method comprises the following steps that (100) a colored image is acquired by a color camera, and a depth image which is in alignment with the colored image is acquired by a depth camera; (200) the colored image and the depth image are processed preliminarily, three-dimensional information under a virtual coordinate system is acquired, and the three-dimensional information is projected to the plane of a virtual camera to acquire an eye correction image; and (300) the median of the eye correction image is filtered, and a direct eye image is acquired. According to the eye interaction method and the an eye interaction system for the video conference, the operation is convenient, the real-time performance is high, different positions of video conference attendees are adapted to automatically, the realization is simple, and the attention to the video conference can be enhanced.

Description

technical field [0001] The present invention relates to video conferencing, in particular to an eye interaction method and system for video conferencing. Background technique [0002] Video conferencing occupies a pivotal position in future communication. It enables people to communicate more effectively. Video conferencing allows both participants to observe each other's facial expressions, body movements and responses to their own words. Through the video capture device, the image of one participant will be captured and then transmitted through the network to the display screen of the other participant. [0003] But remote video conferencing cannot guarantee the interaction of participants' eyes. Participants must choose to look directly at the camera or at the screen. Only when one participant chooses to look directly at the camera, the other party has the feeling that the other party is looking at him. But that eye contact was missing if the participants chose to star...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06T7/00H04N7/15
Inventor 尹苓琳陈益强纪雯
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products