Eye interaction method and system for video conference

Abstract

The invention provides an eye interaction method and an eye interaction system for a video conference; the method comprises the following steps that (100) a colored image is acquired by a color camera, and a depth image which is in alignment with the colored image is acquired by a depth camera; (200) the colored image and the depth image are processed preliminarily, three-dimensional information under a virtual coordinate system is acquired, and the three-dimensional information is projected to the plane of a virtual camera to acquire an eye correction image; and (300) the median of the eye correction image is filtered, and a direct eye image is acquired. According to the eye interaction method and the an eye interaction system for the video conference, the operation is convenient, the real-time performance is high, different positions of video conference attendees are adapted to automatically, the realization is simple, and the attention to the video conference can be enhanced.

Description

technical field [0001] The present invention relates to video conferencing, in particular to an eye interaction method and system for video conferencing. Background technique [0002] Video conferencing occupies a pivotal position in future communication. It enables people to communicate more effectively. Video conferencing allows both participants to observe each other's facial expressions, body movements and responses to their own words. Through the video capture device, the image of one participant will be captured and then transmitted through the network to the display screen of the other participant. [0003] But remote video conferencing cannot guarantee the interaction of participants' eyes. Participants must choose to look directly at the camera or at the screen. Only when one participant chooses to look directly at the camera, the other party has the feeling that the other party is looking at him. But that eye contact was missing if the participants chose to star...

AI Technical Summary

Problems solved by technology

And the virtual fusion point of multiple images is fixed at one position, ignoring the relative positional relationship between the person and the camera, and it is not adaptive to the position change of the person. When the head of the person deviates far from this fixed point, it will cause The image obtained from this virtual point of view still cannot achieve the effect of looking directly at the eyes

Moreover, the establishment of a 3D point cloud requires a large amount of calculation, resulting in poor real-time performance of the method

Images