Real time three dimensional (3D) video communication system and implement method thereof based on Kinect

A video communication and 3D technology, applied in the field of 3D video communication, can solve the problems of good three-dimensional effect, good real-time performance, and inability to present three-dimensional video scenes in real time, so as to improve the speed and effect, reduce the size of compressed data, and facilitate real-time transmission. Effect

Inactive Publication Date: 2013-07-24
TONGJI UNIV
View PDF5 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the disadvantage that the existing video communication system using ordinary cameras cannot present stereoscopic video scenes in real time, t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real time three dimensional (3D) video communication system and implement method thereof based on Kinect
  • Real time three dimensional (3D) video communication system and implement method thereof based on Kinect
  • Real time three dimensional (3D) video communication system and implement method thereof based on Kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The technical solution of the present invention will be further introduced below in conjunction with the embodiments and the accompanying drawings.

[0050] The system composition of this embodiment: notebook computer + KINECT +TP-LINK + EPCM505C development board + 3D glasses, the physical composition of the system is as follows figure 1 shown.

[0051] The principle of the whole system is as follows: figure 2 , image 3 The system shown is based on the EPCM-505C development board, and uses the Microsoft KINECT camera to design a 3D video conferencing system, which encodes and transmits the color information, depth information and audio information collected by KINECT, and decodes the color information and depth information. Perform 3D reconstruction, play synchronously with the audio, and restore the 3D video conference scene.

[0052] System hardware architecture such as Figure 4 Shown: When the system is designed, fully consider the high-performance characteri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real time three dimensional (3D) video communication system and an implement method of the real time 3D video communication system based on Kinect. A KINECT camera is utilized to collect color video information, depth video information and audio information synchronously and carry out filtering optimizing processing on depth information. X264 is utilized to carry out compression processing on the two-way video information. A moving picture expert group audio layer-3 (MP3) encoder is utilized to carry out audio compression. A multithreading technology is utilized to achieve synchronous acquisition of the three-way information. A real time protocol (RTP) is utilized to carry out network transmission. The system decodes the two-way video information after receiving the three-way information, the color video information and the depth video information are obtained, reconfiguration of a virtual viewpoint scene is carried out, and a left eye scene video and a right eye scene video corresponding to human eye parallax are obtained. According to a double-eye 3D imaging principle, the two-way video is synthesized to obtain a 3D video scene, DirectX is utilized to play the 3D video scene after the 3D video scene is synchronous with the audio information, and a 3D video conference system is formed.

Description

technical field [0001] The invention relates to the field of 3D video communication, in particular to a real-time 3D video communication system and method based on a Kinect camera. Background technique [0002] At present, the video communication system mainly transmits two-dimensional video, such as QQ, MSN, Gtalk, Skype and other video chat or video conferencing systems. Although two-dimensional video communication can provide high-definition video quality, it cannot provide the effect of immersive communication for users due to the lack of stereo depth information. [0003] With the popularity of 3D movies and 3D TV programs, people are no longer satisfied with the traditional two-dimensional flat video, but turn their attention to the more amazing three-dimensional video. Stereoscopic video introduces parallax information, so that the viewer can feel the three-dimensional distance space and produce an immersive feeling. 3D video imaging requires two channels of video i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N13/00
Inventor 张冬冬刘典叶晨王昕薛敏峰臧笛
Owner TONGJI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap