Hololens2-based three-dimensional holographic video conference system

A video conferencing system, three-dimensional holographic technology, applied in the field of video conferencing

Inactive Publication Date: 2021-07-06
NORTHWESTERN POLYTECHNICAL UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Existing mainstream technologies such as zoom, Tencent conference and other traditional ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hololens2-based three-dimensional holographic video conference system
  • Hololens2-based three-dimensional holographic video conference system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0028] see figure 1 , the present invention provides a technical solution: a three-dimensional holographic video conferencing system based on Hololens2, including multiple depth cameras, such as AzureKinect, multiple depth cameras collect depth image data, and multiple depth cameras are respectively connected to multiple via USB for collection. On the PC end of the depth image data, the PC end connected to the depth camera adopts the windows10 system. A powerful PC is needed as the server to handle some computing services. The PC software and hardware requirements of the server are: windows10 system, CPU is i7-8700k, and graphics card is GTX1070.

[0029] The PC terminal that collects the depth image data sends the collected data to the service terminal through a network protocol, and the calibration of the depth camera and the splicing and optimization of the point cloud are performed on the service terminal to obtain the point cloud model, or through Deep learning, to obtai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Hololens2-based three-dimensional holographic video conference system, and the system comprises a plurality of depth cameras for acquiring depth image data and respectively connected to a plurality of PC terminals for acquiring the depth image data through USBs, and further comprises a PC terminal as a service terminal; the PC terminal for collecting the depth image data sends collected data to the server terminal through a network protocol, calibration of a depth camera and splicing and optimization of point cloud are carried out on the server terminal to obtain a point cloud model, or human skeleton data are obtained through deep learning and used for driving a digital virtual human, and the system further comprises a Hololens2; the generated three-dimensional scene is transmitted to a Hololens2 through a network UDP protocol, the Hololens2 is used for displaying the obtained three-dimensional point cloud model and the virtual human model, the effect of a three-dimensional video conference is achieved, and better communication is achieved.

Description

technical field [0001] The invention relates to the technical field of video conferencing, in particular to a three-dimensional holographic video conferencing system based on Hololens2. Background technique [0002] The application scenarios of remote collaboration are becoming more and more common. With the popularization of VR / MR equipment, network infrastructure such as 5G and optical fiber will be upgraded. Three-dimensional video conferencing technology has the possibility of landing. In contrast, the traditional two-dimensional video conferencing technology exposed its limitations. [0003] There are certain limitations in the information conveyed by traditional two-dimensional video communication technologies such as zoom and Tencent conferences, which are existing mainstream technologies. For example, when a sports coach is teaching remotely, students often only see one perspective. This is not conducive to the correct teaching of technical movements; another exam...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/15G06T17/00
CPCH04N7/152H04N7/157G06T17/00
Inventor 严愉程沈真轩辕福泰程龙唐年福
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap