Dynamic capture and holographic projection-based remote interactive method

A holographic projection and remote interaction technology, which is applied in the input/output of user/computer interaction, image data processing, instruments, etc., can solve the problems of unnatural interaction, can only give up, and limit, etc., and achieve the effect of rich content

Inactive Publication Date: 2017-12-12
KUNMING UNIV OF SCI & TECH
View PDF9 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the existing video interaction process, because the screen is two-dimensional, the way of interaction is not natural enough, and most of the time stays in a small area in front of the computer, and the interaction with the remote control entity cannot be completed, so the content of the interaction is very limited For example, to participate in academic exchanges, you must be present in person to explain, and if you are far away, you can only give up if you are delayed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic capture and holographic projection-based remote interactive method
  • Dynamic capture and holographic projection-based remote interactive method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] Embodiment 1: as figure 1 As shown, first user 1 uses the client to apply to the server to connect to user 2, and if rejected, it ends. If the request is received by user 2, the client will query the server to see if there are available models and scenes for user 1 to determine whether it is the first use. If there are no available models and scenes, it will ask whether to create a new one. If the user chooses to create a new model, the model will be scanned by the 3D body scanner, the scene model will be obtained through the 3D scene setting or the above-mentioned model will be constructed through modeling tools, and the standard model data and scene setting parameter data will be processed and uploaded to the user database ; Otherwise, the user needs to choose from the shared models and scenes provided and re-apply to connect to user 2. If there are available models and scenes, user 1 chooses the model and scene used for interaction. Considering that there are a lot ...

Embodiment 2

[0036] Embodiment 2: as figure 2 As shown in , the vertical dotted line divides the whole picture into real and virtual parts, which refer to reality and virtual image, and the upper and lower rectangular dotted lines are the scenes constructed by the two interactive clients. You can see the path from the upper left through the middle processing service to the lower right arrow, indicating that the actual situation of user 1 is mapped to an image of user 1 at the client where user 2 is located, and the actual user 2 is the image of user 1 The interaction has been established, here is just an overview, see the detailed process figure 1 Explanation; the path from the lower left through the middle processing service to the upper right arrow indicates that the actual situation of user 2 is mapped to an image of user 2 at the client where user 1 is located, and the actual user 1 is established with the image of user 2 interaction. This kind of interaction is similar to remote v...

Embodiment 3

[0038] Embodiment 3: In the data collection of the present invention, the 3D body scanner type adopts precise positioning technology such as laser to draw the model layer by layer under the premise of ensuring no harm to the human body. When the person is still and the laser positioning point spirals up or down quickly, it can draw a 360-degree precise position on the human body surface. The model is segmented according to the skeletal structure. By passing the generated model to the cloud for processing, in order to bind with human actions in real time, the skeletal joints rotate and fold most frequently, while the deformation of other parts is relatively small, so the human skeletal structure Dividing the control area of ​​each part is faster and can maintain a certain degree of accuracy.

[0039] In the data collection of the present invention, the motion capture technology is optical motion capture: optical motion capture is closer to the natural nature of people than sens...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a dynamic capture and holographic projection-based remote interactive method and belongs to the field of man-machine interaction. The method comprises the steps of storing a shared virtual scene and a shared virtual model in a cloud end, storing custom virtual scene and virtual model in a database of a user, performing motion capture by using an optical motion capture device, and performing voice capture by using an audio input device; then, establishing a logic host in the cloud end to manage a primary logic slave and a secondary logic slave to process collected data; and finally projecting received three-dimensional scene holographic information processed in the cloud end to air or water mist by using a three-dimensional holographic projection technology through a client, thereby realizing interaction between the user and a three-dimensional image. By utilizing technologies of motion capture, holographic projection and the like, video communication is extended to a naked eye augmented reality technology of remote virtual interaction.

Description

technical field [0001] The invention relates to a remote interaction method based on dynamic capture and holographic projection, belonging to the field of human-computer interaction. Background technique [0002] In the existing video interaction process, because the screen is two-dimensional, the way of interaction is not natural enough, and most of the time stays in a small area in front of the computer, and the interaction with the remote control entity cannot be completed, so the content of the interaction is very limited For example, to participate in academic exchanges, you must be present in person to explain, and if you are far away, you can only give up if you are delayed. Contents of the invention [0003] Technical problem to be solved by the present invention: Aiming at the deficiencies of the prior art, the present invention uses technologies such as motion capture and holographic projection to expand video calls into a naked-eye augmented reality technology f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T19/00H04L29/08H04N13/02H04N13/04
Inventor 娄泽华殷继彬
Owner KUNMING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products