Unlock instant, AI-driven research and patent intelligence for your innovation.

A system and method for realizing multi-dimensional perceptual virtual interaction

A virtual interaction and multi-dimensional technology, applied in the field of physiological signal analysis, can solve the problems of user physiological signal analysis, not involving the user's emotional behavior, and failing to achieve virtual interaction effects, etc.

Active Publication Date: 2017-07-21
ZHEJIANG UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Although many virtual interaction systems have been developed in various companies, most of them are limited to the perception interaction in the five dimensions of 3D vision, hearing and touch, and do not involve the user's emotional behavior, and the interaction information based on it is only The motion signal of the user during the virtual interaction process, without further analyzing the physiological signal of the user during the virtual interaction process, so that the interaction between the human and the virtual scene generated by the system is more multi-dimensional
Moreover, the dimensional perception of virtual interaction is still limited to 3D visual, auditory and tactile three-dimensional sensations, which cannot achieve the effect of virtual interaction based on the user's multi-dimensional perception. Therefore, it is necessary to develop a system and method that can realize multi-dimensional perception of virtual interaction. very necessary

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for realizing multi-dimensional perceptual virtual interaction
  • A system and method for realizing multi-dimensional perceptual virtual interaction
  • A system and method for realizing multi-dimensional perceptual virtual interaction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0104] Taking virtual piano interaction as an example, the process of realizing multi-dimensional perceptual virtual musical instrument interaction is illustrated.

[0105] The schematic diagram of the virtual piano playing interactive scene of the present invention is as follows: Image 6 shown. The interactive relationship between the user and the virtual piano here is a multi-dimensional perceived virtual interactive relationship. The multi-dimensional perception virtual interaction system of the present invention can provide the user with a complete experience of 3D vision, hearing, touch and pressure. Any action of the user on the virtual object can cause the virtual object to change accordingly. It is as if the real object changes when the user touches the real object. The realization of the interactive relationship between the user and the virtual piano is not limited to multi-dimensional virtual piano interactive perception, but can be applied to any place. In order...

Embodiment 2

[0118] The multi-dimensional interactive system can realize multi-person space-time synchronous virtual interaction. Users can perform synchronous virtual interaction at different times and places. Taking two people playing the piano with four hands as an example, two users can not only You can see the multi-dimensional perception virtual interaction behavior of yourself playing the virtual piano, and you can also see the multi-dimensional perception virtual interaction behavior of other users.

[0119] The schematic diagram of the multi-user virtual piano playing interactive scene of the present invention is as follows: Figure 7 As shown, the interactive relationship between multiple users' virtual piano playing can be explained. The system of the present invention can provide the user with a complete experience of 3D vision, hearing, touch and pressure, allowing the user to create a scene of multi-dimensional perception and interaction. In order to better illustrate the ef...

Embodiment 3

[0135] The multi-dimensional interactive system of the present invention can record the multi-dimensional virtual interaction information of the user using the system, and the user can not only see the multi-dimensional perception virtual interaction behavior of playing the virtual piano, but also the multi-dimensional perception virtual interaction Behaviors are stored, and the stored information is shared with other users, so that other users can perform the same multi-dimensional perception virtual interaction behavior.

[0136] The structural composition of the multi-dimensional virtual interactive information storage system of the present invention is as follows: Figure 10 As shown in the schematic diagram of the stored virtual piano-playing interaction scene of the present invention, it can be used to illustrate the interactive relationship between multiple users' virtual piano-playing. The system can provide users with a complete experience of 3D vision, hearing, touch...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a system and an implementation method for multi-dimensional perception virtual interaction, and also relates to a function expansion system and an implementation method based on the system. The system of the present invention includes a core processing unit, a user assistance unit, a 3D camera unit, a 3D projection unit, and may also include an expansion unit. The system and implementation method for multi-dimensional perception virtual interaction of the present invention better realize multi-dimensional perception virtual interaction, and can truly realize virtual interaction between users and the system from multiple dimensions. Meetings, virtual gatherings, and more. Based on a plurality of systems of the present invention, a multi-dimensional perception virtual interaction in which multiple users are synchronized in time and space can also be realized.

Description

technical field [0001] The invention relates to physiological signal analysis technology, in particular to a system and method for realizing multi-dimensional perceptual virtual interaction. Background technique [0002] Although many virtual interaction systems have been developed in various companies, most of them are limited to the perception interaction in the five dimensions of 3D vision, hearing and touch, and do not involve the user's emotional behavior, and the interaction information based on it is only The motion signal of the user during the virtual interaction process, without further analyzing the physiological signal of the user during the virtual interaction process, so that the interaction between the human and the virtual scene generated by the system is more multi-dimensional. Moreover, the dimensional perception of virtual interaction is still limited to 3D visual, auditory and tactile three-dimensional sensations, which cannot achieve the effect of virtua...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01
Inventor 孟濬陈啸刘琼
Owner ZHEJIANG UNIV