Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for realizing somatic sensory interaction

A somatosensory and realistic technology, applied in the input/output of user/computer interaction, the input/output process of data processing, image data processing, etc., can solve the problems of unnatural control experience and achieve a good operating experience

Active Publication Date: 2012-08-01
BEIJING NUFRONT MOBILE MULTIMEDIA TECH
View PDF5 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In other words, the user must first map himself into the game's display frame of reference before he can play the game, which is an unnatural manipulation experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for realizing somatic sensory interaction
  • Method and system for realizing somatic sensory interaction
  • Method and system for realizing somatic sensory interaction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] With the continuous development and popularization of 3D technology, and people's increasing demand for interactive systems, this invention proposes a method and system for realizing somatosensory interaction based on 3D video, so that users can have a good operating experience and have physical An immersive interactive experience.

[0028] figure 2 Shown is the schematic diagram of realizing somatosensory interaction based on the 3D video system in the technical solution provided by the present invention, referring to figure 2 , firstly, sense the operator's movement, and map his movement to the coordinates of the real reference system; and locate the operator's eyes: obtain the position information of the human eye, and measure the position parameters of the human eye in the real reference system; Secondly, the parallax calculation and adjustment are performed on the 3D image, and the imaging coordinates of the virtual 3D stereoscopic image in the real reference sy...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for realizing somatic sensory interaction. The method comprises the following steps of: acquiring movement information about an operator and mapping the movement information to a real reference system; measuring and calculating position parameters of the human eyes in the real reference system, calculating imaging coordinates of a virtual three-dimensional (3D) image in the real reference system by combining parallax information in a display reference system and the human eye position parameters, and mapping the 3D image in the display reference system to the real reference system; detecting interaction information about a human body action and the 3D image in the real reference system; and performing corresponding interaction operation according to the interaction information. The invention also provides a corresponding somatic sensory interaction system. According to the method and the system, human-computer interaction can be realized in a 3D environment, so that a user has a very good operation experience, and the operator has an immersive interactive experience feeling.

Description

technical field [0001] The invention relates to the technical field of 3D video image processing and human-computer interaction, and in particular to a method and system for realizing somatosensory interaction. Background technique [0002] Existing somatosensory interaction technology, typical somatosensory interactive systems, such as Microsoft's Kinect system, Nintendo's Wii system, Sony's PS Move system, etc., enable people to interact with multimedia terminals through body movements, breaking through the previous simple use of handle buttons The operation mode of the input. Although this mode gets rid of the limitation of the handle operation, the user's experience in operation is very unintuitive. The reason is that the user's reference coordinate system during operation is the display reference system on the display screen. The somatosensory technology maps the user's body movements to the screen, and interacts with software programs or games under the display refer...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/048G06T19/00
Inventor 王嘉鲍东山
Owner BEIJING NUFRONT MOBILE MULTIMEDIA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com