A 3D Gesture Interaction Method Oriented to User Mental Model Expression

A three-dimensional gesture and mental model technology, applied in the field of three-dimensional gesture interaction, can solve the problem that the user's mental model is rare, and achieve the effect of improving the interaction experience, reducing cognitive load, and simple gesture expression.

Active Publication Date: 2018-01-09
UNIV OF JINAN
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are not many studies that pay attention to gesture style and use it to express the user's mental model (Mental Model)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D Gesture Interaction Method Oriented to User Mental Model Expression
  • A 3D Gesture Interaction Method Oriented to User Mental Model Expression
  • A 3D Gesture Interaction Method Oriented to User Mental Model Expression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to reflect different movement styles of users, the present invention proposes a monocular vision-based human movement style expression algorithm from three aspects of speed, trajectory and angle of view. First, an interactive experiment platform is established, and a gesture behavior model is established by using cameras, data gloves and position trackers; second, according to the behavior model, the speed, trajectory and viewing angle models of human hand movements are established in stages. Finally, through the gesture image and motion model, the human hand movement style is obtained, so that the 3D virtual gesture movement style is consistent with the actual human hand movement style, and displayed in real time, so as to successfully complete the harmonious, natural and convenient human-computer interaction tasks.

[0029] Firstly, a three-dimensional virtual gesture model is established in the computer, and a virtual scene is built, and a human-computer inte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The three-dimensional gesture interaction method oriented to the user's mental model expression of the present invention proposes a monocular vision-based human hand movement style expression algorithm from three aspects of speed, trajectory and viewing angle. First, an interactive experiment platform is established, and a gesture behavior model is established by using cameras, data gloves and position trackers; second, according to the behavior model, the speed, trajectory and viewing angle models of human hand movements are established in stages. Finally, through the gesture image and motion model, the human hand movement style is obtained, so that the 3D virtual gesture movement style is consistent with the actual human hand movement style, and displayed in real time, so as to successfully complete the harmonious, natural and convenient human-computer interaction tasks. The beneficial effects of the present invention are: the present invention applies the gesture style algorithm based on the behavior model to the design of the natural interactive interface, expresses the user's mental model, reduces the user's cognitive load, and improves the user's interactive experience.

Description

technical field [0001] The invention relates to a three-dimensional gesture interaction method oriented to user psychological model expression. Background technique [0002] Natural human-computer interaction is carried out using people's everyday skills, emphasizing that no special training is required or required. Among the input methods based on face, head, arm, human hand, human eye and the whole human body, human hand is the most effective and versatile input tool due to its dexterity in communication and operation. Gesture is a natural, intuitive, and easy-to-learn means of human-computer interaction. Using human hands directly as the input method of the computer, the communication between human and computer will no longer require an intermediate medium. Users can simply define an appropriate gesture to interact with the surrounding environment. Gestures are a form of non-verbal communication between humans, ranging from simple gestures of the hand to point directions...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06K9/00
Inventor 冯志全黄忠柱
Owner UNIV OF JINAN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap