Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional gesture interacting method used for expressing user mental model

A three-dimensional gesture and mental model technology, applied in the field of three-dimensional gesture interaction, can solve the problem that the user's mental model is rare, and achieve the effect of improving the interaction experience, simple gesture expression, and reducing cognitive load.

Active Publication Date: 2015-11-11
UNIV OF JINAN
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are not many studies that pay attention to gesture style and use it to express the user's mental model (MentalModel).

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional gesture interacting method used for expressing user mental model
  • Three-dimensional gesture interacting method used for expressing user mental model
  • Three-dimensional gesture interacting method used for expressing user mental model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] Firstly, a three-dimensional virtual gesture model is established in the computer, and a virtual scene is built, and a human-computer interaction platform is built in the virtual scene. The experimenter uses a camera, a data glove, and a position tracker to carry out operations including the initial translation of the human hand, grasping objects, translation again, and release. Human-computer interaction experiments in four stages of objects.

[0030] In order to obtain gesture images and joint angle data, a virtual platform based on data gloves, position trackers and ordinary USB cameras is established. The gesture interaction process is completed by basic operations one by one, and these basic operations include "grab", "release", "pan" and so on. The general mathematical expression of these basic operations is called a gesture behavior model. During the interaction process, a 3D gesture animation model that follows the operator's gestures appears on the screen. T...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a three-dimensional gesture interacting method used for expressing a user mental model, and provides an algorithm expressing a user's hand movement style based on monocular vision from three aspects: the speed, the locus and the visual angle. The method comprises firstly establishing an interaction experiment platform, and establishing a gesture behavior model using a camera, a data glove and a position tracker; secondly establishing a speed, locus and visual angle model of a user's hand in stages in depending the behavior model; at least, acquiring a user's hand movement style through gesture images and the behavior model, making a three-dimension virtual gesture movement style stay the same as an actual user's hand movement style, and displaying in real time. So harmonious, natural and convenient a human-computer interaction task can be smoothly completed. A gesture style algorithm based on a behavior model is utilized in design of a natural interactive interface, a user mental model can be expressed, a user's cognitive load can be reduced, and user interactive experience can be improved.

Description

technical field [0001] The invention relates to a three-dimensional gesture interaction method oriented to user psychological model expression. Background technique [0002] Natural human-computer interaction is carried out using people's everyday skills, emphasizing that no special training is required or required. Among the input methods based on face, head, arm, human hand, human eye and the whole human body, human hand is the most effective and versatile input tool due to its dexterity in communication and operation. Gesture is a natural, intuitive, and easy-to-learn means of human-computer interaction. Using human hands directly as the input method of the computer, the communication between human and computer will no longer require an intermediate medium. Users can simply define an appropriate gesture to interact with the surrounding environment. Gestures are a form of non-verbal communication between humans, ranging from simple gestures of the hand to point directions...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06K9/00
Inventor 冯志全黄忠柱
Owner UNIV OF JINAN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com