Wearable three-dimensional gesture interaction system and using method thereof

A technology of three-dimensional gestures and interactive systems, applied in user/computer interaction input/output, mechanical mode conversion, instruments, etc., can solve problems such as high hardware requirements, unsuitable for mobile devices, and unsuitable for large-scale commercial promotion, etc., to achieve The effect of simple equipment, vivid three-dimensional graphical interface and low cost

Inactive Publication Date: 2011-09-21
SHANGHAI UNIV
View PDF5 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These patents get rid of the traditional mouse and keyboard hardware constraints to achieve the purpose of device virtualization, but they need the support of special hardware, which is not suitable for the requirements of mobile devices.
Chinese patent: its name is "Wearable Multimedia Wireless Microcomputer with Chinese LINUX Operating System", application number 00107607.8, this patent uses human natural language for human-computer interaction, but people are more accustomed to using hands for interaction, so this patent Not suitable for large-scale commercial promotion
Chinese patent: its name is "A Human-Computer Interaction Helmet for Wearable Computers", application number 200710023167.X, this patent proposes a device with eye-tracking function, which can realize human-computer interaction with wearable computers by cooperating with voice The helmet can be widely used in aviation, aerospace, machinery manufacturing, electric power, military and other application fields that cannot completely liberate people's hands, but the hardware requirements are too high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Wearable three-dimensional gesture interaction system and using method thereof
  • Wearable three-dimensional gesture interaction system and using method thereof
  • Wearable three-dimensional gesture interaction system and using method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0022] Embodiment one: if figure 1 As shown, the wearable 3D gesture interaction system includes a portable computer (1), a camera (2), a micro-projector (3) and some colored markers (4). The interactive system has low requirements for hardware, and no requirements for micro-projectors and cameras, so the system cost is low. In order to make the picture taken by the camera the picture that the user sees, and the hand movement does not affect the projection effect, such as figure 1 As shown, the micro-projector and camera are placed on the hat.

Embodiment 2

[0023] Embodiment two: the use method of wearable three-dimensional gesture interaction system, such as figure 2 As shown, the specific steps are as follows:

[0024] ①, mark recognition;

[0025] ②, action recognition;

[0026] ③. Response output.

[0027] The mark recognition described in the above step ① is to obtain the information of the colored mark on the user's finger through the camera, and obtain its coordinate information through image segmentation. The specific steps are as follows:

[0028] (1). Obtain key frame images.

[0029] (2) Carry out image segmentation on the colored markers in the key frame image, obtain the coordinates of each colored marker, and calculate the relative position of each marker as a gesture.

[0030] The action recognition described in the above step ② performs gesture interaction, and its specific steps are as follows:

[0031] (3) Is it a multi-touch gesture? If it is a multi-touch gesture, go to step (7), otherwise go to step (4...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a wearable three-dimensional gesture interaction system and a suing method thereof. The system consists of a micro projector, a common camera, a portable computer, and a group of simple and easy marks. The function of human-computer interaction by using gestures and a three-dimensional graphical interface is realized through simple and easy computer vision computation. In the wearable three-dimensional gesture interaction system, a three-dimensional graphical interface is more vivid and the interaction mode is more flexible through a projection screen marked three-dimensional graphical interface mode and a virtual mouse gesture. The wearable three-dimensional gesture interaction system has simple equipment and low cost and can meet the requirements on mobile equipment.

Description

technical field [0001] The present invention relates to a wearable three-dimensional graphic interface gesture interaction technology, in particular to a wearable three-dimensional gesture interaction system based on monocular vision and marking, using gestures for human-computer interaction and its use method. Background technique [0002] With the continuous improvement of people's requirements for natural interaction, human-computer interaction through gestures has become a mainstream trend. In order to operate virtual data anytime and anywhere, wearable computer technology is a feasible method to solve this problem. With the development of pico projectors, it is an irreversible trend that pico projectors become the standard configuration of mobile devices. At the same time, people are gradually dissatisfied with the too small display screen of mobile devices. Therefore, projecting the interface onto a plane to expand the screen size has become a research hotspot. [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/033
Inventor 凌晨陈明张文俊赵凡
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap