Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An Augmented Reality Keyboard and Mouse System Based on Gesture Interaction

An augmented reality and gesture technology, applied in the field of human-computer interaction, can solve the problems of harsh background noise and cloud computing network environment, low tracking system accuracy, discounted recognition accuracy, etc., to achieve short cycle, good user experience and stable performance. Effect

Active Publication Date: 2020-12-04
NAT INNOVATION INST OF DEFENSE TECH PLA ACAD OF MILITARY SCI +1
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the image-based method is susceptible to interference from natural light, which makes it extremely vulnerable to failure in outdoor environments. Moreover, due to the large range of motion of the human hand in space, fingers will occlude and interfere with each other, and the surface of the hand lacks a strong resolution. Features and other issues, resulting in low accuracy of image-based dynamic gesture tracking system, and it is prone to ambiguity
The voice-based interaction method has strict requirements on the background noise of the environment and the cloud computing network environment. For crowded public places or environments with unstable network environments, the recognition accuracy will be greatly reduced.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Augmented Reality Keyboard and Mouse System Based on Gesture Interaction
  • An Augmented Reality Keyboard and Mouse System Based on Gesture Interaction
  • An Augmented Reality Keyboard and Mouse System Based on Gesture Interaction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0047] Aiming at the technical problems existing in the prior art, the present invention provides an augmented reality keyboard and mouse system based on gesture interaction, which is simple in structure, easy to operate, can increase control speed, and can improve control reliability and accuracy.

[0048] figure 1 It is a system hardware composition diagram of the present invention, wherein, 1 is an electrotactile stimulation ele...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an augmented reality keyboard and mouse system based on gesture interaction. The augmented reality keyboard and mouse system comprises an MEMS module, an EMG module, an infraredlight module, an electric tactile stimulation module, an auditory feedback module, a depth image acquisition module, a visual enhancement module and a comprehensive processing module. The comprehensive processing module is connected with the MEMS module, the EMG module, the infrared light module, the electrotactile stimulation module, the auditory feedback module, the depth image acquisition module and the visual enhancement module. The auditory feedback module, the depth image acquisition module and the vision enhancement module are installed on the augmented reality glasses. Compared with atraditional keyboard and a traditional mouse, more natural man-machine interaction can be achieved, a stronger sense of reality is achieved, the manufacturing cost is low, and the period is short. The system is simple and light to wear, high in universality and suitable for various application scenes. Compared with a single-mode interaction method, the multi-mode gesture recognition and touch andauditory feedback combined interaction method based on the MEMS and the EMG is more stable in performance and better in user experience.

Description

technical field [0001] The invention mainly relates to the field of human-computer interaction, in particular to an augmented reality keyboard and three-dimensional mouse human-machine interface system based on gesture interaction. Background technique [0002] Augmented reality technology (Augmented Reality, referred to as AR), is an interactive experience with the real world environment. Objects residing in the real world are "enhanced" by computer-generated visual, auditory, tactile and other sensory information. The superimposed sensory information can be a supplement to the natural environment, or it can be a cover for the natural environment, and it is seamlessly intertwined with the physical world, so that people can get an immersive interactive experience. Augmented reality is used to enhance natural environments or situations and provide perceptually rich experiences. With augmented reality, information from the real world around the user becomes interactive and di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01
CPCG06F3/011G06F3/015G06F3/016G06F3/017
Inventor 印二威谢良秦伟鹿迎邓宝松闫野
Owner NAT INNOVATION INST OF DEFENSE TECH PLA ACAD OF MILITARY SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products