Man-machine interface device and method for achieving auxiliary information prompting based on regions of interest

A human-machine interface device and region-of-interest technology, applied in computer components, mechanical mode conversion, user/computer interaction input/output, etc., to facilitate hands-free human-computer interaction, highlight substantive features, and improve overall efficiency Effect

Inactive Publication Date: 2013-08-14
NAVAL AERONAUTICAL & ASTRONAUTICAL UNIV PLA
View PDF3 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention mainly solves the problems of unreliable and accurate speech input of existing man-machine interface devices, narrow scope of application of body language recognition and low efficiency of providing prompt information of interest to users And other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine interface device and method for achieving auxiliary information prompting based on regions of interest
  • Man-machine interface device and method for achieving auxiliary information prompting based on regions of interest
  • Man-machine interface device and method for achieving auxiliary information prompting based on regions of interest

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] Example 1, see figure 1 , 2 , choose the camera 4 as the sensor 1, choose the wearable computer for the computer 2 according to the needs, connect the camera 4 and the see-through head-mounted display (See-Through HMD) 3 to the computer 2 respectively through lines, and connect the computer 2 and the see-through The head-mounted display (See-Through HMD) 3 is connected to the video adapter 6, and a power supply module 7 is added to the computer 2 at the same time, so that the direction and range of the field of view of the camera 4 overlaps with the field of view of the user, forming a man-machine of the first method of the present invention interface device.

Embodiment 2

[0042] Embodiment 2, the same as Embodiment 1, the difference is that the electromagnetic tracker is selected as the sensor 1, and the electromagnetic field sensitive terminal of the electromagnetic tracker is worn on the user's head, and the relative position relationship with the user's head is fixed; A portable computer; forming a human-machine interface device for realizing the second method of the present invention.

[0043] According to the different sensors used, the realization method of this system is also different. Divided into the following two methods:

[0044] 1. Target object recognition method 1 (must have camera, computer, HMD)

[0045] The first method uses the camera as the sensor, and its working principle is as follows: figure 2 As shown; the video adapter is used to adapt the input signal of the HMD. If the computer can directly provide the video signal required by the HMD, the video adapter is not needed; the wearable computer is used as an example in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a man-machine interface device and method for achieving auxiliary information prompting based on regions of interest. The man-machine interface device is characterized by adopting a camera or an electromagnetic tracker as an input device and a perspective head-mounted display as an output device and aims at providing auxiliary prompting information for customers in real time. The achieving principle is that: firstly recognizing a target object (like aviation cockpit instruments) saw by a user currently, and then displaying the auxiliary prompting information corresponding to the target object on the miniature head-mounted display so as to achieve intelligent teaching, training or maintenance tasks. Manual operation of users are not needed when users carry out auxiliary information prompting, so that handless man-machine interaction can be achieved conveniently, intelligent teaching, training and maintenance tasks can be finished in aviation cockpits, vehicle cabs, workshop operation tables, operating rooms and the like, and the man-machine interface device and method can be used in fighter-pilot helmet aiming line measuring and the like.

Description

technical field : [0001] The present invention relates to the technical field of augmented reality and artificial intelligence, and specifically relates to a human-machine interface device and method for realizing auxiliary information prompt based on an area of ​​interest, respectively adopting a digital camera or an electromagnetic tracker as an input The display See-Through HMD is an output device whose goal is to provide auxiliary information to the user in real time. Background technique : [0002] With the development of virtual reality technology, augmented reality technology and artificial intelligence technology, computer-aided teaching, computer-aided training, computer-aided maintenance, and computer-aided manufacturing in the form of intelligent man-machine systems are gradually applied to industries including national defense, industry, education, Various fields including medicine and entertainment. In these man-machine systems, there are generally two proble...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
Inventor 乔勇军谢晓方李德栋孙涛陈青华曹建唐江
Owner NAVAL AERONAUTICAL & ASTRONAUTICAL UNIV PLA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap