Man-machine interaction method based on laser

A human-computer interaction and laser technology, applied in the field of laser-based human-computer interaction, can solve the problems of unfriendly human-computer interaction, poor user experience, inconvenient operation, etc., achieve novel interaction methods, convenient operation, and improved ease of use sexual effect

Active Publication Date: 2019-10-18
HARBIN INST OF TECH AT WEIHAI +1
View PDF10 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention aims to solve the technical problems of inconvenient operation, heavy burden, poor precision and low efficiency; the human-computer interaction is not friendly enough and the user experience is poor because the existing arm-carrying wheelchair-type robot for helping the elderly and the disabled is operated by a handle. A laser-based human-computer interaction method with more convenient operation, light burden, high precision and high efficiency; more friendly human-computer interaction and better user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine interaction method based on laser
  • Man-machine interaction method based on laser
  • Man-machine interaction method based on laser

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0078] refer to Figure 4 , place a plurality of objects (such as: cups, spoons, water bottles, etc.) The switch of the pen 60 emits laser light and irradiates it on a target object (such as a cup), and a laser spot will be formed on the target object. In this embodiment, the laser spot is mainly used as the human-computer interaction medium. The system recognizes the target object according to the laser spot on the object, and realizes that the mechanical arm 20 automatically grabs the target object (that is, grabs the object on the table and moves to a certain fixed space) position), to realize the function of laser spotting objects, such as Figure 5 As shown, the specific control method is as follows:

[0079] Step S101 , use the RGB-D camera 30 to take pictures of the area where the object on the table is located, acquire a video, and send the video information to the main controller 50 .

[0080] In step S102, the main controller 50 performs sampling processing on the...

Embodiment 2

[0106] refer to Figure 4 , place a plurality of objects (such as: cups, spoons, water bottles, etc.) The switch of the pen 60 emits laser light and irradiates it on the water bottle of the first target object, and a laser spot will be formed on the water bottle. Stay for a period of time t2. This embodiment mainly identifies two target objects according to the two laser spots that appear on different target objects, and realizes that the mechanical arm 20 automatically grabs the first target object and moves to a certain fixed position above the second target object (that is, the object moves to the desktop on another fixed space position), such as Figure 7 As shown, the specific control method is as follows:

[0107] Step S201 , use the RGB-D camera 30 to take pictures of the area where the object on the table is located, acquire a video, and send the video information to the main controller 50 .

[0108] In step S202, the main controller 50 performs sampling processing...

Embodiment 3

[0153] refer to Figure 4 , place a plurality of objects (such as: cups, spoons, water bottles, etc.) The switch of the pen 60 emits laser light and irradiates on the water bottle of the first target object, and a laser spot will be formed on the water bottle. After staying for a period of time t1, the laser output by operating the laser pointer 60 is irradiated on a certain point on the cup of the second target object and stays for a period of time t2. The arm 20 automatically grasps the task of the first target object, the water bottle, moving to a certain fixed position above the second target object, the cup, and pouring water into the cup. Such as Figure 8 As shown, the specific control method is as follows:

[0154] Step S301 , use the RGB-D camera 30 to take pictures of the area where the object on the table is located, acquire a video, and send the video information to the main controller 50 .

[0155] In step S302, the main controller 50 performs sampling process...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a man-machine interaction method based on laser, and solves the problems of inconvenience in operation, heavy burden, poor precision and low efficiency due to the fact that anexisting arm-carrying wheelchair type robot for helping the old and the disabled is operated by a handle. The method comprises the following steps: acquiring an image of an object; identifying a laser spot existing in the image; and identifying the target object according to the laser spots. The method is widely applied to the technical field of human-computer interaction.

Description

technical field [0001] The invention relates to the technical field of robots for helping the elderly and the disabled, and in particular, relates to a laser-based human-computer interaction method. Background technique [0002] As we all know, China is in the stage of rapid development of an aging society, and the number of elderly and disabled people who need nursing care in society is increasing, which has greatly increased the rigid demand for robots for helping the elderly and the disabled. [0003] With reference to the Chinese invention patent application whose publication number is CN109048918A, the Chinese invention patent application whose application publication number is CN109262632A, and the Chinese invention patent application whose application publication number is CN107595505A, the arm-carrying wheelchair type robot for helping the elderly and the disabled has the functions of carrying, grabbing, and moving Object function, the human-computer interaction of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/0354G06F3/038G06K9/00G06K9/32G06N3/04G06N3/08
CPCG06F3/03545G06F3/0383G06N3/08G06V20/20G06V10/25G06N3/045
Inventor 刘亚欣钟鸣姚玉峰王思瑶
Owner HARBIN INST OF TECH AT WEIHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products