Unlock instant, AI-driven research and patent intelligence for your innovation.

A new non-contact human-computer interaction method and system

A human-computer interaction and non-contact technology, applied in the field of human-computer interaction, can solve problems such as complex calculation process and hardware complexity, and achieve the effect of simple hardware equipment and small amount of calculation

Active Publication Date: 2021-05-28
SHENZHEN TECH UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the embodiments of the present invention is to provide a new non-contact human-computer interaction method, which aims to solve the problems in the prior art of using the camera calibration principle to perform non-contact human-computer interaction with complicated calculation process and complicated hardware.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A new non-contact human-computer interaction method and system
  • A new non-contact human-computer interaction method and system
  • A new non-contact human-computer interaction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0037] refer to figure 1 , figure 1 It is a flowchart of a new non-contact human-computer interaction method provided by an embodiment of the present invention, and the method includes the following steps:

[0038] S100. In the two-dimensional plane image of the depth camera, use the deep learning system to automatically detect the three vertices A, B, C and the target point F of the display screen, and obtain the plane pixel coordinates A(ua, va) and B( ub, vb), C (uc, vc), F (u0, v0);

[0039] S200. Convert the plane pixel coordinates of each point into three-...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention is applicable to the technical field of human-computer interaction, and provides a new non-contact human-computer interaction method and system. The method includes the steps: S100, in the two-dimensional plane image of the depth camera, automatically detect the position of the display screen Three vertices A, B, C and the target point F; S200, combined with the internal reference of the depth camera, converting the plane pixel coordinates of the vertices A, B, C and the target point F into three-dimensional coordinates in the depth camera coordinate system; S300, calculating the target The three-dimensional coordinates of the projected point F' of the point F on the display screen under the depth camera coordinate system; S400, calculate the plane pixel coordinates of the projected point F' on the display screen; S500, identify the action of the target point F, and call the relevant system mouse Interface for mouse event triggering. The invention solves the problem of using detectable target objects such as fingertips to manipulate screen content in a mouseless environment, without any calibration, and has the advantages of small calculation amount and simple hardware equipment.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a new non-contact human-computer interaction method and system. Background technique [0002] At present, non-contact human-computer interaction technology is widely used in interactive games, interactive museums, interactive tourism halls, and VR / AR (virtual reality / augmented reality) and other fields. In the past, various non-contact gestures can be used to interact with electronic products, such as adjusting the volume with gestures. This human-computer interaction technology without mouse operation has great market value and economic value. [0003] In the patent application document with the publication number CN102841679A, the invention name is a non-contact human-computer interaction method and device, a non-contact human-computer interaction method and device are disclosed, mainly using the camera calibration principle, which requires To ob...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06N3/04
CPCG06F3/017G06N3/045
Inventor 袁誉乐于奇郭学胤梁立新相韶华
Owner SHENZHEN TECH UNIV