Equipment controlling method and device, control equipment and storage medium

A device control and device technology, which is applied in the field of eye tracking and can solve problems such as the inability to realize the control of the device interaction process.

Active Publication Date: 2018-10-19
BEIJING 7INVENSUN TECH
View PDF7 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, gaze tracking is widely used to control devices, but it cannot control the interaction process between devices

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Equipment controlling method and device, control equipment and storage medium
  • Equipment controlling method and device, control equipment and storage medium
  • Equipment controlling method and device, control equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] figure 1 It is a schematic flowchart of a device control method provided in Embodiment 1 of the present invention. This method is applicable to the situation where multiple devices are controlled to interact with each other through eye-tracking technology. The method can be executed by the device control device provided in the embodiment of the present invention. Wherein the device can be realized by software and / or hardware, and generally integrated on the control device. In this embodiment, the control device includes but not limited to: an eye tracking device.

[0032] Such as figure 1 As shown, a device control method provided in Embodiment 1 of the present invention includes the following steps:

[0033] S101. When the user looks at the first device, determine the identity of the first device according to the image information of the first device, and acquire the user's eye image and movement information.

[0034] In this embodiment, a user may be understood as ...

Embodiment 2

[0055] Figure 2a It is a schematic flow chart of a device control method provided in Embodiment 2 of the present invention. This Embodiment 2 is optimized on the basis of the foregoing embodiments. In this embodiment, determining the identity of the first device according to the image information of the first device is further embodied as: acquiring the image information of the first device; The identification information corresponding to the image information of the first device is used as the identity of the first device.

[0056] Further, this embodiment will also determine the interactive operation instruction to be executed according to the gaze point corresponding to the eye image and the motion information, and further optimize it as: extracting feature information in the eye image, the feature information Including pupil features; determining the line of sight corresponding to the eye image according to the feature information; determining the gaze point of the user ...

Embodiment 3

[0096] image 3 It is a schematic structural diagram of a device control device provided by Embodiment 3 of the present invention. The device is applicable to the situation where multiple devices are controlled to interact through eye-tracking technology. The device can be implemented by software and / or hardware, and is generally integrated in the control device.

[0097] Such as image 3 As shown, the device control device includes: an information acquisition module 31 , an instruction determination module 32 , an identification determination module 33 and a sending module 34 .

[0098] Wherein, the information acquisition module 31 is used to determine the identity of the first device according to the image information of the first device when the user looks at the first device, and obtain the user's eye image and motion information;

[0099] An instruction determination module 32, configured to determine an interactive operation instruction to be executed according to the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an equipment controlling method and device, control equipment and a storage medium. The method comprises the steps of: when a user watches first equipment, determining an identity of the first equipment according to image information of the first equipment and acquiring eye images and motion information of the user; determining a to-be-executed interactive operation instruction according to watching points corresponding to the eye images and the motion information; determining an identity of second equipment according to image information of the second equipment when the user watches the second equipment; and sending the identity of the first equipment, the identity of the second equipment and the interactive operation instruction to the first equipment and/or the second equipment on the basis of the interactive operation instruction. By utilizing the method, in the process of controlling the equipment, the watching points of the user can be determined by analyzing the eye images of the user and the interactive control among multiple pieces of equipment is effectively realized by combining the motion information of the user; and application scenes of eye tracking techniques are expanded.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of gaze tracking, and in particular, relate to a device control method, device, control device, and storage medium. Background technique [0002] Human-computer interaction refers to the process of information exchange between humans and machines that use a certain dialogue language to complete certain tasks in a certain interactive way before humans and machines (such as computers). With the development of related fields such as machine learning and computer vision, machines can recognize the user's gestures, postures, and line of sight. Among them, line of sight has gradually become one of the most important means of human-computer interaction, and has broad application prospects in the field of human-computer interaction. [0003] Gaze tracking is to use eye movement measurement equipment to capture the user's eye image, analyze the feature information in the eye image, estimate the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
CPCG06F3/013
Inventor 秦林婵刘琳黄通兵
Owner BEIJING 7INVENSUN TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap