Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Target pushing method, system and device based on eyeball tracking

A target and eyeball technology, applied in the information field, can solve problems such as traffic accidents, unfavorable drivers' personal safety, multi-level interaction, cumbersome operation, etc., and achieve the effects of ensuring personal safety, fast and accurate positioning, and accurate maps

Active Publication Date: 2020-11-13
宁波均联智行科技股份有限公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, when the user needs to know a certain point of interest while driving, the user usually needs to click on the navigation or enter the search engine search. Although this method has certain accuracy and can meet the needs of most scenarios, but due to The whole operation process requires multi-level interaction, and the operation is too cumbersome, and if the interaction is performed while the vehicle is running, it is not conducive to the personal safety of the driver, and it is very likely to cause traffic accidents

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target pushing method, system and device based on eyeball tracking
  • Target pushing method, system and device based on eyeball tracking
  • Target pushing method, system and device based on eyeball tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] In order to achieve the above purpose, as figure 1 As shown, a method for pushing an object based on eye tracking is provided, including the following steps:

[0063] 110. The first server receives the first picture about the user's line of sight sent by the first camera and the second picture about the foreground of the vehicle sent by the second camera. The first picture and the second picture are respectively acquired by the first camera and the second camera It is captured when a shooting command triggered by the user is received.

[0064] Specifically, the user can issue "what is that " and similar shooting instructions, while looking at the target object, at this time, the first camera and the second camera are triggered to start shooting.

[0065] Above-mentioned first camera is an intelligent camera, and it is installed in the car, is aimed at the driver, and the second camera can be installed in the car likewise, and it is aimed at the outside of the car, is...

Embodiment 2

[0114] Corresponding to Embodiment 1, this application provides an eye tracking-based target push system, the system includes a first camera, a second camera, a vehicle terminal and a first server;

[0115] The first server is used for:

[0116] Receive the first picture about the user's line of sight sent by the first camera and the second picture about the foreground of the vehicle sent by the second camera, the first picture and the second picture are respectively captured by the first camera and the second camera when the user triggers the shooting Captured when commanded;

[0117] Identify the user's eyeball steering angle in the first picture, and simultaneously calculate the depth of field data of the second picture and obtain the GPS data of the vehicle at the trigger moment, and calculate a target GPS data according to the eyeball steering angle, the depth of field data and the GPS data of the vehicle;

[0118] Load the target GPS data into a retrieved map to determi...

Embodiment 3

[0139] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, all the methods described in Embodiment 1 are implemented.

[0140] image 3 The internal structure diagram of the computer equipment provided by the embodiment of the present invention. The computer device can be a server, and its internal structure diagram can be as follows image 3 shown. The computer device includes a processor, memory and a network interface connected by a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs and databases. The internal memory provides an environment for the operation of the operating system...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a target pushing method, system and device based on eyeball tracking. The method comprises the steps: enabling a first server to receive a first picture aboutthe sight of a user sent by a first camera and a second picture about the foreground of a vehicle sent by a second camera; identifying an eyeball steering angle of the user in the first picture, calculating depth-of-field data of the second picture and acquiring GPS data of the vehicle at the triggering moment, and calculating and obtaining target GPS data according to the eyeball steering angle,the depth-of-field data and the GPS data of the vehicle; loading the target GPS data to a called map, and judging whether a target object exists or not; and if yes, pushing the related information corresponding to the target object to the vehicle terminal. According to the invention, the interest point positioning can be realized only by capturing the eyeball rotation information, the complex interaction process is simplified, and the safety of the driving process can also be improved.

Description

technical field [0001] The invention belongs to the field of information technology, and in particular relates to an eye tracking-based target pushing method, system and equipment. Background technique [0002] At present, when the user needs to know a certain point of interest while driving, the user usually needs to click on the navigation or enter the search engine search. Although this method has certain accuracy and can meet the needs of most scenarios, but due to The entire operation process requires multi-level interaction, and the operation is too cumbersome, and if the interaction is performed while the vehicle is running, it is not conducive to the personal safety of the driver, and it is very likely to cause traffic accidents. Contents of the invention [0003] In order to solve the problems of the prior art, the present invention proposes a method, system, and device for pushing objects based on eye tracking. This method can realize point-of-interest positionin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G01S19/42G06F16/29
CPCG01S19/42G06F16/29G06V40/18G06V20/56
Inventor 陈翔陈豪
Owner 宁波均联智行科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products