Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Visual attention recognition method and system, storage medium and processor

A visual attention and recognition method technology, applied in the visual attention recognition method and system, storage media, and processor fields, can solve problems such as inability to accurately identify user attention

Pending Publication Date: 2020-01-10
BANMA ZHIXING NETWORK HONGKONG CO LTD
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] Embodiments of the present invention provide a visual attention recognition method, system, storage medium, and processor to at least solve the technical problem that the prior art cannot accurately identify the user's attention

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual attention recognition method and system, storage medium and processor
  • Visual attention recognition method and system, storage medium and processor
  • Visual attention recognition method and system, storage medium and processor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035]According to an embodiment of the present invention, an embodiment of a visual attention recognition method is also provided. It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0036] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. figure 1 A block diagram of a hardware structure of a computer terminal (or mobile device) for realizing a recognition method of visual attention is shown. Such as figure 1 As shown, the computer terminal 10 (or mobile device 10) may include one or more (shown by 102a, 102b, ..., 102n in the figure) processor 102 (the processor 10...

Embodiment 2

[0120] The present invention is described below through a more detailed embodiment. In the following embodiment, a classroom teaching quality assessment system is introduced in detail, wherein the schematic diagram of the classroom teaching quality assessment system is as follows Figure 8 As shown, the specific steps are as follows:

[0121] Step S1: The video information of the front camera is used as input.

[0122] Step S2: line-of-sight prediction based on facial features. Among them, line of sight prediction includes: face detection, marking facial feature points, calculating head orientation and eye direction, and finally obtaining the direction of visual attention.

[0123] Step S3: Because the method of determining the direction of visual attention based on facial feature points in step S2 usually cannot accurately obtain the feature points of all students, such as being affected by light or glasses, the face image is blurred, or even the face is blocked , then the ...

Embodiment 3

[0147] According to an embodiment of the present invention, there is also provided a system for implementing the recognition method of the above-mentioned visual attention, such as Figure 11 As shown, the system includes:

[0148] A first camera 1101, configured to collect first image information of the target area;

[0149] Processor 1103, connected to the first camera, used to identify the predetermined facial area of ​​the first target object from the first image information; use the first model to analyze the predetermined facial area, and obtain the facial feature points of the first target object , determine the head posture and visual direction of the first target object according to the facial feature points, wherein the first model is trained by machine learning using multiple sets of data, and each set of data in the multiple sets of data includes at least one of the following: The image and facial feature points are identified in the image; according to the head p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a visual attention recognition method and system, a storage medium and a processor. The method comprises the following steps: acquiring first image information of a target areathrough a first camera; identifying a face predetermined area of the first target object from the first image information; analyzing the predetermined area of the face by using a first model to obtain the facial feature points of the first target object, then determining the head posture and the visual direction of the first target object according to the facial feature points, training the firstmodel through machine learning by using multiple sets of data, wherein each set of data in the multiple sets of data comprises at least one of the following: an image and the facial feature points identified in the image; and determining an object of visual attention of the first target object according to the head posture and the visual direction. The technical problem that the attention of theuser cannot be accurately recognized in the prior art is solved.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a visual attention recognition method and system, a storage medium, and a processor. Background technique [0002] In recent years, with the deepening of artificial intelligence technology, artificial intelligence is rapidly changing various industries. [0003] In the education industry, classroom teaching is the core of the education industry. By introducing artificial intelligence technology, educational big data and artificial intelligence can be closely linked. For example, artificial intelligence technology can be introduced in the recording and broadcasting of classroom teaching. [0004] It should be noted that recording and broadcasting refers to the recording of classroom teaching content through camera devices, and the combination of recording and broadcasting with artificial intelligence technology makes recording and broadcasting courses not only recorders and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06N20/00
CPCG06V40/166G06V40/171G06V40/172
Inventor 郑魁刘林岩沈宇峰
Owner BANMA ZHIXING NETWORK HONGKONG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com