Video character recognition method and device, storage medium and electronic equipment

A person recognition and person recognition technology, which is applied in the fields of computer-readable storage media and electronic equipment, video person recognition, and video person recognition devices, can solve the problems of low accuracy of recognition results, reduce asynchrony, improve accuracy, and The effect of recognition accuracy

Pending Publication Date: 2020-03-24
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has high requirements on the clarity of the face image. When the face im

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video character recognition method and device, storage medium and electronic equipment
  • Video character recognition method and device, storage medium and electronic equipment
  • Video character recognition method and device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0028] Among them, the key frame image refers to an image containing the appearance of a human face in the target video. One key frame or multiple key frames may be extracted, and the number of them is not limited in the present disclosure. The following provides several specific implementation methods on how to determine the key frame:

[0029] (1) Using a fixed interval method, in the target video, each interval is fixed for a fixed length of time or a fixed number of frames, and one frame is selected as a key frame. For example, a key frame image can be extracted for every 3 frames.

[0030] (2) Detect frames that contain or do not contain people in the target video, mark the frames that do not contain people as the background frame, and use the background frame as the dividing point to divide the target video into multiple sub-videos, and each sub-video contains people Consecutive frames. It can be considered that the person in each sub-video is the same person, so at least on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video character recognition method, a video character recognition device, a storage medium and electronic equipment, and relates to the technical field of artificial intelligence. The method comprises the following steps: acquiring a key frame image from a target video; extracting figure appearance features from the key frame image; intercepting sub-audios corresponding tothe key frame images from audios of the target video according to the time of the key frame images in the target video, and extracting voiceprint features from the sub-audios; and processing the figure appearance features and the voiceprint features by using a pre-trained fusion model to obtain a figure recognition result of the target video. According to the method and the device, the multi-modal features in the video can be fused, relatively high figure recognition accuracy is realized, and the method and the device are suitable for situations that the definition of the face image in the video is not high or the face image is shielded and the like and have relatively high robustness.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, and in particular to a video character recognition method, a video character recognition device, a computer-readable storage medium, and electronic equipment. Background technique [0002] Video character recognition refers to identifying the identity of the person in the video to classify the video or add character tags, etc. It has important applications in security, video classification, video content review, smart photo album and other scenarios. [0003] In related technologies, video person recognition is mainly realized based on face recognition in video images. Images containing faces are detected from videos, and then the faces in the images are further accurately recognized to determine the identity of the person. This method has high requirements on the clarity of the face image, and when the face image is not clear enough or is blocked, the accuracy of the rec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G10L17/04G06K9/62
CPCG10L17/04G06V40/10G06V40/172G06V20/46G06F18/241
Inventor 彭冬炜
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap