Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video character recognition method and device, storage medium and electronic equipment

A person recognition and person recognition technology, which is applied in the fields of computer-readable storage media and electronic equipment, video person recognition, and video person recognition devices, can solve the problems of low accuracy of recognition results, reduce asynchrony, improve accuracy, and The effect of recognition accuracy

Pending Publication Date: 2020-03-24
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has high requirements on the clarity of the face image. When the face image is not clear enough or is blocked, the accuracy of the recognition result is low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video character recognition method and device, storage medium and electronic equipment
  • Video character recognition method and device, storage medium and electronic equipment
  • Video character recognition method and device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0029] (1) Using a fixed interval method, in the target video, select a frame as a key frame at a fixed interval or a fixed number of frames, for example, a key frame image can be extracted every 3 frames.

[0030] (2) Detect frames that contain people or do not contain people in the target video, mark the frames that do not contain people as background frames, use the background frame as the segmentation point, and divide the target video into multiple sub-videos, each of which contains people consecutive frames. It can be considered that the characters in each sub-video are the same person, so at least one frame is extracted from each sub-video as a key frame.

[0031] (3) Considering that video frames usually need to be decoded when extracting a complete image from a video, an intra-coded frame can also be extracted from a target video and decoded to obtain a key frame image.

[0032] Wherein, an intra-coded frame (Intra-Coded frame, referred to as I frame) is a frame inde...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a video character recognition method, a video character recognition device, a storage medium and electronic equipment, and relates to the technical field of artificial intelligence. The method comprises the following steps: acquiring a key frame image from a target video; extracting figure appearance features from the key frame image; intercepting sub-audios corresponding tothe key frame images from audios of the target video according to the time of the key frame images in the target video, and extracting voiceprint features from the sub-audios; and processing the figure appearance features and the voiceprint features by using a pre-trained fusion model to obtain a figure recognition result of the target video. According to the method and the device, the multi-modal features in the video can be fused, relatively high figure recognition accuracy is realized, and the method and the device are suitable for situations that the definition of the face image in the video is not high or the face image is shielded and the like and have relatively high robustness.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, and in particular to a video character recognition method, a video character recognition device, a computer-readable storage medium, and electronic equipment. Background technique [0002] Video character recognition refers to identifying the identity of the person in the video to classify the video or add character tags, etc. It has important applications in security, video classification, video content review, smart photo album and other scenarios. [0003] In related technologies, video person recognition is mainly realized based on face recognition in video images. Images containing faces are detected from videos, and then the faces in the images are further accurately recognized to determine the identity of the person. This method has high requirements on the clarity of the face image, and when the face image is not clear enough or is blocked, the accuracy of the rec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G10L17/04G06K9/62
CPCG10L17/04G06V40/10G06V40/172G06V20/46G06F18/241
Inventor 彭冬炜
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com