Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Software interaction method and system for face recognition and storage medium

A face recognition and interaction method technology, which is applied to systems and storage media, and the field of software interaction methods for face recognition, can solve problems such as adverse user health, and achieve the effects of rich interfaces, rapid data feedback, and small installation packages.

Pending Publication Date: 2022-03-22
广州轻游信息科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a software interaction method, system and storage medium for face recognition, so as to solve the problem mentioned in the above-mentioned background technology that existing mobile games are not conducive to the health of users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Software interaction method and system for face recognition and storage medium
  • Software interaction method and system for face recognition and storage medium
  • Software interaction method and system for face recognition and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Such as figure 1 As shown, the present embodiment provides a software interaction method for face recognition, and the specific steps of the method are as follows:

[0059] S1: Based on a large number of face data models, combined with AI algorithms, train the marking model of key points of facial recognition under different postures and expressions;

[0060] S2: Use audio equipment to collect sound information, and judge the volume, and use the camera to capture video stream data;

[0061] S3: and according to the different application scenarios, call the collection scheme of different numbers of facial recognition key points;

[0062] S4: Preprocessing the video stream data;

[0063] S5: Combining the marking model of the key points of facial recognition after training, mark the key points of facial recognition under different gestures and expressions of the user in the preprocessed video stream data, and output the coordinate set of each facial recognition key poin...

Embodiment 2

[0088] Such as Figure 5 As shown, the present invention provides a software interaction system for face recognition, which includes: a face recognition key point labeling model training module, an information collection module, an information extraction module, and an information processing module. in:

[0089] Facial recognition key point marking model training module: collect a large number of face images under different poses and expressions, and manually mark them to obtain the actual key point coordinates of the face image, and use the face image as the input of the preset convolutional neural network to obtain The face image predicts the key point coordinates, updates the preset convolutional neural network through regression training, uses the difference between the actual face image key point coordinates and the face image predicted key point coordinates as a loss, and repeats the training until the network parameters converge or reach the maximum The number of itera...

Embodiment 3

[0094] This embodiment takes the balloon blowing game as an example to demonstrate the software operation method:

[0095] (1) Open the software, enter the scene selection interface, click the blowing balloon, enter the interactive window under the scene, and the user starts the operation according to the prompt on the screen;

[0096] (2) Call the front camera and audio equipment of the mobile phone. The camera captures the player's movements. Through the calculation of the key point coordinates, it is determined that the user has mouth opening and closing and pouting movements, indicating that the balloon is starting to blow. If the user's mouth opening and closing is not detected The balloon cannot be blown if the mouth is pouting; the audio device collects the user's voice information, and determines the volume through the volume judgment algorithm. The louder the volume and the longer the duration, the bigger the balloon will be blown until it explodes;

[0097] It should...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a software interaction method and system for face recognition and a storage medium, and the method comprises the steps: training a marking model of face recognition key points under different posture expressions based on a large number of face data models in combination with an AI algorithm; the method comprises the following steps: acquiring sound information by using audio equipment, judging the volume, and shooting by using a camera to obtain video stream data; according to different application scenes, calling acquisition schemes of different numbers of face recognition key points; in combination with the trained marking model of the facial recognition key points, marking the facial recognition key points of the user under different posture expressions, and outputting a coordinate set of each facial recognition key point under the corresponding posture expression; and performing operation control on an object in the software through the change of the key point coordinates and the volume. The system has the advantages of high recognition precision, high speed, super real-time feedback, small SDK size, abundant interfaces and the like, in addition, the system can also help people who sit for a long time to relieve cervical vertebra pressure and eyestrain and exercise vital capacity, and can be widely applied to games and related health care industries.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a software interaction method, system and storage medium for face recognition. Background technique [0002] With the rapid development of society, people's living standards are improving day by day, and the demand for entertainment life is also increasing. The rapid innovation of computer technology not only brings convenience to people's work and life, but also brings richness to people. entertainment games. In order to adapt to the current fast-paced lifestyle, mobile games that can be played anytime and anywhere have emerged as the times require, and have become one of everyone's favorite entertainment methods. At present, traditional mobile games are mostly operated by manual touch screen. Generally, the range of finger movement is small, and it needs to slide on the touch screen for a long time. It will lead to a series of health problems such as muscle fatigue, stiff a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/16G06V40/16G06V40/20G06V10/774G06V10/766G06V10/82G06K9/62
CPCG06F3/011G06F3/012G06F3/013G06F3/167G06F18/214
Inventor 曹伟伟陈庆展孙宏岩申霞
Owner 广州轻游信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products