186 results about "Target expression" patented technology

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for automatically generating datasets for a particular target expression photo effect. In one aspect, a system comprises receiving a plurality of image pairs, each comprising an original face image and an expressive face image representative of a target expression photo editing effect, generating an initial overall editing vector, wherein generating the initial overall editing vector comprises processing each image pair using a style space encoder model to generate an embedding of the original face image and an embedding of the expressive face image in an embedding space, optimizing the initial overall editing vector in accordance with one or more optimization criteria to generate an optimized overall editing vector, and applying the optimized overall editing vector to an input face image to generate a target expression face image that has the target expression photo editing effect.

The invention discloses a skin type robot facial expression control method and system based on a vision and language model. The method comprises the following steps of S1, obtaining an input image; capturing an image corresponding to the target expression through a camera installed at the eyes of the robot; S2, extracting facial key point features of the input image; s3, preliminarily acquiring a parameter instruction of a robot face steering engine; s4, a robot face steering engine is driven; according to the skin type robot facial expression driving method developed by the invention, visual and language information is analyzed in a staged manner, the real-time driving effect of the robot facial expression can be realized, and the driving of the robot facial expression is finely adjusted by utilizing a large language model; the robot can show good distinction degree in some subtle expressions, and the developed skin type robot has vivid facial expressions and can be applied to multiple interaction fields such as text travel, medical treatment and education.

The invention discloses an infrared and visible light image fusion method based on text supervised contrast learning. Comprising the steps that an infrared image, a visible light image and text description of the infrared image and the visible light image of the same scene are acquired, and multi-modal image features are extracted through linear embedding and cross attention Mama modules by adopting a preprocessing and image block division strategy; a pre-training text encoder is used for obtaining text semantic features, dimension alignment and weighted fusion of images and text features are achieved through an image-text feature alignment fusion module, and a fused image is generated. End-to-end training is carried out through image-text contrast learning loss in combination with pixel reconstruction and infrared intensity retention loss, and the semantic consistency and the thermal target retention capability of the fused image are effectively improved. The fusion process further comprises image-text matching weight calculation, feature weighting adjustment and fusion convolution operation. The method has the advantages of being high in semantic guiding capacity, excellent in fusion effect, accurate in hot target expression and the like, and is suitable for a multi-modal image processing task.

The invention relates to an audio data processing method, a neural network training method, an audio data processing device, electronic equipment and a computer readable storage medium. The method comprises the following steps: determining facial prior information of a virtual object based on reference video data; determining a target audio feature based on the target audio data; determining target expression sequence information based on the face prior information and the target audio feature; and determining target video data corresponding to the target audio data based on the target expression sequence information and a reference frame in the reference video data. According to the method and the device, the synchronization precision between the audio content and the facial component (such as the mouth) action of the virtual object can be remarkably improved, the real texture of the mouth action is enhanced, the expression difference between individuals is more accurately captured and reproduced, and the operation efficiency and the stability of the whole system are also improved while the performance of the system is improved.

The invention discloses an intelligent reminding method, device and equipment based on a large model, and relates to the field of natural language process.The method comprises the steps that first dialogue content input by a user is recognized through an exclusive model agent, and a first condition execution rule corresponding to a reminding task is obtained, the exclusive model agent is obtained by performing parameter fine tuning on a pre-trained large model; converting a first condition execution rule corresponding to the reminding task into a corresponding target CRON expression; establishing connection channels with a plurality of user terminals of the user; and under the condition that the triggering opportunity of the target CRON expression is met, based on a pre-configured execution mode of a reminding task and the target CRON expression, actively triggering the reminding task, and sequentially triggering the reminding task according to a multi-stage reminding matrix, so as to actively send reminding information to a user through a connection channel of a user terminal corresponding to each stage of reminding. According to the method, the reminding matrix is constructed, so that the cross-device cooperation capability is improved.

The present disclosure relates to an audio data processing method, a neural network training method, an audio data processing apparatus, an electronic device, and a computer readable storage medium. The audio data processing method comprises: determining facial prior information of a virtual object on the basis of reference video data; determining a target audio feature on the basis of target audio data; determining target expression sequence information on the basis of the facial prior information and the target audio feature; and on the basis of the target expression sequence information and a reference frame in the reference video data, determining target video data corresponding to the target audio data. According to the present disclosure, the synchronization precision between audio content and a facial component (e.g., the mouth) action of a virtual object can be significantly improved, the sense of reality of the mouth action is enhanced, an expression difference between individuals is captured and reproduced more accurately, and the operation efficiency and stability of the whole system are improved while the system performance is improved.

The invention relates to the technical field of movie and television animation production, in particular to a movie and television animation character expression generation method and system combined with motion capture, and the method comprises the steps: firstly collecting a real-time motion data set of a target actor through motion capture equipment, including face and body motion data subsets; the facial action data is composed of facial key point displacement data with multiple continuous timestamps, then calling a preset expression mapping model to decouple the facial action data to obtain a basic and personalized expression feature set, then adjusting the basic expression feature set according to preset emotion parameters of an animation role, generating an emotion adaptive expression feature set, and generating a personalized expression feature set according to the emotion adaptive expression feature set; the method comprises the steps of obtaining a personalized expression feature set, fusing with the personalized expression feature set to obtain a target expression feature set, finally driving a three-dimensional face model to generate an expression animation by using the target expression feature set, and binding body action data to a three-dimensional body model to generate a complete character animation, thereby improving the authenticity and expressive force of animation character expressions.

The invention provides an analysis method and system based on confused PASS in LLVM, and relates to the technical field of software protection. The method comprises the following steps: extracting a target function from a confused binary program, positioning the position of an encrypted character string in the target function, and determining decryption logic according to the position of the encrypted character string; searching a target expression in the target function, identifying expression logic through a mode matching mode, and determining character string encryption algorithm parameters based on decryption logic and the expression logic; constructing a control flow diagram according to the expression logic, identifying control variables in the control flow diagram, and generating a state conversion diagram of the control variables according to an assignment sequence of the control variables; and identifying an identifier of a useless basic block in the target function according to the state transition diagram, and determining obfuscation implementation logic of the obfuscated binary program based on the character string encryption algorithm parameter and the identifier of the useless basic block. According to the technical scheme provided by the invention, reverse derivation of the confusion implementation logic can be realized.

The embodiment of the invention discloses a transaction risk identification method and device, a storage medium and a program product, and relates to the field of information security and artificial intelligence. The method comprises the following steps: acquiring a face image sequence and a first voice sequence of a user within a preset time length and a behavior data sequence in a target application; performing expression recognition on each frame of facial image in the facial image sequence to obtain a target expression type sequence; performing emotion recognition on the first voice sequence to obtain a target emotion type, and performing behavior recognition on the behavior data sequence to obtain a target behavior type; and performing risk analysis on the target expression type sequence, the target emotion type and the target behavior type to obtain a transaction risk value, and determining a transaction risk level of the transaction performed by the user through the target application within the preset duration based on the transaction risk value, so that risk transactions can be identified from multiple dimensions, and the user experience is improved. Especially for risk transactions of special crowds in special risk scenes, the accuracy of transaction risk identification is improved.

The invention provides a customer service platform based on an AI digital human, a service method, equipment and a medium, and relates to the field of intelligent customer service, and the platform comprises a front-end display layer which is used for generating a chat interface for interaction between a user and the AI digital human; the digital human customer service interaction layer is used for performing sentiment analysis on the query content to obtain a sentiment category corresponding to the query content; matching a target virtual image and a target expression feature corresponding to the emotion category from a configured comparison table of different emotion categories, different virtual images and different expression features; generating a target virtual image of the AI digital human according to the target virtual image and the target expression feature; outputting response content by using the target virtual image voice; and the business processing layer is used for matching response content corresponding to the query content from the configured customer service knowledge base after receiving the query request. According to the application, the AI digital human image can be combined to realize multi-terminal efficient interaction intelligent customer service.

The invention provides expression migration and model training methods and devices, equipment and a storage medium, and relates to the technical field of expression migration. The method comprises the following steps: acquiring expression features of a sample reference expression image and identity features of a target virtual face image; generating a sample virtual face expression image according to the expression features and the identity features; according to the sample virtual face expression image and the sample reference expression image, calculating a loss function value by adopting a calculation mode corresponding to the face type of the sample reference expression image; the face type is a virtual face or a real face; and performing model training according to the loss function value to obtain a target expression migration model of the target virtual face image. Compared with the prior art, the problem that expression migration cannot be accurately completed is avoided.

The invention discloses an advertisement material intelligent optimization system and method based on knowledge extraction and knowledge fusion, and the method comprises the following steps: S1, obtaining and preprocessing a to-be-optimized advertisement material, and collecting an external knowledge source; s2, combined semantic analysis is executed, and cross-modal semantic alignment is carried out; s3, extracting entity units and corresponding semantic attributes, performing type labeling on the entity units, and establishing a semantic relation structure; s4, performing semantic fusion with an external knowledge source, calculating similarity between semantic vectors, performing entity mapping, performing normalization, and correcting conflict boundaries and attribute value divergence; s5, extracting a target expression fragment, and performing optimization according to a preset optimization rule set; and S6, verifying and detecting the optimized advertisement material, and outputting an optimization result. According to the method, deep understanding and cross-modal fusion optimization of advertisement materials can be realized, and the accuracy, attraction and propagation effect of advertisement semantic expression are improved.

According to the portrait action driving method and device, the storage medium and the computer equipment provided by the invention, when action driving is performed on the target portrait, the target audio data are firstly acquired, then the audio expression features of the target audio data are extracted by using the target feature extraction model, and the model can simultaneously capture the features of multiple layers in the audio data, so that the accuracy of action driving is improved. Many-to-many mapping among mouth shape action features, expression style features and head posture features in the audio expression features is realized, so that the driving effect coordination is improved; then, a target expression parameter generation model is determined, and the model is obtained through training based on the overlapping frame prediction technology, so that seamless conversion of the motion driving parameters obtained by predicting the audio expression characteristics through the model on the time sequence can be realized, the naturalness of the driving effect is further improved, and therefore, the driving efficiency is improved. And head action driving is performed on the target portrait based on the action driving parameters, so that a portrait action animation with high harmony and high naturalness can be generated.

The invention discloses a bionic robot facial expression synchronization method and device based on visual perception, equipment and a medium, and relates to the technical field of man-machine interaction, and the method comprises the steps: controlling a target bionic robot to execute a target expression control instruction used for achieving a preset expected robot facial expression, and capturing a robot visual facial expression of the robot; based on the robot visual facial expression and a preset expected robot facial expression, carrying out calibration on the target bionic robot so as to construct a hardware compensation parameter vector; executing a facial expression synchronization operation based on the hardware compensation parameter vector and a pre-trained target expression mapping model by asynchronously running a preset sensing thread and a preset driving thread; the preset sensing thread is used for collecting a target face image in real time and outputting a target steering engine control vector through a target expression mapping model; and the preset driving thread is used for outputting a steering engine control instruction at a preset output frequency based on a preset frame compensation algorithm, the hardware compensation parameter vector and the target steering engine control vector.

The invention discloses an expression recognition method and device, electronic equipment and a storage medium, and belongs to the technical field of artificial intelligence. The method comprises the following steps: acquiring an image pair comprising a target user face; the image pair comprises a natural expression image of the target user and a to-be-recognized image; performing fusion processing on the image pair, and inputting the image pair after fusion processing into a trained expression recognition model to obtain an expression recognition result of the to-be-recognized image generated by the expression recognition model; wherein the expression recognition model comprises an expression change extraction module and a decoder; the expression change extraction module is used for extracting target expression change features of the fused image pair; and the decoder is used for outputting an expression recognition result based on the target expression change feature. According to the embodiment of the invention, inherent differences of different individuals in emotional expression are fully considered, and the problem of identification deviation caused by neglecting individual expression characteristics in a traditional expression identification method is reduced, so that the accuracy of expression identification is improved.

The application provides a high-efficiency expression migration method using base expression space transformation, comprising a preprocessing stage and a facial expression migration stage; the preprocessing stage comprises: obtaining a source model O, the source model O being a base expression model comprising expression meshes under multiple different expressions; performing facial expression reconstruction on the source model O and a target model T to obtain expression description parameters of the two; performing similarity estimation according to the expression description parameters to obtain an expression parameter conversion matrix and a similarity matrix; the facial expression migration stage comprises: inputting a character picture into the base expression model, calculating expression description parameters of a target expression model according to the expression description parameters in the base expression model and the similarity matrix, and completing expression migration.

The present disclosure relates to an expression generation method and device, and a training method and device of an expression generation model, and relates to the technical field of computers. The method of the present disclosure comprises: acquiring feature information of each frame of image in an original video, feature information of a face key point, and classification information of an original expression; fusing the feature information of each frame of image, the feature information of the face key point, and the classification information of the original expression with preset classification information corresponding to a target expression to obtain feature information of a fused image corresponding to each frame of image; and generating a fused image corresponding to each frame of image according to the feature information of the fused image corresponding to each frame of image to obtain a target video in which a face expression formed by the fused images corresponding to all images is the target expression.

The present disclosure provides a landmark feature determination method and device, electronic equipment and storage medium. The landmark feature determination method comprises: obtaining target expression data, wherein the target expression data is used to represent the expression amount of each candidate feature in different cells; the average expression amount and expression proportion of each candidate feature in different cell types are counted; for each candidate feature, the first inter-class comparison data is determined according to the average expression amount of the candidate feature in the target cell type and the average expression amount of the candidate feature in the non-target cell type; for each candidate feature, the second inter-class comparison data is determined according to the expression proportion of the candidate feature in the target cell type and the expression proportion of the candidate feature in the non-target cell type; and the landmark feature of the target cell type is determined according to the first inter-class comparison data and the second inter-class comparison data. The embodiment of the present application can solve the problem of landmark feature specificity.

The invention provides an emotion recognition method and device, equipment, a storage medium and a program product, and relates to the field of artificial intelligence. The method comprises the following steps: acquiring a target image containing a target object; performing feature extraction on the target image through an R-FCN algorithm to obtain an individual model corresponding to the target object; obtaining target expression recognition data, target posture recognition data and target action recognition data corresponding to the target object through an R-FCN algorithm based on the individual model; based on the reference emotion data set, the target expression recognition data, the target posture recognition data and the target action recognition data, determining an expression score corresponding to the target expression recognition data, a posture score corresponding to the target posture recognition data and an action score corresponding to the target action recognition data; and determining a target emotional state corresponding to the target object based on the expression score, the posture score and the action score. According to the invention, the target emotional state corresponding to the target object can be identified more accurately.

This invention relates to an automatic base expression selection method based on local hybrid optimization, belonging to the field of computer and automation technology. The method includes: acquiring a sequence of facial expression models with the same topology; segmenting each facial expression model into multiple sub-regions; fitting each sub-region of the base expression in the base expression group to the corresponding sub-region of each target expression model; obtaining a local facial expression model corresponding to each target expression model; fusing the obtained local facial expression models to obtain a complete facial expression model corresponding to each target expression model; comparing each complete facial expression model with its corresponding target expression model, identifying the target expression model with the largest error compared to the corresponding complete facial expression model, and adding this target expression model as the base expression to the base expression group; obtaining the base expression group when the rate of change of the largest error is less than 0.1.

The invention provides a manufacturing decision system-oriented modular functional architecture and a collaborative mechanism thereof, and the structural organization and reusable collaboration of a manufacturing decision process are realized by constructing a multi-layer capability system, a functional module system and a standardized behavior interface. The architecture comprises a data interface module, a decision-making target module, a disturbance response module and a fusion decision-making module, and defines a data flow, a control flow and a trigger relationship among the modules. The system completes target expression, constraint analysis, disturbance identification and collaborative decision generation through standardized access of multi-source data such as orders, productivity, materials and processes, and forms an interpretable and executable decision link. According to the invention, modularization, interpretability and intelligent cooperation of the manufacturing decision-making system are realized, and multi-scene and multi-industry manufacturing decision-making application is supported.

Embodiments of the present application provide a face expression migration method and an expression migration device, an electronic device and a storage medium, and belong to the technical field of artificial intelligence. The method comprises: obtaining an original face image of a target object and a target expression category; determining a first training set according to the target object, the first training set comprising a plurality of first face sample images; determining a second training set according to the target expression category, the second training set comprising a plurality of second face sample images; inputting the second face sample images into a preset initial recurrent probability model for pre-training to obtain a pre-training model; inputting the first face sample images and the second face sample images into the pre-training model to obtain a first face processing image, and then obtaining a face expression migration model; and inputting the original face image into the face expression migration model to convert the original face image into a target face image matching the target expression category. The embodiments of the present application can efficiently and accurately realize migration of a face expression in an image.

The invention discloses a kinematics semi-analytical modeling method and terminal for a human wrist-simulated parallel mechanism, and the method comprises the steps: constructing a global coordinate system, a first coordinate system and a second coordinate system when the wrist parallel mechanism is subjected to kinematics positive solution, and then obtaining a target D-H expression corresponding to the tail end pose of the human wrist-simulated parallel mechanism, a target D-H expression is obtained, the target D-H expression shows the relation between the tail end pose and a first joint angle and the relation between the tail end pose and a second joint angle, then a target modular length expression is obtained, the target modular length expression shows the relation between a first modular length and the first joint angle and the relation between a second modular length and the second joint angle, and finally, the target D-H expression shows the relation between the tail end pose and the second joint angle. And obtaining numerical values of a first modulus length and a second modulus length, and substituting the numerical values of the first modulus length and the second modulus length into the target D-H expression and the target modulus length expression to obtain a tail end pose. The invention provides a solution capable of completing operation on a low-computing-power platform for a parallel mechanism simulating a human wrist.

The application discloses a three-dimensional face generation method and device, a three-dimensional face reenactment method and device, wherein the generation method comprises the following steps: acquiring an expression vector of a first image containing a first identity object based on a target expression coding network model; the first image is an image with a face having an occlusion; inputting the expression vector and a second image containing a second identity object into a target face generation network model to determine a target image of migrating the expression vector of the first image to a face of the second identity object in the second image; and enabling the face region of the first identity object in the first image to be identified as the expression vector even in the case of having the occlusion and to be migrated to the face of the second identity object in the second image, so that the accuracy of face expression migration is improved, and the robustness of face expression migration in the case of having the occlusion is improved.

The invention discloses a picture display method, device and equipment and a readable storage medium, and belongs to the technical field of electronic equipment. The method comprises the steps of receiving second input of a target expression label in at least one expression label under the condition that the at least one expression label is displayed; and in response to a second input, displaying an image corresponding to the target expression tag. According to the scheme, the images are classified according to the expression labels, so that the user can directly screen the images under the specified expression labels and then search the images required by the user from the images, and the image search efficiency is improved.

The present application relates to a facial expression-based unlocking method, device, computer equipment and storage medium. The method comprises: displaying an expression unlocking page; displaying an unlocking node sequence on the expression unlocking page; displaying a real-time acquired facial image in the facial preview area of ​​the expression unlocking page; generating an unlocking state identifier at the unlocking node to be processed in the unlocking node sequence based on the facial expression in the corresponding facial image; when an unlocking state identifier is generated at each unlocking node in the unlocking node sequence and the facial expression in each facial image matches the corresponding target expression, the unlocking is successful. The use of this method can effectively improve information security.

The invention discloses a data access control method and device, equipment and a storage medium, and relates to the field of data security, and the method comprises the steps: sending a preset execution logic to an execution end, and then obtaining a post-packaging execution logic and post-packaging parameter information returned from the execution end; converting the packaged execution logic into a target expression, and determining target function data based on the generated target expression and the obtained packaged parameter information by using a preset engine tool; determining a target time range corresponding to the target function data, caching the target function data to a preset ordered queue according to the target time range, and obtaining a target time range execution result based on the preset ordered queue, the target function data and the target time range; and performing a preset result encapsulation operation on the target time range execution result to obtain a target encapsulation result, and sending the target encapsulation result to an execution end to complete data access control. According to the invention, the security of the data can be improved, and the security and integrity of the data are ensured.

The invention discloses an information recommendation method, electronic equipment and a computer readable storage medium. The method comprises the following steps: in response to a received first data request, based on environmental parameters and position transformation information of a target object, controlling expression acquisition equipment to acquire the target object to view a target expression image of current recommendation information; performing feature extraction on the target expression image to obtain expression features of multiple dimensions; analyzing the expression of the target object for viewing the current recommendation information based on the expression features of the multiple dimensions to obtain an expression analysis result; in response to a received second data request sent by the target client, obtaining object behavior data of the target object for the current recommendation information; and adjusting the current recommendation information based on the expression analysis result and the object behavior data to obtain target recommendation information. According to the invention, the technical problem of poor information recommendation effect in related technologies is solved.

The application discloses a face expression recognition method and device, equipment and storage medium, relates to the artificial intelligence technical field, and includes: in the process of utilizing a target expression recognition model to perform face expression recognition on video frames of a target face video, for any video frame at any time, extracting each face key point, and generating a spatial heat map based on each face key point, and generating a spatial feature vector based on the spatial heat map and the image features of the video frame; determining the spatial feature vector difference between the spatial feature vector of the video frame at the current time and the spatial feature vector of the video frame at the previous time, and determining the first hidden state corresponding to the spatial feature vector of the video frame at the current time and the second hidden state corresponding to the spatial feature vector difference; determining the fusion features based on the first hidden state and the second hidden state, and determining the face expression recognition result of the video frame at the current time based on the fusion features. The application can improve the stability and accuracy of dynamic face expression recognition.

Embodiments of the present application provide a method and device for generating a dynamic image based on audio, an apparatus, and a storage medium, relating to the field of natural human-computer interaction. The method comprises: first obtaining a reference image and a reference audio input by a user; then, based on the reference image and a trained generation network model, determining a target head action feature and a target expression coefficient feature, and adjusting the trained generation network model based on the target head action feature and the target expression coefficient feature to obtain a target generation network model; finally, based on the reference audio, the reference image, and the target generation network model, processing a to-be-processed image to obtain a target dynamic image; wherein the to-be-processed image is the same as an image object in the reference image; in this way, a corresponding digital person can be obtained based on a single picture of a target person; in this way, video acquisition work and data cleaning work are not required, the production cost of the digital person can be reduced, and the production cycle of the digital person is shortened.