21 results about "Mouth shape" patented technology

The application relates to the technical field of video data processing, and relates to an audio-video synchronous noise reduction method and system based on AI visual perception, which comprises the following steps: pre-processing audio data to obtain pre-processed audio data; performing time-frequency analysis on the pre-processed audio data to obtain a speech feature set and a background sound feature set; performing noise reduction on video data to obtain primary noise reduction video data, performing visual perception on the primary noise reduction video data to obtain a video feature set; performing time axis correction operation on the speech feature set based on a mouth shape feature according to the video feature set to obtain an updated time axis; performing active noise reduction operation on the progress correction audio data according to the updated time axis and a pre-constructed background sound adaptation degree sequence to obtain noise correction audio data; and performing merging operation on the noise correction audio data and the primary noise reduction video data to obtain synchronous noise reduction audio-video. The application can improve the clarity of images and sounds in a video.

This utility model discloses an integrated multifunctional intubation device with flushing, drainage, and drug administration functions. The device includes an intubation tube, a three-way drug administration flushing and drainage device, a connecting tube, and an anti-backflow negative pressure drainage ball. The inner surface of the intubation tube has supporting teeth to prevent compression closure. One end is a connecting section, and the working section's tail end is fish-mouth shaped with staggered flushing holes on its smooth surface. The outer circumference of the intubation tube has an "I"-shaped fixing ring. The three-way valve is connected to the anti-backflow negative pressure drainage ball through the connecting tube, allowing liquid in the intubation tube to flow into the drainage ball, preventing backflow and allowing liquid to flow out through the drain hole. The connections between the connecting tube, the intubation tube, and the three-way valve are all threaded and tightened. This device integrates multiple functions, has a reasonable structural design, and can effectively realize flushing, drainage, and drug administration operations, while also preventing blockage of the intubation tube due to compression and dislodgement due to external force.

The utility model relates to face mask base cloth technical field discloses a kind of seaweed fibre face mask base cloth, including face mask base cloth, the outside of face mask base cloth is provided with fitting mechanism, the outside of face mask base cloth is equipped with connecting mechanism, the fitting mechanism includes nose paste, the side of nose paste is fixedly connected in the side of face mask base cloth, the both sides of nose paste are fixedly connected with nose side covering paste, the outside of face mask base cloth is equipped with mouth slot, the inner wall of mouth slot is provided with mouth covering paste, the bottom of face mask base cloth is equipped with mounting assembly, the mounting assembly includes support block, the top of support block is bonded in the bottom of face mask base cloth.In the utility model, ensure that face mask is closely fitted nose curve, mouth covering paste is adapted according to mouth profile, optimize the absorption effect of essence, the adjustable design of eye slot meets the demand of eye, overall improvement comfort, make skin care effect reach best.

The application discloses a kind of virtual digital person multimedia teaching interaction method, system and storage medium, method includes: in unified time caliber and window basis, based on the same window data group calculates audio mouth shape time difference, mouth shape caption time difference, audio caption time difference, video mouth shape time difference, and compared with time difference threshold value output misplacement alarm result, realize the unified constraint to four kinds of key alignment relationship;When alarm triggers, according to misplacement alarm result selection degradation strategy and generate execution record, misplacement alarm result and execution record are formed evidence chain data package by summarizing;When the cumulative number in preset window number exceeds diffusion blocking threshold value, recording output switches to the video stream that reserved audio and caption are not superimposed mouth shape;Based on evidence chain data package generates rectification publishing stream and replaces recording and broadcast corresponding time segment and keeps hash check value when time sequence consistent index satisfies publishing threshold value, so that it realizes that handling action can be driven, diffusion can be inhibited and rectification can be replaced.

The application provides a multi-stage semantic emotion-driven digital human action generation method, and relates to the technical field of digital human action generation. The application extracts audio features and text semantic features and completes time alignment and fusion through multi-modal preprocessing of input audio and text to obtain a multi-modal feature sequence. Then, the sequence is used to identify semantic intent and analyze emotion to obtain a semantic intent sequence and an emotion curve containing categories, intensity and change trend. Subsequently, a global action script containing action type, intensity, duration and priority is generated according to a preset action mapping rule. The script is encoded into a feature vector and input into a lightweight neural network to obtain an action parameter sequence containing facial expressions, mouth shapes, skeletal actions and gaze directions. After time sequence smoothing and physical constraint checking, the final digital human driving parameters are output, which can realize low-power real-time operation, smooth action, accurate mouth shape synchronization and emotion and semantic matching.

The utility model relates to high accuracy controller waterproof shell, including upper casing and lower casing, the lower casing has the first lower connecting plate of square mouth shape and the second lower connecting plate of square mouth shape, the upper casing has the first upper connecting plate of square mouth shape and the second upper connecting plate of square mouth shape, the first lower connecting plate and first upper connecting plate are oppositely arranged, and are provided with the first sealing ring between first lower connecting plate and first upper connecting plate, and the second lower connecting plate and second upper connecting plate are oppositely arranged, and are provided with the second sealing ring between second lower connecting plate and second upper connecting plate, the first lower connecting plate and second lower connecting plate form the lower recess, and the first upper connecting plate and second upper connecting plate form the upper recess, the utility model can prolong the service life of sealing ring, and the sealing effect is good, and can guarantee the sealing effect of overall shell under the condition that one of sealing rings fails.

Whether or not a translated text corresponds to the character's mouth movements is appropriately evaluated. At least one processor (11) generates a similarity degree indicating a similarity of the character's mouth movements, based on the character's mouth shape corresponding to each of phonemes (33a through 33c) included in a pre-translation phoneme sequence (33) and on the character's mouth shape corresponding to each of phonemes (34a through 34e, 35a, and 35b) included in post-translation phoneme sequences (34 and 35).

The application relates to the technical field of three-dimensional digital people, and discloses a three-dimensional digital person action generation method and device and electronic equipment. In the application, two mutually independent facial mouth shape feature coding units and body action feature coding units are adopted to code the related feature information of the three-dimensional digital person, and a bidirectional coding feature interaction unit is used to interact the feature information of the mutually independent facial mouth shape feature coding units and body action feature coding units, so that the generated facial mouth shape and body action can be ensured to be sufficiently coordinated, the mutually independent coding modes are used, the two coding units can more deeply learn the respective unique feature distribution, and the finally generated facial mouth shape is accurate and the body posture is expressive.

The application belongs to the technical field of image processing, and discloses a digital human lip synchronization driving method and system. The method comprises the following steps: constructing a continuous audio playing time axis according to an audio stream sampling rate and actual output sampling frame numbers in an audio processing callback; generating a mouth shape advancing clock according to the continuous audio playing time axis; generating a mouth shape parameter sequence with a time label according to speech frame features and pronunciation context; writing the mouth shape parameter sequence with the time label into a mouth shape parameter ring buffer in chronological order and setting a target occupation depth; querying the mouth shape parameter corresponding to a current output time according to the mouth shape advancing clock, and performing a prediction advancing when the mouth shape parameter has been generated; determining callback jitter according to a deviation ratio, and performing a change amplitude limitation and adjusting the target occupation depth when the callback jitter occurs. The application improves the lip synchronization precision by constructing the continuous audio playing time axis and generating the mouth shape advancing clock.

The utility model provides a kind of multi-composite tire tread pre mouth shape, comprising: pre mouth shape main part, pre mouth shape main part is provided with multiple end surfaces, pre mouth shape main part is communicated with extruder flow channel mouth by first end surface, to receive fluid glue, pre mouth shape main part is connected with mouth shape plate by second end surface, to form the tire tread with predetermined cross-sectional shape;Multi-layer composite flow channel, each layer flow channel is provided with several glue inlets and several glue outlets, and the glue outlet of different layer flow channel is provided with preset interval width towards the gel flow direction end, to facilitate the composite between different layer glue material.The utility model uses multi-layer composite flow channel, by introducing and pattern style matching tread pre mouth shape structure, after combination, the composite tread of different pattern can be extruded, improve tread wear resistance and tear resistance, obtain to meet the performance requirements of composite tire tread structure, solve the problem of low tire shoulder hardness and poor tear resistance of previous pre mouth shape.

The utility model discloses a locking connector relates to locking connector technical field, including outer conductor, dielectric medium and inner conductor, the bottom of outer conductor is equipped with the close mouth shape locking structure, the inner wall of close mouth shape locking structure is by at least two different taper face of inclination continuous transition composition. The outer conductor top extends four round pins, and the stress release groove is equipped with in the pin root, and four pins are centrally symmetric distribution. The utility model discloses simple structure, through setting up multi -end taper face close mouth structure, namely through 20 shallow taper face and 40 steep taper face combination design, avoid excessive deformation while guaranteeing locking force. Optimize pin layout, adopt 2.9mm 3.1mm equidistance distribution's round pin, cooperate unique stress release groove, reduce stress, enhance inner conductor contact ability and signal transmission capacity.

1. The name of the design product: teaching mirror. 2. The use of the design product: for preschool children to train pronunciation and mouth shape. 3. The design points of the design product: the combination of shape and pattern. 4. The picture or photo that best shows the design points: perspective drawing.

This invention provides a digital human lip-syncing method, apparatus, and electronic device. The method includes: extracting audio features from the original audio signal and mapping the audio features to lip-sync parameters; fusing the lip-sync parameters with at least one preset reference image frame to obtain fused features; and rendering the fused features into a digital human image. This significantly improves the realism of digital human interaction and user experience.

Embodiments of the present application provide a digital person video generation method and device, a storage medium and a program product. In the embodiments of the present application, the original inference environment of the target digital person inference model is changed from inference running on a server to inference running on a mobile terminal, thereby improving the inference speed of the target digital person model. In addition, the target digital person inference model is used to infer a plurality of target face region images with continuous changes in mouth shape based on a plurality of audio feature segments corresponding to audio data, and a digital person action picture is generated according to the plurality of target digital person images with continuous changes in mouth shape, the digital person in the digital person action picture is driven to play the audio data, so as to obtain a target digital person video. Not only can the adaptation degree of the mouth shape and the audio content be improved, but also the delay and the lag problem of playing the digital person video can be reduced, and the playing quality of the target digital person video can be improved.

This application provides a digital human mouth shape driving method, system, and medium based on phoneme recognition. The method includes: acquiring input raw speech signals and processing the raw speech signals; performing feature extraction and phoneme recognition on preprocessed data information to obtain accurate phoneme category and time sequence information; constructing a preset phoneme and mouth shape parameter mapping library, the mapping library including mouth shape parameters and muscle deformation parameters corresponding to different phonemes and different pronunciation styles; dynamically matching the phoneme time sequence information with the mapping library to obtain corresponding mouth shape driving parameters and muscle deformation parameters; inputting a digital human mouth and surrounding muscle model, driving the model to deform, obtaining the driving result, and performing synchronous processing of mouth shape and speech pronunciation on the model to obtain synchronization result information; through phoneme-level fine-grained recognition, dynamic mapping matching, and precise driving of muscle models, real-time synchronization of mouth shape and speech pronunciation is achieved, improving the naturalness and realism of digital human voice interaction.

The system and method for generating realistic lip synchronization for an AI avatar. The lip synchronization process begins by receiving input data. The input data can either be text input or audio stream. If the input data is text input, a text-to-speech (TTS) module converts it into speech while generating word-level timestamps. If the input data is the audio stream, an automatic speech recognition (ASR) module transcribes the spoken content and provides word-level timestamps. The transcribed text is transformed into a sequence of phonemes using a grapheme-to-phoneme conversion system. The phonemes are mapped to visemes based on their corresponding mouth shapes using a predefined phoneme to viseme mapping table. Then the visemes are mapped to the blendshapes of the AI avatar using image similarity comparison. The selected blendshapes are animated to generate synchronized animation of the AI avatar, with transitions smoothed to ensure natural lip movements and facial expressions.

The application relates to a training method of a mouth shape image generation model and a mouth shape image generation method. The method comprises the following steps: acquiring first sample data used for training a generator in a mouth shape image generation model; the first sample data comprises a plurality of sample pairs; inputting a sample face image and a sample audio into the generator to obtain a synthesized frame image containing a complete face; taking a first mouth region image cut from a real frame image and a second mouth region image cut from the synthesized frame image as second sample data used for training a discriminator in the mouth shape image generation model; and performing adversarial training on the generator and the discriminator by using the first sample data and the second sample data until a training end condition is met, so that a trained mouth shape image generation model is obtained. By using the method, the trained mouth shape image generation model can generate a high-definition tooth image, and the overall quality of mouth shape image generation is effectively improved.

The utility model discloses a mouth shape direct suction heat preservation cup with bactericidal function, including cup body and cup cover, the cup cover includes with the lower cover of cup body screw connection and with the upper cover of lower cover screw connection, the lower cover has the spout for pouring water and the mouth shape mouth of direct drinking on, the upper cover has the antibacterial component on, and the antibacterial component includes: the outer cover, sets up at the outer end of upper cover, can adjust with the cooperation degree of outer cover, the carousel, rotates and is installed in the inside of outer cover, and its outward one end is installed respectively with the closure shaft no.