21 results about "Video optimization" patented technology

The present invention relates to an encoding / decoding method and apparatus for using optimized quantization according to a video, a method for transmitting a bitstream, and a bitstream storage medium. A decoding method according to an embodiment of the present disclosure may comprise the steps of: acquiring data optimization information related to a video data optimization method according to a purpose of video data; and reconstructing the video data based on the data optimization information, wherein the data optimization information includes data optimization application information indicating whether to perform optimization on each use of the video data.

The invention discloses an intelligent processing method and system for multi-modal data of an oral broadcast video based on deep learning, and relates to the technical field of oral broadcast video data processing, and the method comprises the following steps: 1, collecting multi-modal oral broadcast data in real time, recognizing emotion types, and carrying out the data preprocessing; step 2, constructing an oral playing animation generation model, judging the synchronization degree of the mouth shape, the head action and the audio in the oral playing animation, and taking coordinated regulation measures; 3, judging the consistency of the mouth shape and the emotion intensity in the oral playing animation, and implementing an anomaly repair measure; 4, constructing a depth time sequence prediction model, evaluating the difference degree between the actual oral playing animation and the prediction result of the depth time sequence prediction model, and carrying out video optimization and model tuning; the problems that when mouth shape supplement and animation filling are carried out by AI, precise synchronization of mouth shapes, expressions, head actions and emotional fluctuations is difficult to achieve, so that visual abnormity is caused, and the reality sense and the professional degree of videos are affected are solved.

The invention discloses a mine disaster self-rescuer AI video identification practical training system, which belongs to the technical field of coal mine safety simulation, and comprises a shooting simulation module for simulating an underground environment, an operator wearing a mine disaster self-rescuer in the simulated environment, shooting a wearing process and a simulation process, and carrying out real-time video identification on the mine disaster self-rescuer. The video optimization module optimizes the video frame image with poor image quality, and the action analysis module performs key point detection and action recognition on the optimized video to obtain the operation steps of an operator and judge whether the action is completed or not; the multi-dimensional scoring module constructs a quantitative scoring model according to the time dimension, the action specification dimension and the component operation dimension, and scores the operation process of the operator, so that the operator can practice in an environment close to reality, the operation proficiency and psychological quality of the operator in an emergency scene are improved, and the user experience is improved. Emergency operation errors caused by insufficient environment adaptation are avoided, the action judgment accuracy is improved, and a comprehensive and objective quantitative basis is provided for practical training effect evaluation.

The application discloses an audio and video optimization processing method and system for a handheld terminal, and relates to the technical field of multimedia signal processing, which comprises the following steps: independently of an audio coding process, a lightweight neural network model is used to perform real-time analysis on original audio data in parallel, and a structured audio semantic descriptor is output; in response to a selected current video coding strategy mode, a set of operation parameters of a video encoder is dynamically reconstructed to code a synchronously collected video frame; if the current video coding strategy mode is a speech active mode, the coding frame rate is increased and a region of interest coding for a face region is started; if the current video coding strategy mode is a music dominant mode, the coding resolution is increased; and if the current video coding strategy mode is a silent listening mode, the coding frame rate and resolution are reduced. Through dynamic video coding strategy adjustment based on audio semantics, the application realizes accurate balance of video quality, smoothness and resource consumption.

The invention discloses a marketing video automatic editing method based on machine learning, relates to the technical field of artificial intelligence video processing, and solves the problems that the marketing video editing efficiency is low and the content is disjointed from user preference. According to the method, video clips are extracted, visual and audio features are analyzed, key emotional climax clips are recognized, a narrative path is constructed by adopting an attention mechanism, a sequence is optimized to generate a personalized video, a transition effect is inserted, parameters are rendered and determined, a complete video is generated, interaction potential is optimized, and automatic intelligent editing is achieved. And the content creation efficiency and the user interaction capability are improved.

The present disclosure provides a large model-based audio and video clipping method, device, medium, equipment and product, relating to the technical field of audio and video processing, which comprises: segmenting original audio and video data to obtain an audio and video data set, the audio and video data set comprising a plurality of audio and video segments; determining a target content corresponding to the audio and video data set, the target content comprising video picture text, audio text and video picture description; obtaining target clipping information through a target large model according to the target content; identifying the audio and video data set to obtain a target optimization strategy; clipping the audio and video data set according to the target clipping information to obtain a plurality of target clipping segments; and performing video optimization and audio optimization on the plurality of target clipping segments according to the target optimization strategy to obtain a target audio and video. Thus, the accuracy of the obtained target clipping information can be improved, and the quality of the obtained target audio and video can be improved.

The invention discloses an intelligent terminal adaptive audio and video optimization method and device based on terahertz sensing and multi-mode fusion, equipment and a storage medium, and relates to the technical field of intelligent terminals, and the method comprises the steps: obtaining the spatial data, collected by a terahertz sensor, of a user relative to terminal equipment; acquiring multi-modal environment data acquired by a camera, a microphone array and an environment light sensor; fusing the spatial data and the multi-modal environment data to generate a dynamic environment model; based on a dynamic environment model, audio output and video output are optimized, high-precision, multi-dimensional and non-contact environment perception capability is realized, user distance, position distribution and micro-motion behaviors can be accurately identified, and dynamic cooperative control of audio and video output is realized under the guidance of a unified environment model. The technical problems that an existing intelligent terminal depends on a traditional sensor, so that the environment perception dimension is single, precision is insufficient, and audio and video optimization lacks collaboration are effectively solved.

The invention relates to the field of video processing, in particular to a post-processing method and system for improving video fluency and definition, and the method comprises the steps: firstly responding to the generation of an upstream video, transcoding the upstream video, and generating a corresponding video frame, a PTS frame code table and an audio; the method comprises the following steps of: inputting a video frame into a preset scene detection and video scene segmentation model to generate a target scene frame column used for assisting frame insertion, inputting the target scene frame column into a frame insertion model based on a diffusion Transform architecture for frame insertion to obtain an updated frame column, and synchronously updating a PTS frame code table based on the updated frame column, the method comprises the following steps: firstly, updating a PTS frame code table, sending an updated frame column into a real-time streaming video super-resolution model for super-resolution updating to obtain a super-resolution continuous frame column, and finally, carrying out alignment check and fragment fusion on the super-resolution continuous frame column, audio and the synchronously updated PTS frame code table, and outputting an upgraded video. According to the method, the problem that the fluency and the definition are difficult to consider at the same time in the existing video optimization technology is solved.

The present disclosure relates to the technical field of streaming media, and discloses a video optimization information generation method and apparatus, and an electronic device, the method comprising: obtaining a target video and features of the target video, the features comprising metadata and video element semantics; based on the metadata of the target video, retrieving to obtain a reference video of the target video; comparing and analyzing the target video and the reference video to obtain a first analysis result; performing analysis based on the information entropy of the target video and the interaction content to obtain a second analysis result; and performing conjoint analysis by using the video element semantics, the first analysis result and the second analysis result to obtain and display video optimization information corresponding to the target video. By implementing the method disclosed by the invention, relatively accurate video optimization information can be generated.

The application discloses a video optimization method and system based on wireless transmission and belongs to the technical field of image communication. The application scheme achieves the effect of adaptive bandwidth allocation through signal strength monitoring, adopts multiple optimization modes, can effectively alleviate the image distortion and operation delay problems in wireless transmission, and can significantly improve the user experience, especially in the fields of cloud games, remote medical treatment, unmanned plane control and the like which have extremely high real-time requirements. The application combines a prediction algorithm, can obtain data for decoding more quickly through comparison and correction of actual frames and predicted frames, and adopts interframe interpolation, frame freezing, background filling and the like to slow down the perceptual loss.

Aspects of the subject disclosure may include, for example, a machine-readable storage medium, including executable instructions that, when executed by a processing system including a processor, facilitate performance of operations that include assuming control of a video content transfer between a video server and a video client for HTTP traffic responsive to determining the HTTP traffic is for video content, generating a video transfer rate selection and a video transfer resolution selection for a requested video chunk of a time slot of the video content, generating an optimized manifest file for the requested video chunk, and publishing the optimized manifest file to the video client, wherein the video client request the requested video chunk from the video server based on the optimized manifest. Other embodiments are disclosed.

The invention discloses a video picture optimization method and device, equipment and a medium, and the method comprises the steps: analyzing a to-be-displayed target video frame obtained in real time, determining the picture quality, the picture scene and the element region of the picture element of the target video frame, and storing the picture configuration data, the picture quality and the picture scene of a user into the element region of the picture element; inputting a model subjected to picture optimization training, outputting parameters for optimization and the confidence coefficient of the corresponding parameters, and for any picture partition for dividing the picture of the target video frame, optimizing the picture partition according to the element areas of all picture elements, the parameters and the confidence coefficient of the corresponding parameters, the method comprises the following steps: optimizing a picture partition according to the picture partition, obtaining an optimized picture partition, obtaining an optimized target video frame according to the optimized picture partition, and playing and displaying the optimized target video frame. According to the invention, the optimization of the video picture is automatically realized, the accuracy and adaptability of picture optimization are improved, the video optimization effect is improved, and thus the user experience is improved.

Embodiments of the present disclosure provide a video analysis method, device, equipment and storage medium. The method comprises: determining a target video meeting a first analysis trigger condition from at least one video to be analyzed, and detecting whether the target video has a video feature; determining a corresponding condition determination strategy according to the detection result of the video feature; if a condition determination result corresponding to the condition determination strategy meets a second analysis trigger condition, performing video feature analysis on the target video to obtain a current video feature of the target video. By using the method, the video feature analysis timing of the video in different video life cycle stages can be determined more accurately, the effective use of video analysis computing resources is ensured, the computing resource consumption is reduced, the effective determination of the video feature on the video optimization and promotion strategy is ensured, and the overall improvement of the video viewing experience is realized.

The invention relates to the technical field of data processing, in particular to an end-cloud collaborative video data processing and privacy protection method and system. The method comprises the following steps: detecting a to-be-uploaded video at a client, and performing localized desensitization processing on a video frame containing a sensitive cultural symbol to obtain an initial desensitization video; uploading the initial desensitized video to a cloud server; determining the probability distribution of each creation motivation of the initial desensitized video through an ethical sandbox of the cloud server; and judging whether the initial desensitized video belongs to a risk video or not according to the probability of each creation motivation of the initial desensitized video, performing secondary verification on the initial desensitized video in response to the fact that the video is the risk video, and controlling issuing of a video optimization suggestion according to a verification result. According to the method, the privacy of the creator can be effectively protected, and meanwhile, the situation that improper video optimization suggestions are automatically generated for the creator is reduced.

The invention relates to the technical field of video optimization, in particular to a self-adaptive optimization method and device for a hospital inquiry video, equipment and a storage medium. Analyzing the inquiry video frame based on a preset text classification model and a preset image classification model to obtain a scene semantic tag; adjusting the inquiry video frame according to the scene semantic tag and a preset broadband constraint condition to obtain an adjusted code rate; analyzing the inquiry video frame according to a defect detection method and a preset compensation gain coefficient to obtain a definition compensation value; optimizing the inquiry video frame according to the definition compensation value and the adjustment code rate to obtain an optimized video frame; generating a hospital inquiry video according to the optimized video frame; according to the scheme, inquiry video scene adaptation is achieved, transmission is smooth, information is clear, and remote inquiry quality and doctor-patient interaction experience are improved.

The invention provides a jitter video optimization method and device, electronic equipment and a storage medium, and belongs to the technical field of artificial intelligence, and the method comprises the steps: obtaining a jitter video frame sequence of a jitter video; extracting optimization condition information from the jitter video frame sequence; encoding the jitter video frame sequence into a jitter video latent variable sequence; inputting the jitter video latent variable sequence, the optimization condition information and the random noisy latent variable sequence into a video denoising network model to obtain a denoising latent variable sequence; and decoding the de-noising latent variable sequence to output a stable video. According to the method, a jitter video is used as a guide condition of content and motion, a brand new stable video frame is gradually generated from noise by using a generative diffusion model, and geometric correction is not carried out on an original jitter frame. According to the generation type method, the problems of picture distortion, detail loss and artifacts caused by a traditional correction method are fundamentally avoided, a stable video with consistent content and smooth motion can be generated, and the watching experience is remarkably improved.

The application discloses a real-time audio and video optimization processing method based on television station live broadcast, and relates to the technical field of audio and video optimization. The application solves the problem of poor coherence between the inserted frame picture and the original frame picture caused by not positioning the frame insertion interval in combination with key information such as audio frequency band characteristics and spectral peak points, optimizes the audio quality through denoising processing, accurately positions the frame insertion interval based on the frequency band characteristics, selects a standard value segment through the value segment density, locks the position of the frame to be supplemented in combination with the spectral peak point time interval, generates the pixel to be supplemented based on the pixel change characteristics of the front and rear frames in the frame insertion process, ensures the coherence and consistency between the inserted frame picture and the original frame picture, and avoids the picture quality blur caused by blind frame insertion. For the scene in which the video duration is greater than the audio duration, the lost signal is directly generated and returned for completion, the process is simple and efficient, the single-scene processing duration can be controlled within the delay range allowed by the live broadcast, and the processing quality and real-time performance are considered.

This application discloses a video optimization method, a playback device, a gateway device, a storage medium, and a system. The method includes: determining video parameter data corresponding to the current video stream; calculating the resolution based on the video parameter data to determine a target resolution; and sending the target resolution to the gateway device so that the resolution of the video stream to be transmitted most recently received by the gateway device is the target resolution. In this way, after sending the target resolution to the gateway device, the resolution of subsequent video streams to be transmitted can be the target resolution. By integrating a software development kit (SDK) into the playback device, the resolution of the video stream can be dynamically adjusted based on the video parameter data. This not only effectively alleviates video stuttering caused by poor network conditions but also makes the dynamic resolution adjustment more precise and reasonable, thus improving video quality.

Methods and systems provide dynamic adjustments for video optimization in a communication session. In one embodiment, the system receives, at a server, an outgoing video stream from a transmitting device to a receiving device; identifies a first set of video parameter data corresponding to the quality of the outgoing video stream; receives, from the receiving device, a second set of video parameter data corresponding to the quality of the video stream; determines one or more quality discrepancies between the first set of video parameter data and the second set of video parameter data; and provides notification of at least a subset of the quality discrepancies to one or both of the transmitting device and the receiving device.

The invention provides an audio and video editing method and device based on a large model, a medium, equipment and a product, and relates to the technical field of audio and video processing, the method comprises the following steps: segmenting original audio and video data to obtain an audio and video data set, the audio and video data set comprising a plurality of audio and video segments; determining a target content corresponding to the audio and video data set, wherein the target content comprises a video picture text, an audio text and a video picture description; according to the target content, obtaining target edited information through a target large model; identifying the audio and video data set to obtain a target optimization strategy; editing the audio and video data set according to the target editing information to obtain a plurality of target editing segments; and performing video optimization and audio optimization on the plurality of target edited fragments according to the target optimization strategy to obtain a target audio and video. Therefore, the accuracy of the obtained target editing information can be improved, and the quality of the obtained target audio and video is improved.

The embodiment of the invention relates to a live video optimization method and device, computer equipment and a storage medium. The method comprises the following steps: loading an element material package according to a game identifier corresponding to a game live video stream; identifying a target game element contained in the current frame of the game live video stream, and determining a target element feature point corresponding to the target game element from the element material packet; based on a game category corresponding to the game identifier, according to the target element feature point, executing picture optimization processing on a pixel region corresponding to the target game element in the current frame to obtain an enhanced current frame; and outputting the enhanced current frame to a subsequent picture processing module for processing and then displaying. Therefore, the element material package can be loaded based on the game identifier, the target game element in the current frame can be identified by utilizing the element feature point, and the picture optimization processing matched with the game category is executed, so that the picture definition of the game element is improved, the processing on a non-target area is reduced, the calculation pressure is reduced, and the overall consistency of the enhanced picture is ensured.