36 results about "Video optimization" patented technology

The invention discloses an intersection traffic violation total factor snapshot system based on multi-view collaboration, and relates to the technical field of intelligent traffic, and the system comprises a data collection and transmission module, a data preprocessing and splicing module, a data optimization and analysis module, a traffic violation judgment module, and a data storage and management module. According to the invention, through a panoramic video optimization unit in the data optimization and analysis module, the spliced panoramic video is deeply optimized, and tiny splicing traces or image local distortion generated in the splicing process is further eliminated, so that the panoramic video picture is clearer, smoother and more real, and high-quality image materials are provided for subsequent analysis; and the target in the video is accurately recognized through the image recognition and analysis unit, target feature information of vehicles, pedestrians and traffic signs and marked lines is extracted, traffic illegal behaviors can be more accurately judged based on the information, and the situations of misjudgment and missed judgment are reduced.

Methods and systems provide dynamic adjustments for video optimization in a communication session. In one embodiment, the system receives, at a server, an outgoing video stream from a transmitting device to a receiving device; identifies a first set of video parameter data corresponding to the quality of the outgoing video stream; receives, from the receiving device, a second set of video parameter data corresponding to the quality of the video stream; determines one or more quality discrepancies between the first set of video parameter data and the second set of video parameter data; and provides notification of at least a subset of the quality discrepancies to one or both of the transmitting device and the receiving device.

The invention relates to the technical field of image processing, and discloses a video processing method, device, equipment and medium, and the method comprises the steps: obtaining video data, vehicle speed data, vehicle angular speed data and illumination intensity data from a vehicle-mounted terminal, the resolution of the video data being a first resolution; fusing the video data, the vehicle speed data and the vehicle angular speed data based on the timestamp to obtain fused data, and performing motion compensation based on the fused data to generate intermediate frame data; extracting multi-scale feature data based on the intermediate frame data, the illumination intensity data and the preprocessed data, and generating texture data based on the multi-scale feature data; and performing dynamic weighting based on the intermediate frame data, the multi-scale feature data and the texture data to generate processed video data, the resolution of the processed video data being a second resolution, and the first resolution being lower than the second resolution. The image quality bottleneck of an inherent automobile data recorder of a vehicle can be broken through, and video dynamic optimization is realized.

Data encryption and Human Pose Estimation based on imaging a body segment. A key for encrypting a data file is generated based on image data that represent a unique biometric feature of a body segment of a user or motion of the user. An image engine executes artificial intelligence to identify matching image data for decrypting the data file. The image engine is further trained to predict changes in image data due to aging, stress, and the like. An avatar associated with the user, which is generated based on a movement pattern of the user, is configurable for generating an encryption key and for use in an avatar-based language.

The present invention relates to an encoding / decoding method and apparatus for using optimized quantization according to a video, a method for transmitting a bitstream, and a bitstream storage medium. A decoding method according to an embodiment of the present disclosure may comprise the steps of: acquiring data optimization information related to a video data optimization method according to a purpose of video data; and reconstructing the video data based on the data optimization information, wherein the data optimization information includes data optimization application information indicating whether to perform optimization on each use of the video data.

The invention discloses an intelligent processing method and system for multi-modal data of an oral broadcast video based on deep learning, and relates to the technical field of oral broadcast video data processing, and the method comprises the following steps: 1, collecting multi-modal oral broadcast data in real time, recognizing emotion types, and carrying out the data preprocessing; step 2, constructing an oral playing animation generation model, judging the synchronization degree of the mouth shape, the head action and the audio in the oral playing animation, and taking coordinated regulation measures; 3, judging the consistency of the mouth shape and the emotion intensity in the oral playing animation, and implementing an anomaly repair measure; 4, constructing a depth time sequence prediction model, evaluating the difference degree between the actual oral playing animation and the prediction result of the depth time sequence prediction model, and carrying out video optimization and model tuning; the problems that when mouth shape supplement and animation filling are carried out by AI, precise synchronization of mouth shapes, expressions, head actions and emotional fluctuations is difficult to achieve, so that visual abnormity is caused, and the reality sense and the professional degree of videos are affected are solved.

The invention discloses a mine disaster self-rescuer AI video identification practical training system, which belongs to the technical field of coal mine safety simulation, and comprises a shooting simulation module for simulating an underground environment, an operator wearing a mine disaster self-rescuer in the simulated environment, shooting a wearing process and a simulation process, and carrying out real-time video identification on the mine disaster self-rescuer. The video optimization module optimizes the video frame image with poor image quality, and the action analysis module performs key point detection and action recognition on the optimized video to obtain the operation steps of an operator and judge whether the action is completed or not; the multi-dimensional scoring module constructs a quantitative scoring model according to the time dimension, the action specification dimension and the component operation dimension, and scores the operation process of the operator, so that the operator can practice in an environment close to reality, the operation proficiency and psychological quality of the operator in an emergency scene are improved, and the user experience is improved. Emergency operation errors caused by insufficient environment adaptation are avoided, the action judgment accuracy is improved, and a comprehensive and objective quantitative basis is provided for practical training effect evaluation.

The application discloses an audio and video optimization processing method and system for a handheld terminal, and relates to the technical field of multimedia signal processing, which comprises the following steps: independently of an audio coding process, a lightweight neural network model is used to perform real-time analysis on original audio data in parallel, and a structured audio semantic descriptor is output; in response to a selected current video coding strategy mode, a set of operation parameters of a video encoder is dynamically reconstructed to code a synchronously collected video frame; if the current video coding strategy mode is a speech active mode, the coding frame rate is increased and a region of interest coding for a face region is started; if the current video coding strategy mode is a music dominant mode, the coding resolution is increased; and if the current video coding strategy mode is a silent listening mode, the coding frame rate and resolution are reduced. Through dynamic video coding strategy adjustment based on audio semantics, the application realizes accurate balance of video quality, smoothness and resource consumption.

The application discloses a short video optimization method and device based on a knowledge graph, computer equipment and a readable storage medium, and comprises the following steps: firstly, a target short video link and basic information are acquired, and a big data service of a net celebrity is called; then, based on the basic information and a net celebrity knowledge graph, deep information is extracted through a big language model of the net celebrity; finally, the basic information and the deep information are input into the model to obtain optimization suggestions. In this way, various technical resources are cooperated, the value of the short video is effectively mined, and the propagation effect is improved.

The invention discloses a marketing video automatic editing method based on machine learning, relates to the technical field of artificial intelligence video processing, and solves the problems that the marketing video editing efficiency is low and the content is disjointed from user preference. According to the method, video clips are extracted, visual and audio features are analyzed, key emotional climax clips are recognized, a narrative path is constructed by adopting an attention mechanism, a sequence is optimized to generate a personalized video, a transition effect is inserted, parameters are rendered and determined, a complete video is generated, interaction potential is optimized, and automatic intelligent editing is achieved. And the content creation efficiency and the user interaction capability are improved.

The invention discloses a video optimization method and system based on wireless transmission, and belongs to the technical field of image communication. According to the scheme, the self-adaptive bandwidth allocation effect is achieved through signal intensity monitoring, various optimization modes are adopted, the problems of image distortion and untimely operation in wireless transmission can be effectively solved, and the user experience can be remarkably improved especially in the fields of cloud games, telemedicine, unmanned aerial vehicle control and the like with extremely high real-time performance requirements. According to the method, a prediction algorithm is combined, data for decoding can be obtained more quickly through comparison and correction of an actual frame and a predicted frame, and perception loss is relieved by adopting modes of inter-frame interpolation, frame freezing, background filling and the like.

The application discloses a real-time high-speed target recognition and tracking scheme based on a domestic artificial intelligence framework, realizes rapid target detection and accurate tracking by combining target recognition and tracking technology, can automatically restart the recognition network and reposition when the system loses the target, supports manual selection of target tracking by the user, adopts a self-developed long-time tracking algorithm, is not limited by the target category, processes multiple videos in the front end, optimizes the use of computing resources, and improves the processing speed and efficiency by optimizing the hardware visual preprocessing and network inference part. The system provides a flexible output mode and is suitable for various application scenarios.

The present invention relates to a system (1) for customizing video contents for specific target audiences or individuals through artificial intelligence.

The invention discloses a conference environment optimization method and device of a conference room, equipment and a storage medium, and relates to the technical field of artificial intelligence, and the conference environment optimization method of the conference room comprises the steps: collecting audio data, video data and environment parameters of the conference room in real time; performing optimization processing on the audio data and the video data to obtain an audio and video optimization result; judging a conference state according to the audio data, the video data and the environmental parameters, and determining an optimization strategy according to the conference state; and realizing conference environment optimization according to the audio and video optimization result and the optimization strategy. The conference optimization strategy is determined through the multi-modal data of the conference environment, the conference environment can be adjusted and optimized from all aspects, and the audio and video quality and environment adaptability in the conference scene are improved.

The present disclosure provides a large model-based audio and video clipping method, device, medium, equipment and product, relating to the technical field of audio and video processing, which comprises: segmenting original audio and video data to obtain an audio and video data set, the audio and video data set comprising a plurality of audio and video segments; determining a target content corresponding to the audio and video data set, the target content comprising video picture text, audio text and video picture description; obtaining target clipping information through a target large model according to the target content; identifying the audio and video data set to obtain a target optimization strategy; clipping the audio and video data set according to the target clipping information to obtain a plurality of target clipping segments; and performing video optimization and audio optimization on the plurality of target clipping segments according to the target optimization strategy to obtain a target audio and video. Thus, the accuracy of the obtained target clipping information can be improved, and the quality of the obtained target audio and video can be improved.

The invention discloses an intelligent terminal adaptive audio and video optimization method and device based on terahertz sensing and multi-mode fusion, equipment and a storage medium, and relates to the technical field of intelligent terminals, and the method comprises the steps: obtaining the spatial data, collected by a terahertz sensor, of a user relative to terminal equipment; acquiring multi-modal environment data acquired by a camera, a microphone array and an environment light sensor; fusing the spatial data and the multi-modal environment data to generate a dynamic environment model; based on a dynamic environment model, audio output and video output are optimized, high-precision, multi-dimensional and non-contact environment perception capability is realized, user distance, position distribution and micro-motion behaviors can be accurately identified, and dynamic cooperative control of audio and video output is realized under the guidance of a unified environment model. The technical problems that an existing intelligent terminal depends on a traditional sensor, so that the environment perception dimension is single, precision is insufficient, and audio and video optimization lacks collaboration are effectively solved.

The invention relates to the field of video processing, in particular to a post-processing method and system for improving video fluency and definition, and the method comprises the steps: firstly responding to the generation of an upstream video, transcoding the upstream video, and generating a corresponding video frame, a PTS frame code table and an audio; the method comprises the following steps of: inputting a video frame into a preset scene detection and video scene segmentation model to generate a target scene frame column used for assisting frame insertion, inputting the target scene frame column into a frame insertion model based on a diffusion Transform architecture for frame insertion to obtain an updated frame column, and synchronously updating a PTS frame code table based on the updated frame column, the method comprises the following steps: firstly, updating a PTS frame code table, sending an updated frame column into a real-time streaming video super-resolution model for super-resolution updating to obtain a super-resolution continuous frame column, and finally, carrying out alignment check and fragment fusion on the super-resolution continuous frame column, audio and the synchronously updated PTS frame code table, and outputting an upgraded video. According to the method, the problem that the fluency and the definition are difficult to consider at the same time in the existing video optimization technology is solved.

The present disclosure relates to the technical field of streaming media, and discloses a video optimization information generation method and apparatus, and an electronic device, the method comprising: obtaining a target video and features of the target video, the features comprising metadata and video element semantics; based on the metadata of the target video, retrieving to obtain a reference video of the target video; comparing and analyzing the target video and the reference video to obtain a first analysis result; performing analysis based on the information entropy of the target video and the interaction content to obtain a second analysis result; and performing conjoint analysis by using the video element semantics, the first analysis result and the second analysis result to obtain and display video optimization information corresponding to the target video. By implementing the method disclosed by the invention, relatively accurate video optimization information can be generated.

The application discloses a video optimization method and system based on wireless transmission and belongs to the technical field of image communication. The application scheme achieves the effect of adaptive bandwidth allocation through signal strength monitoring, adopts multiple optimization modes, can effectively alleviate the image distortion and operation delay problems in wireless transmission, and can significantly improve the user experience, especially in the fields of cloud games, remote medical treatment, unmanned plane control and the like which have extremely high real-time requirements. The application combines a prediction algorithm, can obtain data for decoding more quickly through comparison and correction of actual frames and predicted frames, and adopts interframe interpolation, frame freezing, background filling and the like to slow down the perceptual loss.

The present invention discloses a system and method for synchronous audio and video transmission of an HDMI interface, and specifically relates to the field of transmission technology. The system and method include an interface device configuration and identification module, an audio and video data acquisition module, an audio quality evaluation module, a video quality evaluation module, an audio and video optimization processing module, and an audio and video synchronization accuracy analysis module. The system acquires audio and video signals of ultra-high-definition video through an audio acquisition circuit and a video acquisition chip, and comprehensively evaluates the audio and video quality based on frequency response deviation, dynamic range, clarity, dynamic contrast, and color reproduction indicators. The system optimizes audio or video frames of poor quality through an audio optimization unit and an ultra-high-definition video rendering unit, thereby improving audio and video quality, enhancing the expression of video picture details, and enhancing user experience. Based on the optimized ultra-high-definition video, the system evaluates the audio and video transmission synchronization accuracy through inter-frame delay and audio delay, thereby achieving audio and video synchronous transmission.

Aspects of the subject disclosure may include, for example, a machine-readable storage medium, including executable instructions that, when executed by a processing system including a processor, facilitate performance of operations that include assuming control of a video content transfer between a video server and a video client for HTTP traffic responsive to determining the HTTP traffic is for video content, generating a video transfer rate selection and a video transfer resolution selection for a requested video chunk of a time slot of the video content, generating an optimized manifest file for the requested video chunk, and publishing the optimized manifest file to the video client, wherein the video client request the requested video chunk from the video server based on the optimized manifest. Other embodiments are disclosed.

The invention discloses a video picture optimization method and device, equipment and a medium, and the method comprises the steps: analyzing a to-be-displayed target video frame obtained in real time, determining the picture quality, the picture scene and the element region of the picture element of the target video frame, and storing the picture configuration data, the picture quality and the picture scene of a user into the element region of the picture element; inputting a model subjected to picture optimization training, outputting parameters for optimization and the confidence coefficient of the corresponding parameters, and for any picture partition for dividing the picture of the target video frame, optimizing the picture partition according to the element areas of all picture elements, the parameters and the confidence coefficient of the corresponding parameters, the method comprises the following steps: optimizing a picture partition according to the picture partition, obtaining an optimized picture partition, obtaining an optimized target video frame according to the optimized picture partition, and playing and displaying the optimized target video frame. According to the invention, the optimization of the video picture is automatically realized, the accuracy and adaptability of picture optimization are improved, the video optimization effect is improved, and thus the user experience is improved.

This invention provides a method and system for processing factory equipment operation data for safe production management, relating to the field of artificial intelligence technology. In this invention, multiple typical equipment operation information are extracted, including typical equipment operation monitoring videos and typical optimized operation monitoring videos. Based on this typical equipment operation information, an initial video optimization network is updated and adjusted. Through the updated and adjusted initial video optimization network, video optimization operations are performed on the target equipment operation monitoring video to form a target optimized operation monitoring video corresponding to the target equipment operation monitoring video. Through the equipment operation status analysis network formed by the update and adjustment operations, operation status analysis operations are performed on the target optimized operation monitoring video to output operation status analysis data corresponding to the target factory equipment. Based on the above, the reliability of operation data analysis can be improved to a certain extent.

The invention discloses an audio and video optimization processing method and system for a handheld terminal, and relates to the technical field of multimedia signal processing, and the method comprises the steps: carrying out the real-time analysis of original audio data through employing a lightweight neural network model in parallel independent of an audio coding process, and outputting a structured audio semantic descriptor; in response to the selected current video encoding strategy mode, dynamically reconstructing an operation parameter group of a video encoder to encode the synchronously acquired video frames; if the current video coding strategy mode is a voice active mode, the coding frame rate is increased, and region-of-interest coding of the face region is started; if the current video coding strategy mode is the music dominant mode, the coding resolution is improved, and if the current video coding strategy mode is the silent listening mode, the coding frame rate and the resolution are reduced. According to the invention, through dynamic video coding strategy adjustment based on audio semantics, accurate balance of video quality, fluency and resource consumption is realized.

The invention relates to a video information interaction method and device, equipment and a storage medium. The method comprises the following steps: displaying at least one detection item for representing a video problem existing in a to-be-released video; in response to a problem optimization operation for the to-be-released video, displaying a video optimization element of the first detection item; the video optimization element comprises at least one optimization control corresponding to the first detection item and comparison video content before and after the selected optimization control acts on the to-be-published video; different optimization controls correspond to different video optimization contents; and in response to a confirmation operation on a target optimization control in the at least one optimization control, switching to display the video optimization element of the second detection item until a problem optimization operation for the at least one detection item is executed. According to the technical scheme, the video modification difficulty is reduced, the overall passing time of the video works is shortened, and the publishing efficiency of the high-quality video works is improved.

Embodiments of the present disclosure provide a video analysis method, device, equipment and storage medium. The method comprises: determining a target video meeting a first analysis trigger condition from at least one video to be analyzed, and detecting whether the target video has a video feature; determining a corresponding condition determination strategy according to the detection result of the video feature; if a condition determination result corresponding to the condition determination strategy meets a second analysis trigger condition, performing video feature analysis on the target video to obtain a current video feature of the target video. By using the method, the video feature analysis timing of the video in different video life cycle stages can be determined more accurately, the effective use of video analysis computing resources is ensured, the computing resource consumption is reduced, the effective determination of the video feature on the video optimization and promotion strategy is ensured, and the overall improvement of the video viewing experience is realized.

The invention relates to the technical field of data processing, in particular to an end-cloud collaborative video data processing and privacy protection method and system. The method comprises the following steps: detecting a to-be-uploaded video at a client, and performing localized desensitization processing on a video frame containing a sensitive cultural symbol to obtain an initial desensitization video; uploading the initial desensitized video to a cloud server; determining the probability distribution of each creation motivation of the initial desensitized video through an ethical sandbox of the cloud server; and judging whether the initial desensitized video belongs to a risk video or not according to the probability of each creation motivation of the initial desensitized video, performing secondary verification on the initial desensitized video in response to the fact that the video is the risk video, and controlling issuing of a video optimization suggestion according to a verification result. According to the method, the privacy of the creator can be effectively protected, and meanwhile, the situation that improper video optimization suggestions are automatically generated for the creator is reduced.

The invention relates to the technical field of video optimization, in particular to a self-adaptive optimization method and device for a hospital inquiry video, equipment and a storage medium. Analyzing the inquiry video frame based on a preset text classification model and a preset image classification model to obtain a scene semantic tag; adjusting the inquiry video frame according to the scene semantic tag and a preset broadband constraint condition to obtain an adjusted code rate; analyzing the inquiry video frame according to a defect detection method and a preset compensation gain coefficient to obtain a definition compensation value; optimizing the inquiry video frame according to the definition compensation value and the adjustment code rate to obtain an optimized video frame; generating a hospital inquiry video according to the optimized video frame; according to the scheme, inquiry video scene adaptation is achieved, transmission is smooth, information is clear, and remote inquiry quality and doctor-patient interaction experience are improved.

The invention provides a jitter video optimization method and device, electronic equipment and a storage medium, and belongs to the technical field of artificial intelligence, and the method comprises the steps: obtaining a jitter video frame sequence of a jitter video; extracting optimization condition information from the jitter video frame sequence; encoding the jitter video frame sequence into a jitter video latent variable sequence; inputting the jitter video latent variable sequence, the optimization condition information and the random noisy latent variable sequence into a video denoising network model to obtain a denoising latent variable sequence; and decoding the de-noising latent variable sequence to output a stable video. According to the method, a jitter video is used as a guide condition of content and motion, a brand new stable video frame is gradually generated from noise by using a generative diffusion model, and geometric correction is not carried out on an original jitter frame. According to the generation type method, the problems of picture distortion, detail loss and artifacts caused by a traditional correction method are fundamentally avoided, a stable video with consistent content and smooth motion can be generated, and the watching experience is remarkably improved.

The application discloses a real-time audio and video optimization processing method based on television station live broadcast, and relates to the technical field of audio and video optimization. The application solves the problem of poor coherence between the inserted frame picture and the original frame picture caused by not positioning the frame insertion interval in combination with key information such as audio frequency band characteristics and spectral peak points, optimizes the audio quality through denoising processing, accurately positions the frame insertion interval based on the frequency band characteristics, selects a standard value segment through the value segment density, locks the position of the frame to be supplemented in combination with the spectral peak point time interval, generates the pixel to be supplemented based on the pixel change characteristics of the front and rear frames in the frame insertion process, ensures the coherence and consistency between the inserted frame picture and the original frame picture, and avoids the picture quality blur caused by blind frame insertion. For the scene in which the video duration is greater than the audio duration, the lost signal is directly generated and returned for completion, the process is simple and efficient, the single-scene processing duration can be controlled within the delay range allowed by the live broadcast, and the processing quality and real-time performance are considered.