239 results about "Frame time" patented technology

The invention discloses a high-temperature airflow two-dimensional temperature field and velocity field synchronous measurement system and method based on laser-induced phosphorescence, and the system comprises phosphorescence particles, a low-frequency double-pulse laser, an image collection device, a synchronous controller, and an image processing device. The image processing device analyzes the gray intensity ratio of different wave band images acquired by the two PIV cameras at the same time, and combines a temperature response function calibrated by an experiment to realize inversion of a temperature field; meanwhile, a double-frame time-resolved image acquired by any PIV camera is subjected to cross-correlation calculation, particle displacement is extracted, and then a velocity field is reconstructed. According to the invention, synchronous acquisition of temperature and speed based on the same data source is realized, and the system has the remarkable advantages of simple structure, high measurement precision and wide application environment.

A dynamic adaptive depth camera occlusion detection method, system and device, and a storage medium, the method comprising: step T1: constructing a three-frame time sequence analysis window, continuously obtaining infrared speckle image sequences at different moments and corresponding dense depth map sequences, and establishing a pixel-level space-time alignment mapping relationship; t2, calculating a motion vector between adjacent frames, and executing the step T3 when the average motion intensity exceeds a dynamic threshold value; wherein the dynamic threshold is determined by the dense depth map; t3, positioning a speckle feature point in the infrared speckle image, generating an analysis window by taking the speckle feature point as a center, calculating a gradient change rate, and when the gradient change rate is smaller than a gradient threshold value, marking the region as a primary candidate region; and T4, carrying out space-time consistency comparison on the primary candidate region and two adjacent frames, and reserving a shielding region of which the variation value is smaller than a variation threshold value in three continuous frames. The method is high in precision, good in real-time performance and high in stability.

The invention relates to the technical field of video content understanding, in particular to a video content understanding method of a multi-mode advertisement inventory intelligent matching system, and the method comprises the steps: taking a video frame of an original advertisement video as a benchmark, and in a shot where a timestamp of each video frame is located, obtaining a video frame of the original advertisement video; analyzing the similarity of adjacent video frames and the dispersion degree of feature matrix elements corresponding to the voice segments, and determining a first search window; meanwhile, analyzing the occurrence frequency and duration of the text fragment in unit time, and confirming a second search window; based on the search window, analyzing the feature similarity degree of the voice segment and the text segment with the video frame in the corresponding window, and obtaining an optimal alignment path; and aligning the timestamps of the voice segments and the text segments with the timestamps of the video frames, and realizing multi-level semantic analysis through a multi-modal fusion technology and a deep learning model. The invention aims to synchronize the sequential relationship among the audio, the text and the video frame and prompt the accuracy of video content understanding.

The invention belongs to the technical field of image processing, and relates to a shot picture quality analysis method based on a video image, which comprises the following steps of: tracking a key semantic object mask region in a continuous video frame, dynamically setting a standard threshold standard by combining an object type and the condition of a saliency region to which the object belongs, generating a single-frame score according to a preset rule on the basis, and then, carrying out image quality analysis on the single-frame score. A local object level display quality score is output through multi-frame time fluctuation variance calibration, a lens global picture quality evaluation result is generated through fusion of multiple local object level display quality scores, and a lens display defect position labeling alarm is triggered when local abnormity occurs, so that the limitation that only the overall picture quality is concerned in the prior art is effectively broken through, and the overall picture quality evaluation accuracy is improved. Evaluation is refined to a semantic unit level, characteristics of different objects and picture visual key points are fully considered, a picture local quality condition is helped to be more accurately captured, a linkage mechanism of local display quality score and lens defect position labeling is developed, and an accurate decision basis is provided for lens maintenance.

The invention relates to the technical field of graph number synchronization, and discloses a flight equipment graph number synchronization method and device under a time window verification mechanism, and the method comprises the steps: carrying out the demultiplexing operation of the video stream data, obtained in real time, of flight equipment, and obtaining a plurality of video frames corresponding to the video stream data and a frame timestamp corresponding to each video frame; performing target processing operation on all the video frames to obtain a metadata set corresponding to all the video frames, and determining a timestamp corresponding to each piece of metadata in the metadata set; and according to the frame timestamps corresponding to all the video frames and the timestamps corresponding to all the metadata, performing time window verification operation on all the video frames and all the metadata to obtain synchronous metadata corresponding to all the video frames. Therefore, by implementing the method and the device, time window verification can be performed on the timestamps between the video frames and the metadata, so that the synchronous metadata can be matched for the video frames, and improvement of image and data synchronization precision of flight equipment and reduction of image and data transmission delay are facilitated.

The invention discloses a multi-camera imaging method and system for head-mounted equipment, and relates to the technical field of multi-camera imaging, and the system comprises an image data acquisition module, a weight acquisition module, an image fusion module, a feedback control module, a visual angle movement determination module and a preloading module. The gaze weight of the image is obtained by obtaining the gaze direction of the user, an image weighted fusion mode with the current visual attention area of the user as the core is achieved, the generated main view angle image better conforms to the actual view field of the user, and immersive visual experience is enhanced; inter-frame time sequence consistency loss is introduced in the fusion process, the pixel change of the fusion image between continuous frames is restrained through time sequence smoothing, the image flicker and jump phenomena are remarkably reduced, and the visual stability in a dynamic scene is improved.

The invention relates to a video generation method based on time sequence similarity, and is applied to the field of video generation. Specifically, the video generation method based on the time sequence similarity comprises the following steps: acquiring generated video information; generating a key video frame sequence with frame rate information based on the text information, wherein the key video sequence is separated by a plurality of frame marks; performing recursive interpolation processing on the key video frame sequence, fusing front and back key frame features through a preset attention mechanism, and generating an initial intermediate frame between adjacent key frames; extracting visual features of a plurality of key frames and intermediate frames included in the key video frame sequence, calculating cosine similarity of the visual features of adjacent frames, and adjusting intermediate frame generation parameters based on the similarity to optimize inter-frame coherence so as to obtain an optimized intermediate frame; and combining the key video frame sequence with the optimized middle frame to generate a complete video clip which is consistent with the text information and has a coherent inter-frame time sequence.

The invention discloses an AI-based creative thinking auxiliary generation method and system, relates to the technical field of artificial intelligence, and solves the problem of inaccurate sound and picture matching in a traditional method by performing timestamp alignment and feature extraction on audio data and a visual image frame and calculating the correlation between the audio data and the visual image frame by using a cross-modal attention mechanism. According to the method, user eye movement track data is introduced, real attention points of a user are mapped into a visual sequence, and an optimized weight matrix is generated by constructing attention masks and fusing model attention weights, so that a generation result is more in line with perception key points of the user. And meanwhile, a feedback mechanism is established based on the synchronization error score, and when the sound and the picture are detected to be asynchronous, the visual frame timestamp can be dynamically adjusted, so that the self-adaptive correction of the content is realized. On the whole, the method has remarkable advantages in the aspects of improving modal alignment precision, enhancing user perception consistency and optimizing generation result naturalness.

The invention relates to the technical field of video image processing, and discloses a video image super-resolution enhancement method based on a generative adversarial network. The method comprises the following steps: segmenting a low-resolution video sequence, and analyzing frame timestamp information to generate a dynamic time axis containing key frame nodes so as to reflect video time change characteristics; then, in combination with the time axis and an image feature extraction system, feature mapping is carried out on the low-resolution frames, and a preliminary high-resolution image sequence with feature information is obtained; enhancing the preliminary sequence by using a generative adversarial network containing a generator and a discriminator in combination with a context-aware optimization technology to generate an enhanced sequence; and a machine learning algorithm is introduced to identify and classify different image quality region characteristic modes, and an intelligent identification rule base is established, so that an enhanced sequence is optimized. And finally, in response to user interaction, adjusting display parameters to realize personalized display, integrating a multi-dimensional analysis tool, calculating details of a specific region, and presenting a result in a visual interface, so that the video image quality can be improved.

The embodiment of the invention provides a digital video monitoring data transmission synchronization method and system, and relates to the technical field of digital video monitoring data transmission synchronization, and the method comprises the steps: receiving a video data stream and an external sensor data stream which is related to the content of the video data stream and has an independent stable time synchronization mechanism; identifying a visual event from the video data stream, and identifying a physical event associated with the visual event from the external sensor data stream; taking the timestamp of the physical event as a time anchor point, obtaining a visual original timestamp of the visual event, and calculating the time deviation of the video data stream according to the time anchor point and the visual original timestamp; based on the time deviation, correcting the frame timestamp of the video data stream by adopting an adaptive weighted average or filtering strategy to obtain a corrected timestamp; and fusing the corrected timestamps to obtain a global time reference. The reliability of the monitoring data and the accuracy of the analysis result can be improved.

The invention discloses a laser cavitation diagnosis device and method based on double-frame delay synchronous phase shift. The device comprises an excitation module and a detection module. The excitation module comprises a first laser, a first 1 / 2 wave plate, a polarization splitting prism, a spectroscope, an energy meter, a convex lens and a water tank; the detection module comprises a second laser, a beam expanding lens group, a second 1 / 2 wave plate, a second polarization splitting prism, a third 1 / 2 wave plate, a first reflector, a second reflector, a fourth 1 / 2 wave plate, a third polarization splitting prism, a third reflector, a fourth polarization splitting prism, a first 1 / 4 wave plate, a first imaging lens, a first micro-polarization camera, a second 1 / 4 wave plate and a second imaging lens; and a second micro-polarization camera. According to the invention, a double-frame delay method is introduced into traditional synchronous phase-shifting interference, the defects of the existing cavitation detection technology are overcome, and instantaneous phase change observation in a single cavitation pulsation period is realized.

The invention relates to the field of digital people, and discloses a method and a device for synchronizing voice and mouth shape of a digital person, and electronic equipment. The method comprises the steps of obtaining natural language information, converting the natural language information into character information, determining a video frame and an audio frame based on the character information, and controlling the digital person to speak when the first frame time of the audio frame is the same as the first frame time of the video frame, so that the voice and mouth shape of the digital person can be kept consistent.

The invention relates to the technical field of video detection, in particular to an anomaly detection method and system fusing large and small models and cooperating with cross-time domain perception. Comprising the steps of configuring a small model, a multi-modal large model and a cross-time domain parameter based on an electric power scene; acquiring a monitoring video stream, calculating a dynamic frame extraction frequency based on a scene change coefficient of continuous video frames of the monitoring video stream, extracting a frame sequence and recording a timestamp of each frame; inputting a frame sequence into the small model to obtain a candidate target, removing redundancy through non-maximum suppression, screening an effective target in combination with a single-frame confidence coefficient and an inter-frame time domain continuous overlapping rate, marking an alarm image and generating a preliminary analysis result; a time-domain-crossing video frame, power scene sensor data and environment data are collected according to a dynamic time window by taking an alarm image timestamp as a center, a visual time-domain feature and a power scene sensor time sequence feature are extracted, and a time-domain-crossing fusion feature is obtained through fusion. The problem of misjudgment and missed judgment caused by single-frame dependence in power scene anomaly detection is solved.

A signal generator may include a reference horizontal synchronization signal generation block which generates reference horizontal synchronization signals based on a number of clock signals per a horizontal time, a frame clock calculation block which calculates a first frame clock number based on a number of the clock signals per the horizontal time, a frame clock comparation block which calculates a clock offset by comparing the first frame clock number and a second frame clock number generated based on a number of the clock signals per a frame time, a clock distribution block which generates horizontal synchronization signals by distributing a number of the clock signals corresponding to the clock offset to the reference horizontal synchronization signals, and a vertical synchronization signal generation block which generates a vertical synchronization signal based on the horizontal synchronization signals.

The invention provides an underwater video enhancement method based on semantic guidance, and the method comprises the following steps: S1, carrying out the global feature enhancement of a multi-frame video, and obtaining a feature map after global enhancement; s2, performing region enhancement on the context features of the multi-frame video to obtain a feature map after region enhancement; s3, performing semantic guidance on the feature map after region enhancement to obtain a region enhancement feature map after semantic guidance; and S4, fusing the semantically guided region enhanced feature map and the globally enhanced feature map to obtain an output effect of the intermediate frame. According to the global feature enhancement method disclosed by the invention, an encoder-decoder architecture is mainly used, multi-frame time sequence information is fully utilized to perform spatial alignment of adjacent multi-frame features by using grouping spatial shift, context information is fully learned to suppress irrelevant noise, the robustness of feature representation is enhanced, and the effect of global feature enhancement is achieved.

The embodiment of the invention discloses a virtual scene rendering method and device, computer equipment, a medium and a program product. A frame time consumption threshold value corresponding to a virtual scene and frame time consumption for rendering an ith group of video frames of the virtual scene are obtained. If the current computing resources are abundant, preferentially increasing the detail level of the relatively important interaction object and rendering; and if the current computing resource is limited, preferentially reducing the detail level of the relatively unimportant interaction object and rendering. Namely, the detail level of the interaction object is dynamically adjusted according to the change of the hardware performance, and the interaction object capable of improving the rendering effect is selected from the plurality of interaction objects based on the importance degree for adjustment, so that the utilization rate of the hardware performance is improved, and the rendering effect is relatively high in the limited hardware performance. Besides, in the process of rendering the virtual scene, only the interaction object is adjusted instead of all virtual objects in the virtual scene, so that the utilization rate of hardware performance is further improved.

The invention discloses an image acquisition method and device, electronic equipment and a storage medium. The image acquisition method comprises the following steps: acquiring a frame synchronization signal; and simultaneously outputting the frame synchronization signal to the plurality of acquisition devices based on a frame synchronization signal line, so that the plurality of acquisition devices acquire a group of synchronizable images. A plurality of acquisition devices are connected with a control chip through the same frame synchronization signal line, and frame synchronization signals are simultaneously output to the plurality of acquisition devices through the frame synchronization signal line, so that the plurality of image acquisition devices can perform image acquisition at the same triggering moment, and a group of synchronous images which are aligned during frame are obtained. According to the invention, the image synchronization between the synchronizable images is improved, so that if the synchronizable images are spliced, the jelly effect in the splicing process can be obviously reduced, and the acquisition requirement of the intelligent parking system on the high-time-sequence consistency image data is met.

A method of an optical sensor device includes: providing an optical sensor for receiving reflected light associated with a light emission unit to generate at least one sensed image; using a first exposure setting to make the optical sensor generate a first frame data during a first frame time period of a frame; when performing an exposure adjustment operation, using a second exposure setting to make the optical sensor generate a second frame data during a second time period of the frame neighbor to the first frame time period of the frame; and, generating a normalized digital signal corresponding to the first frame data based on the relation between the first frame data and the second frame data.

The invention relates to the technical field of artificial intelligence, can be applied to the fields of financial science and technology and medical science and technology, and discloses a video key frame extraction method, device and equipment and a medium. Then, a time-space relation graph of the video frames is constructed, nodes represent the video frames, and edge weights are jointly determined by inter-frame time proximity and visual feature similarity; performing feature propagation on the space-time relation graph by using a source domain pre-trained space-time graph neural network to obtain an initial importance score of each video frame; then, on the basis of scene characteristic indexes of a target video, through neural architecture search driven by a reinforcement learning strategy, topological structure parameters of the space-time diagram neural network are dynamically adjusted; and finally, recalculating the importance score of the video frame by using the adjusted space-time diagram neural network, and outputting a key frame sequence according to a scoring result, thereby improving the accuracy of key frame extraction and scene adaptability.

The invention relates to the technical field of communication interface conversion, in particular to a USB (Universal Serial Bus) to CAN (Controller Area Network) device and a transmission rate adjusting method, and the method comprises the following steps: acquiring a CAN bus load by monitoring a frame time interval of a sending frame and data traffic on a bus; the standard bit error rate is obtained by monitoring the proportion between the error frame and the data frame; generating an initial adjustment transmission rate value through weighted summation operation based on the CAN bus load and the standard bit error rate; according to the method, the CAN bus load condition, the bit error rate, the USB link characteristic parameters and the data communication characteristics are comprehensively considered, and the multi-dimensional input vector is established and input into the rate optimization prediction model, so that the dynamic optimization adjustment of the data transmission rate is realized, and the data transmission efficiency is improved. According to the scheme, the transmission pressure can be evaluated in real time according to the actual communication link state and the system performance, the rate is reasonably adjusted, the stability and efficiency of data transmission are remarkably improved, and the error rate and the link conflict risk are reduced.

The invention relates to the technical field of audio and video synchronization, in particular to a video call real-time audio and video synchronous monitoring system which comprises a frame time extraction module, a main time sequence locking module, a delay structure analysis module, a synchronous node generation module and a synchronous control instruction module. According to the invention, through real-time extraction and analysis of timestamp difference calculation of audio and video frames and establishment of a transmission delay interval comparison sequence, the time difference in audio and video transmission can be effectively identified, the monitoring accuracy of an audio and video asynchronization phenomenon is enhanced, and through real-time adjustment of timestamp offset, the synchronization accuracy of the audio and video in a playing process is ensured; in a dynamic network environment, the offset rate is monitored and adjusted in real time, the continuity and fluency of interactive experience are ensured, the synchronization state of the audio and video frames can be controlled more accurately by analyzing the offset difference value centralized distribution section and marking the synchronization fluctuation section, and the situation that the large-scale user experience is reduced due to synchronization error accumulation is avoided.

The embodiment of the invention discloses a satellite communication system and a time synchronization method thereof. The satellite communication system comprises a gateway, a terminal and a satellite. The method comprises the steps that a gateway is used for sending a time synchronization signal containing a super frame number or a frame number to a satellite in first X frames of an Nth gateway frame, the duration time of the first X frames is larger than the round-trip time from a terminal to the gateway, the actual sending moment of the time synchronization signal has first delay sending time relative to frame headers of the first X frames, N is a positive integer, and the first delay sending time is larger than the first delay sending time. X is a positive integer; receiving the time synchronization signal sent by the satellite by using the terminal, and calculating a second delay sending time according to the duration of the first X frames, the round-trip time from the terminal to the gateway and the first delay sending time, and the Nth terminal frame corresponding to the Nth gateway frame is sent at the end moment of the second delay sending time, so that the Nth gateway frame and the Nth terminal frame are synchronized in time.

The invention discloses a video advertisement intelligent insertion method and system based on semantic segmentation and multi-modal context fusion. Through pixel-level semantic mask and multi-frame time sequence analysis, a space neutral area which can be used for advertisement embedding in a video is automatically identified, and background stability judgment is carried out in combination with indexes such as structural similarity and brightness change; and constructing a multi-modal context modeler, fusing a character emotion vector, a video rhythm vector and a scene structure vector, generating a context situation vector through a cross attention mechanism, and outputting an insertion suitability score. And when the score reaches a set threshold value and the neutral area meets the condition, the system executes advertisement generation and visual fusion operation to realize natural advertisement insertion consistent with the original video content style. The method is suitable for various content platforms such as short video and live broadcast, and experiments show that the click rate and the complete broadcast rate can be remarkably improved, and the jump-out rate is reduced.

The invention discloses a video quality evaluation method and system based on space-frequency combination and time sequence interaction, and relates to the technical field of computer vision, and the method comprises the steps: carrying out the standardization and data enhancement of an immersive video key frame; then, spatial domain and frequency domain double-path features are constructed through learnable Gabor convolution, two-dimensional Fourier transform and a logarithmic magnitude spectrum; space-frequency dynamic fusion is realized through bidirectional Cross-Attention, and a joint representation is generated; then, inputting Transform architecture modeling inter-frame time sequence dynamic and global dependence, and obtaining time sequence correlation characteristics; and finally, outputting frame-by-frame quality scores through learning weighted MLP regression, and aggregating the frame-by-frame quality scores into an overall quality score. According to the method, high-fidelity no-reference quality evaluation of immersive video distortion is realized through space-frequency joint modeling and time sequence interactive learning.

The invention discloses a video abstraction method fusing cross-modal semantic information, and belongs to the technical field of computer vision. The method comprises the following steps: firstly, extracting an image frame sequence and a motion frame sequence from an input video, and then respectively extracting static features and dynamic features by using a cross-modal feature extraction network; then, frame features are processed through a space-time convolution association attention mechanism, an attention graph reflecting the space-time importance of the frame features is generated, and meanwhile intra-frame space information and inter-frame time information are captured; in addition, a cross-modal dynamic fusion module and a semantic consistency corrector are introduced to optimize a video abstract generation process, reduce noise interference and improve abstract quality. And finally, constructing an objective function, training a video abstract generation model through unsupervised or supervised learning, and generating a dynamic video abstract according to the predicted importance score. According to the method, the static and dynamic characteristics in the video are comprehensively utilized, and the semantic accuracy and content coherence of the abstract are improved.

The application discloses a video instance segmentation method and system based on global feature enhancement, and belongs to the technical field of computer vision and deep learning, which comprises the following steps: inputting continuous video frames into a double-channel decoupling feature extraction module to obtain appearance and position features; inputting the two types of features into a tracker and a global feature memory updating module to dynamically update and obtain long-time sequence global context features; completing instance detection matching by the tracker, judging target state to obtain disappeared and newly appeared target queries; combining long-time sequence features to model current frame time sequence to generate enhanced features; finally, the tracker completes segmentation and tracking based on the enhanced features and the target queries, and outputs a segmentation mask sequence, an instance ID, a category ID and a tracking state. Through double-channel decoupling, double-memory block updating, multi-cost matching and multi-weight feature fusion, the application strengthens appearance feature representation and long-time sequence information utilization, and significantly improves segmentation accuracy and tracking robustness in complex scenes.

The invention discloses a sentry mode recording and dotting method and device for automobile parking monitoring, and the method comprises the following steps: setting an area detection unit to carry out the real-time detection of an abnormal event of a camera video frame around the parking of an automobile, and notifying a recording management module of the starting timestamp and the ending timestamp of the abnormal event; coordinates are provided for sensitive information identified in the abnormal event video frame; setting a desensitization unit to code the sensitive frame according to the coordinate information, outputting the frame by the desensitization unit and transmitting the frame to a first coding unit; setting a first encoding unit to encode a video frame, and transmitting the encoded frame to an upper cloud unit; the latest camera video frame is input to the cache unit every time, and the cache unit stores frames within m seconds before the timestamp of the latest frame by taking the timestamp of the latest frame as a reference, and discards the frames before m seconds; and when receiving notifications of the start timestamp and the end timestamp of the abnormal event, the cache unit inputs the corresponding video frame to the second coding unit.

The invention provides a method and device for obtaining first frame time delay, and relates to the technical field of short video processing. The method comprises the following steps: judging whether a video is preloaded or not when being played in terminal equipment; if the video is preloaded when being played in the terminal equipment, determining that the time delay of the first frame of the video is 0; and if the video is not preloaded when being played in the terminal equipment, determining the first frame time delay of the video according to the video playing start time and the playing request time of the video. According to the method provided by the embodiment of the invention, the first frame time delay of the video can be conveniently and accurately determined.

The invention discloses a one-way link data integrity rapid verification method and system, and relates to the technical field of communication security, and the method comprises the steps: determining a whistle frame interval and a fingerprint sampling layout in a window according to a preset rule, sending a whistle frame, and forming an effective anchor point at a receiving side according to tolerance verification; segmenting the to-be-verified data according to the block length, generating a block-level rapid verification value, and verifying according to arrival; extracting sparse fingerprints on the data stream according to the fingerprint sampling layout and sending the sparse fingerprints, and performing recalculation and comparison at corresponding positions; and judging that the window does not pass when the whistle frame intervals are accumulated in a border crossing manner or effective anchor points are insufficient, otherwise, establishing an anchor neighborhood by using the effective anchor points, counting expected sampling hit and dissociation, synthesizing whistle finger coupling steady quantity, and judging that the window passes when the block-level rapid verification is passed, the sparse fingerprints are consistent and the whistle finger coupling steady quantity is greater than a threshold value. Through combination of a whistle frame time sequence, block verification and fingerprint sampling in a time window, one-way link transmission consistency evaluation is realized, and the exception screening and tampering detection capabilities are improved.

The invention relates to the technical field of data processing, in particular to a game lag analysis method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining the current frame time consumption of a target game program in a current game frame based on a frame interval interface; determining lag information of the current game frame based on the current frame time consumption and adjacent frame time consumption of an adjacent game frame before the current game frame; under the condition that the lagging information of the current game frame represents that the current game frame is lagged, obtaining function consumed time corresponding to at least one function group based on a consumed time instrumentation function corresponding to the at least one function group; and based on the function time consumption corresponding to the at least one function group, determining a lag factor corresponding to the current game frame. The game lag analysis efficiency can be improved.