29 results about "Variable frame rate" patented technology

The invention discloses an avian influenza host bird behavior prediction method based on deep reinforcement learning, and the method comprises the following steps: S1, deploying a multi-angle and variable-frame-rate camera in a target habitat, and collecting multi-source video data; s2, performing frame insertion, illumination normalization and background denoising processing on the video data; s3, inputting the preprocessed data into an improved YOLOv5 model to obtain a target detection result; s4, constructing a dynamic graph neural network based on bird nodes and space-time edges, and outputting a clustering situation vector; s5, inputting the flight path into a low-layer Actor-Critic strategy network, and generating a local short-term behavior decision; s6, generating a global multi-walk prediction sequence in combination with the clustering situation vector and historical error feedback; and S7, comparing a prediction result with actual observation data, and triggering online fine adjustment according to deviation. According to the invention, non-intrusive and high-precision bird behavior prediction can be realized, and the method is suitable for bird flu monitoring and early warning scenes.

The invention discloses a display method and display equipment, and the method comprises the steps: obtaining a signal type of media asset data sent by external equipment in communication connection with the display equipment when the display equipment is detected to enter a frame frequency adjustment mode; under the condition that the signal type of the first media asset data sent by the external equipment is a variable frame rate signal, obtaining display screen parameters corresponding to the external equipment; the display screen parameter comprises an initial frame frequency maximum span value corresponding to the external equipment; controlling the display to refresh and display the first media asset data based on the display screen parameter; if it is determined that a screen flash phenomenon or a lag phenomenon occurs when the display refreshes and displays the first media asset data, adjusting a maximum span value in a first frame frequency maximum span interval based on the first frame frequency maximum span interval, the initial frame frequency maximum span value and the frame frequency span adjustment times corresponding to the external equipment to obtain a target frame frequency maximum span interval; and based on the maximum span interval of the target frame frequency and the screen parameters, controlling the display to refresh and display second media asset data sent by the external equipment. According to the scheme, the maximum span value of the initial frame frequency of different external devices is dynamically adjusted, and the more accurate maximum span value of the target frame frequency can be obtained, so that when the external devices transmit the variable-frame-rate media asset data to the display device, the maximum span value of the target frame frequency can be obtained; the media asset data is refreshed and displayed based on the maximum span value of the target frame frequency, so that the screen flash phenomenon or the jamming phenomenon at the screen end can be reduced.

The invention discloses a voice reconstruction method and device, a storage medium and a program product, and relates to the technical field of audio processing, and the method comprises the steps: obtaining to-be-reconstructed original voice data, and extracting the granularity voice frame features of the original voice data at each frame rate; calculating the voice information density of each granularity voice frame feature in each time window; screening granularity frame feature fragments according with a preset granularity proportion from each granularity voice frame feature according to the voice information density; the granularity proportion predefines the time proportion of the fragment duration of each granularity frame feature fragment in a unit time period; and performing voice reconstruction based on each granularity frame feature fragment to obtain corresponding reconstructed voice data. Therefore, through voice information density analysis, dynamic frame segment distribution of a variable frame rate is realized, high-sound-quality reconstruction is ensured, the coding complexity and delay are remarkably reduced, and the real-time performance and the self-adaptive capability of the whole system are improved.

Provided is an information processing apparatus that draws a display frame image to be displayed on a display apparatus and transmits the drawn display frame image to the display apparatus in one of operation modes of a fixed frame rate and a variable frame rate. The information processing apparatus draws a display frame image and transmits the drawn display frame image to the display apparatus in the operation mode of a variable frame rate, and switches, in a case where a moving image including contents that are drawn already when the drawing of the display frame image is performed is to be displayed on the display apparatus, the operation mode to the operation mode of a fixed frame rate.

Systems and methods for displaying a three-dimensional video at a different frame rate from which the video was stored or acquired are described. In one aspect, a frame N corresponding to a frame number N in the video is received at a video reader and decoder. A 3D mesh including a plurality of vertices, a texture, and one or more offset vectors associated with each vertex of the 3D mesh in the frame N are retrieved and transmitted to a rendering device. At least one vertex of the 3D mesh is adjusted according to the corresponding offset vectors and a playback time moment. The playback time moment is between N and N+1, where N+1 is a frame number corresponding to a frame N+1 immediately following the frame N. The adjusted 3D mesh and the texture are rendered according to one or more camera parameters associated with a display device.

To provide a method for frame-rate scalable video coding and a non-transitory processor-readable medium.SOLUTION: In a method for frame rate scalability, support is provided for input and output video sequences with a variable frame rate and variable shutter angle across scenes, or for input video sequences with a fixed input frame rate and input shutter angle, but a decoder is allowed to generate a video output at a different output frame rate and shutter angle than corresponding input values. A decoder is allowed to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed.SELECTED DRAWING: Figure 3

Disclosed are systems and techniques for processing one or more images. For example, a method includes obtaining, using an image sensor, a first plurality of frames associated with a scene at a first frame rate, wherein the first plurality of frames are associated with a first region of the image sensor and have a first resolution; obtaining, using the image sensor, a second plurality of frames associated with the scene at a second frame rate different from the first frame rate, wherein the second plurality of frames are associated with a second region of the image sensor and have a second resolution that is different from the first resolution; and combining a first frame of the first plurality of frames and a second frame of the second plurality of frames to generate a combined frame.

Disclosed are a display apparatus and a method for the display apparatus. The method includes: obtaining device information of an external device in connection with the display apparatus; parsing a variable frame rate mode supported by the external device from the device information by traversing a flag bit field in the device information; controlling the display to present an interactive menu, and receiving an interactive operation from a user through the interactive menu, wherein the interactive menu includes at least one option of variable frame rate modes; setting a display parameter of the display apparatus according to a first variable frame rate mode indicated by the interaction operation.

The present application provides a control method for multi-cameras, which is used for a self-propelled device. The self-propelled device includes a main camera, at least one slave camera, and a controller. The method includes: starting the main camera to perform image acquisition, and the controller periodically receiving an interrupt signal; in response to receiving the interrupt signal, the controller dynamically adjusts the frame rate of the slave camera according to the frame rate information of the main camera, and controls the slave camera to perform image acquisition at intervals with the adjusted frame rate and the main camera. Through this solution, after the controller receives the interrupt signal, according to the frame rate information of the main camera, by using the characteristic of the variable frame rate of the slave camera for image acquisition, the time interval for the slave camera to acquire images is dynamically adjusted, so as to achieve the effect of multiple cameras collaborating to perform image acquisition.

The invention discloses a microbubble dynamic tracking method and device for diving medicine, and relates to the technical field of dynamic detection, a variable frame frequency detection mode is introduced, an ultrasonic image device is controlled, ultrasonic detection based on a first continuous frame is executed, a microbubble image is determined, and a background domain and a bubble domain are classified according to a classifier. The method comprises the following steps: executing background domain blank collocation and microbubble group coding, calibrating each microbubble by introducing a central window and an alternative window, executing inter-frame dynamic graph network analysis in combination with a generator, performing trend prediction, generating a step frame, positioning a detection node, and controlling ultrasonic imaging equipment to execute ultrasonic detection based on a second continuous frame. And executing periodic detection and dynamic analysis based on a variable frame frequency detection mode, and integrating and determining a tracking chain, so as to solve the technical problem of insufficient capability of comprehensively, dynamically and automatically monitoring and judging the microbubbles in the prior art. And automatic, comprehensive, accurate and effective tracking management in a dynamic operation scene is realized.

Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.

A variable frame rate video generation method based on optical flow estimation, which introduces optical flow supervision information into an OpFode-Net model, the OpFode-Net model comprising an encoder-decoder structure; the encoder uses an ODE-ConvGRU to embed input video sequence X T into a hidden state h T ; wherein the ODE-ConvGRU uses a ConvGRU as a node of a neural ODE and embeds it into the neural ODE to realize dynamic modeling of the video sequence; the decoder starts from h T , and uses an ODE solver to generate a new video frame at any time step S, which can realize more accurate prediction results and achieve optimal performance in video interpolation and video prediction tasks.

A neural TTS system is trained to generate key acoustic frames at variable rates while omitting other frames. The frame skipping depends on the acoustic features to be generated for the input text. The TTS system can interpolate frames between the key frames at a target rate for a vocoder to synthesis audio samples.

A display device is disclosed. The display device includes a communication interface, a display, a memory for storing at least one instruction, and at least one processor. The at least one processor may control the display to: transmit available range information including a minimum value and a maximum value of a variable refresh rate (VRR) to an external server via the communication interface; and displaying the variable frequency image based on the variable frame rate information when a content including the variable frequency image rendered based on the available range information and the network bandwidth information and the variable frame rate information corresponding to the variable frequency image is received from the external server via the communication interface.

The present application provides a variable frame rate human motion analysis processing method, device and equipment, the method comprises: acquiring a preset frame rate motion video file; each video frame image in the motion video file is recognized to obtain a three-dimensional motion data model set based on time domain; the motion video file is divided according to preset frame rate distribution rule, to determine the target frame rate corresponding to the motion video file in different time periods; the frame rate of the motion video file in different time periods is converted into the corresponding target frame rate, to determine the frame rate set of the motion video file; the three-dimensional motion data model set and the frame rate set are encapsulated to obtain an encapsulation file, so that the user can analyze the motion data through the encapsulation file, the present application adopts a variable frame rate processing mode, dynamically analyzes and processes according to the actual motion type, and ensures the accuracy of model data and the timeliness of processing as far as possible.

Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.

A neural TTS system is trained to generate key acoustic frames at variable rates while omitting other frames. The frame skipping depends on the acoustic features to be generated for the input text. The TTS system can interpolate frames between the key frames at a target rate for a vocoder to synthesis audio samples.

The application discloses an avian influenza host bird behavior prediction method based on deep reinforcement learning, comprising the following steps: S1, deploying multi-angle and variable frame rate cameras in the target habitat to collect multi-source video data; S2, performing frame insertion, illumination normalization and background denoising processing on the video data; S3, inputting the pretreated data into an improved YOLOv5 model to obtain target detection results; S4, constructing a dynamic graph neural network based on bird nodes and space-time edges to output a flocking tendency vector; S5, inputting the flight trajectory into a low-level Actor-Critic policy network to generate a local short-term behavior decision; S6, combining the flocking tendency vector and historical error feedback to generate a global multi-step behavior prediction sequence; and S7, comparing the prediction results with actual observation data and triggering online fine-tuning according to the deviation. The application can realize non-invasive and high-precision bird behavior prediction and is suitable for avian influenza monitoring and early warning scenes.

The present invention discloses a video processing method and system with real-time variable refresh rate for atmosphere light rendering. The method includes: collecting an HDMI video signal and converting it into an RGB signal; obtaining the frame rates X1, X2, X3 of the current video source by detecting the field frequency signal V-SYNC; when the user selects and sets a constant frame rate and sets it as N, obtaining the constant frame rate N set by the user, and through data processing, outputting color rendering data with a fixed frequency in real time; when the user selects and sets a variable frame rate and sets it as M, obtaining the change rate M set by the user, and through data processing, outputting color rendering data with a variable frequency in real time. The present invention mainly collects the RGB signal output by the HDMI conversion chip, and according to the V-SYNC parsed from the signal, through different algorithms, matches the customer's requirements for the rendering effect, ensures that the rendering effect is consistent with the customer's requirements, and enriches the customer's subjective experience in different scenarios.

The application discloses a face recognition database image automatic updating method and system in security scenarios, and relates to the technical field of face recognition, comprising the following steps: collecting at least two kinds of identity certificate information for weighted fusion verification; continuously collecting multiple frames of face images at a variable frame rate after verification; performing multi-dimensional quality assessment on each frame of image in terms of definition, brightness, attitude angle and shielding; selecting an optimal candidate set with qualified quality and complementary attitude; calculating the marginal incremental contribution of the candidate set to determine whether the updating condition is met; performing direct addition or elimination and replacement based on multi-dimensional utility score according to the sub-database capacity; entering the verification observation period after updating, and automatically rolling back when the recognition fails and exceeds the threshold value. The application adopts the above method and system, ensures safety through multi-source fusion verification, improves the database quality through complementary attitude and incremental contribution evaluation, realizes dynamic evolution through multi-dimensional utility score, and guarantees robustness through the rollback mechanism.

The present application provides an application loading method and an electronic device. The application loading method comprises: detecting that a target application enters a loading phase; in response to the target application entering the loading phase, loading the target application at a variable frame rate, wherein the frame rate of each frame in the loading phase is determined on the basis of an operating duration of each frame, and at least one frame in the loading phase has a frame rate higher than a preset frame rate; and if a loading page of the target application is a blank screen, acquiring a first loading page and displaying the first loading page in the loading phase. The method of the present application can increase the application loading speed. When the loading page is the blank screen, an electronic device displays the first loading page to prevent a user from viewing the blank screen in the loading phase, thereby improving the entertainment experience of the user.

Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.

Provided is an information processing apparatus that draws a display frame image to be displayed on a display apparatus and transmits the drawn display frame image to the display apparatus in one of operation modes of a fixed frame rate and a variable frame rate. The information processing apparatus draws a display frame image and transmits the drawn display frame image to the display apparatus in the operation mode of a variable frame rate, and switches, in a case where a moving image including contents that are drawn already when the drawing of the display frame image is performed is to be displayed on the display apparatus, the operation mode to the operation mode of a fixed frame rate.

Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.

Video visualization systems with customizable image sensor frame rates to output multiple imaging modalities. A system includes an image sensor and an emitter. The system includes a controller that synchronizes operations of the emitter and the image sensor to output a video stream comprising data from one or more of a plurality of possible imaging modalities including color video imaging data, fluorescence video imaging data, and multispectral video imaging data. The controller selects a frame rate for the image sensor to output a video stream comprising two or more requested imaging modalities requested by a user, and further based on a minimum required frame rate for each of the two or more requested imaging modalities.

The invention relates to a signal processing device and a vehicle display device having the same. A signal processing apparatus according to an embodiment of the present invention comprises: at least one neural processor; the central processing unit runs a virtual machine monitoring program; the central processing unit runs a plurality of virtual machines on the virtual machine monitoring program; a first virtual machine of the plurality of virtual machines is controlled to operate the neural processor at a variable frame rate or output result data based on sensor data from a sensor device in the vehicle. As a result, the neural processor can operate efficiently.

A method for reading and writing frame images having variable frame rates and a system therefor are provided. The system provides a video processing system that includes a write end and a read end for accessing a single buffer block. In the method performed in the video processing system, when the read end starts to read an image frame, the read end is controlled to not read data from the buffer block until the data written by the write end to the buffer block reaches a progress threshold; and when it is determined that a portion of the data in the buffer block not yet read by the read end will be overwritten by the data written by the write end, the writing process is terminated until the read end finishes reading the data in the portion in the buffer block.

To provide a method for frame-rate scalable video coding and a non-transitory processor-readable medium.SOLUTION: In a method for frame rate scalability, support is provided for input and output video sequences with a variable frame rate and variable shutter angle across scenes, or for input video sequences with a fixed input frame rate and input shutter angle, but a decoder is allowed to generate a video output at a different output frame rate and shutter angle than corresponding input values. A decoder decodes more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed.SELECTED DRAWING: Figure 3