1063 results about "Frame rate" patented technology

The invention discloses a container application on-screen method based on texture full-process optimization, which comprises the following steps: taking a swan-gap system as a host and an Android system as a container, distributing a plurality of first buffers by the host, screening out a first texture format by the container, writing original textures of the format generated by rendering into frame buffers, identifying a dirty area of the rendered textures, and displaying the original textures in the frame buffers; packaging the texture data of the region, storing the packaged texture data into a shared memory, transmitting a file descriptor FD to a host, binding an idle first buffer setting priority, a state, a generation timestamp and a texture data pointer at the same time, and obtaining the texture data by the host through the FD; the host establishes a fixed thread task pool, executes multiple tasks in parallel to obtain on-screen texture data, and then updates the state of the first buffer and a texture data pointer; and finally, the host queries the first buffer with the processed state, reads the texture data after sorting according to the priorities and the generation timestamps to finish on-screen, and resets the state of the first buffer to be idle, so that the on-screen delay is effectively reduced, and the actual frame rate of the Android application is improved.

The invention discloses a video stream adaptive low-delay real-time transmission method and system based on edge calculation. The method comprises the following steps: receiving a real-time video stream from a network camera, creating a pipeline queue, adding timestamp information for each video frame, and setting a queue protection mechanism; the coded video frames are taken out from the input queue, and the frames in the video are processed through hardware acceleration decoding; the resource use condition of the system is monitored in real time; executing a self-adaptive frame skipping decision according to a performance monitoring result; timestamp generation: dynamically calculating a timestamp interval according to an actual processing frame rate; receiving the decoded original video frame and the corresponding timestamp information, accelerating decoding by using hardware, and executing a video coding operation; and packaging and transmitting the coded video data, and providing a standard protocol interface to be connected with a client for playing. According to the scheme, stable low delay and relatively low resource occupation can be kept, and meanwhile, the video quality is remarkably improved.

The invention discloses a three-dimensional model lightweight reconstruction and rendering method based on multi-strategy collaboration, and the method comprises the steps: 1, extracting geometric information, appearance information and semantic attribute information of a three-dimensional model, separating the geometric information from the appearance information and the semantic attribute information, and storing the semantic attribute information to a three-dimensional model database; 2, instantiating components with the same geometric structure in the three-dimensional model, realizing material sharing through a material reference mechanism, and reducing rendering overhead on the premise of not changing the structure of the model; step 3, carrying out lightweight processing on the exported geometric and appearance information to obtain reconstructed lightweight models with different precision grades; and 4, dynamically adjusting the geometric complexity of the lightweight model through the sight distance and the frame rate by using a hierarchical calculation algorithm for rendering, and meanwhile, obtaining component semantic attribute information and synthesizing the semantic attribute information by calling a three-dimensional model database interface to realize visual display of the reconstruction model.

The embodiment of the invention discloses a safety monitoring method and system for building construction, and the method comprises the steps: collecting the original video data of a construction site, carrying out the denoising, illumination correction and frame rate adjustment, and outputting a standardized video data stream; extracting attitude features of the constructors and representing the attitude features as a feature matrix to form an attitude feature matrix set containing spatio-temporal information; the sensitivity and correlation of the feature matrix are analyzed, calibration noise is added after dimension reduction, and feature data conforming to differential privacy are generated; and extracting data advanced representation by utilizing a pre-training model, and completing behavior classification, dangerous area judgment and safety violation detection. And the violation risk is evaluated in combination with the risk level of the construction area, graded early warning is generated, and meanwhile violation information is recorded to form a traceable management mechanism. According to the embodiment of the invention, accurate and efficient safety violation behavior detection is realized, and intelligent technical support is provided for safety management of building construction.

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.

Embodiments of this application provide a frame rate switching method and apparatus, applied to the field of terminal technologies. The method includes: drawing and rendering, by an application thread, a first image frame at a frame interval corresponding to a first frame rate in a first period; drawing and rendering, by the application thread, a second image frame at a frame interval corresponding to a second frame rate in a second period, where the second period is preceded by the first period, and the second frame rate is different from the first frame rate.

In an example, a device may include logic to receive a plurality of video frames from a video source, logic to process the plurality of video frames, logic to provide at least some of the plurality of video frames to a video sink, and logic to reduce a display latency of each of the video frames provided to the video sink by changing the frame rate of some or all of the frames.

The embodiment of the invention provides a picture display method and a related device, and the method comprises the steps: firstly, storing thumbnails according to the arrangement order of the thumbnails in a thumbnail display interface when electronic equipment stores the thumbnails corresponding to shot or stored pictures; in this way, the electronic equipment has the capacity of inquiring and obtaining the thumbnails in batches. And then, when the electronic equipment displays the thumbnail display interface, the electronic equipment can query and obtain the thumbnails in batches. In the embodiment of the invention, the electronic equipment can splice the plurality of obtained thumbnails to obtain the spliced thumbnail, and then the electronic equipment can display the spliced thumbnail through the view control. Through the picture display method provided by the invention, the performance and the frame rate of loading and displaying a large number of thumbnails by the electronic equipment can be improved, so that the problems of white blocks and lagging in the process of browsing a large number of thumbnails by a user can be avoided or reduced.

The invention discloses a million-frame-level industrial vision system and method based on event driving and compressed sensing, and the system is characterized in that an event camera imaging module in the system captures the brightness change of each pixel in a field of view of the event camera imaging module in an asynchronous manner, and generates an event containing a pixel coordinate, a timestamp and change polarity for each change; a compressed sensing coding module constructs sparse image vectors for events in a time window, and the sparse image vectors are projected to low-dimensional observation vectors through an observation matrix phi; the sparse image reconstruction module is used for optimizing an objective function through sparse constraint and total variation regularization; a dynamic ROI compression module controls a compression mask function according to the event density and a gradient threshold. The method can break through the limitation of the traditional frame rate, has the advantages of high precision, high efficiency, low power consumption, strong robustness and the like, and has a wide industrial application prospect.

The invention discloses a single-frame three-dimensional imaging method based on multi-frequency RGB (red, green and blue) stripe compression. According to the method, three groups of structured light stripe patterns with relatively prime frequencies and different directions are respectively embedded into RGB channels by utilizing channel characteristics of a color camera, the patterns are switched at a high speed by a projector, dynamic superposition is completed within single-frame exposure time of the camera, space compression acquisition of time domain information is realized, and a color superposition image fused with multiple pieces of time slice information is obtained. According to the invention, a multi-stage deep neural network architecture is designed to realize separation of fringe images of a color superposition image at different moments, phase information is accurately extracted from the decomposed fringe images, and finally unambiguous high-speed three-dimensional imaging in dynamic scenes at different moments is realized. According to the method, the time resolution of three-dimensional imaging can be remarkably improved without improving the frame rate of the camera, meanwhile, the space precision and the system stability are considered, and good universality and expandability are achieved.

The invention relates to the technical field of image data processing, in particular to a workshop filter defect detection method and system based on image processing, and the method comprises the steps: calculating the real-time rotating speed of a fan based on image analysis; dynamically adjusting the frame rate of the camera according to a rotating speed comparison result; reconstructing a three-dimensional surface model of the equipment; performing camera vibration compensation through the coding mark points; fusing the visible light image, the thermal imaging and the three-dimensional model data to generate a comprehensive diagnosis result; compared with the prior art that blade images are blurred and illumination and shadow interference cannot be accurately distinguished when a fixed frame rate camera fluctuates in rotating speed, the method has the advantages that the frame rate is dynamically adjusted by tracking the fan rotating speed deviation in real time, and multiple groups of images of each blade at the same rotating angle position are captured; the blade tip gradient vector is combined to analyze illumination shadow distribution characteristics, real defects and shadow artifacts are effectively separated, the microcrack recognition accuracy is remarkably improved, and meanwhile misjudgment caused by sudden change of environment illumination is avoided.

The invention provides a multi-process decoupling and double-state self-adaptive flow pushing method for a real-time digital human, and relates to the technical field of real-time digital humans. The method comprises the steps that a server initializes a digital human instance and starts two decoupling processes by responding to a client session request; the method comprises the following steps: processing input into an audio frame sequence, forming an audio buffer area through a sliding window, extracting structured features by a first process, and transmitting the structured features with corresponding original audio through cross-process communication; in the second process, a dynamic face area is generated based on the structural features and the visual parameters, and a digital human image frame is synthesized; packaging the image frame, the original audio and the state information into a multimedia unit, and stabilizing frame rate plug flow; based on state and audio input trigger event notification, sessions are monitored, processes are terminated and resources are recycled when the sessions are terminated or abnormal, multi-process decoupling processing and double-state self-adaptive stream pushing of a real-time digital human can be achieved, stream pushing stability is guaranteed, and dynamic monitoring and resource recycling can be achieved.

The invention discloses an AI digital human real-time rendering method based on GPU acceleration, and relates to the technical field of digital human rendering, and the method comprises the steps: S1, constructing a multi-GPU hardware feature and load monitoring module, and collecting hardware feature parameters and current load states of each GPU participating in collaborative rendering in real time; according to the method, by constructing the multi-GPU hardware feature and load monitoring module and combining a dynamic task allocation algorithm, dynamic allocation of the rendering sub-tasks to the optimal GPU is achieved, the problems of GPU performance bottleneck and resource idleness caused by traditional fixed task allocation are solved, the multi-GPU collaborative rendering efficiency is improved, and the multi-GPU collaborative rendering efficiency is improved. A scene complexity analysis module and a self-adaptive resource allocation algorithm are built, the proportion of GPU resources between an AI driving module and a rendering module is dynamically adjusted according to scene complexity, the AI digital human interaction naturalness is improved in a simple scene, the rendering frame rate and the picture quality are guaranteed in a complex scene, and the method is suitable for being used in a large-scale scene. And finally, dual optimization of rendering efficiency and picture quality in AI digital human real-time rendering is realized.

The invention discloses an auxiliary screen driving method and system based on a virtual display architecture, and the method comprises the steps: creating virtual display which takes an image output target as a rendering terminal in a system layer; preferentially acquiring the latest available composite frame at each display synchronization beat; performing content change detection on the current frame and the previous frame to determine an area to be updated; adaptively adjusting a target frame rate, an output resolution, a difference threshold value and / or update block granularity of virtual display based on the operation states of the auxiliary screen transmission link and the frame queue; scheduling the differential updating sequence according to regional importance, and preferentially ensuring that a region containing user interface elements is transmitted in time; using synchronous isolation to limit a synthesis and submission path of virtual display; and sending the differential update to the secondary screen through the point-to-point communication link to complete display refresh. According to the technical scheme, on the premise of not depending on additional video output hardware, the double-screen display capacity with controllable cost, compatibility with a native architecture and higher robustness is achieved.

At least one monocular camera is installed in a vehicle in addition to in-cabin camera(s). Images captured by the in-cabin camera(s) at a first frame rate are processed to determine first positions of facial landmark features of a user and first poses of the user's face. Images captured by the at least one monocular camera at a second frame rate, higher than the first frame rate, are processed to identify facial landmark features of the user in the second images. Second positions of the facial landmark features are determined at the second frame rate, by correlating the facial landmark features identified in the second images with the first positions of the facial landmark features determined from the first images. Second poses of the user's face are determined at the second frame rate based on the second positions of the facial landmark features and the first poses of the user's face.

The invention discloses a practical training platform three-dimensional scene mass data loading optimization method, and relates to the technical field of computer graphics and three-dimensional visualization. Passive response of data loading is converted into active pre-judgment through an orbit prediction model and prospective visible area calculation, and the real-time performance of data loading is improved. The rendering lag caused by the rapid change of the satellite track is obviously reduced; the combination of the predicted position and the camera vision cone ensures that the point location is scheduled before the vision field is switched; secondly, GPU resource utilization is optimized through dynamic attribute increment updating and a dirty marking mechanism; static and dynamic attribute buffer areas are separated, only change data are updated, the CPU-GPU communication overhead is reduced, the frame rate fluctuation problem caused by batch updating is solved, and the system is still kept smooth under ten-thousand-level point location dynamic updating; in addition, the collaborative design with terrain rendering eliminates point location dislocation during terrain detail level switching through monitoring and double-buffer correction, and improves visual consistency.

The invention relates to the technical field of vehicle-mounted human-computer interaction and graphic rendering, and discloses a method and a device for optimizing picture fluency of a vehicle-mounted display screen. The method comprises the following steps: collecting multi-source data and preprocessing the multi-source data to obtain a denoised sight line position and light intensity data; fusing the data and determining real-time sight focus coordinates of the driver through light correction; if the focus is located in the navigation area, preferentially calculating a rendering thread of the focus, judging the residence time and calibrating the locking precision; the navigation area frame rate is improved according to the locking state, and secondary area transition data are prepared; residual computing resources are obtained, a degradation rendering scheme is determined, and resource balanced distribution is achieved; extracting a pre-rendering frame when a total load peak value is detected, and obtaining seamless transition data; and finally, injecting the pre-rendered frame into an output buffer area and fusing the real-time coordinates to generate a smooth picture frame sequence. According to the method, dynamic resource allocation and smooth picture output can be realized, and the vehicle-mounted display fluency and the driving safety are remarkably improved.

The invention relates to the technical field of image communication, in particular to a video slow-action frame insertion playback system based on a generative adversarial network, which comprises a video signal acquisition module, a signal processing module, a frame rate conversion module and a playback code output module. The acquisition module outputs an original video frame sequence through an annular buffer; the processing module separates the denoised detail components and the edge gradient features in parallel; the frame rate conversion module uses a geometric structure as a boundary locking condition to guide detail components to execute nonlinear motion compensation and intermediate frame reconstruction; and the playback module executes time base remapping and distributed coding transmission. According to the invention, through a depth generation architecture of structural constraint textures, in combination with space-time consistency verification and a nearest neighbor pixel backfilling mechanism and a virtual time base rate decoupling technology, real-time slow-action video redisk with high signal-to-noise ratio and no artifacts for a high-speed moving target is realized.

The invention discloses a railway freight car loading state detection method based on image recognition, and particularly relates to the field of railway freight car loading state detection.The method comprises the steps that in the process that a railway freight car passes through an image collection area, carriage image frames are collected at a constant frame rate through linear array imaging equipment; an image sequence is constructed based on the wheel axle displacement, the acquisition timestamp and the frame number, the image sequence comprises a main image frame, a relay interpolation frame and an interpolation pseudo frame, and the main image frame, the relay interpolation frame and the interpolation pseudo frame are arranged to support time domain modeling of subsequent state response changes. The dynamic capture and accurate identification of the instantaneous abnormal state of the loading structure are realized by constructing an anchor point tracking graph and combining a time sequence rhythm modeling and similarity discrimination mechanism of a disturbance behavior. The problems that in the prior art, an identification system lacks the space-time continuous modeling capacity for the short-time change state, and an abnormal judgment blind area and misjudgment distortion exist are solved.

The invention relates to the technical field of steel wire rope state detection, in particular to a steel wire rope diameter measuring method and system based on event compensation correction. According to the technical scheme, the system comprises an imaging module, a boundary initial extraction module, a dynamic motion estimation module, a dynamic correction compensation module and a diameter calculation module. The imaging module comprises a traditional camera, an event camera, an optical component, a synchronous triggering device and a spectroscope. The traditional camera is used for collecting frame images of the steel wire rope. According to the method, on the basis of complementary advantages of an event camera and a traditional camera, systematic measurement deviation under the dynamic working condition is solved from the mechanism through an event-driven dynamic geometric compensation model, and quasi-static imaging dependence is broken through. The method does not need extra constraint or increase of frame rate, control cost and hardware complexity, avoids the problems of reduction of signal-to-noise ratio and the like, realizes high-precision stable measurement under high-speed and vibration working conditions, adapts to online monitoring of multiple industrial scenes, and is remarkable in practicability and application value.

The invention relates to the technical field of image data processing, in particular to a screen projection remote control method and system based on the gap NEXT. The method comprises the following steps: constructing a port mapping channel, and judging the type of current equipment; if the equipment type is a mobile phone, a preset screen projection tool is injected into a controlled end of the swan NEXT system, and screen picture content of the controlled end is extracted through the preset screen projection tool to form picture data; if the equipment type is a simulator, intercepting simulator operation frames according to a preset frame rate, and combining the simulator operation frames into a continuous image sequence to form picture data; performing video coding on the picture data, and transmitting the picture data to a control end in real time through a port mapping channel; and the control end receives, decodes, renders and displays to obtain a visual picture. By establishing an adaptive port mapping channel and a differentiated picture acquisition mechanism, cross-platform low-delay screen projection and high-precision remote control between the real machine and the simulator of the gap NEXT are realized.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

The invention relates to the technical field of mobile phone end cloud rendering display, and discloses a mobile phone end simulation scene interactive display method based on cloud rendering. The method comprises the following steps: collecting user interaction data, equipment state information and network environment parameters of a mobile phone end, and generating an interaction state monitoring value through validity verification, noise filtering and multi-source integration; extracting a rendering engine configuration parameter based on the monitoring value, and selecting a resolution and detail level balance point through an optimization algorithm to obtain a rendering parameter optimization value; in combination with real-time network delay and equipment electric quantity, a rendering strategy is adjusted according to the optimization value, and an environment response adjustment value is generated; setting a frame rate and an image quality threshold and dynamically applying the frame rate and the image quality threshold to obtain a display threshold set value; capturing a user behavior mode and scene complexity change, analyzing a prediction demand through a time sequence, and generating a scene demand prediction value; and comparing the actual rendering output with the predicted value, calculating an error, feeding back and controlling a rendering process, and outputting an optimized interactive display result.

The invention discloses a method and system for packaging a webpage embedded sign language translation JS library, and belongs to the field of electrical digital data processing.The method comprises the steps that by constructing an ECS core architecture with perception feedback, a bidirectional data flow between modules is established to achieve dynamic collaboration of rendering and grammar; predictive streaming resource management is adopted, and resources are intelligently preloaded based on gesture sequence contexts; multi-instance physical isolation is realized by utilizing a sandboxed container and a ShadowDOM (Document Object Model); implementing multi-level adaptive rendering, and dynamically switching a rendering path and a frame rate according to equipment performance; and finally, shielding the bottom layer difference through cross-end unified rendering of the abstraction layer. According to the method, the problems of animation and semantic dislocation, resource loading conflict and poor equipment compatibility in a multi-user concurrent scene are effectively solved, and high-fidelity, low-delay and cross-end consistent experience of sign language translation animation is realized.

The invention discloses a global neural drawing method and system oriented to hybrid representation optimization, and belongs to the technical field of computer graphics, and the method comprises the steps: dividing a screen into a plurality of tiles, and obtaining a first workload index on each tile in a first drawing stage and a second workload index on each tile in a second drawing stage; generating a cross-tile and cross-stage unified scheduling queue based on the first workload index and the second workload index, and executing the drawing tasks on different tiles in parallel according to the unified scheduling queue; and triggering a subsequent feature fusion and neural global illumination drawing stage when the inter-stage dependency condition is met so as to generate an output image with a global illumination effect. According to the method, the end-to-end frame rate oriented to the modern AI accelerator / AI-GPU can be remarkably improved and the tail delay can be reduced on the premise of ensuring the visual quality and the time sequence stability, and the method is suitable for application scenes such as real-time global illumination, large-scale complex scene drawing and interactive neural rendering.

The invention relates to the technical field of stereoscopic vision, and discloses a synchronous speed visual matching method and system, electronic equipment and a storage medium, and the method comprises the steps: synchronously collecting a stereoscopic video sequence with a predefined frame rate; executing multi-target hybrid tracking and motion induction detection, and outputting target motion information including position and velocity vectors; extracting hierarchical motion features of the target from continuous multiple frames of the stereoscopic video sequence, and performing unified space-time coding; under geometric constraints of stereoscopic vision, scale cosine similarity, direction similarity and trajectory consistency measurement are calculated and serve as observation evidences to be input into the probabilistic reasoning model for fusion, and a posterior probability representing matching reliability is output; the weight distribution of the speed similarity and the direction similarity is adjusted according to the motion characteristics of the targets in the scene, and the stable corresponding matching relation between the left view target and the right view target is established. According to the method, high-time-resolution information can be utilized, motion features and geometric constraints can be effectively fused, and the method has self-adaptive capacity.

The invention discloses a 4K multi-frame-rate YUV422 low-delay collaborative coding and decoding method, which relates to the technical field of video coding and decoding, and comprises the following steps of: configuring coding and decoding device parameters, establishing network connection, and setting a multi-frame-rate range and a buffer area; acquiring a 4K YUV422 original frame sequence from a video source and temporarily storing the 4K YUV422 original frame sequence; analyzing the difference and texture change between the current frame and the previous frame, and calculating the comprehensive content complexity; dynamically selecting an optimal target frame rate according to the complexity value and the network delay; the codec exchanges a frame rate switching command through a control channel and realizes synchronization, adjusts a compression parameter according to a selected frame rate, and generates a bit stream; and periodically exchanging network state information while transmitting the coded data. According to the invention, by introducing a dynamic frame rate collaborative adjustment mechanism based on content complexity, adaptive matching of coding parameters, scene contents and network states can be realized, and the problem that the stability of video image quality cannot be ensured while low delay is maintained in the prior art is solved.

A playback system is provided for altering the frame rate of streaming digital movie data for synchronizing with audio data recording to create a synchronized audiovisual work. The system can have a video that is synchronized with the variations in the tempo of the audio data through a variable timing reference track designed and provided for a user, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the audio data.

The invention discloses a three-dimensional visualization method, system and device based on heterogeneous spatial data fusion and dynamic sectioning, and a medium, belongs to the technical field of urban information model visualization, and aims to solve the technical problem of how to improve data fusion efficiency, sectioning response delay and mobile terminal frame rate in a million patch scene. Light-weight and high-interaction visual display of scenes such as smart cities and underground pipe galleries is realized, and the defects of multi-source spatial data splitting, high sectioning interaction delay and poor cross-terminal compatibility are overcome. According to the technical scheme, heterogeneous data dynamic normalization is carried out, wherein local coordinates of a building information model, WGS84 coordinates of a geographic information system and computer aided design data are unified to an Euclidean coordinate system through a space dynamic reference conversion algorithm, and normalized data are obtained; constructing a semantic data relation graph; generating a dynamic sectioning plane in real time; vector elements are highlighted in a linkage manner; and carrying out cross-terminal adaptive rendering.

The invention provides a virtual environment rendering method and device, electronic equipment and a storage medium. The method comprises the steps that a scene visual area corresponding to a controlled virtual object located in a game scene is recognized; the area type of each grid in the scene visible area is obtained, and the multiple grids are obtained by dividing the game scene; and rendering the scene visible area according to an illumination execution mode corresponding to the area type. According to the method, the illumination quality and the performance overhead can be balanced, and the problems that a full-baking scheme cannot support a dynamic light source and the baking time is long are solved to a certain extent, and the problems that a full-real-time GI scheme is high in performance consumption and low in frame rate at a mobile terminal are solved.