Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1585 results about "Frame rate" patented technology

Frame rate (expressed in frames per second or FPS) is the frequency (rate) at which consecutive images called frames appear on a display. The term applies equally to film and video cameras, computer graphics, and motion capture systems. Frame rate may also be called the frame frequency, and be expressed in hertz.

High-reflection and high-transmittance material surface flaw detection method based on improved YOLOv11

The invention discloses an improved YOLOv11-based high-reflection and high-transmittance material surface defect detection method, which comprises the following steps: S1, acquiring a mobile phone screen surface defect image, preprocessing and labeling, and generating a training data set containing three defects of scratches, edge breakage and cracks; s2, constructing a defect detection model; s3, averagely dividing an input image into four independent detection regions, adopting a bounding box overlapping area weight distribution strategy for cross-region defects, and performing partition counting on the image by using a defect detection model; s4, constructing a surface defect detection network meeting the real-time requirement of the industrial production line, and outputting a detection result and a processing frame rate; s5, pixel-level mask segmentation is carried out on the scratch defect, and contour coordinates and geometric features are extracted; and S6, fitting the actual damage size of the scratch defect on the surface of the high-reflection and high-transmittance material according to the segmentation result. According to the method, the detection speed is high under the condition that the accuracy is ensured, and a reliable solution is provided for surface flaw detection of the high-reflection and high-transmittance material.
Owner:ANHUI AGRICULTURAL UNIVERSITY

Game animation character display method based on virtual reality technology

The invention provides a game cartoon character display method based on a virtual reality technology. The method comprises the following steps: acquiring three-dimensional model data of a game cartoon character in a target display area through a user interaction terminal; the virtual reality content management platform determines a dynamic rendering precision level according to the model data, and generates a real-time rendering strategy including a model patch reduction coefficient, a texture compression rate and a skeleton animation updating frequency in combination with terminal performance parameters; the strategy is sent to a virtual reality supervision platform and a user interaction terminal, and a virtual reality rendering engine platform is instructed to execute real-time rendering; and the virtual reality supervision platform monitors the frame rate fluctuation data of the head-mounted display device, calculates the scene rendering stability, sends a rendering optimization instruction if the scene rendering stability is lower than a threshold value, and adjusts the model data acquisition frequency and the video memory cleaning period to optimize the performance. The rendering efficiency and the system stability can be improved, and the hardware load and the frame rate fluctuation are reduced.
Owner:JIANGSU JIUQU INTERACTIVE ENTERTAINMENT NETWORK TECHNOLOGY CO LTD

Container application on-screen method based on texture full-process optimization

The invention discloses a container application on-screen method based on texture full-process optimization, which comprises the following steps: taking a swan-gap system as a host and an Android system as a container, distributing a plurality of first buffers by the host, screening out a first texture format by the container, writing original textures of the format generated by rendering into frame buffers, identifying a dirty area of the rendered textures, and displaying the original textures in the frame buffers; packaging the texture data of the region, storing the packaged texture data into a shared memory, transmitting a file descriptor FD to a host, binding an idle first buffer setting priority, a state, a generation timestamp and a texture data pointer at the same time, and obtaining the texture data by the host through the FD; the host establishes a fixed thread task pool, executes multiple tasks in parallel to obtain on-screen texture data, and then updates the state of the first buffer and a texture data pointer; and finally, the host queries the first buffer with the processed state, reads the texture data after sorting according to the priorities and the generation timestamps to finish on-screen, and resets the state of the first buffer to be idle, so that the on-screen delay is effectively reduced, and the actual frame rate of the Android application is improved.
Owner:北京麟卓信息科技有限公司

Image frame insertion method and device in virtual shooting and storage medium

The invention relates to an image frame insertion method and device in virtual shooting and a storage medium. The method comprises the following steps: acquiring at least two frames of reference images generated by a rendering engine; obtaining motion information and depth information of at least two frames of reference images generated by a rendering engine; and based on the motion information and the depth information of the at least two frames of reference images, determining a pixel value of a frame insertion image between the at least two frames of reference images, the frame insertion image and the at least two frames of reference images being used for sending to a display screen for display, and the display screen serving as a shooting background in virtual shooting. According to the embodiment of the invention, on-screen content can be smoothly played without improving the performance of a rendering end, the picture quality of a picture is remarkably improved, the data output capability of a rendering engine is fully played, redundant calculation is avoided, the computing power is saved, the remarkable frame rate improvement can be realized at relatively low cost, and the user experience is improved. The method meets the requirements of a virtual shooting scene, and has good stability and robustness.
Owner:YOUKU CULTURE TECH (BEIJING) CO LTD

Video stream adaptive low-delay real-time transmission method and system based on edge calculation

The invention discloses a video stream adaptive low-delay real-time transmission method and system based on edge calculation. The method comprises the following steps: receiving a real-time video stream from a network camera, creating a pipeline queue, adding timestamp information for each video frame, and setting a queue protection mechanism; the coded video frames are taken out from the input queue, and the frames in the video are processed through hardware acceleration decoding; the resource use condition of the system is monitored in real time; executing a self-adaptive frame skipping decision according to a performance monitoring result; timestamp generation: dynamically calculating a timestamp interval according to an actual processing frame rate; receiving the decoded original video frame and the corresponding timestamp information, accelerating decoding by using hardware, and executing a video coding operation; and packaging and transmitting the coded video data, and providing a standard protocol interface to be connected with a client for playing. According to the scheme, stable low delay and relatively low resource occupation can be kept, and meanwhile, the video quality is remarkably improved.
Owner:SICHUAN WEIBANG XINCHUANG TECH CO LTD

Three-dimensional model lightweight reconstruction and rendering method based on multi-strategy collaboration

The invention discloses a three-dimensional model lightweight reconstruction and rendering method based on multi-strategy collaboration, and the method comprises the steps: 1, extracting geometric information, appearance information and semantic attribute information of a three-dimensional model, separating the geometric information from the appearance information and the semantic attribute information, and storing the semantic attribute information to a three-dimensional model database; 2, instantiating components with the same geometric structure in the three-dimensional model, realizing material sharing through a material reference mechanism, and reducing rendering overhead on the premise of not changing the structure of the model; step 3, carrying out lightweight processing on the exported geometric and appearance information to obtain reconstructed lightweight models with different precision grades; and 4, dynamically adjusting the geometric complexity of the lightweight model through the sight distance and the frame rate by using a hierarchical calculation algorithm for rendering, and meanwhile, obtaining component semantic attribute information and synthesizing the semantic attribute information by calling a three-dimensional model database interface to realize visual display of the reconstruction model.
Owner:CHINA INFOMRAITON CONSULTING & DESIGNING INST CO LTD

Video stream concurrent access front-end dynamic scheduling control system and method based on digital twinborn scene

The invention discloses a video stream concurrent access front-end dynamic scheduling control system and method based on a digital twinborn scene, and relates to the technical field of computer software and network communication, the system comprises three core modules: a self-adaptive request queue module manages UE rendering resources based on a session token pool, distributes tokens through preemptive scheduling, and sends the tokens to a server; in combination with a GPU frame rate feedback dynamic adjustment strategy, queuing through a Promise asynchronous queue when the request fails; the front-end fusing and backoff retry module monitors the connection failure rate, when the connection failure rate reaches a threshold value, fusing is triggered, retry is delayed by adopting an exponential backoff strategy, and a semi-open state tends to recover; and the local cache collaboration module intercepts the request through Service Worker, caches the latest video clip, pushes the local content when the request is delayed, and ensures the freshness through ETag verification. The method and the device are used for efficiently managing loading and interaction of multiple users on real-time rendering pictures at a browser end.
Owner:浪潮智慧城市科技有限公司

Safety monitoring method and system for building construction

The embodiment of the invention discloses a safety monitoring method and system for building construction, and the method comprises the steps: collecting the original video data of a construction site, carrying out the denoising, illumination correction and frame rate adjustment, and outputting a standardized video data stream; extracting attitude features of the constructors and representing the attitude features as a feature matrix to form an attitude feature matrix set containing spatio-temporal information; the sensitivity and correlation of the feature matrix are analyzed, calibration noise is added after dimension reduction, and feature data conforming to differential privacy are generated; and extracting data advanced representation by utilizing a pre-training model, and completing behavior classification, dangerous area judgment and safety violation detection. And the violation risk is evaluated in combination with the risk level of the construction area, graded early warning is generated, and meanwhile violation information is recorded to form a traceable management mechanism. According to the embodiment of the invention, accurate and efficient safety violation behavior detection is realized, and intelligent technical support is provided for safety management of building construction.
Owner:内江市住房保障和房地产事务中心

Visual fatigue relieving method based on ambient light self-adaption and AI algorithm

The invention provides a visual fatigue relieving method based on ambient light self-adaption and an AI algorithm, and relates to the technical field of visual health protection. The visual fatigue relieving method based on ambient light self-adaption and the AI algorithm comprises the following specific steps: S1, data acquisition: acquiring a user eye image sequence in real time through a high-frame-rate camera; and S2, parameter extraction: when the user uses the eye for the first time, testing the eyes by combining the adjustable light source with ambient light. Multi-dimensional features (such as eyeball movement, blinking mode, pupil function and the like) of eyes are collected in real time through a high-frame-rate camera, an individualized base line is established and a fatigue rate value is dynamically calculated in combination with data of an ambient light sensor, and conversion from passive response to active prevention is realized. Through a hierarchical intervention strategy (such as brightness adjustment, blue light control and forced rest), the visual load is remarkably reduced, the intervention efficiency is improved, and the problem of insufficient adjustment hysteresis and individual adaptability in the prior art is solved.
Owner:WENZHOU TIANYI EYE HEALTH TECHNOLOGY CO LTD

Real-time rendering and interaction method for immersive virtual reality scene

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.
Owner:CHENGDU TECHNICIAN COLLEGE (CHENGDU VOCATIONAL & TECH COLLEGE OF IND & TRADE CHENGDU ADVANCED TECH SCHOOL CHENGDU RAILWAY ENG SCHOOL)

Backlight source dynamic refreshing method and system based on content change frequency

The invention provides a backlight dynamic refreshing method and system based on content change frequency, and is applied to the field of image data processing. According to the method, the inter-frame variable quantity of the current image content of the display screen is pre-collected, whether the image refreshing speed is matched with the backlight response or not is judged, the pixel change rate in unit time is calculated based on the frame difference method, the content change frequency index is reasonably divided, the backlight PWM parameters are dynamically adjusted in combination with user setting, and the display quality is improved. The response coordination of the display screen under the dynamic image is effectively improved, when the frame rate fluctuation is recognized, the gray scale compensation frame is introduced and the brightness change slope is limited, and the problems of smear, splash screen and the like caused by asynchronous refreshing can be relieved.
Owner:SHENZHEN GAOXINXING TECH CO LTD

Real-time badminton action detection system and device based on MediaPipe and Motion Bidirectional Encoder Representation Transformer

A real-time badminton action detection system, consisting of: a video recording module configured to continuously record video images at a frame rate of at least thirty frames per second; a pose estimation processing unit configured to detect and output two-dimensional skeletal landmark coordinates for a variety of body joints, including at least wrists, elbows, shoulders, hips, knees and ankles, from each video frame; a Motion Bidirectional Encoder Representation Transformer (Motion-BERT) configured to receive sequential skeleton landmark coordinates over a defined time window and encode motion trajectories using multi-head self-attention mechanisms across past and future frames; and a classification controller module operationally coupled to the Motion-BERT, wherein the classification controller module comprises a dense neural network with a softmax output layer configured to generate real-time probability distributions over a variety of badminton-specific action classes, the end-to-end system being configured to produce recognition results with a processing latency of less than 100 milliseconds; and wherein the video recording module comprises a high-speed digital camera with a wide-angle lens positioned at a point on the perimeter of the court, the camera being calibrated with intrinsic and extrinsic parameters for perspective correction, and wherein the system includes a calibration routine that aligns detected skeletal landmarks with a reference badminton court coordinate system.
Owner:NITTE MEENAKSHI INSTITUTE OF TECHNOLOGY (DEEMED TO BE UNIVERSITY) BENGALURU +3

AR real-time scene reconstruction and illumination matching system and method based on neural rendering

The invention relates to the technical field of augmented reality, in particular to an AR real-time scene reconstruction and illumination matching system and method based on neural rendering, and the system comprises a real-time scene understanding module, a real-time neural radiation field module and a real-time reflection inference and enhancement module. Comprising a forward network, a feature transformation layer and a backward network, the forward network maps a high-dimensional rendering space to a feature manifold, the feature transformation layer executes mapping from the feature manifold to a rendering manifold, and the backward network performs rendering calculation based on a Riemannian metric driven adaptive ray tracing mechanism; the real-time reflection inference and enhancement module performs material prediction and illumination information calculation based on an illumination dynamic adaptation system on a differential manifold, real-time application of a neural radiation field technology in an AR scene is realized through an innovative differential geometry framework, and a real-time rendering frame rate of 30-60 fps is achieved while a high-quality rendering effect is kept.
Owner:UNIV OF SHANGHAI FOR SCI & TECH

Network video streaming with trick play based on separate trick play files

Network services encode multimedia content, such as video, into multiple adaptive bitrate streams of encoded video and a separate trick play stream of encoded video to support trick play features. The trick play stream is encoded at a lower encoding bitrate and frame rate than each of the adaptive bitrate streams. The adaptive bitrate streams and the trick play stream are stored in the network services. During normal content streaming and playback, a client device downloads a selected one of the adaptive bitrate streams from network serviced for playback at the client device. To implement a trick play feature, the client device downloads the trick play stream from the network services for trick play playback.
Owner:DIVX LLC

Frame rate switching method and apparatus

Embodiments of this application provide a frame rate switching method and apparatus, applied to the field of terminal technologies. The method includes: drawing and rendering, by an application thread, a first image frame at a frame interval corresponding to a first frame rate in a first period; drawing and rendering, by the application thread, a second image frame at a frame interval corresponding to a second frame rate in a second period, where the second period is preceded by the first period, and the second frame rate is different from the first frame rate.
Owner:HONOR DEVICE CO LTD

Auxiliary driving device and system based on video image processing

The invention relates to the technical field of data processing, in particular to an auxiliary driving device and system based on video image processing, and the device comprises a frame buffer queue with a multi-channel video collection module aligned with timestamps; a hierarchical calculation task decoupling module identifies task types in the frame buffer queue and marks priority labels, including a first priority label of a radar data analysis and distance superposition task, a second priority label of a vehicle profile generation task and a third priority label of a video fusion task, and outputs a data stream with priority labels; the calculation module generates a task processing result; the genetic algorithm optimization scheduling module generates a resource allocation strategy and controls the calculation module to execute task processing; and the output synchronous control module synthesizes a high-priority task result and performs frame rate synchronous output on a low-priority task. According to the method, the problem of real-time degradation caused by multi-path high-definition video stream processing is solved through task grading and dynamic resource scheduling, and the image output delay of the auxiliary driving scene is reduced.
Owner:BEIJING XINGJIAN CHANGKONG MEASUREMENT CONTROL TECH

Image acquisition method based on three-dimensional modeling

The invention discloses an image acquisition method based on three-dimensional modeling, and the method comprises the steps: A, improving the modeling robustness of a complex scene through the integration of a multi-modal sensor, including a visible light camera, a laser radar, an infrared sensor and a six-axis IMU, through the fusion of a data level, a feature level and a decision level; b, evaluating scene complexity in real time by using a convolutional neural network, dynamically adjusting parameters of resolution, frame rate, exposure time and equipment path, and realizing AI adaptive acquisition; c, geometric point cloud modeling and multi-view texture mapping are combined, global model precision is adjusted and optimized through a bundle method, and a hybrid modeling framework is formed. By combining the multi-modal data fusion technology and the artificial intelligence self-adaptive acquisition mechanism, the precision and efficiency in the three-dimensional modeling process are greatly improved, meanwhile, the adaptability of the model to different scenes is remarkably enhanced, the dependence on complex environmental conditions is effectively reduced, and the three-dimensional modeling technology is more flexible and reliable.
Owner:HANGZHOU YICUI INFORMATION TECHNOLOGY CO LTD

Video generation method and device based on time sequence similarity, electronic equipment and medium

The invention relates to a video generation method based on time sequence similarity, and is applied to the field of video generation. Specifically, the video generation method based on the time sequence similarity comprises the following steps: acquiring generated video information; generating a key video frame sequence with frame rate information based on the text information, wherein the key video sequence is separated by a plurality of frame marks; performing recursive interpolation processing on the key video frame sequence, fusing front and back key frame features through a preset attention mechanism, and generating an initial intermediate frame between adjacent key frames; extracting visual features of a plurality of key frames and intermediate frames included in the key video frame sequence, calculating cosine similarity of the visual features of adjacent frames, and adjusting intermediate frame generation parameters based on the similarity to optimize inter-frame coherence so as to obtain an optimized intermediate frame; and combining the key video frame sequence with the optimized middle frame to generate a complete video clip which is consistent with the text information and has a coherent inter-frame time sequence.
Owner:ACADEMY OF BROADCASTING SCI STATE ADMINISTATION OF PRESS PUBLICATION RADIO FILM & TELEVISION

Picture display method and related device

The embodiment of the invention provides a picture display method and a related device, and the method comprises the steps: firstly, storing thumbnails according to the arrangement order of the thumbnails in a thumbnail display interface when electronic equipment stores the thumbnails corresponding to shot or stored pictures; in this way, the electronic equipment has the capacity of inquiring and obtaining the thumbnails in batches. And then, when the electronic equipment displays the thumbnail display interface, the electronic equipment can query and obtain the thumbnails in batches. In the embodiment of the invention, the electronic equipment can splice the plurality of obtained thumbnails to obtain the spliced thumbnail, and then the electronic equipment can display the spliced thumbnail through the view control. Through the picture display method provided by the invention, the performance and the frame rate of loading and displaying a large number of thumbnails by the electronic equipment can be improved, so that the problems of white blocks and lagging in the process of browsing a large number of thumbnails by a user can be avoided or reduced.
Owner:HUAWEI TECH CO LTD

Million-frame-level industrial vision system and method based on event driving and compressed sensing

The invention discloses a million-frame-level industrial vision system and method based on event driving and compressed sensing, and the system is characterized in that an event camera imaging module in the system captures the brightness change of each pixel in a field of view of the event camera imaging module in an asynchronous manner, and generates an event containing a pixel coordinate, a timestamp and change polarity for each change; a compressed sensing coding module constructs sparse image vectors for events in a time window, and the sparse image vectors are projected to low-dimensional observation vectors through an observation matrix phi; the sparse image reconstruction module is used for optimizing an objective function through sparse constraint and total variation regularization; a dynamic ROI compression module controls a compression mask function according to the event density and a gradient threshold. The method can break through the limitation of the traditional frame rate, has the advantages of high precision, high efficiency, low power consumption, strong robustness and the like, and has a wide industrial application prospect.
Owner:HANGZHOU HUICUI INTELLIGENT TECH CO LTD

Single-frame three-dimensional imaging method based on multi-frequency RGB stripe compression

The invention discloses a single-frame three-dimensional imaging method based on multi-frequency RGB (red, green and blue) stripe compression. According to the method, three groups of structured light stripe patterns with relatively prime frequencies and different directions are respectively embedded into RGB channels by utilizing channel characteristics of a color camera, the patterns are switched at a high speed by a projector, dynamic superposition is completed within single-frame exposure time of the camera, space compression acquisition of time domain information is realized, and a color superposition image fused with multiple pieces of time slice information is obtained. According to the invention, a multi-stage deep neural network architecture is designed to realize separation of fringe images of a color superposition image at different moments, phase information is accurately extracted from the decomposed fringe images, and finally unambiguous high-speed three-dimensional imaging in dynamic scenes at different moments is realized. According to the method, the time resolution of three-dimensional imaging can be remarkably improved without improving the frame rate of the camera, meanwhile, the space precision and the system stability are considered, and good universality and expandability are achieved.
Owner:NANJING UNIV OF SCI & TECH

High-speed high-resolution compressed sensing imaging system and imaging method thereof

The invention discloses a high-speed high-resolution compressed sensing imaging system and an imaging method. Light of an object is emitted to the polarization splitting prism to be transmitted and reflected after passing through the first-stage imaging module, the transmitted light is reflected back to the polarization splitting prism after being coded and modulated by the spatial light modulator, and then the transmitted light enters the target surface of the camera through the second-stage imaging module to form a coded imaging image; the reflected light is transmitted to the hollow ridge reflecting prism through the quarter-wave plate, is reflected back to the quarter-wave plate through the hollow ridge reflecting prism, then sequentially passes through the quarter-wave plate, the polarization splitting prism and the secondary imaging module and then enters the target surface of the camera to form a common imaging image, and then coded imaging data is matched with common imaging data; and decoding reconstruction is carried out by adopting an alternating direction multiplier method of a point spread function integrated with the first-stage imaging module and the second-stage imaging module. Compared with a traditional imaging mode, the method can break through the imaging frame rate limit of a camera, and has the advantages of high imaging resolution and small data volume.
Owner:ZHEJIANG UNIV

Workshop filter defect detection method and system based on image processing

The invention relates to the technical field of image data processing, in particular to a workshop filter defect detection method and system based on image processing, and the method comprises the steps: calculating the real-time rotating speed of a fan based on image analysis; dynamically adjusting the frame rate of the camera according to a rotating speed comparison result; reconstructing a three-dimensional surface model of the equipment; performing camera vibration compensation through the coding mark points; fusing the visible light image, the thermal imaging and the three-dimensional model data to generate a comprehensive diagnosis result; compared with the prior art that blade images are blurred and illumination and shadow interference cannot be accurately distinguished when a fixed frame rate camera fluctuates in rotating speed, the method has the advantages that the frame rate is dynamically adjusted by tracking the fan rotating speed deviation in real time, and multiple groups of images of each blade at the same rotating angle position are captured; the blade tip gradient vector is combined to analyze illumination shadow distribution characteristics, real defects and shadow artifacts are effectively separated, the microcrack recognition accuracy is remarkably improved, and meanwhile misjudgment caused by sudden change of environment illumination is avoided.
Owner:CHANGSHA JIUXIN TECH CO LTD

Real-time digital human-oriented multi-process decoupling and double-state self-adaptive flow pushing method

The invention provides a multi-process decoupling and double-state self-adaptive flow pushing method for a real-time digital human, and relates to the technical field of real-time digital humans. The method comprises the steps that a server initializes a digital human instance and starts two decoupling processes by responding to a client session request; the method comprises the following steps: processing input into an audio frame sequence, forming an audio buffer area through a sliding window, extracting structured features by a first process, and transmitting the structured features with corresponding original audio through cross-process communication; in the second process, a dynamic face area is generated based on the structural features and the visual parameters, and a digital human image frame is synthesized; packaging the image frame, the original audio and the state information into a multimedia unit, and stabilizing frame rate plug flow; based on state and audio input trigger event notification, sessions are monitored, processes are terminated and resources are recycled when the sessions are terminated or abnormal, multi-process decoupling processing and double-state self-adaptive stream pushing of a real-time digital human can be achieved, stream pushing stability is guaranteed, and dynamic monitoring and resource recycling can be achieved.
Owner:XIAODUO INTELLIGENT TECH (BEIJING) CO LTD

Ecological environment protection method and system for power transmission and transformation project

The invention belongs to the technical field of power transmission and transformation project construction, and provides an ecological environment protection method and system for a power transmission and transformation project, which can construct a frequency portrait of a bird flapping behavior in real time by fusing multiple technical means such as high-frame-rate visual perception, target tracking, individual flapping frequency extraction and frequency domain behavior modeling. The operation state of the rotating device is adaptively adjusted according to a frequency interference similarity principle, so that high-frequency phase dislocation disturbance with the most interference effect is triggered at the moment when birds enter a key critical area, the flight rhythm and the path recognition capability of the birds are effectively damaged, and the birds are promoted to deviate from a flight path of a power transmission equipment area; birds can be prevented from approaching a lead area in time, and the risks of short-circuit tripping, biological casualties and other events caused by the fact that the birds strike the lead are remarkably reduced.
Owner:STATE GRID SHANDONG ELECTRIC POWER CO

AI digital human real-time rendering method based on GPU acceleration

The invention discloses an AI digital human real-time rendering method based on GPU acceleration, and relates to the technical field of digital human rendering, and the method comprises the steps: S1, constructing a multi-GPU hardware feature and load monitoring module, and collecting hardware feature parameters and current load states of each GPU participating in collaborative rendering in real time; according to the method, by constructing the multi-GPU hardware feature and load monitoring module and combining a dynamic task allocation algorithm, dynamic allocation of the rendering sub-tasks to the optimal GPU is achieved, the problems of GPU performance bottleneck and resource idleness caused by traditional fixed task allocation are solved, the multi-GPU collaborative rendering efficiency is improved, and the multi-GPU collaborative rendering efficiency is improved. A scene complexity analysis module and a self-adaptive resource allocation algorithm are built, the proportion of GPU resources between an AI driving module and a rendering module is dynamically adjusted according to scene complexity, the AI digital human interaction naturalness is improved in a simple scene, the rendering frame rate and the picture quality are guaranteed in a complex scene, and the method is suitable for being used in a large-scale scene. And finally, dual optimization of rendering efficiency and picture quality in AI digital human real-time rendering is realized.
Owner:GUANGZHOU PERANG IND CHAIN DEVELOPMENT CO LTD

Silicon wafer stress lossless non-contact measurement method and device

The invention provides a silicon wafer stress lossless non-contact measurement method and device, and the method comprises the steps: generating a near-infrared femtosecond pulse; the optical power of the near-infrared femtosecond pulse is sufficient to penetrate through an object to be detected for imaging; enabling the near-infrared femtosecond pulse to penetrate through the to-be-measured object, applying stress to the interior of the to-be-measured object, and receiving a light pulse signal of transmission light; analyzing and reconstructing a light pulse signal of the transmission light, and constructing an interference image sequence penetrating through the to-be-detected object; and based on the interference image sequence of the to-be-measured object, determining a principal stress difference value at each point on the to-be-measured object. According to the invention, the stress condition of each point on the to-be-detected object can be accurately detected, and the problems that fixed-point measurement is difficult to realize and the number of detection frames is low in the prior art are solved.
Owner:WUHAN UNIV

Mirror image display image overturning processing method and system for AR (Augmented Reality) equipment

The invention discloses a mirror image display image overturning processing method and system for AR equipment. The method comprises the steps that layered mirror image overturning is carried out; performing unified horizontal flipping processing on the input image of the physical camera and the virtual rendering layer through a GPU shader; independently rendering the UI channel; in a UI channel independent of the main image channel, drawing a UI layer according to the original space coordinates; calibrating interactive coordinates; performing reverse mapping on the position coordinate of the user operation event through a coordinate reverse mapping algorithm, so that the position coordinate is matched with the logic position of the UI control which is not overturned; optimizing dynamic performance; and monitoring a system load index in real time, and dynamically adjusting an image processing parameter according to a performance threshold so as to maintain a stable frame rate. The invention provides an efficient integrated solution, and the consistency of vision and interaction is realized through a cooperative processing mechanism of Shader image flipping and multi-channel rendering decoupling design. And the image direction logic consistency, the operation interface readability and the user experience real-time performance are effectively considered.
Owner:SHANGHAI YOUQI NETWORK TECH CO LTD