Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

73 results about "Rendering algorithms" patented technology

The most commonly used rendering algorithm is the scan-line algorithm. Any digital image is composed of a 2D grid of the smallest picture elements called pixels. A scan line is each row of pixels. The can-line algorithm looks at each pixel, one after the other, scan line by scan line, and calculates the color that pixel should be rendered.

Scene reconstruction method based on delayed rendering and three-dimensional Gaussian

The invention provides a scene reconstruction method based on delayed rendering and three-dimensional Gaussian. The method comprises the following steps: S1, generating initial three-dimensional point cloud data based on a multi-view image; s2, constructing a trainable structural body for three-dimensional Gaussian modeling; s3, normal initialization and residual optimization are carried out on the Gaussian ellipsoid primitives, depth consistency constraint is combined, and a differentiable and learnable normal reconstruction mechanism is realized, so that the geometric expression ability of illumination modeling is enhanced; s4, introducing a reflection training mechanism based on ambient light and a reflection direction, and generating a Gaussian attribute based on a visual angle; and S5, a final image is generated through a differentiable Gaussian sputtering rendering algorithm, and optimization is carried out through pixel loss of the final image and a real image. According to the method, the reality sense and geometric consistency of the Gaussian sputtering model under the complex illumination condition are remarkably improved, and the technical problems of unreal rendering effect, inaccurate surface normal estimation, weak propagation capability and the like of the existing three-dimensional Gaussian sputtering model under the complex illumination condition are solved.
Owner:GUANGDONG BOHUA UHD INNOVATION CENT CO LTD

Automatic lecturer video generation method based on AI speech synthesis and animation driving

The invention discloses a lecturer video automatic generation method based on AI speech synthesis and animation driving. The method comprises the following steps: performing structured analysis on a PPT or a text script through an improved interior point method and an incremental shortest path algorithm; performing semantic grouping by applying a full-dynamic parallel single-link clustering algorithm and generating an enhanced script with an expressive mark; a CosyVoice technology is combined with a low-rank approximation method to generate a high-quality voice data stream; establishing a mapping relation between contents and action expressions through semantic analysis, and generating a complete action expression instruction set; and driving the digital human model by using the msueTalk technology, and generating a final lecturer teaching video through a parallel rendering algorithm. According to the invention, the method achieves the efficient and automatic generation of the education video, remarkably improves the content production efficiency, reduces the production cost, and guarantees the specialty and expressive force of the teaching video.
Owner:SHENZHEN XUEYOU TECHNOLOGY CO LTD

Method and system for controlling an artwork-generating robot using a robot interface system

A method and system for controlling an artwork-generating robot using a robot interface system. The method includes generating a digital prototype of an artwork using a rendering algorithm of the robot interface system; setting a digital canvas using the robot interface system; displaying the digital prototype of the artwork on a display of the robot interface system; calibrating the robot and a robotic environment to enable the robot to generate a robot-generated artwork corresponding to the digital prototype; converting the digital prototype into a physical robot-generated artwork using the artwork-generating robot; and using the robot interface system to adjust settings and to interact with the robot while the digital prototype is being converted into the robot-generated artwork. The step of calibrating the robot is performed by using a calibrating tool of the robot interface system.
Owner:ROBOHOOD INC

Three-dimensional model generation method and system based on fractional distillation sampling

The invention discloses a three-dimensional model generation method and system based on fractional distillation sampling, and the method comprises the steps: obtaining an original image, and enabling the original image to be aligned with a preset tetrahedral ball grid, and obtaining a first model; according to a fractional distillation sampling algorithm and the noise residual error, a gradient updating direction is generated through iterative calculation, the second model is adjusted according to the gradient updating direction to obtain a third model until the number of iterations is reached, and the current third model is output as a final model; updating the first model to the current third model after the third model is obtained each time; wherein the noise residual error is obtained by performing noise prediction and calculation on the first rendering image injected with the random noise according to a frozen two-dimensional image generation model; the first rendering graph is obtained by rendering the first model according to a micro rendering algorithm; the second model is obtained by adjusting the current first model according to the rendering loss between the first rendering graph and the original image. According to the method, the problems that local distortion easily occurs and deformation is uncontrollable when the three-dimensional model is generated are solved.
Owner:RUIQI ELECTRIC TECHNOLOGY CO LTD +2

Lithium niobate metasurface defect intelligent identification method based on reactive ion beam etching

The invention relates to the technical field of industrial detection, and discloses a lithium niobate metasurface defect intelligent identification method based on reactive ion beam etching, which systematically solves the problem of scarcity of experimental data through physical driving simulation and a physics-based rendering algorithm, and provides large-scale field specific training data for a deep learning model. The bidirectional coupling simulation model generates defect morphology prediction data conforming to an etching dynamics law based on real process parameters and material parameters, the prediction data is converted into a synthetic image with real microscopic image statistical characteristics by a physical rendering algorithm, and the quality and consistency of the synthetic data are ensured by an automatic labeling and statistical verification process. According to the method, the number of samples of the ternary association database is multiplied, and extreme process conditions and rare defect modes which are difficult to obtain through experimental collection are covered.
Owner:NAT UNIV OF DEFENSE TECH

Three-dimensional reconstruction and damage detection method for intelligent driving environment building

The invention relates to the technical field of building geometric reconstruction and crack detection, in particular to a three-dimensional reconstruction and damage detection method for a building in an intelligent driving environment, and the method comprises the steps: collecting a building video in a road environment during intelligent driving, and reconstructing a sparse point cloud of the building through an SfM algorithm; inputting each frame of time sequence image into a pre-trained semantic segmentation model to generate a crack highlight image; according to the sparse point cloud, initializing a corresponding parameterized 3D Gaussian ellipsoid, and optimizing parameters of the 3D Gaussian ellipsoid; mapping the 3D Gaussian ellipsoid to a two-dimensional image plane through a camera model, and generating a rendered image through a differentiable rendering algorithm; and comparing the rendered image with the crack highlight image, iteratively calculating the overall loss, and transmitting the overall loss through a back propagation gradient until a preset convergence condition is reached, thereby obtaining a final 3D model which simultaneously expresses the overall structure of the building and crack details. According to the invention, accurate environment data can be provided for the automatic driving system.
Owner:SHENZHEN YUANSITE APPL TECH CO LTD

Dynamic lightweight method for digital BIM twinborn model of combined air conditioning unit

The invention discloses a dynamic lightweight method for a digital BIM (Building Information Modeling) twin model of a combined air conditioning unit, and belongs to the technical field of BIM and digital twin. The method comprises the following steps: firstly, carrying out functional component semantic segmentation on a BIM model to generate a submodule set with labels; key performance features are extracted based on sensor data and CFD simulation results to generate a feature weight matrix; constructing a dynamic lightweight rule base to define a multi-level LOD template and a scene adaptation rule; fusing the feature weight and the real-time scene parameter through a fuzzy decision tree algorithm to output an LOD matching priority and a lightweight instruction set; and finally, extracting a target LOD data block according to an instruction set, and outputting a lightweight model by adopting a GPU accelerated rendering algorithm. The method solves the problems that the high-precision BIM model of the combined air conditioning unit is unsmooth in operation at a low-computing-power terminal and low in data transmission efficiency, and is suitable for a real-time operation and maintenance scene of a heating ventilation air conditioning system.
Owner:CCCC MECHANICAL & ELECTRICAL ENG

Hoisting equipment distribution visualization and monitoring method

The invention discloses a hoisting equipment distribution visualization and monitoring method, and relates to the technical field of industrial hoisting safety, and the method comprises the following steps: generating a synchronously associated multi-source fusion data set; constructing a three-dimensional basic model of the hoisting operation area; dividing the three-dimensional dynamic model into a base layer, an equipment layer, a key component layer and a data layer by adopting a self-adaptive hierarchical rendering algorithm, adjusting the rendering precision of each layer according to a priority coefficient, and generating an equipment distribution visual interface; identifying an abnormal state of the equipment and positioning a fault position, and triggering a corresponding grading early warning signal according to an abnormal grade; and based on the abnormity type and the fault position corresponding to the early warning signal, a targeted disposal suggestion scheme is generated. The real-time monitoring, fault early warning and three-dimensional dynamic visualization of the hoisting equipment are realized by fusing space-time alignment, multi-source data synchronization, a digital twinning technology and a self-adaptive rendering algorithm, and the equipment safety and the operation efficiency are remarkably improved.
Owner:CHINA RAILWAY 14TH BUREAU GRP NO 3 ENG CO LTD +1

Urban Beidou cubic grid rapid rendering method

The invention relates to a rapid rendering method for an urban Beidou cubic grid. The method comprises the following steps: firstly, acquiring urban low-altitude geographic space data; constructing a multi-level grid system according to conflict detection precision and response requirements by using a Beidou cubic grid subdivision technology, and associating codes and airspace attributes with grid units; unloading the geometric generation task to a GPU for parallel calculation, and generating rendering adaptive grid geometric data; then developing a three-dimensional rapid rendering algorithm to realize real-time rendering of any region and precision grid; subsequently establishing a rendering result and airspace management cooperation mechanism to assist route planning, management and control and zoning; and finally, an algorithm optimization module is linked. The invention aims to solve the problems that the existing ground object 3D rendering adaptive city low-altitude field is insufficient, the conflict detection precision is not matched, the real-time performance is poor and the existing ground object 3D rendering adaptive city low-altitude field is disjointed with a low-altitude management service.
Owner:GUIZHOU TUZHI INFORMATION TECH CO LTD

Mid-air haptic textures

Described is a method for instilling the haptic dimension of texture to virtual and holographic objects using mid-air ultrasonic technology. A set of features is extracted from imported images using their associated displacement maps. Textural qualities such as the micro and macro roughness are then computed and fed to a haptic mapping function together with information about the dynamic motion of the user's hands during holographic touch. Mid-air haptic textures are then synthesized and projected onto the user's bare hands. Further, mid-air haptic technology enables tactile exploration of virtual objects in digital environments. When a user's prior and current expectations and rendered tactile texture differ, user immersion can break. A study aims at mitigating this by integrating user expectations into the rendering algorithm of mid-air haptic textures and establishes a relationship between visual and mid-air haptic roughness.
Owner:SIM IP HXR LLC

Penetration-type supervision method and system based on market subject digital twinning

The invention discloses a penetrating supervision method and system based on market subject digital twinning, belongs to the technical field of market supervision and digital twinning, and aims to solve the technical problem of how to realize full-flow penetrating supervision of multi-source data and improve supervision accuracy and efficiency. Comprising the steps of performing data preprocessing on multi-source heterogeneous data, and constructing a unified data pool; performing 1: 1 three-dimensional modeling on the physical space of the market subject to obtain a digital twin model capable of real-time interaction; acquiring market subject state data in real time, synchronizing the state data to the digital twin model, checking the dynamic operation state of the market subject through the digital twin model, and marking an abnormal state; performing parallel computing on a large-scale scene through a parallel visual rendering algorithm, simulating a risk evolution path in combination with a simulation deduction and algorithm integration technology, and generating a risk level and early warning information; and generating a processing task based on the risk level and the early warning information, and feeding back a processing result to the digital twinborn model.
Owner:INSPUR SOFTWARE CO LTD

VR-based garment rendering method and system

The invention provides a VR-based garment rendering method and system, and the method comprises the steps: obtaining a plurality of images of a garment shot from different perspectives, carrying out the feature matching and geometric information correction, selecting one image, and carrying out the triangulation, and obtaining a preliminarily recovered sparse point cloud structure diagram; performing pose estimation and light beam optimization on the point cloud structure diagram, sequentially adding images corresponding to other visual angles into the point cloud structure diagram after light beam optimization, and performing triangulation and light beam optimization to obtain a point cloud clothing diagram of the clothing and corresponding pose data; generating a three-dimensional Gaussian by taking each point of the point cloud clothing graph as a center, projecting the generated three-dimensional Gaussian to an image plane by utilizing a shooting pose, and calculating the light intensity from each point to the projection center based on a volume rendering algorithm to obtain a preliminary rendered image; and performing aliasing artifact elimination on the preliminary rendering image to obtain a target garment rendering image. The VR-based garment rendering method provided by the invention is high in efficiency and good in rendering quality.
Owner:EAST CHINA JIAOTONG UNIVERSITY

A Real-time Global Illumination Rendering Method for a Virtual Cable Tunnel Scenario Model

The present invention discloses a method for real-time global illumination rendering of a virtual cable tunnel scene model, comprising the following steps: using a computer to load panoramic image data and a three-dimensional scene model of the cable tunnel scene; calculating the position and radiation intensity of a light source in the three-dimensional scene model by using the panoramic image data, and thus obtaining the material properties of the three-dimensional scene model; reading in the triangular patches of the three-dimensional scene model; tracing the light rays emitted from the viewpoint to the screen pixels, and determining whether the light rays intersect with the triangular patches. If they intersect, the color value of the intersection point is calculated as the color value of the screen pixel according to the material properties of the intersection point. If they do not intersect, the background color is filled into the screen pixel, thereby completing the real-time global illumination rendering of the screen image to obtain a realistic screen image. It can realize the real-time global illumination rendering of the three-dimensional scene model of the virtual cable tunnel, effectively improve the efficiency of the global illumination rendering algorithm, and reduce the time cost.
Owner:BEIJING SHUNYI LIYUAN POWER SUPPLY ENG INSTALLATION CO +1

Cigarette box strip two-dimensional code rendering model construction method for code reading camera response function estimation

PendingCN120163722AImage enhancementImage analysisCamera response functionTone mapping
The invention discloses a cigarette box strip two-dimensional code rendering model construction method for code reading camera response function estimation, and the method comprises the steps: constructing an end-to-end neural network rendering algorithm through employing a cigarette box strip two-dimensional code image sample, recovering a radiation field with a high dynamic range from low-illumination images with different exposures, and estimating a response function of a camera; comprising the following steps: designing a neural radiation field module, and constructing two continuous implicit neural network functions which are respectively used for modeling the density and scene radiance of a radiation field so as to more accurately estimate a camera response function and reflect the real physical characteristics of a camera; a tone mapping module is designed, a high-dynamic-range image is converted into a low-dynamic-range image, the density of a radiation field and scene radiance are combined with tone mapping of image color brightness, comprehensive modeling of the physical imaging process of the camera is achieved, and the generated image is more authentic. The method can adapt to changes of different scenes and lighting conditions, and the practical effect in a specific scene is enhanced.
Owner:CHINA TOBACCO HENAN IND CO LTD

Ablation needle puncture training auxiliary system

The invention relates to the technical field of medical simulation, in particular to an ablation needle puncture training auxiliary system, and aims to solve the problems of insufficient tactile feedback and low fineness when an existing ablation needle puncture training system simulates a needle tip to penetrate through multiple layers of biological tissues so as to improve the'needle feeling 'cognition and fine operation skills of doctors. The system is characterized by comprising a physical interaction module, a virtual simulation module, a central processing module and a visual presentation module, a high-fidelity virtual tissue model is constructed, real-time multi-mode tactile feedback is combined, and an accurate needle-tissue interaction mechanical simulation and multi-dimensional tactile rendering algorithm is adopted. By the adoption of the technical scheme, the problem of a touch gap is effectively solved, the authenticity and effectiveness of simulation training are improved, and the precision and safety of clinical puncture operation are remarkably improved.
Owner:THE FIRST AFFILIATED HOSPITAL OF MEDICAL COLLEGE OF XIAN JIAOTONG UNIV

A collaborative cloud rendering system

This invention discloses a collaborative cloud rendering system, including a lighting and shadow rendering module. The module's direct lighting rendering unit performs rendering through direct lighting calculations, the shadow rendering unit performs rendering through shadow calculations, the ambient occlusion rendering unit performs rendering through ambient occlusion calculations, and the indirect lighting rendering unit performs rendering through indirect lighting calculations. The indirect lighting rendering unit runs on a cloud backend device. A hybrid rendering unit performs rendering through hybrid calculations and runs on a web frontend device. Depending on the performance of the web frontend device, each unit runs on either the web frontend device or the cloud backend device. Therefore, this invention proposes four key real-time lighting and shadow rendering algorithms for collaborative real-time dynamic lighting and shadow rendering in Web3D cloud rendering, optimized through analysis of various data such as algorithm frame rate, the operating efficiency of the device running the algorithm, and the lighting and shadow rendering results.
Owner:QINGDAO VIRTUAL REALITY RES INST CO LTD

Full-real virtual reality virtual-real fusion method and system

The invention relates to the technical field of virtual reality, in particular to an all-true virtual reality virtual-real fusion method and system, and millimeter-level virtual-real fusion is realized through light field reconstruction, algorithm dimension raising and space programming. Light field reconstruction adopts a 6500K spectrum matrix and a P0.9-P2.5 LED array to construct a three-order framework, and 0.1 mm positioning precision and 18KHDR rendering are realized in combination with a 200-point / cm < 2 > laser grid and a 1000Hz TOF array; in algorithm dimension raising, SE (3) manifold optimization is utilized to control the 6DoF pose error to be + / -0.03 degrees, 4K-18K super-division (the information amount is increased by 5.2 times) is achieved through a GAN network, and a material sensing engine simulates 87 types of surface characteristics (the reflectivity error is smaller than or equal to 0.8%); the distortion rate of space programming is reduced from 2.1% to 0.05% based on an SIGGRAPH2024 algorithm, 5.7 m < 2 > / second modeling is realized through three-level computing power scheduling, and delta Elt under 105lux is ensured through 1269 color block light field compensation; and 1.2. The system supports 3.2 TB / min VR content conversion, adapts to 23 types of special-shaped screens, and solves the problems of insufficient precision and poor environmental adaptability of traditional VR.
Owner:SHANGHAI YAHONG CULTURE COMMUNICATION CO LTD

AI-based panoramic audio generation method, system, and storage medium

This invention discloses an artificial intelligence-based method, system, and storage medium for generating panoramic sound audio. The method includes the following steps: S1. Inputting the original audio signal and scene parameters, obtaining the time-domain-frequency domain features and spatial scene features of the original audio signal through a multimodal feature extraction algorithm, and weighted fusing the time-domain-frequency domain features and spatial scene features to obtain fused features; S2. Constructing the mathematical expression basis of the 3D spatial sound field model based on the spherical harmonic function, mapping the fused features to three-dimensional spatial coordinates through a sound field modeling algorithm to obtain the 3D spatial sound field model; S3. Using an adaptive rendering algorithm, converting the 3D spatial sound field model into multi-channel panoramic sound audio output according to the parameters of the target playback device. This invention achieves automated panoramic sound audio generation by inputting the original audio signal and scene parameters for feature extraction, fusion, and sound field modeling, and converting the output based on adaptive rendering. It has the advantages of automation, high efficiency, and high precision.
Owner:SHANGHAI RUIHEFENG ELECTRONIC TECHNOLOGY CO LTD

Efficient real-time shadow rendering

ActiveUS12315068B2Image memory managementImage codingShadow mappingDeferred shading
A method for real-time shadow rendering using cached shadow maps and deferred shading by a video processor of a game console or the like includes, for at least each key frame of video output, determining a viewpoint for a current key frame based on user input, filtering a texel of a frame-specific shadow map based on a dynamic mask wherein the texel is filtered, for a shadowed light, from a static shadow map and a dynamic shadow map or from the static shadow map only, based on the dynamic mask value for the texel, and rendering the current key frame based on the frame-specific shadow map and a deferred-shadow rendering algorithm. The method enables efficient rendering of thousands of shadowed lights in large environments by consumer-grade game consoles.
Owner:WARNER BROS ENTERTAINMENT INC

Natural reserve data fusion display method based on three-dimensional digital twinborn model

The invention relates to the technical field of image data fusion processing, in particular to a natural reserve data fusion display method based on a three-dimensional digital twinborn model. The method comprises the steps of collecting multi-source heterogeneous data of a natural reserve, and performing intelligent preprocessing to obtain preprocessed data; performing preliminary feature extraction and dimension reduction processing on the preprocessed data to obtain feature data after dimension reduction; introducing a multi-dimensional data hierarchical adaptive fusion algorithm, and performing fusion processing on the feature data after dimension reduction to obtain fused data; and processing the fused data through an incremental updating and spatial adaptive rendering algorithm, embedding the data into a three-dimensional digital twinborn model for display, and updating the display data. The technical problems of inaccurate processing of multi-source heterogeneous data in a natural reserve, low display efficiency and poor self-adaption are solved.
Owner:GUANGZHOU ZHONGSEN FORESTRY CO LTD +1

Intelligent identification method for defects of lithium niobate metasurface based on reactive ion beam etching

The application relates to the technical field of industrial detection, and discloses a lithium niobate metasurface defect intelligent identification method based on reactive ion beam etching, which systematically solves the problem of experimental data scarcity through physical driving simulation and a physical-based rendering algorithm, and provides large-scale field-specific training data for a deep learning model. A bidirectional coupling simulation model generates defect morphology prediction data conforming to etching dynamics rules based on real process parameters and material parameters, a physical rendering algorithm converts the prediction data into synthetic images with real microscopic image statistical characteristics, and an automatic labeling and statistical verification process ensures the quality and consistency of the synthetic data. The method expands the sample quantity of the ternary correlation database by several times, and covers extreme process conditions and rare defect modes that are difficult to obtain through experimental acquisition.
Owner:NAT UNIV OF DEFENSE TECH

WebGL display optimization method and system for multi-device dynamic adaptation

The invention provides a WebGL display optimization method and system for multi-device dynamic adaptation, and belongs to the technical field of WebGL display.The method comprises the steps that display parameters of target devices are collected, and device display feature vectors are constructed; a texture image in the WebGL model is preprocessed; training and generating a mapping relation library on the basis of historical adaptation data, dynamically adapting the device feature display vector of the target device, obtaining required WebGL model operation parameters, and dynamically adjusting the calculation graph of the preprocessed WebGL model; executing a vector graphic rendering algorithm on the fixed layout of the WebGL model, and dynamically sampling and optimizing the dynamic content of the WebGL model to realize multi-resolution adaptation; and monitoring the state of the target equipment in real time, pausing the rendering task of the WebGL model when detecting that the display mode is switched, and carrying out equipment parameter acquisition again. According to the invention, optimal visual effects and performance optimization on different devices are realized.
Owner:INSPUR ARTIFICIAL INTELLIGENCE RES INST CO LTD SHANDONG CHINA

Audio transcoding method and device, equipment and storage medium

The invention discloses an audio transcoding method and device, equipment and a storage medium, and relates to the technical field of audio signal processing, and the method comprises the steps: carrying out the analysis of a target 2D audio and a target video, so as to obtain corresponding audio features and video features; determining a target scene type corresponding to the target video by using the audio features and the video features, and separating a plurality of independent object sounds from the target 2D audio; generating a space coordinate track corresponding to each independent object sound, and mapping each space coordinate track to a target sound channel position; and determining a target rendering algorithm based on the target scene type, and rendering each independent object sound in the target sound channel position by using the target rendering algorithm. Through the means of determining the target scene type by using the audio features, the video features and the target scene analysis model, the problem of poor audio and video adaptation degree is solved.
Owner:MALANSHAN AUDIO & VIDEO LABORATORY

A patch-extraction-based generalizable neural radiance field reconstruction method

The application belongs to the technical field of three-dimensional reconstruction and machine learning, and discloses a generalizable neural radiance field reconstruction method based on patch extraction, which is based on a multi-view stereo vision and a volume rendering algorithm of a neural radiance field to implicitly learn a static three-dimensional scene, realize new view synthesis of a complex scene at any angle, and perform three-dimensional reconstruction of the scene. Firstly, two-dimensional image features of a source view and a target view are extracted, and a three-dimensional cost volume is constructed by using a plane scanning algorithm to distort the coordinate system of reference view features through homography transformation. Secondly, the cost volume constructed for the current scene is input into a three-dimensional convolutional neural network to obtain a neural encoding volume. The neural encoding volume is input into a multi-layer perception to regress volume density and color, so as to construct a neural radiance field. Then, the current neural radiance field is used for rendering to obtain a target view, patches of the target view and the reference view are extracted respectively, and reference view patch features and target view patch features are extracted by using a pre-trained VGG-16 low-level network to compare the features. Finally, the average absolute error is calculated to quantify the content feature difference between the target view patch and the reference view patch, and the difference is used as a regular term of an overall loss function to improve the rendering quality of the model. The application can be used for generalizable multi-view three-dimensional reconstruction, can enhance local features through an efficient training mechanism, and can improve the rendering capability for image details and object boundaries.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

Composite distributed rendering method based on depth map algorithm and partitioning algorithm

The invention discloses a composite distributed rendering method based on a depth map algorithm and a blocking algorithm, and relates to the technical field of image processing. The method comprises the following steps: dividing a scene image into a plurality of image areas, and partitioning the image areas based on a partitioning algorithm to obtain a plurality of first image blocks; based on the information complexity value corresponding to each first image block, classifying each first image block into a first type of image blocks and a second type of image blocks; based on a depth map algorithm, obtaining rendering priorities corresponding to the second-class image blocks; and on the basis of the rendering priority, independently rendering each second-class image block, and on the basis of a block rendering algorithm, carrying out block rendering on each first-class image block, and finally obtaining a rendered image. According to the method, the image blocks of the rendered image are classified according to the information complexity value, and different rendering modes are adopted for different image blocks, so that rendering resources are fully utilized, and the purpose of improving the rendering quality and efficiency is achieved.
Owner:HUNAN SANYUE SUWEI TECH CO LTD

Closest silhouette queries for ray traversal

Inverse rendering is important for training neural networks for generative artificial intelligence (AI), and it involves inverting the rendering process by taking an image and converting it into scene or model parameters that can be backpropagated through a network, helping to train the network to learn to generate models, materials, textures, etc. Because of the gradients required for this backpropagation, inverse rendering requires differentiable rendering algorithms. Current differentiable renderers are based on rasterization which make it difficult to learn scene properties depending on second order effects. The present disclosure provides closest silhouette queries for computing differential visibility, which can be used for inverse rendering.
Owner:NVIDIA CORP

Audio processing method and apparatus

The present disclosure relates to the technical field of audio processing technology, and in particular to an audio processing method, an audio processing apparatus, a computer-readable storage medium and a computer program product. The audio processing method includes: receiving IR information of audio data transmitted by a first renderer; determining, based on a sound field structure of the IR information, a corresponding rendering algorithm for the IR information; and processing, based on the corresponding rendering algorithm, the IR information by using a second renderer.
Owner:DOUYIN VISION CO LTD

An augmented reality method, system and computer readable storage medium for real-time atomized video

The application discloses a kind of real-time atomization video's augmented reality method, system and computer readable storage medium, method includes:1, augmented reality equipment gathers camera picture and coding to generate uplink video stream, and push stream to server;2, server is decoded to uplink video stream, shaping, and encapsulation is frame batch;3, call single view three-dimensional reconstruction model to frame batch, generate three-dimensional main scene and pixel level depth, according to pixel level depth calculation three-dimensional world coordinate;4, generate a atomization Gaussian particle for each pixel;5, 3DGS volume rendering algorithm will Gaussian scatter point of three-dimensional scene with atomization Gaussian particle be volume rendering and forward synthesis, obtain enhancement frame;6, to enhancement frame coding to generate downlink enhancement video stream and push stream to server;7, augmented reality equipment is pulled from server enhancement video stream and real-time decoding and display.The application has the advantages that augmented reality equipment end side burden is low, end-to-end time delay is small and atomization level is controllable.
Owner:NORTHWEST UNIV

Display method and device, electronic equipment and storage medium

PendingCN121996182ARefresh frame rate impactThe drawing process does not interfere with each otherDigital output to display device3D-image renderingComputer hardwareAnimation
The invention provides a display method and device, electronic equipment and a storage medium. The method comprises the steps that a video stream is acquired, a video layer is determined based on the video stream, and the video stream is used for presenting at least one animation obtained through pre-rendering; according to a layer set of the current frame, display content of a display screen of the wearable device in the current frame is determined, and the layer set comprises at least one dial plate layer and the video layer. On the basis, on one hand, the display of complicated contents of the dial plate can be realized on the premise of not depending on a real-time rendering algorithm, so that some relatively complicated animations can be applied to wearable equipment such as a smart watch on the premise of not deleting an animation algorithm; and on the other hand, the video layer and other layers are decoupled, so that the drawing processes of the video layer and the other layers do not interfere with each other, and the influence of the rendering bottleneck of the video layer on the refresh frame rate of the display screen is avoided.
Owner:BEIJING XIAOMI MOBILE SOFTWARE CO LTD

Visual function training method and system based on stereoscopic vision and storage medium

The invention discloses a visual function training method and system based on stereoscopic vision and a storage medium. The method comprises the steps that a first view and a second view are displayed on a display module; rendering the first view and the second view through a rendering algorithm to obtain a first rendered view and a second rendered view; reflecting the first rendering view and the second rendering view into an imaging lens group through glass; pixels of the first rendering view are controlled to enter the left eye through the glass, the imaging lens group and the periodic modulation element, so that the left eye of a user sees a virtual image after the first rendering view is pulled away; and controlling pixels of the second rendering view to enter a right eye, so that the right eye of the user sees a virtual image after the second rendering view is pulled away. The left eye image and the right eye image are transmitted to the corresponding eyes respectively, short-distance eye use is converted into long-distance virtual images, adjustment lag is reduced, the ciliary muscle contraction capacity is enhanced, and therefore the myopia prevention and control effect is achieved.
Owner:ANHUI PROVINCIAL HOSPITAL