29 results about "Rendering algorithms" patented technology

The invention relates to the technical field of industrial detection, and discloses a lithium niobate metasurface defect intelligent identification method based on reactive ion beam etching, which systematically solves the problem of scarcity of experimental data through physical driving simulation and a physics-based rendering algorithm, and provides large-scale field specific training data for a deep learning model. The bidirectional coupling simulation model generates defect morphology prediction data conforming to an etching dynamics law based on real process parameters and material parameters, the prediction data is converted into a synthetic image with real microscopic image statistical characteristics by a physical rendering algorithm, and the quality and consistency of the synthetic data are ensured by an automatic labeling and statistical verification process. According to the method, the number of samples of the ternary association database is multiplied, and extreme process conditions and rare defect modes which are difficult to obtain through experimental collection are covered.

The invention discloses a hoisting equipment distribution visualization and monitoring method, and relates to the technical field of industrial hoisting safety, and the method comprises the following steps: generating a synchronously associated multi-source fusion data set; constructing a three-dimensional basic model of the hoisting operation area; dividing the three-dimensional dynamic model into a base layer, an equipment layer, a key component layer and a data layer by adopting a self-adaptive hierarchical rendering algorithm, adjusting the rendering precision of each layer according to a priority coefficient, and generating an equipment distribution visual interface; identifying an abnormal state of the equipment and positioning a fault position, and triggering a corresponding grading early warning signal according to an abnormal grade; and based on the abnormity type and the fault position corresponding to the early warning signal, a targeted disposal suggestion scheme is generated. The real-time monitoring, fault early warning and three-dimensional dynamic visualization of the hoisting equipment are realized by fusing space-time alignment, multi-source data synchronization, a digital twinning technology and a self-adaptive rendering algorithm, and the equipment safety and the operation efficiency are remarkably improved.

The invention relates to a rapid rendering method for an urban Beidou cubic grid. The method comprises the following steps: firstly, acquiring urban low-altitude geographic space data; constructing a multi-level grid system according to conflict detection precision and response requirements by using a Beidou cubic grid subdivision technology, and associating codes and airspace attributes with grid units; unloading the geometric generation task to a GPU for parallel calculation, and generating rendering adaptive grid geometric data; then developing a three-dimensional rapid rendering algorithm to realize real-time rendering of any region and precision grid; subsequently establishing a rendering result and airspace management cooperation mechanism to assist route planning, management and control and zoning; and finally, an algorithm optimization module is linked. The invention aims to solve the problems that the existing ground object 3D rendering adaptive city low-altitude field is insufficient, the conflict detection precision is not matched, the real-time performance is poor and the existing ground object 3D rendering adaptive city low-altitude field is disjointed with a low-altitude management service.

The invention discloses a penetrating supervision method and system based on market subject digital twinning, belongs to the technical field of market supervision and digital twinning, and aims to solve the technical problem of how to realize full-flow penetrating supervision of multi-source data and improve supervision accuracy and efficiency. Comprising the steps of performing data preprocessing on multi-source heterogeneous data, and constructing a unified data pool; performing 1: 1 three-dimensional modeling on the physical space of the market subject to obtain a digital twin model capable of real-time interaction; acquiring market subject state data in real time, synchronizing the state data to the digital twin model, checking the dynamic operation state of the market subject through the digital twin model, and marking an abnormal state; performing parallel computing on a large-scale scene through a parallel visual rendering algorithm, simulating a risk evolution path in combination with a simulation deduction and algorithm integration technology, and generating a risk level and early warning information; and generating a processing task based on the risk level and the early warning information, and feeding back a processing result to the digital twinborn model.

The invention relates to the technical field of medical simulation, in particular to an ablation needle puncture training auxiliary system, and aims to solve the problems of insufficient tactile feedback and low fineness when an existing ablation needle puncture training system simulates a needle tip to penetrate through multiple layers of biological tissues so as to improve the'needle feeling 'cognition and fine operation skills of doctors. The system is characterized by comprising a physical interaction module, a virtual simulation module, a central processing module and a visual presentation module, a high-fidelity virtual tissue model is constructed, real-time multi-mode tactile feedback is combined, and an accurate needle-tissue interaction mechanical simulation and multi-dimensional tactile rendering algorithm is adopted. By the adoption of the technical scheme, the problem of a touch gap is effectively solved, the authenticity and effectiveness of simulation training are improved, and the precision and safety of clinical puncture operation are remarkably improved.

This invention discloses an artificial intelligence-based method, system, and storage medium for generating panoramic sound audio. The method includes the following steps: S1. Inputting the original audio signal and scene parameters, obtaining the time-domain-frequency domain features and spatial scene features of the original audio signal through a multimodal feature extraction algorithm, and weighted fusing the time-domain-frequency domain features and spatial scene features to obtain fused features; S2. Constructing the mathematical expression basis of the 3D spatial sound field model based on the spherical harmonic function, mapping the fused features to three-dimensional spatial coordinates through a sound field modeling algorithm to obtain the 3D spatial sound field model; S3. Using an adaptive rendering algorithm, converting the 3D spatial sound field model into multi-channel panoramic sound audio output according to the parameters of the target playback device. This invention achieves automated panoramic sound audio generation by inputting the original audio signal and scene parameters for feature extraction, fusion, and sound field modeling, and converting the output based on adaptive rendering. It has the advantages of automation, high efficiency, and high precision.

The application relates to the technical field of industrial detection, and discloses a lithium niobate metasurface defect intelligent identification method based on reactive ion beam etching, which systematically solves the problem of experimental data scarcity through physical driving simulation and a physical-based rendering algorithm, and provides large-scale field-specific training data for a deep learning model. A bidirectional coupling simulation model generates defect morphology prediction data conforming to etching dynamics rules based on real process parameters and material parameters, a physical rendering algorithm converts the prediction data into synthetic images with real microscopic image statistical characteristics, and an automatic labeling and statistical verification process ensures the quality and consistency of the synthetic data. The method expands the sample quantity of the ternary correlation database by several times, and covers extreme process conditions and rare defect modes that are difficult to obtain through experimental acquisition.

The application discloses a kind of real-time atomization video's augmented reality method, system and computer readable storage medium, method includes:1, augmented reality equipment gathers camera picture and coding to generate uplink video stream, and push stream to server;2, server is decoded to uplink video stream, shaping, and encapsulation is frame batch;3, call single view three-dimensional reconstruction model to frame batch, generate three-dimensional main scene and pixel level depth, according to pixel level depth calculation three-dimensional world coordinate;4, generate a atomization Gaussian particle for each pixel;5, 3DGS volume rendering algorithm will Gaussian scatter point of three-dimensional scene with atomization Gaussian particle be volume rendering and forward synthesis, obtain enhancement frame;6, to enhancement frame coding to generate downlink enhancement video stream and push stream to server;7, augmented reality equipment is pulled from server enhancement video stream and real-time decoding and display.The application has the advantages that augmented reality equipment end side burden is low, end-to-end time delay is small and atomization level is controllable.

The invention provides a display method and device, electronic equipment and a storage medium. The method comprises the steps that a video stream is acquired, a video layer is determined based on the video stream, and the video stream is used for presenting at least one animation obtained through pre-rendering; according to a layer set of the current frame, display content of a display screen of the wearable device in the current frame is determined, and the layer set comprises at least one dial plate layer and the video layer. On the basis, on one hand, the display of complicated contents of the dial plate can be realized on the premise of not depending on a real-time rendering algorithm, so that some relatively complicated animations can be applied to wearable equipment such as a smart watch on the premise of not deleting an animation algorithm; and on the other hand, the video layer and other layers are decoupled, so that the drawing processes of the video layer and the other layers do not interfere with each other, and the influence of the rendering bottleneck of the video layer on the refresh frame rate of the display screen is avoided.

The invention provides a virtual modeling system and electronic equipment, and the virtual modeling system comprises a motion capture and collaborative synchronization module which is used for capturing gesture operation data of a first user under the condition that the first user logs in the virtual modeling system, synchronizing the gesture operation data to a second user in real time through a synchronous rendering algorithm, determining an operated virtual object according to the gesture operation data, and performing operation conflict detection on the first user and the second user; wherein the second user is another user who logs in the virtual modeling system; the physical feedback module is used for determining physical parameters of the operated virtual object; and the rendering and modeling module is used for performing virtual modeling based on the physical parameters and synchronizing the modeling state of the virtual modeling to the second user in real time through a distributed rendering algorithm.

In some embodiments, a computing system accesses multiple input images of a specular object with a scene. The computing system encodes near-field interreflections of the scene on the specular object to obtain a first set of feature representations of the specular object in multiple viewing directions based on the multiple input images. The computing system encodes far-field reflections of the scene on the specular object to obtain a second set of feature representations in the multiple viewing directions based on the multiple input images. The computing system determines a set of specular color values for the specular object in the multiple viewing directions based on the first set of feature representations and the second set of feature representations using a multi-layer perceptron algorithm. The computing system renders the specular object representation at least based on the set of specular color values using a neural rendering algorithm.

The application discloses a scene reverse rendering method and device based on neural implicit expression, and the method is based on a signed distance field network, a neural radiation field network and a neural material field network to realize joint implicit expression of geometric information, illumination information and material information of a scene, and a ray tracing rendering algorithm based on Monte Carlo sampling is used to obtain a rendering result, a loss function is constructed according to the rendering result to optimize network parameters, and the signed distance field network, the neural radiation field network and the neural material field network capable of accurately predicting the geometric information, the illumination information and the material information are obtained. Meanwhile, the method also supports re-illumination editing and material editing, and achieves an augmented reality function.

The application discloses a kind of based on AI speech synthesis and animation driving's lecturer video automatic generation method, comprising: by improved inner point method and incremental shortest path algorithm to PPT or text script is structured and analyzed;Application full dynamic parallel single link clustering algorithm carries out semantic grouping and generates enhanced script with expressive mark;High-quality voice data stream is generated by using CosyVoice technology combined with low-rank approximation method;The mapping relationship between content and action expression is established by semantic analysis, and a complete set of action expression instructions is generated;The museTalk technology is used to drive the digital human model, and the final lecturer teaching video is generated by using parallel rendering algorithm.The application realizes the efficient and automatic generation of educational videos, significantly improves the content production efficiency, reduces the production cost, and ensures the professionalism and expressiveness of the teaching video.

The invention discloses a three-dimensional model loading optimization method and device and a storage medium, and relates to the technical field of three-dimensional graph rendering. The three-dimensional model loading optimization method comprises the following steps: performing compression processing on an obtained three-dimensional model based on a Draco compression library to obtain a compressed three-dimensional model; a MergeHelperHY optimization tool is constructed, small models in the compressed three-dimensional model are combined, and a combined three-dimensional model is obtained; and calling a rendering algorithm for the combined three-dimensional model to obtain a three-dimensional model loading result. The optimized model can have high loading speed and interaction response speed during page loading, the jamming phenomenon is effectively avoided, the user experience is improved, and it is ensured that good performance can be kept when more complex or larger three-dimensional models are processed.

The rendering model training method comprises the steps that an object in a first digital content scene is rendered through two different rendering modes, two rendered images which are different in rendering quality but the same in number are obtained, and the two rendered images are kept consistent in view angle; based on the two rendered images, performing fine tuning on the general AI image denoising model; when the rendering effect of the target model does not meet the requirement, the number of the two rendering images is updated, the general AI image denoising model continues to be finely adjusted, the number of the rendering images is configured by a user, and the number of the two updated rendering images is the same; the target model is a fine-tuned general AI image denoising model, and the target model is used for converting a low-quality rendered image into a high-quality rendered image; and when the rendering effect of the target model meets the requirement, fine tuning of the general AI image denoising model is terminated. In this way, the model after fine tuning can be combined with a traditional rendering algorithm subsequently, so that the requirement for high-quality and high-efficiency rendering scenes is met.

The invention relates to the technical field of medical data processing, and discloses a medical data visualization system and method, and the system comprises a rendering object module, a rendering scene controller module, and a rendering strategy module. The rendering object module is used for acquiring multiple pieces of to-be-rendered medical data and packaging the multiple pieces of to-be-rendered medical data to obtain multiple rendering objects; the rendering strategy module is used for pre-defining a plurality of rendering strategies, and one rendering strategy corresponds to one specific rendering algorithm; and the rendering scene controller module is used for managing one or more rendering scene controllers, and the rendering scene controllers are used for rendering the rendering objects by using the corresponding rendering strategies. According to the method and the device, after a plurality of different medical data are encapsulated into different rendering objects, different rendering strategies can be selected for rendering according to corresponding rendering requirements, so that the visualization requirements of various different types of medical data in various different scenes can be simultaneously supported.

The invention provides a construction and operation method of a dry-process cement production process digital factory, and the method comprises the steps: constructing a refined model of a dry-process cement production process, and forming a digital factory; a multi-scale real-time simulation system is adopted to obtain simulation data, and the simulation data is preprocessed and processed by adopting a rendering algorithm; providing a method for exploring three-dimensional space internal data of analog data according to a real-time cross section of the digital factory; and performing three-dimensional visualization and dynamic interaction on the digital factory and the processed simulation data, and displaying the production flow of the digital factory of the dry cement production process in all directions. According to the method, three-dimensional modeling is carried out on the production environment and process equipment of the whole flow of the dry cement production process, multi-scale simulation calculation is carried out on main equipment such as a preheater, a decomposing furnace and a rotary kiln, and data are preprocessed and rendered; and three-dimensional visualization and dynamic interaction of various attribute information in the dry cement process core equipment simulation data are realized.

The application discloses an audio transcoding method and device, equipment and a storage medium, and relates to the technical field of audio signal processing. The method comprises the following steps: analyzing a target 2D audio and a target video to obtain corresponding audio features and video features; determining a target scene type corresponding to the target video by using the audio features and the video features, and separating a plurality of independent object sounds from the target 2D audio; generating spatial coordinate tracks corresponding to the independent object sounds respectively, and mapping the spatial coordinate tracks to target channel positions respectively; determining a target rendering algorithm based on the target scene type, and rendering the independent object sounds in the target channel positions by using the target rendering algorithm. By using the means of determining the target scene type by using the audio features, the video features and a target scene analysis model, the problem of poor audio-video adaptation is solved.

A method and system for controlling an artwork-generating robot using a robot interface system. The method includes generating a digital prototype of an artwork using a rendering algorithm of the robot interface system; setting a digital canvas using the robot interface system; displaying the digital prototype of the artwork on a display of the robot interface system; calibrating the robot and a robotic environment to enable the robot to generate a robot-generated artwork corresponding to the digital prototype; converting the digital prototype into a physical robot-generated artwork using the artwork-generating robot; and using the robot interface system to adjust settings and to interact with the robot while the digital prototype is being converted into the robot-generated artwork. The step of calibrating the robot is performed by using a calibrating tool of the robot interface system.

A hidden structure of a volumetric data set is rendered in a medical image based on a volumetric data set received from a medical scanner. Reference information indicative of a parameter for a clip plane is received for rendering the hidden structure within the medical image. A differentiable rendering, DR, algorithm is applied on the received volumetric data set, which comprises determining a light accumulation along a viewing ray. The clip plane is approximated by including a smooth approximation to a Dirac delta distribution, which depends on the parameter comprised in the received reference information, in the determining of the light accumulation along the viewing ray. The parameter for the clip plane is optimized by optimizing an objective function. The medical image with the hidden structure visible is output for final rendering, and / or for display.

This invention discloses a high-speed rail visualization and interaction system and method based on pixel streaming on a tablet, belonging to the field of high-speed rail visualization and intelligent interaction technology. The system includes a cloud rendering center, a tablet client, a signaling collaboration server, and a high-speed rail data platform. The high-speed rail data platform is configured with a model storage server, an operation and maintenance data interface module, and a data encryption chip; the tablet client integrates status awareness hardware, touch interaction hardware, a dual-NIC communication module, and an offline caching chip, and deploys touch command mapping software; the signaling collaboration server is configured with an access control chip and a data synchronization transmission module, and runs multi-role collaboration software; the cloud rendering center integrates Unreal Engine rendering nodes, a pixel streaming plugin, and a layered rendering controller, with the layered rendering controller running a layered rendering algorithm. The high-speed rail visualization and interaction system and method based on pixel streaming provided by this invention improves the continuous working time of the tablet client and the efficiency of multi-terminal collaboration, adapting to all application scenarios such as high-speed rail maintenance, design review, and remote technical support.

Described is a method for instilling the haptic dimension of texture to virtual and holographic objects using mid-air ultrasonic technology. A set of features is extracted from imported images using their associated displacement maps. Textural qualities such as the micro and macro roughness are then computed and fed to a haptic mapping function together with information about the dynamic motion of the user's hands during holographic touch. Mid-air haptic textures are then synthesized and projected onto the user's bare hands. Further, mid-air haptic technology enables tactile exploration of virtual objects in digital environments. When a user's prior and current expectations and rendered tactile texture differ, user immersion can break. A study aims at mitigating this by integrating user expectations into the rendering algorithm of mid-air haptic textures and establishes a relationship between visual and mid-air haptic roughness.

This invention relates to the field of image processing, providing an image processing method, an image processing system, a head-up display device, an in-vehicle projection device, a vehicle, and a readable storage medium. The method includes: dividing a screen space to be rendered into rendering tiles, such that each rendering tile is rendered in parallel and independently. The rendering algorithms and / or resource utilization rates of different rendering tiles are different, and the rendering algorithm and / or resource utilization rate of each rendering tile is determined based on the information displayed corresponding to that rendering tile. The information displayed corresponding to the rendering tile is generated based on vehicle driving information and / or environmental information; and displaying and / or projecting the rendered tiles. This invention can solve the latency problem of existing overall rendering modes and improve the real-time performance and accuracy of display and / or projection interactions.

One aspect of this disclosure relates to a computer-implemented method for assisting rendering of an image comprising at least one object on a display screen using a computer system. The method may be performed for each pixel individually. One method step involves obtaining at least three monochromatic pre-rendered pixels of the object for at least three intrinsic reflectance levels (R1, R2, R3) of each pixel from a pre-rendering algorithm. Each of the at least three intrinsic reflectance levels (R1, R2, R3) corresponds to a radiance level (L1, L2, L3) generated in the pre-rendering algorithm to constitute at least three respective control points (R1, L1; R2, L2; R3, L3) in a radiance vs. intrinsic reflectance plane, L-Rint. Some rendering algorithms indeed predict radiance levels L for a pixel. The method may further comprise the step of calculating, for a plurality of wavelengths  for a selected spectral colour for the object, a set of spectral fitting weights S derived from a reflectance level R' associated with the selected spectral colour and monochromatic fitting weights W. These monochromatic fitting weights W result from inversely fitting a curve through the at least three control points (R1, L1; R2, L2; R3, L3) in an intrinsic reflectance vs. radiance plane Rint-L. The method further comprises the step of applying the spectral fitting weights S to assist in rendering the image.

The invention discloses an audio playing method, device and equipment and a computer readable storage medium, and is applied to the technical field of computers, and the method comprises the steps: mapping a real physical environment to a virtual reality environment based on a mapping relation; determining the translation speed and position of the user in the virtual reality environment; performing frequency conversion on the audio signal based on the translation speed to obtain an audio signal after frequency conversion, and determining a rendering parameter based on the position; wherein the rendering parameters at least comprise a distance parameter, an azimuth angle, a pitch angle and loudness; and rendering the audio signal after frequency conversion based on the rendering parameter to obtain a rendered audio signal, and playing the rendered audio signal. According to the translation speed of the head of the user in the virtual reality environment, frequency conversion is carried out according to the Doppler effect, the sense of reality of the spatial sound effect is enhanced, and the sense of reality of the spatial sound effect is enhanced according to the rendering parameters such as the distance parameter, the azimuth angle, the pitch angle and the loudness of the rendering algorithm.

This application discloses a composite distributed rendering method based on depth map algorithms and block-based algorithms, relating to the field of image processing technology. The method includes: dividing a scene image into several image regions; dividing the image regions into blocks based on a block-based algorithm to obtain multiple first image blocks; classifying each first image block into a first type of image block and a second type of image block based on the information complexity value corresponding to each first image block; obtaining the rendering priority corresponding to each second type of image block based on a depth map algorithm; rendering each second type of image block individually based on the rendering priority; and performing block-based rendering on each first type of image block based on a block-based rendering algorithm to finally obtain the rendered image. This application classifies the image blocks of the rendered image according to information complexity values ​​and uses different rendering methods for different image blocks to fully utilize rendering resources and improve rendering quality and efficiency.

The application provides a script-based virtual-real fusion guide method and system based on Beidou positioning, and relates to the technical field of intelligent travel guide, which comprises filtering and calibrating the user position collected through Beidou positioning and collecting real scene pictures; an interactive framework is constructed, and the node content is triggered when the deviation between the user position and the node position is not greater than the deviation threshold; the virtual character is called according to the node content to explain the real scene pictures, and the interactive task is published in combination with the behavior data of the user; the emotion recognition is performed on the node content, the real scene pictures, the behavior data and the interactive task to generate emotion features, which are input into an AI composition model to output scene music; the interactive interface of the virtual character and the interactive task is fused with the real scene pictures based on a fusion rendering algorithm, and the guide picture is output and the scene music is played synchronously, so that the script-based virtual-real fusion immersive guide based on Beidou high-precision positioning can be realized, and the tour experience of tourists and the operation efficiency of the scenic spot can be greatly improved.

In some embodiments, a computing system receives an input image of a target in a first view. The computing system creates a single-view feature representation of the target using a trained single-view reconstruction model based on the input image. The computing system generates a multi-view feature representation of the target using a pre-trained generative model based on the single-view feature representation. The computing system determines a 3-dimensional (3D) representation of the target based on the multi-view feature representation using a neural volume rendering algorithm. The computing system generates one or more output images of the target in one or more views based on the 3D representation of the target.

This invention proposes an embodied interactive smart accessory system based on affective computing and haptic feedback. It comprises a wearable biofeedback and haptic interaction device, a mobile computing device, and a cloud device. The wearable biofeedback and haptic interaction device is responsible for collecting data from electrical activity data (EDA), photoplethysmography (PPG), and inertial measurement unit (IMU), and executing haptic rendering commands. The mobile computing device handles Bluetooth communication, signal preprocessing, affective feature extraction, haptic rendering algorithm calculation, and communication with the cloud device. The cloud device runs a large language model, receives affective vectors, and generates personalized content. This invention addresses the lack of human touch in AI interaction by introducing an affective computing closed loop; and it resolves safety concerns in outdoor AR experiences through spatialized haptic navigation. This design aligns more closely with the scientific principles of embodied cognition, providing a more natural interface for human-machine symbiosis.