112 results about "Texture rendering" patented technology

The invention relates to the technical field of digital oil painting optimization, in particular to a multi-level visual texture feature optimization method and system for a digital oil painting. The method comprises the following steps: acquiring an original digital oil painting image, performing regional image semantic deep mining, performing illusion perception noise abstract injection, and constructing an illusion perception texture feature layer; performing local continuity texture visual detection on the illusion perception texture feature map layer, performing stroke tension transmission analysis, and constructing a stroke tension perception texture map; performing multi-scale semantic region division and inter-region cross shielding mining on the stroke tension sensing texture map, and constructing a multi-layer texture detail expression map; and carrying out layer-by-layer texture time sequence drawing speculation on the multi-layer texture detail expression map, and carrying out time sequence texture visual rendering optimization to generate a time sequence layered texture rendering effect. According to the method, through multi-layer texture reconstruction, oil painting textures of different time sequence levels are improved, and the stereoscopic visual effect is embodied.

The invention relates to the field of real-time visualization of road conditions, in particular to a data simulation visualization rendering method and system for urban traffic road conditions. The method comprises the following steps: extracting a real-time satellite streetscape image based on urban satellite remote sensing scanning, and performing scene pixel-level segmentation to obtain scene texture rendering parameters; scene illumination visual identification is carried out according to the real-time satellite streetscape image, traffic scene background modeling is carried out based on scene texture rendering parameters, and a real-time scene background model is constructed; the method comprises the following steps: acquiring urban-level multi-source traffic monitoring data flow, performing vehicle state sensing, and constructing a multi-dimensional particle feature matrix; road network topological correlation analysis and global traffic network state perception are carried out according to the real-time satellite streetscape images, and a road network state perception model is constructed. According to the invention, a real real-time traffic environment is visualized, scene effects in different traffic states are presented, the current road condition can be rapidly evaluated, and the traffic control decision efficiency is improved.

The invention relates to a robot environment perception method based on single-view three-dimensional scene generation, and the method comprises the steps: collecting a two-dimensional image containing target environment information through employing a monocular camera, generating multi-view information through combining depth estimation, normal prediction and a two-stage semantic guidance diffusion model, and constructing a high-quality three-dimensional scene. And reconstructing three-dimensional point cloud data through the neural radiation field, and performing texture rendering optimization on the point cloud data. A Point Net + + network is used for carrying out semantic analysis on point clouds, a multi-frame time sequence point cloud registration and Kalman filtering tracking method is introduced, modeling is carried out on a dynamic target, and a dynamic semantic map with a motion state is constructed. And finally, structured output environment information is used for robot navigation, path planning and task execution. The problems of high cost, high complexity and insufficient real-time performance and robustness of a three-dimensional scene generation technology in the field of robot environment perception are solved, and the method is high in structuring degree, standard and unified in output format and high in universality and engineering adaptation capacity.

The invention provides a game scene rendering method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining real-time scene data of a to-be-rendered game scene of a preset web game, analyzing the real-time scene data to obtain real-time scene features of the to-be-rendered game scene, and rendering the to-be-rendered game scene according to the real-time scene features. And determining a target scene texture matched with the real-time scene feature, performing texture rendering on the three-dimensional scene model of the to-be-rendered game scene according to the target scene texture, and generating and displaying a game picture of the to-be-rendered game scene. The scene texture is adapted according to the real-time change of the game scene, manual intervention is not needed, and the immersion, intelligence and authenticity of the game are improved.

A system for encoding and compressing images and textures to a bitstream as an executable program of computer instructions operable on pixel space, permitting the Encoder to arbitrarily determine the order, location and method used for reconstructing the components of an image at the decoder. The bitstream is typically further compressed by an Adaptive Entropy Compressor. Bitstream execution reconstructs the image directly to pixel space. Memory management and parallel processing controls may be embedded in the bitstream. The system is optimised for AI processing of images with a universally interpretable construction format that enables machines and humans to understand precisely how the image was created and can be reconstructed. Dual bitstreams may be combined at the decoder for securely embedding customised content (e.g., advertising) at the edge.

The invention discloses a three-dimensional rendering method and system based on digital twinning. The method comprises the steps of obtaining model parameters, constructing an initial model, rendering textures, separating and compressing data, loading the compressed data in parallel, blending an optimization model, and presenting the optimization model on a digital platform. According to the WebGL rendering method, by optimizing the number of model patches and the number of vertexes, multiplexing geometric data, adopting a unified texture map and compressing the model and the texture file, the occupation of WebGL rendering on a memory is reduced, and the rendering efficiency is improved. By utilizing the method and the device, the burden of the graphics card and the CPU is effectively reduced, and the frame rate and the rendering effect in a localized platform environment are improved.

The invention provides a document image correction method based on deep learning, and belongs to the field of computer vision, and the method comprises the steps: carrying out texture rendering and offset mapping processing based on an original texture grid image in a training set, and generating a spatial image to be rendered; performing data enhancement on the spatial to-be-rendered image through a flat image corresponding to the original texture grid image, and performing random disturbance based on a transformation space to obtain a corresponding sample training pair; based on the sample training pairs in the training set, training the initial detection correction model, optimizing control parameters, and obtaining a detection correction model; detecting a four-point detection model and a document correction model in the correction model, and processing the document image to be corrected in sequence to generate a corrected output image; according to the method, model training is carried out based on the self-constructed sample training pair, the document image correction effect of the model is effectively improved, meanwhile, the method can adapt to a complex real scene, and subsequent detection and recognition of the document image are facilitated.

The invention discloses a special effect rendering method and device, electronic equipment and a readable storage medium. The method comprises the steps of determining a first scene texture corresponding to a to-be-rendered virtual scene; the virtual scene comprises at least one virtual object represented by the target special effect to be rendered; determining a first special effect texture and a second special effect texture corresponding to the first scene texture; the first special effect texture is used for storing preset color information represented by the target special effect corresponding to each virtual object; the second special effect texture is used for storing initial special effect configuration information of target special effect performance of each virtual object; according to the first special effect texture and the second special effect texture, each virtual object in the first scene texture is rendered, and the second scene texture with the special effect information represented by the target special effect is obtained. According to the method, the operation overhead in the rendering process can be reduced, and the rendering performance consumption of the game is reduced.

The invention relates to the technical field of lightweight rendering, in particular to a cloud-edge coordinated point cloud model lightweight rendering processing method and system. The method comprises the following steps: performing point cloud coordination prior processing according to electric power facility point cloud data to generate coordination prior point cloud data; a point cloud rendering model is constructed, point cloud curved surface coefficient calculation and curved surface reconstruction processing are carried out, and a point cloud curved surface reconstruction rendering model is generated; obtaining image view angle data, performing rendering model pose alignment processing and model texture enhancement mapping processing, and generating an enhanced texture rendering model; performing rendering coordination lightweight deployment and lightweight real-time rendering processing on the enhanced texture rendering model to generate lightweight real-time rendering data; and obtaining user behavior data, performing point cloud data rendering feedback analysis and cloud edge coordination caching in combination with the lightweight real-time rendering data, and feeding back to the terminal. According to the method, rendering of point cloud power equipment data curved surface reconstruction can be lightened, and redundant transmission of cloud edge rendering data is reduced and coordinated.

The present disclosure provides a model rendering method, device and electronic device, which obtains a model to be rendered and a texture map; for each vertex in the model to be rendered, determines the target distance between the vertex and the virtual camera, determines the target distance range to which the target distance belongs from multiple preset distance ranges, and determines the target resolution of the vertex corresponding to the target distance based on the target resolution range corresponding to the target distance range; multiple preset distance ranges are respectively configured with corresponding resolution ranges; based on the target resolution corresponding to each vertex in the model to be rendered, texture sampling is performed on the texture map to obtain the model to be rendered after texture rendering. This method can determine the resolution corresponding to the vertex at a certain distance from the virtual camera in real time according to the preset distance range and the resolution range corresponding to the preset distance range, and realizes a smooth transition of the resolutions corresponding to different distances, thereby avoiding the phenomenon of sudden changes in the model texture caused by the movement of the virtual camera.

The invention belongs to the field of computer vision processing, and provides a three-dimensional face generation and expression editing method and system based on text and picture driving, which comprises the following steps: extracting key description information from source face text description, generating a control vector based on common mapping of the key description information and a source face picture; enhancing the source face picture by using the control vector to obtain a source face picture after text enhancement; face model parameters are extracted based on the source face picture after text enhancement, a rough shape is generated with the face model parameters as guidance, and detail enhancement and mapping rendering are carried out on the rough shape to generate a final three-dimensional face model; generating a source face picture after expression migration according to the target face picture and the source face picture, enhancing the source face picture after expression migration by using the target face text description to obtain an expression source face picture after text enhancement, and performing three-dimensional reconstruction on the expression source face picture after text enhancement to obtain an expression source face picture after three-dimensional reconstruction. And obtaining a source three-dimensional face model after expression editing.

The invention provides a texture rendering method and system, an equipment terminal and a storage medium, and the method comprises the steps: obtaining a rendering context handle and a shared texture handle, and enabling a rendering engine to call a native rendering library to create the rendering context handle; creating a rendering environment sharing textures with the rendering engine according to the rendering context handle, and creating a rendering component including a native surface view class and a native renderer in the rendering environment; calling the native surface view class, instantiating the native renderer by monitoring the life cycle of the target surface view to obtain a rendering instance, and binding the corresponding shared texture to the rendering instance according to the shared texture handle; the shared texture is rendered on the target surface view by the rendering instance. The native platform can render and use the shared texture, and the limitation of texture data sharing between a rendering engine and the native platform is broken through, so that the flexibility and expansion capability of the native platform in the aspect of picture rendering are improved.

Aspects of the disclosure are directed to three-dimensional (3D) computer graphics processing. In accordance with one aspect, the disclosure includes a memory configured to store a learned triangle mesh and a learned feature texture; a graphics processing unit (GPU) coupled to the memory, the GPU configured to render an inferred three-dimensional (3D) scene based on the learned triangle mesh and the learned feature texture using a ray tracing; and a display unit coupled to the GPU, the display unit configured to display the inferred 3D scene.

The invention relates to the technical field of wordart generation, and provides a wordart generation method and device, equipment and a storage medium, and the method comprises the steps: obtaining user input information which comprises a preset text, a first prompt text and a second prompt text; based on a preset font contour deformation model, according to the first prompt text and the preset text, performing deformation processing on the contour of the preset text to obtain a target text; the contour of the target text is associated with the semantic information of the first prompt text, and the contour of the target text is similar to the contour of the preset text; based on a preset texture rendering model, performing texture filling processing on the interior of the contour of the target text according to the second prompt text to obtain a corresponding wordart; the texture of the wordart is associated with the semantic information of the second prompt text, so that the wordart generation effect is improved.

The invention relates to the technical field of image processing, in particular to a numerical control milling machine workpiece three-dimensional modeling method and system. The method comprises the following steps: clamping a workpiece on a numerical control milling machine, controlling the workpiece to rotate at a constant speed, synchronously performing axial feeding, and collecting a correction spiral image sequence and a groove bottom image sequence; performing space-time registration on the corrected spiral image sequence and the groove bottom image sequence to extract workpiece modeling feature data; performing conversion from polar coordinates to rectangular coordinates based on the workpiece modeling feature data, resolving three-dimensional space coordinates and corresponding surface attribute values, and generating workpiece three-dimensional point cloud data; and inputting the three-dimensional point cloud data of the workpiece into three-dimensional modeling software, and carrying out gridding processing and texture rendering to obtain a three-dimensional digital model of the workpiece. According to the method, the workpiece is driven to execute self-adaptive tracking spiral motion, so that visual shielding caused by dense threads is avoided, and high-precision three-dimensional modeling of the small-helix-angle deep-groove workpiece is achieved.

The invention provides a frame insertion method and device, electronic equipment and a storage medium, and the method comprises the steps: responding to the determination of texture rendering of a user interface UI, switching a rendering buffer from a first buffer to a second buffer, rendering the UI in the second buffer according to a target rendering instruction, and obtaining a first texture, obtaining a second texture which is obtained by rendering in the first buffer area and does not comprise the UI, carrying out frame insertion processing according to the second texture to obtain a frame insertion texture, fusing the frame insertion texture and the first texture to obtain a target frame insertion texture, and carrying out UI texture separation in the rendering process to obtain a first texture of the UI and the second texture which does not comprise the UI. And frame insertion is performed based on the second texture, so that the influence of the UI texture on frame insertion is avoided, and the accuracy of a frame insertion result is improved.

The present application discloses an ambient occlusion processing method, device and equipment, which relates to the field of game light and shadow processing technology, and can solve the current technical problem that the computing pressure of the server is increased and the user's gaming experience is easily affected when performing ambient occlusion processing. It includes: obtaining a target model unit of a target virtual object, the target model unit is a model unit to be processed for ambient occlusion, and the target model unit is provided with a minimum bounding box; obtaining a target three-dimensional texture corresponding to the target model unit, the target three-dimensional texture is a pre-baked three-dimensional texture of the target model unit, and the size of the target three-dimensional texture is related to the minimum bounding box size of the target model unit; obtaining a target cube model of the target model unit, the target cube model is used to render the target three-dimensional texture, and the size of the target cube model is the same as the size of the target three-dimensional texture; according to the target cube model and the target three-dimensional texture, the ambient occlusion effect of the target model unit is rendered.

This invention relates to the field of augmented reality technology and discloses an augmented reality image synthesis method based on the optical properties of pearlescent pigments. The method includes: acquiring spectral reflectance data of pearlescent pigments under different illumination and viewing angles; analyzing the spectral reflectance data to calculate color correlation metrics under multiple angle combinations, thereby determining the delay parameter for signal transmission between angles; using the delay parameter and the distribution characteristics of the spectral reflectance data within a preset time interval to derive a gloss fluctuation index of the pearlescent pigment within the time interval; combining the gloss fluctuation index and the attribute differences of the spectral reflectance data after frequency domain transformation to evaluate the synthesis interference probability at each frequency point and extract key interference frequencies; integrating the distribution patterns of all key interference frequencies to generate an image rendering error probability; and finally adjusting the texture rendering parameters of virtual objects in the augmented reality scene according to the image rendering error probability to achieve the generation and output of the synthesized image.

At least one of material IDs is changed to a different material ID for each of voxels corresponding to a voxel update range, and a display mesh is updated in association with updated voxel data. In addition, generating an in-game behavior based on collision determination between a determination mesh in which a material is determined based on at least a plurality of materials ID included in voxel data, and a determination shape corresponding to a determination target, and a virtual space including a display mesh is rendered based on vertex coordinates of the display mesh and a texture corresponding to a material for the display mesh.

The present invention relates to the technical field of three-dimensional modeling, and particularly to a three-dimensional positioning and surgical navigation system for gastrointestinal stromal tumors with multi-modal image fusion. The system includes: a model initial construction module, which is used to obtain CT images, MRI images and endoscopic images of gastrointestinal stromal tumors, and generate an initial three-dimensional model from multi-layer CT images; a model correction module, which is used to increase the number of triangular meshes in the initial three-dimensional model according to the analysis of the gastrointestinal stromal tumor region in the MRI image to obtain a mesh three-dimensional model; a texture matching module, which is used to determine the best matching pixel corresponding to each triangular mesh in the mesh three-dimensional model, and the best matching pixel belongs to the endoscopic image; a texture rendering module, which is used to perform texture rendering on the mesh three-dimensional model according to the best matching pixel to obtain a three-dimensional positioning model of the gastrointestinal stromal tumor. The present invention combines various types of images to reconstruct a three-dimensional model, improving the detail rendering of the gastrointestinal stromal tumor model.

This invention relates to a method, apparatus, electronic device, and storage medium for rendering terrain tile data. The method includes: acquiring a rendering request for a terrain tile to be rendered; acquiring tile data corresponding to a tile identifier, the tile data including location data and image data, based on a tile identifier; using the image data corresponding to the tile identifier as texture data of a pre-created 3D target texture; and rendering the texture data using the 3D target texture based on the location data corresponding to the tile identifier and a first correspondence. Through this method, since the image data corresponding to the tile identifier can be used as texture data of a 3D target texture, and the location data of the terrain tile can be associated with the texture coordinates of the 3D target texture, multiple terrain tiles can be rendered using a single 3D target texture. When rendering different terrain tiles, there is no need to switch texture objects, which not only ensures the smoothness of rendering but also improves rendering efficiency and GPU performance.

An example of an information processing system generates a display mesh based on voxel data. The information processing system generates a voxel update range in a virtual space, based on game processing, and updates at least one of a density and a material ID, in the voxel data, for each of voxels corresponding to the voxel update range. The information processing system updates the display mesh corresponding to the updated voxel data. The information processing system, based on collision determination between a determination mesh and a determination shape corresponding to a determination target, generates an in-game behavior according to a material of the determination mesh at a collision position. The information processing system renders a virtual space including the display mesh, based on a texture corresponding to the material of the display mesh.

A method of rendering a stereoscopic image of an object is described. The stereoscopic image comprises a left image and a right image. The method comprises initialising a computer model of the object (200) and a texture mapping for rendering the computer model with a texture. The method comprises the steps of receiving a first image of the object from a first image sensor (14a), receiving a second image of the object from a second image sensor (14b), receiving head tracking data of the observer (360), determining one or more render camera viewpoints relative to the computer model based on the head tracking data, and rendering the stereoscopic image based on the computer model and the texture mapping using the one or more render camera viewpoints, wherein the left image of the stereoscopic image is rendered using the first image as the texture and the right image of the stereoscopic image is rendered using the second image as the texture.

The invention discloses a natural adversarial texture-based target detection adversarial attack method, which comprises the following steps of: generating N point bitmaps which are similar to a set prompt image in style content and have the same style by utilizing a sampling module according to a prompt image, a text input condition and a depth map mask of a vehicle model, and enabling the point bitmaps to have the same visual angle as the depth map mask; rendering a natural confrontation texture under human eye observation synthesized through depth perception texture based on the point map by adopting a natural confrontation texture generation algorithm to the outer surface of the three-dimensional vehicle model through a renderer, and generating a confrontation rendering image of the vehicle model; and performing target detection on the adversarial rendering image of the vehicle model by adopting a multi-detector integrated attack module. According to the method, the natural confrontation texture observed by human eyes is generated through a natural confrontation texture generation algorithm and is pasted on the outer surface of a real vehicle target, a confrontation rendering image is generated, a target detector is interfered, and robustness attack of a physical domain is realized.

The invention relates to the technical field of image rendering, and discloses a method and device for rendering high dynamic range content, and the method comprises the steps: obtaining a triangular mesh representing a terrain, a triangular mesh representing a three-dimensional object, a corresponding terrain texture, and a corresponding three-dimensional object texture; rendering the scene model; rendering the celestial body and the sky atmosphere to obtain scene textures; performing downsampling operation on the scene texture, and calculating the average brightness of the current frame; extracting pixel points of which the brightness is higher than a preset threshold value from the downsampled scene texture, and generating an initial floodlight texture; performing down-sampling operation, Gaussian blur operation and up-sampling operation on the initial floodlight texture in sequence to obtain a target floodlight texture; and according to the scene texture and the target floodlight texture, combining the average brightness of the current frame, synthesizing an exposure result of high-dynamic rendering, performing tone mapping on the exposure result, and displaying the exposure result on a target display device. The dynamic range of the color gamut and the brightness of three-dimensional scene rendering is expanded, and the rendering effect is improved.

The invention relates to a multiband infrared adversarial sample generation method and device, equipment and a medium. The method comprises the following steps: constructing a three-dimensional model based on target real data, rendering to-be-optimized confrontation textures to the surface of the model by adopting a neural rendering technology, generating a confrontation texture three-dimensional model, processing the confrontation texture three-dimensional model by a differentiable neural renderer to obtain a two-dimensional rendered graph, and converting the two-dimensional rendered graph into grey-scale maps corresponding to short-wave, medium-wave and long-wave infrared rays. A mask is generated through semantic segmentation, a random background is superposed, an optimized sample matched with the real radiation characteristics of each wave band is generated in combination with style migration, and the target detection network feeds back iterative optimization confrontation textures and is finally arranged on the target surface to realize multi-band infrared interference detection. The method can realize full-band effective interference, is strong in robustness and high in concealment, is adaptive to various detection systems, and improves the target safety protection capability.

The invention discloses a visual language model intelligent confrontation method based on multi-modal collaboration and a related device. Inputting the rendered image rendered by the benign camouflage texture into the white-box visual language model, and maximizing the difference of different images to obtain a target antagonistic texture; inputting the adversarial image rendered by the benign text instruction and the target adversarial texture into a plurality of different visual language models to obtain a plurality of different suffixes, and screening out a target suffix which enables the total attack loss value of the plurality of visual language models to be minimum from the suffixes; inputting the target antagonistic texture and a target text instruction combined by the benign text instruction and the target suffix into a black box visual language model to obtain an error instruction; a composite threat model fusing physical deployability and digital high mobility is constructed, and a comprehensive safety test benchmark and a technical basis are provided for evaluating and improving the safety of an automatic driving visual language model.