Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

15906results about "3D-image rendering" patented technology

Large-scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering

The invention discloses a large-scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering, and relates to computer graphics. The method comprises the following steps: collecting a multi-view image set of a large scene; obtaining a scene sparse point cloud according to the multi-view image set; performing monocular depth estimation on the multi-view image by using a pre-trained depth prediction network to obtain monocular depth estimation priori; the method comprises the following steps of: performing global training on a scene by utilizing scene sparse point cloud and monocular depth estimation prior to obtain an initial three-dimensional Gaussian model, and performing space grid division on the initial three-dimensional Gaussian model to obtain a plurality of scene blocks with axis alignment bounding boxes; setting image view angle data of each scene block; performing deep supervised training on the Gaussian ellipsoids in the plurality of scene blocks by using a parallel GPU (Graphics Processing Unit); combining the trained scene blocks to obtain a final three-dimensional Gaussian model; in view of low geometric structure reconstruction precision caused by only depending on color information of a multi-view image in large-scene three-dimensional rendering, the method improves the reconstruction precision of large-scene rendering.
Owner:JSTI GRP CO LTD +2

Digital human video generation method based on multi-modal large model

The invention belongs to the technical field of virtual person generation, and particularly relates to a digital person video generation method based on a multi-modal large model, and the method comprises the following steps: 1, constructing a multi-modal data system; 2, multi-modal large model training and adaptation are carried out; 3, constructing a digital human three-dimensional model; step 4, performing semantic analysis and modal mapping; 5, generating a time sequence action and a mouth shape; step 6, building and rendering a virtual scene; step 7, audio and video synchronous rendering and synthesis; step 8, quality optimization and defect repair; and step 9, performing user interaction and iterative optimization. Through technical innovation and engineering, the core pain point in digital human video generation is solved, efficient, vivid and customizable content production capacity is provided for virtual anchors, intelligent customer service, enterprise training and other scenes, and the AI digital human technology is promoted to be applied to large-scale business from experiments.
Owner:ZHE JIANG YAN HUANG KE JI YOU XIAN GONG SI

Three-dimensional Gaussian sputtering scene reconstruction method based on structure perception refined Gaussian

The invention discloses a three-dimensional Gaussian sputtering scene reconstruction method based on structure perception refined Gaussian, and aims to solve the problems of Gaussian drift, edge blur, structure artifacts and the like of a reconstruction model due to the fact that sparse point cloud contains outliers, Gaussian morphology and normal are mismatched and a multi-dimensional optimization target is lacked in an existing three-dimensional Gaussian sputtering reconstruction method. A key frame is extracted by collecting target scene video data, sparse three-dimensional point clouds are reconstructed by using an SfM algorithm, a depth map and a normal map are generated through a Lotus model, three-dimensional Gaussian distribution is initialized after the sparse point clouds are filtered, a Gaussian covariance matrix is adjusted by using a normal consistency regular term, and the sparse point clouds are extracted. And after structure attribute analysis is carried out, a comprehensive scoring function is constructed to screen Gaussian points, and finally, a combined training framework including luminosity, normal consistency and structure continuity loss is adopted to optimize and generate a three-dimensional Gaussian scene model. The method is mainly applied to the field of three-dimensional reconstruction and multi-view rendering, and scene reconstruction precision and geometric consistency can be improved.
Owner:GUILIN UNIVERSITY OF TECHNOLOGY

Scene reconstruction method based on delayed rendering and three-dimensional Gaussian

The invention provides a scene reconstruction method based on delayed rendering and three-dimensional Gaussian. The method comprises the following steps: S1, generating initial three-dimensional point cloud data based on a multi-view image; s2, constructing a trainable structural body for three-dimensional Gaussian modeling; s3, normal initialization and residual optimization are carried out on the Gaussian ellipsoid primitives, depth consistency constraint is combined, and a differentiable and learnable normal reconstruction mechanism is realized, so that the geometric expression ability of illumination modeling is enhanced; s4, introducing a reflection training mechanism based on ambient light and a reflection direction, and generating a Gaussian attribute based on a visual angle; and S5, a final image is generated through a differentiable Gaussian sputtering rendering algorithm, and optimization is carried out through pixel loss of the final image and a real image. According to the method, the reality sense and geometric consistency of the Gaussian sputtering model under the complex illumination condition are remarkably improved, and the technical problems of unreal rendering effect, inaccurate surface normal estimation, weak propagation capability and the like of the existing three-dimensional Gaussian sputtering model under the complex illumination condition are solved.
Owner:GUANGDONG BOHUA UHD INNOVATION CENT CO LTD

Three-dimensional environment reconstruction optimization method based on multi-sensor fusion data

The invention discloses a three-dimensional environment reconstruction optimization method based on multi-sensor fusion data, and relates to the field of three-dimensional environment reconstruction optimization, and the three-dimensional environment reconstruction optimization method based on the multi-sensor fusion data comprises the following steps: S1, collecting multi-source sensor data, and constructing a data set under a unified coordinate system; s2, generating dense visual point cloud, and extracting laser point cloud features to construct a model; s3, establishing a local three-dimensional model, and generating a local environment image; s4, shadow parameters are extracted through shadow geometric analysis, and time sequence optimization is carried out; s5, consistency verification and correction are carried out, and three-dimensional reconstruction data are output; and S6, comparing the reconstruction data with the navigation map database, and carrying out map optimization updating. According to the method, time synchronization and space calibration are carried out on data acquired by the depth camera and the laser radar, complete and accurate three-dimensional information modeling of the target environment is realized, and the geometric precision of environment reconstruction and the image detail reduction capability are improved.
Owner:NORTH CHINA UNIV OF WATER RESOURCES & ELECTRIC POWER

Optimization method and device for sparse view angle three-dimensional Gaussian splashing

The invention relates to an optimization method and device for sparse view angle three-dimensional Gaussian splash, and belongs to the technical field of three-dimensional reconstruction in computer vision, and the method comprises the steps: collecting a sparse view angle image; a multi-view stereoscopic vision model based on deep learning generates a geometrically consistent depth map for the sparse view image, converts the depth map into point clouds and fuses the point clouds to obtain dense point clouds; sampling dense point clouds by adopting voxel-guided farthest point sampling to obtain initialized point clouds, and constructing a three-dimensional Gaussian field; rendering the three-dimensional Gaussian field through an enhanced geometric renderer to obtain a rendering depth and a rendering normal; constructing a multi-level geometric regularization loss function, and optimizing the three-dimensional Gaussian field; and performing optimization adjustment on the three-dimensional Gaussian field based on a shape-scale constraint criterion and a two-stage adaptive opacity constraint strategy to obtain an optimized three-dimensional Gaussian field. According to the method, the problems of initialization failure, insufficient geometric supervision and element out-of-control of 3D Gaussian splashing under the sparse view angle are solved.
Owner:CHINESE ACAD OF SURVEYING & MAPPING

Real-time virtual reality scene system based on natural language description using multimodal artificial intelligence

A real-time system for the multimodal generation of virtual reality scenes based on artificial intelligence for the creation of immersive three-dimensional environments from natural language narratives, consisting of: a speech capture module configured to continuously record a user's spoken narrative via one or more directional microphones, preprocesses the captured signal by noise reduction and temporal alignment, and outputs a digital speech stream; A speech-to-text processing unit that is operationally coupled to the speech capture module and configured for real-time speech recognition using a continuous neural transformer model. The unit is trained to transcribe natural language utterances into structured text data while maintaining contextual continuity throughout the evolving narrative. a semantic interpretation processing unit that is communicatively linked to the speech recognition unit and configured to perform natural language understanding techniques to extract contextual entities, spatial references, temporal relationships, and object attributes from the transcribed narrative; the engine includes a large language model that is fine-tuned for spatial reasoning tasks; a scene graph generation module configured to transform the interpreted semantic data into a structured, hierarchical representation that defines nodes for identified entities and edges for corresponding relationships, with each node associated with metadata describing geometry, position, orientation, texture, and linking attributes between objects; a multimodal image-language model processor coupled with the scene graph generation module, wherein the processor is configured to retrieve, adapt, or synthesize appropriate three-dimensional elements from a pre-trained visual-lexical embedding space and align these elements with their semantic and spatial definitions derived from the scene graph; a scene assembly and rendering controller configured to create a cohesive virtual scene from the aligned assets, perform real-time rendering using a GPU-accelerated ray tracing pipeline, and produce a stereoscopic visual output that corresponds to the evolving narrative; A head-mounted virtual reality visualization device connected to the rendering engine and configured to display the generated immersive environment to the user in real time. The device features motion sensors and inside-out tracking cameras to detect head and body movements, dynamically updating viewing angles and perspective within the rendered scene; and a bidirectional feedback module integrated into the head-mounted device and connected to the semantic interpretation processing unit; the module is configured to interpret corrective commands, gestures, or supplementary comments from the user to refine or modify specific scene elements without interrupting the real-time visualization; The system continuously updates the virtual scene as the narrative develops, ensuring temporal synchronization between speech input and rendered output below a defined latency threshold, thus enabling a natural, dialogic construction of complex three-dimensional virtual environments.
Owner:GOUNDER MOHAN SELLAPPA DR BENGALURU +3

Virtual stylist

An example operation may include at least one of receiving, via a user interface of a device, an activation input from a user to initiate a session, capturing, by a camera of the device, a scan of a body of the user, wherein the capturing comprises recording at least one image and / or at least one video of the user, processing the at least one image and / or video to generate a three- dimensional model of the user comprising measurements and contours of the body, retrieving, from a database, at least one clothing item associated with the user, the at least one clothing item comprising dimensional attributes and texture attributes, rendering, by a graphics processing unit, the at least one clothing item onto the three-dimensional model to generate a visual representation, wherein the rendering simulates draping behavior, movement, and light interaction of the at least one clothing item relative to the three-dimensional model, and displaying, on the user interface, an interactive visualization comprising the visual representation of the three-dimensional model with the at least one clothing item from multiple viewing angles.
Owner:ELGORT PENELOPE

Fast single image to 3D objects generation

Disclosed are systems and methods for generating a 3D model from a single 2D image, the method comprising: receiving a single 2D input image of an object; generating a set of consistent multi-view images based on the single 2D input image using a fine-tuned 2D diffusion model that processes multiple views together in a tiled configuration; constructing a 3D feature volume by projecting 2D patch features from the generated multi-view images using corresponding camera pose information; generating a 3D mesh using a pair of 3D diffusion networks conditioned on the multi-view images, wherein the pair of 3D diffusion networks comprises a first network for generating a coarse occupancy volume and a second network for generating a high-resolution sparse volume; and refining a texture of the generated 3D mesh to produce a textured 3D mesh.
Owner:RGT UNIV OF CALIFORNIA

Exhibition hall three-dimensional modeling intelligent optimization system based on multi-modal data fusion

The invention relates to the technical field of computer vision and three-dimensional reconstruction, and discloses an exhibition hall three-dimensional modeling intelligent optimization system based on multi-modal data fusion, and the system comprises a data collection module which is configured to synchronously obtain laser radar point cloud data, a multispectral image sequence and inertial measurement unit data; the preprocessing module is used for receiving the output of the data acquisition module, aligning a multi-source sensor coordinate system through a space-time calibration algorithm, and separating a static scene from a dynamic interference element by using a dynamic segmentation network; and the multi-modal fusion module is used for receiving the preprocessed data and carrying out adaptive weighted fusion on the geometric features of the laser radar and the visual texture features through a cross-modal attention mechanism. According to the invention, through multi-modal data fusion and a dynamic scene adaptive mechanism, the modeling precision and the real-time updating capability in a complex exhibition hall environment are significantly improved.
Owner:SHANDONG BAITE EXHIBITION ENG CO LTD

Digital twin three-dimensional scene modeling method based on webGPU

The invention discloses a digital twin three-dimensional scene modeling method based on a webGPU, and relates to the technical field of three-dimensional scene modeling and graphic computing, multi-source sensing data are asynchronously sampled from sparse point cloud, a video texture sequence, a scene semantic tag graph and a structure boundary tuple, and a six-dimensional structure unit group is generated through a normalization operator; constructing a structural unit atlas with nodes representing component entities and edges representing constraint relations, and introducing a tension balance mechanism and multi-scale constraints to generate a modeling path prior model; constructing a graph calculation and graph rendering dual-channel assembly line in the WebGPU, and executing parallel texture mapping and boundary fitting operation; a dynamic sensing module is used for capturing scene disturbance and driving atlas response, and incremental reconstruction of the model is achieved; and finally, mapping the model to a Web terminal, and supporting microscopic semantic query and multi-layer data linkage. According to the method, the response speed, semantic consistency and structural adaptability of three-dimensional modeling in a complex environment are improved.
Owner:ZHEJIANG ZHEFENG YUNZHI TECH CO LTD

Three-dimensional dynamic scene reconstruction method and apparatus, and storage medium

The present disclosure relates to the field of computer vision and discloses a three-dimensional dynamic scene reconstruction method and apparatus, and a storage medium. The three-dimensional dynamic scene reconstruction method comprises: acquiring synchronized videos of a plurality of viewpoints of a dynamic scene; computing matching points between video images of different viewpoints, and estimating intrinsic and extrinsic parameters of each camera; obtaining a Gaussian splatting point set {p0} on the basis of a sparse point cloud constructed according to the depth of each matching point; for the first image frame of each video, using {p0} to perform static training thereon, to obtain a Gaussian splatting point set {p}; for the remaining image frames, dividing {p} into a static point set {S} and a dynamic point set {D}, performing dynamic training on {D}, and constructing a dynamic Gaussian splatting point set {P} from {p}, {S}, and the final {D}; and, in view of the intrinsic and extrinsic parameters of each camera, rendering {P} using a Gaussian splatting rendering pipeline, to obtain rendered images at different moments from new viewpoints.
Owner:TSINGHUA UNIVERSITY

Visual decision-making method and device for multi-source data of digital twin substation and medium

The invention discloses a digital twin substation multi-source data visualization decision-making method, which comprises the following steps: constructing a three-dimensional holographic digital twin model of substation equipment, integrating BIM data and GIS geographic information, and carrying out lightweight processing; multi-source heterogeneous data, including equipment state data, environment sensing data and video monitoring data, of the transformer substation are collected in real time. Through the technologies of multi-source data fusion, dynamic digital twin modeling, AI aid decision making and the like, holographic data integration is realized, data islands are broken, and unified analysis and visualization of multi-dimensional data such as equipment states, environments, videos and the like are realized. And real-time dynamic mapping is carried out: high-precision digital twin bodies are constructed, the operation state of a physical substation is synchronized, and the fault positioning and prediction capability is improved. And intelligent decision support: in combination with machine learning and an expert knowledge base, fault root cause analysis, risk assessment and optimization operation and maintenance schemes are provided, and manual intervention requirements are reduced.
Owner:STATE GRID HENAN ELECTRIC POWER CORP MAINTENANCE CO

Posture recognition algorithm for any object under monocular camera and application system

The invention provides a posture recognition algorithm for any object under a monocular camera and an application system, and the algorithm comprises the steps: S1, constructing a target three-dimensional model, carrying out the multi-view annular shooting image collection of a target, and generating a dense grid model through feature extraction, matching, posture calculation and a multi-view geometric method; s2, generating an image depth map, and predicting depth information of a target in a motion process based on a monocular image sequence; s3, extracting a target image mask, and generating a target area mask graph through an image encoder, a prompt encoder and a mask decoder; and S4, executing attitude estimation, performing attitude initialization, correction and screening by combining the three-dimensional model, the depth map and the mask map, and outputting a six-degree-of-freedom attitude result of the target. According to the method, the target is subjected to annular shooting modeling through the method based on multi-view geometry, the three-dimensional model of the target is generated, attitude estimation is achieved in combination with the image mask and the depth map, the generalization ability of an attitude estimation algorithm in an actual scene is improved, and the application range of the attitude estimation algorithm in the actual scene is widened.
Owner:HANGZHOU BINGBAI INTELLIGENT TECHNOLOGY CO LTD

VR large-space positioning interaction system based on multi-modal perception

The invention relates to the field of virtual reality positioning, and discloses a VR large-space positioning interaction system based on multi-modal perception, and the system comprises the steps: deploying a multi-modal sensor to obtain sensing data, carrying out the visual feature extraction and preprocessing, building a sparse point cloud map in a matching manner, carrying out the scale calibration, and constructing an environment model; pre-judging a UWB signal path based on an environment model, performing error optimization compensation on an NLOS state, and performing observation updating and fusion through degradation detection to obtain a predicted state change; constructing an interactive perception network, and tracking the hands and the whole body; tactile feedback is realized by using a layered tactile system, and a tactile effect is generated by using vibration frequency mapping; the transmission efficiency is improved by using a beam forming technology, an edge cloud server cluster renders a virtual scene, and the scene is pre-rendered in advance to offset network and rendering delay; an online calibration mechanism is designed, and system errors are corrected through visual loopback detection, UWB beacon dynamic correction and IMU drift compensation.
Owner:HANGZHOU KAILIN CULTURE TECHNOLOGY CO LTD +1

Geographic information visualization intelligent analysis system based on unmanned aerial vehicle surveying and mapping

The invention provides a geographic information visualization intelligent analysis system based on unmanned aerial vehicle surveying and mapping, and belongs to the field of surveying and mapping, and the system comprises an unmanned aerial vehicle aerial survey module which carries out regional aerial survey based on a multi-source sensor carried by an unmanned aerial vehicle, obtains multi-modal geographic data, and carries out the preprocessing of the multi-modal geographic data; the data processing module is used for forming an initial geographic data set under a standard coordinate system; the three-dimensional modeling module is used for obtaining the fused geographic feature data, constructing a three-dimensional geographic information model, optimizing the three-dimensional geographic information model and embedding time dimension information to form a four-dimensional spatio-temporal data set; the analysis and decision module is used for generating an analysis report comprising a terrain evolution trend and disaster risk assessment; and the visual platform module is used for visualizing the analysis report through a preset visual interaction interface and adjusting the rendering precision of the optimized three-dimensional geographic information model in real time according to the change of the visual angle of the user. The system provides an efficient and intelligent solution for geographic surveying and mapping and disaster early warning.
Owner:HEBEI YOUTIEZHICE TECHNOLOGY CO LTD

Large-scale scene multi-level-of-detail cloud rendering processing method and device based on 3DGS

The invention provides a large-scale scene multi-level-of-detail cloud rendering processing method and device based on 3DGS, and relates to the technical field of three-dimensional modeling, and the method comprises the steps: dividing a target modeling scene into a plurality of sub-blocks; performing particle redundancy reconstruction and overlapping region marking on boundary regions between adjacent sub-blocks of each sub-block to obtain processed sub-blocks; performing multi-detail level division on each processing sub-block to generate a particle level set; determining a current visual area according to the user motion data, and scheduling a target hierarchy of a particle hierarchy set in the current visual area; the rendering tasks of all the processing sub-blocks of the target hierarchy are distributed to a plurality of rendering nodes to execute real-time rendering operation; and performing video stream coding on pictures rendered by each rendering node, decoding and displaying received video stream data, and performing particle level updating and re-rendering operation according to an interaction instruction. According to the invention, high-quality detail rendering can be realized for a model of a large scene.
Owner:MOBILE BROADCASTING & INFORMATION SERVICE IND INNOVATION RES INST (WUHAN) CO LTD

Diamond high-strength micro-powder quality detection method and system based on artificial intelligence

The invention relates to the technical field of quality monitoring, and discloses a diamond high-strength micro-powder quality detection method and system based on artificial intelligence. The method comprises the steps of obtaining a two-dimensional projection image sequence of diamond micro-powder particles, calculating a projection matrix based on camera calibration parameters and geometric constraints, obtaining a multi-view image data set of the particles, establishing a pixel-level corresponding relation, extracting three-dimensional space coordinates of the surfaces of the particles, and reconstructing dense point cloud data of the particles. Establishing a local coordinate system based on the dense point cloud data, determining attitude parameters of particles in a three-dimensional space, if the attitude parameters deviate from a normal range, performing attitude compensation processing to obtain standardized point cloud data, and performing three-dimensional grid model construction on the standardized point cloud data; and calculating geometrical characteristic parameters of the particles based on the three-dimensional grid model, performing defect detection on the surfaces of the particles, and generating a crystal integrity evaluation report of the particles. The quality detection accuracy of the diamond high-strength micro-powder particles is improved.
Owner:ZHECHENG HAOXIN SUPERHARD PROD CO LTD

Three-dimensional modeling processing method based on unmanned aerial vehicle oblique photography

PendingCN120672994AImage enhancementImage analysisPhotographic cameraPoint cloud
The invention provides a three-dimensional modeling processing method based on unmanned aerial vehicle oblique photography. The method is applied to the technical field of three-dimensional modeling, and comprises the following steps: obtaining a serialized image set containing geographical coordinate information according to original image data collected by an oblique photography camera carried by a multi-rotor unmanned aerial vehicle; according to time-space synchronization parameters of the serialized image set, determining a multi-view image matching relation matrix with an overlapping degree quantitative index; determining mixed three-dimensional point cloud data fusing sparse point cloud and dense point cloud according to geometric constraint conditions of the multi-view image matching relation matrix; determining an initial three-dimensional grid model with multi-level details according to the topological connection relationship of the mixed three-dimensional point cloud data; and determining an optimized three-dimensional model based on adaptive texture mapping according to the surface curvature distribution characteristics of the initial three-dimensional mesh model. In this way, the efficiency of three-dimensional modeling can be improved.
Owner:HENAN WEITU INFORMATION TECH CO LTD

System and method for reconstructing 3D scene data from 2D image data

A method and apparatus for reconstructing a three-dimensional (3D) scene from a two-dimensional (2D) input image of the scene using a fully-differentiable transformer-based encoder-decode. A 2D input image encoded into a set of image features using a pre-trained vision transformer model, wherein the vision transformer model is pre-trained with multi-view RGB image supervision and point cloud supervision. The set of image features is projected onto a 3D triplane representation using a transformer decoder to obtain output triplane tokens. A triplane representation is created from the tokens and queried. 3D point features of color and density for volumetric rendering re predicted using a multi-layer perceptron. The geometry of the generated 3D asset is represented with a surface mesh including vertices and triangular faces. A texture map by is created with a multichannel image in UV space. Multiple views of the 3D scene are simultaneously generated based on the surface mesh.
Owner:FUTUREVERSE IP LTD

Supervolume historic building three-dimensional simulation modeling method based on multi-source heterogeneous data

The invention relates to the technical field of cultural heritage digital protection, in particular to a super-volume historic building three-dimensional simulation modeling method based on multi-source heterogeneous data, and the method comprises the steps: firstly collecting node multi-source heterogeneous data such as laser point cloud, images, structural mechanical parameters and historical repair records, and then carrying out node feature enhancement through a node feature enhancement module; using an improved generative adversarial network to strengthen node edge features, adopting an adaptive threshold segmentation algorithm to extract surface texture features, converting mechanics and size data into a three-dimensional constraint condition parameter matrix, then using a topological relation verification algorithm, using a graph neural network to traverse and verify a component connection relation, and obtaining a three-dimensional confrontation model; and a re-calibration mechanism is triggered when the deviation exceeds the limit, the weight is adjusted based on a Bayesian optimization algorithm, fusion verification is carried out again, finally, hierarchical grid division is adopted to construct high-precision sub-models, and the sub-models are spliced into an integral three-dimensional model, so that the model precision and reliability are improved, and reliable digital support is provided for ancient building protection.
Owner:SHIJIAZHUANG TIEDAO UNIV +1

Insurance claim settlement-oriented multi-modal image video evidence analysis method and system

The invention discloses an insurance claim settlement-oriented multi-modal image video evidence analysis method and system. The method comprises the following steps of: acquiring video / image and multi-source data such as metadata, audio, IMU (Inertial Measurement Unit), GPS (Global Positioning System), OBD (On-Board Diagnostic) and the like; calculating content Hash of the video and the audio according to frames, connecting the content Hash with time information in series to form chained Hash, and adding a verification digital signature and a credible timestamp; realizing cross-modal time sequence alignment based on self-adaptive time anchor-attitude coupling; tampering detection is carried out in combination with PRNU fingerprints, noise field consistency, dual compression, copy-movement and the like; multi-view geometry and monocular depth are fused, IMU scale constraint and micro rendering are introduced, three-dimensional reconstruction and re-projection optimization are completed, and collision dynamics verification is carried out; and constructing an event cause and effect graph, judging responsibility in combination with traffic rules, outputting a confidence coefficient vector and a structured report, and generating a verifiable evidence packet. The scheme has the advantages of high efficiency and traceability in the aspects of space-time restoration and interpretable responsibility judgment.
Owner:国任财产保险股份有限公司

Tooth three-dimensional modeling system based on computer vision, computer equipment and readable storage medium

The invention relates to the technical field of tooth modeling, and discloses a three-dimensional tooth modeling system based on computer vision, computer equipment and a readable storage medium. According to the method, mirror reflection, diffuse reflection and subsurface scattering components in an original image are separated, mirror reflection intensity is normalized in combination with a dynamic truncation algorithm, pixel saturation is eliminated, groove and nest textures are reserved, a complete point cloud is obtained based on a two-dimensional texture image and cubic spline repair, and a multi-exposure point cloud sequence is obtained through bimodal calibration. The method comprises the following steps: solving the problem of data dislocation, carrying out weight assignment and data fusion on three-dimensional points in a plurality of exposure point cloud sequences to obtain three-dimensional fusion feature data, combining layered optical modeling and photon tracking compensation deviation, fusing clinical constraints, finally dynamically adjusting parameters, feeding back and optimizing, and outputting a micron-sized precision model. The modeling defect caused by difficulty in effectively coordinating feature contribution degrees under different exposure conditions is overcome, and high-precision modeling is realized.
Owner:SHENZHEN JINSHI LIMEI MEDICAL TECH CO LTD

Tablet computer image super-resolution enhancement method based on generative adversarial network

The invention relates to the technical field of image super-resolution enhancement, in particular to a tablet computer image super-resolution enhancement method based on a generative adversarial network. The method comprises the following steps: collecting an image through a tablet computer, and carrying out regional illumination component calculation on the image to obtain detailed illumination component data; secondly, quantizing the motion out-of-focus fuzzy degree based on the illumination data, generating track fuzzy intensity sensing data, performing 3D modeling by combining the data, and estimating the distortion trend of the image; then, a shooting error is eliminated by using rendering visual angle distortion correction, a more real visual angle effect is generated, and super-resolution enhancement is performed on the image by using a generative adversarial network, and image details are improved. And finally, designing automatic firmware based on the super-resolution enhanced data, and embedding the automatic firmware into a tablet computer control system. According to the method, the image super-resolution enhancement technology is optimized, so that the image super-resolution enhancement technology is more perfect.
Owner:GUANGDONG OUDULIFANG TECH CO LTD

Generative ai models for image rendering and inverse rendering

Embodiments of the present disclosure relate to rendering and inverse rendering using one or more generative models. “Rendering” refers to the process of generating a final visual image, video frame, or animation from a 2D or 3D model. “Inverse rendering” is a process that involves deducing or estimating the properties (e.g., material maps or other properties such as geometry, lighting, and textures) of a scene from observed images or visual data. Essentially, it aims to reverse the traditional rendering process. Various aspects of the present disclosure introduce editable light and material controls into generative models to allow for artistic creation. Various embodiments integrate generative models as a renderer for classic rendering pipelines to upcycle and enhance the style of rendered content.
Owner:NVIDIA CORP

Game animation character display method based on virtual reality technology

The invention provides a game cartoon character display method based on a virtual reality technology. The method comprises the following steps: acquiring three-dimensional model data of a game cartoon character in a target display area through a user interaction terminal; the virtual reality content management platform determines a dynamic rendering precision level according to the model data, and generates a real-time rendering strategy including a model patch reduction coefficient, a texture compression rate and a skeleton animation updating frequency in combination with terminal performance parameters; the strategy is sent to a virtual reality supervision platform and a user interaction terminal, and a virtual reality rendering engine platform is instructed to execute real-time rendering; and the virtual reality supervision platform monitors the frame rate fluctuation data of the head-mounted display device, calculates the scene rendering stability, sends a rendering optimization instruction if the scene rendering stability is lower than a threshold value, and adjusts the model data acquisition frequency and the video memory cleaning period to optimize the performance. The rendering efficiency and the system stability can be improved, and the hardware load and the frame rate fluctuation are reduced.
Owner:JIANGSU JIUQU INTERACTIVE ENTERTAINMENT NETWORK TECHNOLOGY CO LTD

Urban building three-dimensional automatic modeling and visualization method

The invention discloses an urban building three-dimensional automatic modeling and visualization method, and belongs to the technical field of building three-dimensional modeling. The method comprises the steps that point cloud data, high-resolution images and geographic information system data of urban buildings are acquired, data cleaning, registration and alignment are carried out, and preliminary building digital representation is formed; accurately segmenting each building, and identifying the contour and main structural features of the building; based on the data integrity and the building complexity, adaptively selecting a proper reconstruction strategy to carry out three-dimensional reconstruction; in the reconstruction process, the geometric structure is analyzed and optimized in real time, and potential topological problems are repaired; automatically generating missing details based on a predefined architectural style library and a component library, and performing material inference and texture mapping; a graph structure is used for representing the relation between the buildings, and the positions and orientations of the buildings are adjusted through a global optimization algorithm; a rendering engine supporting multi-level detail switching is developed, and smooth visualization and interaction of a large-scale city scene are achieved.
Owner:CHANGZHOU JINTAN DISTRICT LUOSUI TECHNOLOGY CO LTD

Grouting method and system for enhancing stability of strip mine slope

The invention discloses a grouting method and system for enhancing strip mine slope stability, and belongs to the technical field of slope protection. The grouting method comprises the steps that early-stage data are pre-collected, and an analysis model is established; grouting is designed according to a model analysis result; a pressure-resistant grouting pipe is installed and connected with a grouting pump; grouting parameters are adjusted in real time according to feedback of the sensor; after grouting, all data in the grouting holes are analyzed; outputting a slurry permeation three-dimensional cloud picture, a stress change curve and a stability evaluation index; and storing all monitoring data and model parameters. A cyclic self-adaptive system is formed, it is ensured that the grouting process is efficient and accurate, the overall stability is improved for heterogeneous rock mass, dependence on a static geological report is reduced, and therefore the problem that grouting parameters depend on engineering experience or conservative of the static report is avoided.
Owner:CHINA MINMETALS CHANGSHA MINING RES INST

Point projection type three-dimensional reconstruction and segmentation method and system based on semi-Gaussian pruning

The invention relates to the technical field of computer vision, in particular to a point projection type three-dimensional reconstruction and segmentation method and system based on semi-Gaussian pruning. The method comprises the following steps: respectively obtaining an SFM point cloud and a consistency label mask of a cross-view label based on an obtained multi-view image; initializing the obtained SFM point cloud into an identity semi-Gaussian point cloud, and performing rendering optimization by using a differentiable renderer; densifying the initial sparse point cloud by using a localized semi-Gaussian point management method, and identifying a local error region for resetting and repairing; using the obtained consistency label mask to supervise Gaussian identity feature learning by using cross entropy loss, and using unsupervised 3D regularization loss to force spatially adjacent gauss to maintain identity consistency; according to the method, the identity coding semi-Gaussian kernel method is adopted, the inherent representation fuzziness of a single opacity formula is eliminated, and the positive influence on the identity coding precision is generated.
Owner:YANTAI UNIV