Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

177 results about "Viewing frustum" patented technology

In 3D computer graphics, the view frustum (also called viewing frustum) is the region of space in the modeled world that may appear on the screen; it is the field of view of the notional camera. The view frustum is typically obtained by taking a frustum—that is a truncation with parallel planes—of the pyramid of vision, which is the adaptation of (idealized) cone of vision that a camera or eye would have to the rectangular viewports typically used in computer graphics. Some authors use pyramid of vision as a synonym for view frustum itself, i.e. consider it truncated.

Virtual reality building roaming method and system based on scene rendering

The invention provides a virtual reality building roaming method and system based on scene rendering, and relates to the technical field of virtual reality, and the method comprises the steps: dividing building three-dimensional model data through an octree space segmentation algorithm, and determining a detail level threshold according to a viewpoint distance, and constructing a multi-level detail model. And baking the basic illumination chartlet by using a pre-calculation irradiance transmission technology, and performing real-time synthesis in combination with the multi-resolution shadow chartlet. And calculating illumination by adopting a physics-based rendering method, and fusing the illumination with the scene light and shadow synthesis data to generate dynamic illumination rendering data. And determining a current viewpoint based on the spatial position and attitude data of the virtual reality head-mounted display, performing view cone elimination and shielding elimination, and performing GPU instantiation rendering on visible building data. And the rendered image is optimized through high dynamic range processing and a time domain anti-aliasing technology, and a final scene image is generated in combination with an atmospheric scattering algorithm. According to the invention, the rendering efficiency and scene reality sense of virtual reality building roaming can be effectively improved.
Owner:GUANGZHOU DABAI DIGITAL TECHNOLOGY CO LTD

Three-dimensional scene loading and rendering method for deep sea three-dimensional environment deduction

The invention discloses a three-dimensional scene loading and rendering method for deep-sea three-dimensional environment deduction, and relates to the technical field of three-dimensional scene rendering, and the method comprises the following steps: obtaining and preprocessing various types of data of a deep-sea environment, and carrying out the grid processing of terrains and objects in the deep-sea environment; a deep sea three-dimensional scene is established based on the preprocessed deep sea environment data, scene uniform segmentation is carried out, a plurality of sub-scene blocks are obtained, and a block rendering sequence table is obtained; the rendering efficiency of the deep sea three-dimensional scene is remarkably improved by adopting the view cone removing technology and the batch processing rendering strategy, the rendering speed is increased, dependence on hardware resources is reduced, the rendering task can be efficiently completed under the condition that the resources are limited, and in addition, the rendering efficiency of the deep sea three-dimensional scene is improved. The strategy of dynamically adjusting the rendering detail level further balances details and performance, and ensures that the optimal rendering effect can be provided under different observation distances and hardware loads.
Owner:NAT DEEP SEA CENT

Scene rendering method and system based on three-dimensional Gaussian splashing

The invention discloses a scene rendering method and system based on three-dimensional Gaussian splashing. The method comprises the following steps: organizing and constructing an original 3D Gaussian set to obtain a spatial hierarchical structure; generating corresponding level details for the primitives in the spatial hierarchical structure to obtain a spatial hierarchical structure associated with the level details; traversing the spatial hierarchical structure associated with level details, and executing hierarchical view cone cutting and shielding elimination to obtain a visible node list; traversing the visible node list, calculating a level detail selection standard, and generating a level detail activity Gaussian set; performing optimization sorting on the level detail activity Gaussian set to obtain an activity primitive list; and performing tile-based rasterization on the active primitive list, and performing adaptive processing according to level details of the primitives to obtain a final color value of each pixel. According to the method, the rendering performance can be greatly improved, the occupation of a memory and a video memory is remarkably reduced, the rendering quality is improved, visual flaws are reduced, and the expandability of the 3DGS rendering method is enhanced.
Owner:CHINA ORDNANCE SCI INST

Three-dimensional gaussian splatting optimization method for unposed input

Disclosed in the present invention is a three-dimensional Gaussian splatting optimization method for an unposed input. The method comprises: for an input image, predicting a ray bundle distribution by using a ray prediction model, to obtain distribution features in the form of ray bundles; on the basis of the distribution features in the form of ray bundles, calculating a camera pose; for the ray bundle distribution, performing sampling on the basis of the volumetric density of light rays, to obtain an initial spatial distribution of a three-dimensional Gaussian point cloud focused on a visual center area; for the input image, obtaining a visible shell by means of view frustum projection and object-mask computation; on the basis of the initial spatial distribution of the three-dimensional Gaussian point cloud and the visible shell, performing three-dimensional Gaussian splatting scene training, to obtain a three-dimensional scene reconstruction model satisfying a preset loss function criterion, the loss function comprising a training regularization term for a camera pose parameter. The present invention provides important scene initialization information for three-dimensional Gaussian splatting training, and significantly improves the quality and the richness of detail of the final three-dimensional structure.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Three-dimensional scene optimization method and system for collaborative rendering of dynamic LOD and view cone elimination based on space-time prediction

The invention relates to the field of scene rendering, and particularly discloses a three-dimensional scene optimization method and system for collaborative rendering of dynamic LOD and view cone rejection based on space-time prediction, and the method comprises the steps: dynamically calculating the visibility frequency of an object, and dynamically adjusting the loading and rendering modes of objects with different priorities; predicting a view cone range of multiple frames in the future by using an LSTM network architecture; dividing the scene into uniform grid blocks, and then performing grading elimination; optimizing a heterogeneous computing pipeline; rendering the execution process; the system comprises a dynamic LOD and visual cone rejection collaborative optimization module, an LSTM visual cone prediction module, a block-level mixed rejection module, a heterogeneous calculation pipeline module, an optimization CPU-GPU task allocation and data transmission module and a rendering execution control module. According to the method, the technologies of collaborative optimization of dynamic LOD and view cone removal, block-level mixed removal, heterogeneous calculation assembly line optimization and the like are adopted, so that unnecessary rendering calculation and resource loading are reduced, and the rendering efficiency is improved.
Owner:YANTAI JIERUI NETWORK TRADING

Three-dimensional GIS intelligent campus visualization platform system based on Cesium

The invention relates to the technical field of smart campuses, in particular to a Cesium-based three-dimensional GIS smart campus visualization platform system, which comprises a three-dimensional visualization engine module, a 1: 1 campus digital twin model constructed based on Cesium, and a GLB format model dynamic loading and 360-degree free view angle browsing support, the data fusion module is used for integrating security and protection monitoring and energy consumption monitoring multi-source data and realizing multi-dimensional data linkage through ECharts; the performance optimization module is used for optimizing the model loading efficiency by adopting view cone cutting and LOD technologies; according to the method, 1: 1 campus digital twin modeling is realized by adopting a Cesium engine, the reality sense and the spatial analysis capability of a three-dimensional scene are improved by combining a precise positioning algorithm of a WGS84-to-Cartesian coordinate system and a GLB format model dynamic loading technology, and meanwhile, real-time coupling of dynamic data such as energy consumption and security and protection and the three-dimensional scene is realized by adopting a CZML protocol.
Owner:JIANGXI UNIV OF SCI & TECH

OpenGL-based large-scale three-dimensional model object rapid pickup method

The invention relates to an OpenGL (Open Graphics Library)-based large-scale three-dimensional model object quick pickup method. The method comprises the following steps: converting an interactive operation of a user into a three-dimensional space structure; a CPU constructs octree space acceleration structures based on a bounding box of an object in a large-scale three-dimensional model, and leaf nodes, intersecting with a pickup ray or a pickup view pyramid, of an axis alignment bounding box in each octree space acceleration structure are screened out to serve as candidate leaf nodes; collecting triangles contained in all candidate leaf nodes, and constructing a candidate triangle set; dynamically allocating thread groups and threads of the GPU based on the number of candidate triangles in the candidate triangle set; and performing highlight display on the candidate triangles intersected with the pickup ray or the pickup view cone, and feeding back IDs of the corresponding candidate triangles. According to the method, the data transmission quantity and the video memory access pressure are remarkably reduced, the pickup response time is greatly shortened in a large-scale three-dimensional model scene, and the requirements of real-time interaction and visual operation can be met.
Owner:SHENZHEN MAIXI SOFTWARE CO LTD

Terrain rendering method and device for virtual scene, equipment, medium and program product

The invention provides a terrain rendering method and device for a virtual scene, electronic equipment, a computer readable storage medium and a computer program product, and the method comprises the steps: obtaining a plurality of three-dimensional grids in a view cone corresponding to the virtual scene, and enabling the three-dimensional grids to be obtained through dividing a three-dimensional terrain in the virtual scene; for each three-dimensional grid, obtaining a division grade corresponding to the three-dimensional grid, and determining a texture grade of the three-dimensional grid based on the division grade; obtaining texture parameters of the three-dimensional grids in the rendering process based on the texture levels of the three-dimensional grids, and rendering the plurality of three-dimensional grids based on the texture parameters and the division levels corresponding to the three-dimensional grids to obtain a target image; wherein the target image is used for indicating a topographic image in a view field range indicated by the view cone in the virtual scene. In this way, the rendering efficiency and the rendering effect can be improved when the terrain of the virtual scene is rendered.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Rendering method and device and medium

The invention discloses a rendering method, which comprises the following steps: constructing an octree, and storing a to-be-rendered object in a to-be-rendered three-dimensional scene in a child node of the octree to obtain a space management octree; dividing the view cone into different view cone levels; traversing the space management octree, and determining a first intersection part between the space of the child node and the view cone and a view cone level to which the first intersection part belongs; distributing the first intersection part to different rendering queues according to the view cone hierarchy to which the first intersection part belongs; shielding and removing the first intersection parts in the different rendering queues to obtain current visible objects to be rendered; and rendering the current visible to-be-rendered object. According to the method, the octree is constructed to manage the three-dimensional scene space, the view cone levels are divided, the rendering queues are distributed, the view cone removing and multi-level shielding removing technologies are combined, the visible objects are accurately judged, the rendering load is effectively reduced, and the method has the advantages that the rendering performance is improved, space management is optimized, and the complex scene processing efficiency is improved.
Owner:CISDI ENGINEERING CO LTD +1

Apparatus and method for converting compressed geometries into acceleration data structures

The invention discloses an apparatus and method for converting compressed geometries into accelerated data structures. An apparatus and method for transforming lossy compressed geometries into a bounding volume hierarchy. For example, one embodiment of a method includes constructing a bounding volume hierarchy (BVH) based on a compressed hierarchy (LOD) structure formed from iteratively merged geometric primitive cluster pairs, where constructing the BVH includes traversing the compressed hierarchy (LOD) structure, to select a subset of the cluster on one or more levels of a compressed hierarchy (LOD) structure based on the current cone of view; decompressing each cluster and constructing a per-cluster BVH on the primitive of each cluster, wherein each per-cluster BVH comprises a per-cluster BVH root node; and fusing the per-cluster BVH root nodes to form a BVH, the BVH being used to efficiently ray trace all decompressed geometric primitives in the scene.
Owner:INTEL CORP

Underwater scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering and related equipment

The embodiment of the invention provides an underwater scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering and related equipment, and belongs to the technical field of computer vision. The method comprises the following steps: performing feature point analysis on each real two-dimensional image to obtain a sparse point cloud set; a three-dimensional Gaussian ellipsoid of each point cloud in the sparse point cloud set is initialized to represent a three-dimensional underwater scene, and the three-dimensional Gaussian ellipsoid is used for representing Gaussian distribution of the position, the covariance matrix, the color and the opacity of the point cloud; selecting a plurality of three-dimensional Gaussian ellipsoids located in a corresponding camera view cone based on the target camera pose, and performing two-dimensional projection rendering according to the plurality of selected three-dimensional Gaussian ellipsoids to obtain a rendered two-dimensional image; and updating the three-dimensional Gaussian ellipsoids in the point cloud space according to the rendered two-dimensional image and the real two-dimensional image with the same target camera pose to obtain a plurality of three-dimensional Gaussian ellipsoids accurately representing the underwater scene. According to the invention, the accuracy and efficiency of underwater scene three-dimensional reconstruction can be improved.
Owner:WUHAN UNIV OF TECH

Unmanned aerial vehicle image compensation slicing method, device and equipment and storage medium

The invention relates to the technical field of unmanned aerial vehicle image processing, and discloses an unmanned aerial vehicle image compensation slicing method, device and equipment and a storage medium. The method comprises the following steps: acquiring flight mark data, inspection parameter data and a region image when an unmanned aerial vehicle inspects a long-strip-shaped target region, and extracting various types of flight parameter data; performing superposition calculation on the coordinates of the unmanned aerial vehicle based on the positioning compensation data, and constructing a camera imaging view cone model in combination with the inspection parameter data; performing intersection calculation on the view cone model and the strip-shaped target area to obtain an effective image coverage area, and determining image slice parameter data; and performing non-uniform tile cutting on the inspection area image based on the slice parameters to generate image slice data, and performing multi-resolution structure storage of non-uniform spatial index according to the inspection main axis direction to obtain an inspection image compensation slice result. According to the invention, the adaptive slicing of the unmanned aerial vehicle image is realized, the redundancy of the long-strip-shaped target slice is reduced, and the three-dimensional visual loading efficiency is improved.
Owner:SHENZHEN QIHANG TERRITORY TECH CO LTD

Engineering BIM model lightweight rendering method based on model semantic information

The invention provides an engineering BIM model lightweight rendering method based on model semantic information, and the method comprises the steps: analyzing an engineering BIM model, and obtaining the semantic information of the engineering BIM model; performing octree space segmentation on the engineering BIM model, and establishing a model octree optimization structure of the engineering BIM model; semantic information of each tile of each level is obtained; and carrying out space elimination based on view cones and semantic elimination based on model semantics. By means of the method, the efficiency of octree index calculation and model rendering simplified calculation of the engineering BIM model can be improved, the data size of the BIM model rendered by a browser at the same time is reduced, the utilization rate of hardware such as a GPU is increased, the loading and rendering efficiency of the BIM model is improved, more BIM models can be loaded at the same time under the same hardware configuration condition, and the loading efficiency and the rendering efficiency of the BIM model are improved. And rendering application of massive BIM models is supported.
Owner:POWERCHINA BEIJING ENG CORP

Methods of extending flatscreen displays with XR devices

Systems and methods for extending the span of content displayed in a first view frustum by virtually overlaying a virtual portion of the content on a display of an XR device are described. A composite image, which includes a primary image portion, and an enhanced image portion are requested. The primary image portion is to be displayed on a physical display having a first view frustum. Characteristics of the enhanced image portion are determined based on factors such as the user comfort, field of view from the XR device, and system rendering and encoding capabilities. The primary image portion is displayed in a first view frustum simultaneously and synchronized with the enhanced image portion in a second view frustum. The enhanced image portion is anchored, and color matched with the primary image portion to provide the appearance of one single composite display that has image and color continuity.
Owner:ADEIA GUIDES INC

Mesh updates via mesh frustum cutting

Various implementations or examples set forth a method for scanning a three-dimensional (3D) environment. The method includes generating, based on sensor data captured by a depth sensor on a device, one or more 3D meshes representing a physical space, wherein each of the 3D meshes comprises a corresponding set of vertices and a corresponding set of faces comprising edges between pairs of vertices; determining that a mesh is visible in a current frame captured by an image sensor on the device; determining, based on the corresponding set of vertices and the corresponding set of faces for the mesh, a portion of the mesh that lies within a view frustum associated with the current frame; and updating the one or more 3D meshes by texturing the portion of the mesh with one or more pixels in the current frame onto which the portion is projected.
Owner:CISCO TECHNOLOGY INC

Port avionics hub digital twinborn multi-level simulation model construction and visualization method and system

The invention discloses a port avionics hub digital twin multi-level simulation model construction and visualization method, which comprises the following steps: obtaining a multi-view RGB image of a target port area, obtaining a camera attitude of each view by using an SfM algorithm, and reconstructing a sparse three-dimensional point cloud; constructing an LOD2 shell model with a semantic mark; an LLO3 model with holes is constructed; the LOD0-LOD3 model is serialized into a glTF 2.0 binary format and transmitted to a client side through HTTP / 2, the client side calls WebGL 2.0 through a browser to complete decompression, uploading and PBR rendering, and interactive plug-in-free visualization is achieved; constructing an eight-fork-two-fork-four-fork mixed spatial index, and performing multi-stage division and persistence on the LOD < 0 >-LOD < 3 > tiles, so that a client locates visible tiles within constant time based on node numbers; visual cone cutting and screen space error judgment are adopted to execute progressive loading on visible tiles, LOD0 is loaded at first, then LOD1-LOD3 is subjected to incremental superposition, low-level tiles in the same area are replaced with the LOD3 in a cross fading mode at the ultra-close distance (the Euclidean distance d from the center of a camera to the center of a target tile is smaller than or equal to 100 m), and smooth visual experience is obtained in a browser.
Owner:SICHUAN MINJIANG PORT AVIONICS DEVELOPMENT CO LTD +2

Method and device for searching window for specific landscape

The invention relates to a method and device for searching a window for a specific landscape, and the method comprises the steps: obtaining building information and a multi-view image set in a target region, and constructing a three-dimensional model of the target region according to the building information and the image set; analyzing frame images in the image set to determine a window data set; determining a view cone of the window according to a preset view field angle and an outer normal vector in the geometric space representation data, and determining view field data of the window generated when the view cone is projected to the three-dimensional model; according to the building information, the geometric space representation data of each window and the visual field data, constructing a visual field database of all windows in the target area; and according to the multi-modal query information uploaded by the user, searching a window conforming to the multi-modal query information in the visual field database. The searching efficiency of the window with the specific landscape outside the window is improved.
Owner:HARBIN INSTITUTE OF TECHNOLOGY (SHENZHEN) (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)

Scene data scheduling and rendering method based on dual PVS

The invention discloses a scene data scheduling and rendering method based on dual PVS, and relates to the technical field of data processing. According to the method, the target scene unit where the camera viewpoint is located is determined, the rendering scene tree corresponding to the target scene unit is obtained, the nodes of the rendering scene tree are the target visible objects corresponding to the target scene unit, and then the view cone corresponding to the camera viewpoint is determined; and selecting a target node in the rendering scene tree as a target rendering object according to the view cone, determining a hierarchical detail model corresponding to the target rendering object according to the distance between the target rendering object and the camera viewpoint, loading the hierarchical detail model to the rendering pipeline from the rendering scene tree, and rendering the target rendering object. According to the method, the target visible objects are screened through the rendering scene tree, and then the target rendering object is determined in the target visible objects through the view cone, so that the objects needing to be rendered are further reduced, and the computing resource consumption of model rendering is reduced.
Owner:SHENZHEN EMAP INFORMATION CO LTD

Geometry culling using bounding volume hierarchy (BVH) for ray tracing

ActiveUS12229877B2GraphicsViewing frustum
Aspects presented herein relate to methods and devices for graphics processing including an apparatus, e.g., a GPU. The apparatus may obtain an indication of a BVH structure associated with a view frustum, where the BVH structure includes at least one first-level BVH including a plurality of first-level nodes and a plurality of second-level BVHs including a plurality of second-level nodes. The apparatus may also calculate whether the view frustum intersects with each first-level bounding box in the at least one first-level BVH. Further, the apparatus may calculate, for each first-level bounding box that the view frustum intersects, whether the view frustum intersects with each first-level child nod that is associated with each first-level bounding box. The apparatus may also output an indication of all of the first-level child nodes that the view frustum intersects for each of the set of first-level bounding boxes that the view frustum intersects.
Owner:QUALCOMM INC

Visual landslide monitoring method and device

The invention relates to a landslide visual monitoring method and device, and belongs to the technical field of landslide monitoring, and the method comprises the steps: obtaining the disaster scene data of a landslide monitoring area, constructing a view cone of the landslide monitoring area, dividing the disaster scene data through a plurality of LOD layers of the view cone, and obtaining the landslide scene data of the landslide monitoring area. Initial disaster scene data of each LOD level are obtained, error calculation and judgment can be carried out on the initial disaster scene data of each LOD level, and therefore multi-level visual analysis of the disaster scene data can be achieved; and the initial disaster scene data of each target LOD level can be subjected to adaptive scheduling and visual display, so that the intelligent degree and the adaptive capability of the disaster scene are improved, and the visualization efficiency is improved.
Owner:CCCC SECOND HIGHWAY CONSULTANTS CO LTD

Three-dimensional Gaussian point cloud rendering method based on graph pipeline

The invention discloses a three-dimensional Gaussian point cloud rendering method based on a graphic pipeline. According to the method, the calculation shader is used for point cloud preprocessing and attribute calculation, the graphic pipeline is used for hardware rasterization and color mixing, the characteristics of the GPU are utilized to the maximum extent, and the extremely high rendering speed is achieved while the universality is higher. The method comprises the following stages: 1, a point cloud preprocessing stage: calculating point cloud attributes and NDC coordinates, and removing view cones at the same time; 2, performing depth sorting; and 3, coloring the point cloud. And 4, a graph pipeline stage, including point cloud Gaussian splashing rasterization and color transparency mixing. Compared with original CUDA rendering, the method can be operated on any platform supporting the graphic pipeline in the environment of a NVIDIA display card which does not need to be operated, higher universality is achieved, meanwhile, rasterization of point cloud Gaussian splashing is conducted through the graphic pipeline, the rasterization and color mixing can be conducted through the graphic pipeline, hardware acceleration can be naturally used, and the method has the advantages of being high in practicability and easy to popularize. Therefore, the extremely high rendering speed is realized.
Owner:HANGZHOU DIANZI UNIV

Water conservancy twin model rendering optimization method for dynamically generating grayscale image frames based on view cone

The invention provides a water conservancy twinborn model rendering optimization method for dynamically generating gray level image frames based on a view cone. The method comprises the following steps: obtaining visible area model data after the current view cone is dynamically cut; outputting the visible area model data to a multi-layer rendering target comprising a color buffer area, a vertex buffer area and a depth buffer area through off-screen rendering so as to generate intermediate frame data isolated from screen display; performing gridding processing on the intermediate frame data, and displaying the equipment resolution according to the physical range size of the water conservancy project or the drainage basin scene; the average color value of each grid unit is calculated, desaturation processing is carried out to generate a basic grey-scale map, and adaptive feature enhancement processing is carried out to generate an optimized grey-scale map or a gradient map; and a GPU rendering pipeline is input and acts on hydrological feature analysis of the post-processing stage of the current frame and a preloading data source rendered by a twinborn model of the next frame at the same time, historical frame data are reused in a static region through motion detection, and real-time rendering is triggered in a dynamic region.
Owner:FUJIAN ZHONGRUI HANDING DIGITAL TECH CO LTD

Ultrahigh-resolution immersive scene rendering method based on hexagonal picture segmentation

The invention discloses an ultrahigh-resolution immersive scene rendering method based on hexagonal picture segmentation. The method comprises the following steps: 1, determining a hexagonal segmentation style of an immersive display surface; 2, unfolding the immersive display surface into a plane; 3, acquiring 3D point information of each hexagonal surface, respectively calculating the width W and the height H of the enveloping quadrilateral surface, and calculating a local coordinate system V of the hexagonal surface S; 4, using W, H and V to construct a view cone and a viewpoint matrix of the three-dimensional scene; 5, setting a shade M of a plane expansion view for the hexagonal surface S; 6, calling a rendering scene of the 3D scene for the mask region by using information of the view cone and the viewpoint matrix, and rendering the mask region into a picture at the position S of the hexagonal surface; and 7, repeating the steps 5-6, and sequentially carrying out the same treatment on each hexagonal surface. According to the method and the device, the ultrahigh-resolution picture can be rendered in a scene segmentation form, and the method and the device are suitable for ultrahigh-resolution picture rendering under immersive display equipment.
Owner:HARBIN AIWELL TECH CO LTD

Roadside multi-mode fusion sensing method

The invention discloses a roadside multi-mode fusion sensing method. According to the method, an initial 3D view cone tensor with depth information is generated through a depth estimation network, features of pixel points are projected to a coordinate system in combination with internal and external parameter matrixes of a camera, then a three-dimensional space point coordinate set is generated according to projected feature position information, a Gaussian function is adopted to distribute weights of neighborhood grids, and a three-dimensional space point coordinate set is obtained. And finally, inputting the image features and the features into a fusion unit, respectively carrying out uncertainty modeling on the two types of features, automatically generating a fusion weight, and finally, carrying out normalization weighted aggregation on the features in the neighborhood so as to reduce the position approximation error and obtain the calibrated image features, and finally, inputting the image features and the features into the fusion unit, and respectively carrying out uncertainty modeling on the two types of features and automatically generating a fusion weight. And dynamic optimization is carried out according to a self-supervised loss function in the fusion process, so that the stability of multi-modal feature fusion is ensured, the detection accuracy is high, the performance is relatively good, and the problem of global feature dislocation caused by external parameter deviation and depth error can be avoided.
Owner:NANJING UNIV OF SCI & TECH

Visualizing non-aligned data sets

The invention pertains to a computer-implemented method for visualizing 3D data of a multitude of data sets (1-5) in a scene using a computing device having limited available memory for visualizing the 3D data, the method comprising receiving the multitude of data sets, each data set having an LOD structure given as a tree comprising a multitude of nodes, determining the amount of memory available, selecting nodes of the data sets that comprise 3D data to be loaded into the available memory, loading the 3D data of the selected nodes into the memory; and visualizing the 3D data loaded into the memory on a display. Selecting the nodes comprises performing an LOD selection comprising obtaining camera-frustrum information defining a camera frustrum (10) comprising a near plane (11) and a far plane (12), dividing the camera frustrum by defining at least a near frustrum (15) and a background frustrum (16), defining a subset of data sets as foreground data sets based on an overlap of their nodes with the near frustrum, dividing the camera frustrum into a multitude of regions, allocating the available memory to the multitude of regions, and selecting, based on the allocated memory, the nodes that comprise 3D data to be loaded into the available memory. Allocating the available memory comprises determining, based at least on the amount of memory available, a tree-traversal depth, traversing the LOD structure of each foreground data set using the tree-traversal depth, recording all nodes that have an overlap with the camera frustrum and determining a screen space for each of the recorded nodes, mapping each recorded node to one of the regions, and assigning memory to each region based on the screen spaces of the nodes that have been mapped to the respective region.
Owner:HEXAGON INNOVATION HUB GMBH

Valve identification pose estimation method and system based on FPPE network

The invention discloses a valve recognition pose estimation method and system based on an FPPE network, and relates to the field of image recognition. The problems that an existing visual positioning and pose detection method for the valve is not high in pose recognition degree and too large in calculated amount are solved. The method comprises the following steps: collecting a multi-angle valve picture and valve point cloud data, and constructing a valve point cloud data set and template point cloud; the RT-DETR v2 target detection network is trained; an FPPE network is constructed and trained; according to the trained RT-DETR v2 network, carrying out target identification and plane target position detection on the valve image to obtain a central position coordinate of a valve area and an ROI boundary point pixel coordinate; points of all depths in the ROI space area are extracted to form a view cone point cloud; and inputting the view cone point cloud into the trained FPPE network to obtain a final valve pose estimation result. The method is applied to the technical field of object positioning.
Owner:HARBIN UNIV OF SCI & TECH

A Sensor Observation Method and System Based on Cesium

The present invention relates to the technical field of geographic information systems, and discloses a sensor observation method and system based on Cesium. In this observation method, a viewing frustum is constructed using the PerspectiveFrustum function, and the parameters of different types of sensors are customized to adjust the observation perspective, and the target to be observed within the viewing frustum is observed, thereby simulating the sensor observation environment. The present invention solves the problems existing in the prior art, such as not supporting the customization of different types of sensors to adjust the current perspective and being difficult to observe various targets in a complex environment from multiple angles in real time.
Owner:XIDIAN UNIV

Game image generation method and system based on 3D rendering engine

The present invention relates to the field of game image generation technology, and in particular to a method and system for generating game images based on a 3D rendering engine. The method comprises: obtaining intersecting objects in a 3D model of a game engine that intersect with a surface of a viewing frustum; screening suspicious objects based on the overlap between the bounding box of the intersecting object and the viewing frustum, the change in physics engine information, and the distance between intersecting objects on the same surface of the viewing frustum; determining the user perspective following time difference based on the consistency between the spatial vector of the historical intersecting object and the corresponding camera perspective vector, and the matching relationship between the change in the spatial vector of the historical intersecting object and the change in the corresponding camera perspective vector; calculating the attention level of the suspicious object based on the projection distribution of the suspicious object and its matching object relative to the plane aligned with the camera lens, and the change in the spatial vector when the suspicious object changes state, thereby generating a game image. The present invention ensures the rendering effect of the game image.
Owner:SHANGRAO XINXIN INFORMATION TECHNOLOGY CO LTD

Holographic computing task distributed allocation method and system based on multi-user multi-view interaction

The invention discloses a holographic computing task distributed distribution method and system based on multi-person multi-view interaction, and relates to the technical field of distributed computing and holographic interaction.The system comprises a main scheduling node, a plurality of computing nodes and a user terminal.The main scheduling node obtains scene graph data of a current frame and view cone parameters of the user terminal; generating a dynamic granularity task block with metadata through a dynamic sensing task block generator; obtaining a visual angle coherence cluster through a visual angle coherence clustering engine; calculating sharing benefits and full-link cost of task blocks and clusters, constructing a benefit-cost ratio objective function, and obtaining an optimal matching relationship through an optimization algorithm; according to the method, dynamic adaptation of task granularity and optimal allocation of resources are achieved, redundant rendering and transmission delay are reduced, and the fluency of multi-user holographic interaction and the resource utilization rate are improved.
Owner:GUANGDONG SANDING INTELLIGENT INFORMATION TECH CO LTD

A three-dimensional map construction method, device, equipment and storage medium

This invention discloses a method, apparatus, device, and storage medium for constructing a 3D map, applicable to the field of 3D mapping. It involves determining a reference point within the view frustum of a viewpoint, constructing a reference plane containing the reference point and parallel to the view frustum, determining the height of the 3D map rendering interface window, and determining the height of the reference plane window. The unit of the 3D map rendering interface window height is pixels, while the unit of the reference plane window height is length. A distance-pixel ratio is determined based on the ratio of the reference plane window height to the 3D map rendering interface window height. The 3D map scale of the reference point is determined based on the distance-pixel ratio, constructing a 3D map containing the 3D map scale. Based on perspective projection rules, the scale information at any location in the 3D map can be calculated quickly and accurately, improving the efficiency of constructing a 3D map with a high-precision scale. The high-precision scale can assist in obtaining accurate geographic information within the 3D map, thereby improving modeling accuracy.
Owner:ZHEJIANG KELAN INFORMATION TECH CO LTD