Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

5290 results about "Angle of view" patented technology

In photography, angle of view (AOV) describes the angular extent of a given scene that is imaged by a camera. It is used interchangeably with the more general term field of view. It is important to distinguish the angle of view from the angle of coverage, which describes the angle range that a lens can image. Typically the image circle produced by a lens is large enough to cover the film or sensor completely, possibly including some vignetting toward the edge. If the angle of coverage of the lens does not fill the sensor, the image circle will be visible, typically with strong vignetting toward the edge, and the effective angle of view will be limited to the angle of coverage.

News scene three-dimensional reconstruction and visualization method based on multi-source remote sensing data

The invention provides a news scene three-dimensional reconstruction and visualization method based on multi-source remote sensing data, and relates to the technical field of three-dimensional reconstruction, and the method comprises the steps: extracting multi-modal data feature points through employing a spatial position weighted iterative nearest point algorithm and a tensor projection algorithm; after bidirectional attention deep neural network processing and local geometric consistency constraint screening, registration multi-source remote sensing data is generated, data enhancement is carried out through a variational auto-encoder network and a generative adversarial network, the enhanced data is used for depth information generation and texture feature migration, an initial three-dimensional grid model is generated based on a Poisson reconstruction algorithm, and the initial three-dimensional grid model is constructed; and carrying out topological optimization by combining multi-view projection consistency constraint and a grid optimization algorithm to obtain an optimized three-dimensional scene model, setting a space division function, carrying out space division, constructing a grade model and a depth region, generating a scene semantic segmentation map, and updating a visual scene.
Owner:XINHUA FUSION MEDIA TECH DEV (BEIJING) CO LTD

Real scene three-dimensional modeling method and system fusing laser point cloud and image

The invention provides a real scene three-dimensional modeling method and system fusing laser point cloud and images, and belongs to the technical field of urban three-dimensional modeling. According to the method, laser point cloud data and multi-view image data of a target scene are acquired through a synchronous acquisition device, and joint calibration is performed on a laser radar and a camera to generate space-time synchronization parameters. And a dynamic weight registration algorithm is utilized to dynamically adjust the registration weight according to the point cloud density distribution and the image texture complexity so as to realize the multi-level registration of the laser point cloud and the image data. The registered data is used for constructing a three-dimensional geometric model and generating a seamless texture map, meanwhile, semantic-driven hole repairing is carried out on a model missing area, and finally a complete three-dimensional model is output. According to the real-scene three-dimensional modeling method and system fusing the laser point cloud and the image, the limitation of single data source modeling is solved, and real-scene three-dimensional modeling with high precision, high integrity and real-time updating is realized.
Owner:CHINA JK INST OF ENG INVESTIGATION & DESIGN

AI visual special effect dynamic generation system fused with multi-modal perception

The invention belongs to the technical field of visual special effects, and discloses an AI visual special effect dynamic generation system fusing multi-modal perception. Through cooperative work of six core modules of multi-modal input processing, importance analysis, parameter configuration, parameterized rendering, parameter optimization and rendering and output, deep fusion of special effects and contents is realized. An image sequence, audio data and scene parameters can be processed at the same time, a multi-modal feature data set is constructed, a scene key visual area is scientifically recognized, a visual importance distribution map is generated, and the special effect parameter configuration and rendering process is guided. An improved neural radiation field technology and a physical constraint model are adopted to ensure the consistency and reality of the special effect at different visual angles; and a multi-dimensional quality evaluation and parameter automatic optimization mechanism is introduced, so that the visual expressive force and the artistic value of the special effect are guaranteed. The creation threshold is remarkably reduced, the cooperative expression ability of the special effect and the content is improved, and the special effect becomes a powerful tool for enhancing the narration and enhancing the emotion.
Owner:SHENZHEN XINGHUO MUTUAL ENTERTAINMENT DIGITAL TECH CO LTD

Bridge structure crack position identification method based on deep learning and computer vision

The invention provides a bridge structure crack position identification method based on deep learning and computer vision, and the method comprises the steps: obtaining a multi-view visible light image and a depth image, fusing the visible light image and the depth image according to registration parameters, and generating a fusion image containing the texture and depth information of a bridge; for the fused image, extracting a crack region by adopting an adaptive threshold segmentation algorithm, and dynamically adjusting the threshold to obtain a crack binary image; according to the crack binary image, calculating three-dimensional coordinates of crack pixel points through a three-dimensional reconstruction algorithm, and performing reconstruction to obtain three-dimensional point cloud data containing crack space position and form information; on the basis of the three-dimensional point cloud data, three-dimensional local feature descriptors are adopted to describe geometric attributes of the surface of the crack, crack fragment parameters are calculated, and a three-dimensional crack model is constructed; based on a deep learning model, a transfer learning strategy is adopted, a self-adaptive transferable bridge crack three-dimensional detection method is formed, and model parameters are updated so that the model parameters can adapt to the characteristics of a target bridge.
Owner:GUANGZHOU MARITIME INST

Reconstruction method of three-dimensional reconstruction model based on two-dimensional Gaussian splashing

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.
Owner:GUANGDONG BOHUA UHD INNOVATION CENT CO LTD

Historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.
Owner:BEIJING UNIV OF CIVIL ENG & ARCHITECTURE

Precise plastic mold detection method, device and equipment and storage medium

The invention relates to the technical field of mold detection, and discloses a precision plastic mold detection method, device and equipment and a storage medium, the method comprises the following steps: carrying out multispectral imaging and three-dimensional laser scanning on the surface of a precision plastic mold to obtain multispectral image data and three-dimensional point cloud data; performing multi-scale adaptive threshold segmentation to obtain a first three-dimensional model; performing tensor voting surface reconstruction and texture recovery to obtain a second three-dimensional model; performing global optimization to obtain a target three-dimensional model; extracting multi-view features and carrying out defect classification and positioning to obtain defect category and distribution information; according to the defect category and distribution information and the geometrical characteristics of the precise plastic mold, an optimal scanning detection path is calculated by using a sequence convex optimization algorithm guided by ray tracing, and a self-adaptive mold detection strategy is generated, so that the coverage rate and the precision of detection are improved, the detection time and the resource consumption are balanced, and the detection efficiency is improved. And efficient, comprehensive and accurate mold quality control is realized.
Owner:SHENZHEN JINGSHI YANNENG TECH CO LTD

Three-dimensional Gaussian sputtering scene reconstruction method based on structure perception refined Gaussian

The invention discloses a three-dimensional Gaussian sputtering scene reconstruction method based on structure perception refined Gaussian, and aims to solve the problems of Gaussian drift, edge blur, structure artifacts and the like of a reconstruction model due to the fact that sparse point cloud contains outliers, Gaussian morphology and normal are mismatched and a multi-dimensional optimization target is lacked in an existing three-dimensional Gaussian sputtering reconstruction method. A key frame is extracted by collecting target scene video data, sparse three-dimensional point clouds are reconstructed by using an SfM algorithm, a depth map and a normal map are generated through a Lotus model, three-dimensional Gaussian distribution is initialized after the sparse point clouds are filtered, a Gaussian covariance matrix is adjusted by using a normal consistency regular term, and the sparse point clouds are extracted. And after structure attribute analysis is carried out, a comprehensive scoring function is constructed to screen Gaussian points, and finally, a combined training framework including luminosity, normal consistency and structure continuity loss is adopted to optimize and generate a three-dimensional Gaussian scene model. The method is mainly applied to the field of three-dimensional reconstruction and multi-view rendering, and scene reconstruction precision and geometric consistency can be improved.
Owner:GUILIN UNIVERSITY OF TECHNOLOGY

Power monitoring system and method integrating image recognition and data analysis

The invention relates to the field of electric power monitoring, and discloses an electric power monitoring system and method fusing image recognition and data analysis, and the method comprises the steps: carrying out the visual angle coverage modeling of a target equipment group through a multi-type visual collection unit disposed at a transformer substation and a power distribution terminal; performing cross-frame fine-grained texture differential analysis on the equipment state image sequence, and constructing an image event time window in combination with synchronous disturbance characteristics of multi-source monitoring parameters; based on the high-vigilance candidate frame set, fusing the image structure variability index and the operation data multi-dimensional deviation vector by using a feature encoder, and constructing a multi-modal state coupling feature tensor; map mapping is carried out on the potential fault evolution trend, and semantic association is established between structural nodes with abnormal attributes in the image and frequently fluctuating parameter indexes in the monitoring data; and combining a node interference path in the local fault association subgraph with fault precursor distribution induced in a historical accident sample. The method has the advantage that the operation safety is improved.
Owner:HANGZHOU HOFF ELECTRICAL AUTOMATION

Building construction monitoring method

The invention provides a building construction monitoring method, which comprises the steps of obtaining multi-view video image data of a construction site, and performing fusion processing on the multi-view video image data by adopting an image splicing algorithm to obtain a panoramic three-dimensional scene model of the construction site; acquiring an image frame in the panoramic three-dimensional scene model, and analyzing the image frame by adopting a pre-trained work type identification model to obtain position information of operating personnel and equipment of each work type; acquiring position information of the operating personnel of each type of work, and analyzing postures of the operating personnel by adopting a pre-trained human body posture estimation model to obtain action state information of the operating personnel; and acquiring the position information and the action state information of the operating personnel of each type of work, and judging the specific operation state of the operating personnel of each type of work in combination with a pre-established work type operation knowledge base.
Owner:GUANGDONG DEHONG CONSTR ENG CO LTD

Multi-view panoramic point cloud splicing method

The invention discloses a multi-view panoramic point cloud splicing method, which comprises the steps of performing joint calibration on a binocular camera and a laser radar through a calibration algorithm, and aligning a coordinate system; a binocular camera is used for collecting a two-dimensional image and carrying out distortion correction, a depth map is generated based on parallax calculation, and three-dimensional point cloud reconstruction is carried out in combination with a triangulation principle; performing deep learning target detection on the two-dimensional image, and screening a line rod assembly area through non-maximum suppression; multi-view point cloud data are collected through a laser radar, point cloud segmentation processing is carried out, and a telegraph pole assembly point cloud subset is reserved; matching the two-dimensional pixel area of the telegraph pole assembly with a laser radar point cloud projection result, and screening point cloud data belonging to the telegraph pole assembly; and carrying out alignment and fusion on the multi-view point clouds through initial registration and fine registration by adopting an improved point cloud splicing algorithm to generate a panoramic point cloud image. According to the method, the point cloud splicing processing time is shortened, and the robustness, precision and integrity of point cloud splicing are improved.
Owner:NANJING SIWEI VECTOR TECH CO LTD

Automatic driving large model framework based on 3D space-time perception and human-like decision-making reasoning

The method is suitable for the technical field of automatic driving, an automatic driving large model framework based on 3D space-time perception and human-like decision reasoning is provided, through deep integration of cross-modal dynamic semantic patch embedding and multi-scale chain reasoning, the three-dimensional space-time semantic reasoning ability of an automatic driving system in a complex scene is effectively improved, and the automatic driving efficiency is improved. The efficient cooperative processing of the full-view scene video stream and the global aerial view is realized; meanwhile, through a multi-level space-time semantic self-adaptive data extraction normal form and semantic action representation generation based on rule driving and semantic action interaction, and in combination with a cross-modal task-oriented multi-level training matrix architecture, the model shows excellent performance in the aspects of scene understanding, decision transparency and end-to-end driving task optimization. The accuracy of the system in dynamic behavior deduction is effectively improved, the decision interpretability is improved, and powerful technical support is provided for global path planning and human-like decision making of automatic driving.
Owner:JILIN UNIVERSITY

Optimization method and device for sparse view angle three-dimensional Gaussian splashing

The invention relates to an optimization method and device for sparse view angle three-dimensional Gaussian splash, and belongs to the technical field of three-dimensional reconstruction in computer vision, and the method comprises the steps: collecting a sparse view angle image; a multi-view stereoscopic vision model based on deep learning generates a geometrically consistent depth map for the sparse view image, converts the depth map into point clouds and fuses the point clouds to obtain dense point clouds; sampling dense point clouds by adopting voxel-guided farthest point sampling to obtain initialized point clouds, and constructing a three-dimensional Gaussian field; rendering the three-dimensional Gaussian field through an enhanced geometric renderer to obtain a rendering depth and a rendering normal; constructing a multi-level geometric regularization loss function, and optimizing the three-dimensional Gaussian field; and performing optimization adjustment on the three-dimensional Gaussian field based on a shape-scale constraint criterion and a two-stage adaptive opacity constraint strategy to obtain an optimized three-dimensional Gaussian field. According to the method, the problems of initialization failure, insufficient geometric supervision and element out-of-control of 3D Gaussian splashing under the sparse view angle are solved.
Owner:CHINESE ACAD OF SURVEYING & MAPPING

Large-scale point cloud registration method, system and device based on power grid transmission line and storage medium

The invention discloses a large-scale point cloud registration method, system and device based on a power grid power transmission line and a storage medium, and the method comprises the steps: collecting point cloud data of the power transmission line under different visual angles, and forming a source point cloud set and a target point cloud set; down-sampling point cloud data in the source point cloud set and the target point cloud set, dynamically adjusting the sampling granularity of different density regions, and obtaining representative point cloud data from the source point cloud set and the target point cloud set; extracting point cloud feature points, accelerating neighborhood search through a KD-Tree structure, and adaptively adjusting a neighborhood search radius; constructing a geometric topology model; performing coarse registration based on an improved RANSAC algorithm, selecting non-collinear feature points, and optimizing a transformation model; an improved ICP algorithm is adopted to carry out fine registration, and normal vector features are utilized to introduce weighting factors to optimize registration precision. According to the invention, large-scale power transmission line point cloud data can be efficiently and accurately processed, and the method is especially suitable for power inspection, three-dimensional modeling and maintenance scenes.
Owner:NARI INFORMATION & COMM TECH

Toll vehicle type identification method and system based on expressway passing image

The invention provides a toll vehicle type identification method and system based on expressway passing images, and the method comprises the steps: obtaining an image set of passing vehicles, carrying out the multi-scale brightness compensation processing of a vehicle side contour image, generating a side feature enhancement image, carrying out the contour sharpening processing of a vehicle top contour image, and obtaining a vehicle top contour image; and generating a top feature enhanced image. And performing dual-channel feature fusion on the side feature enhanced image and the top feature enhanced image, generating a vehicle multi-dimensional fusion feature map, inputting the vehicle multi-dimensional fusion feature map into a pre-trained vehicle type matching model, and obtaining a vehicle type feature matching result output by the vehicle type matching model. And performing similarity comparison according to a vehicle model feature matching result and a pre-stored vehicle model feature library, determining a charging vehicle model category corresponding to the passing vehicle, and generating a vehicle model identification mark. According to the method, the robustness of vehicle type recognition in a complex illumination environment can be improved, and meanwhile, the accuracy of vehicle type classification and the charging and passing efficiency are improved by fusing dual-view feature enhancement and a multi-dimensional feature matching mechanism.
Owner:GUIZHOU HUILIANTONG ELECTRONIC COMMERCE SERVICE CO LTD

Self-adaptive camera pose intelligent adjusting system

The invention relates to the technical field of intelligent control, in particular to a self-adaptive camera pose intelligent adjusting system which comprises a dynamic recognition module, a pose adjusting module, a mechanism control module, an information filtering module and a feedback association module. According to the method, the foreground pixel brightness gradient and the boundary continuity in the image frame are extracted, the target displacement path can be recognized, the tracking information is constructed, the target coherent perception under rapid scene change is guaranteed, the attitude parameters and the target motion direction and speed are combined, the offset correction instruction is generated, the response stability of the dynamic target is improved, and the target tracking accuracy is improved. The execution structure feedback is used for correcting control output, reducing the driving error accumulation risk, eliminating non-target disturbance through image boundary definition and motion consistency, improving data purity and combining a view angle execution state and path information to realize synchronous control of tracking and view angle adjustment; and the response efficiency and the following robustness of the system in a dynamic environment are enhanced.
Owner:SHENZHEN STARCAM TECH

Efficient panoramic image splicing method and system based on multi-view fusion

The invention relates to an image processing technology, and discloses an efficient panoramic image splicing method and system based on multi-view fusion, and the method comprises the steps: collecting a plurality of images from different views; performing multi-scale feature extraction on each image, generating a feature descriptor for each extracted feature point, and matching a corresponding feature point pair; performing multi-view geometric constraint screening on the feature point pairs; according to the screened feature point pairs, estimating a homography matrix between adjacent images, and carrying out global optimization on the homography matrix; aligning all the images into the same coordinate system; determining an overlapping region between adjacent images; and according to the pixel information in the overlapping areas, fusing the overlapping areas by adopting a self-adaptive weighted fusion algorithm so as to splice the plurality of images into a panoramic image. The invention further discloses a control device and a computer readable storage medium. The invention aims to improve the efficiency and accuracy of generating the multi-view fused panoramic image.
Owner:SHENZHEN QINUO TECH CO LTD

Road and bridge crack detection method and system

The invention provides a road bridge crack detection method and system, and the method comprises the steps: collecting a bridge surface multi-view image, and constructing a training data set containing crack feature labeling through quality screening and standardized labeling; preprocessing the image by using a multi-scale feature fused deep convolutional neural network and carrying out semantic segmentation, initially identifying a suspected crack region and generating a segmentation mask; and constructing a BeNNS proxy model based on the mask, and establishing a mapping relationship between the detection result and the bridge structure topology, the stress flow field and the service function chain so as to evaluate the result reliability. And inputting an evaluation result into a hybrid evaluation mechanism, performing online real-time detection and offline batch verification to optimize precision, and outputting a verified crack region. Finally, morphological analysis is conducted on the area, geometric parameters and danger levels of cracks are extracted and integrated to a bridge health monitoring system, a crack evolution tracking algorithm and an early warning mechanism are established, and dynamic tracking early warning is achieved. The problem of low detection precision in a complex environment can be solved.
Owner:SICHUAN YUANHAO LUDA ENGINEERING CONSTRUCTION CO LTD

Aero-engine augmented reality virtual-real fusion method based on depth prior scene reconstruction

An aero-engine augmented reality virtual-real fusion method based on depth prior scene reconstruction comprises the following steps: firstly, collecting data of an aero-engine look-around RGB image and a depth image, calculating a camera frame pose by using an SFM algorithm and obtaining a sparse point cloud, and optimizing the camera pose by using an ICP algorithm and the point cloud converted from the depth image to obtain an aligned prior dense point cloud; gaussian points are initialized based on the priori dense point cloud and the sparse point cloud, and random generation of 3D Gaussian is limited by using the boundary of the dense point cloud as geometric constraint; through the three-dimensional reconstruction of the adjacent multi-view enhancement strategy, the spatial and visual consistency is improved, and an aero-engine model is reconstructed; then understanding the reconstructed aero-engine model based on semantic segmentation, identifying and marking core components, and finally performing virtual-real fusion visualization on the reconstructed aero-engine through augmented reality to guide training, assembling and maintenance operations. According to the invention, rapid high-quality three-dimensional reconstruction and augmented reality virtual-real fusion visualization of the aero-engine are realized.
Owner:XI AN JIAOTONG UNIV

Steel structure construction intelligent monitoring method based on unmanned aerial vehicle inspection and point cloud processing

The invention relates to the technical field of constructional engineering, in particular to a steel structure construction intelligent monitoring method based on unmanned aerial vehicle inspection and point cloud processing, which comprises the following steps: S1, collecting point cloud data of geometric shape, size and position information of each part of a steel structure; s2, registering and fusing the point cloud data from different visual angles to form a three-dimensional point cloud model; s3, geometric features of the steel structure are extracted from the three-dimensional point cloud model, and a steel structure three-dimensional model is established; s4, comparing the steel structure three-dimensional model established in the S3 with a construction drawing, and identifying geometric differences; and S5, analyzing the construction deviation report, and identifying potential quality problems in construction. According to the invention, by combining the unmanned aerial vehicle inspection, the point cloud processing and the graph neural network algorithm, the quality problem in steel structure construction can be efficiently and accurately identified, the safety risk can be evaluated, and the automation and intelligence level of construction quality monitoring can be significantly improved.
Owner:中建五局第三建设有限公司

Cutting workpiece defect detection method and system based on image feature feedback

The invention discloses a cut workpiece defect detection method and system based on image feature feedback, and relates to the technical field of image processing.The method comprises the steps that cut workpiece technological characteristics are obtained, a preset defect type library is constructed, a hardware system is built, and parameters are initialized; synchronously acquiring a multi-view original image, and storing and associating annotation information; de-noising the original image, enhancing the contrast, and extracting a region of interest ROI; extracting texture, shape, edge and gray features from the ROI, and screening through a Relief-F algorithm to obtain an optimal feature subset; inputting into an SVM (Support Vector Machine) model for reasoning, and screening to obtain an effective defect detection result; and calculating an evaluation index and generating a feedback signal, and performing iterative optimization after adjusting parameters. The system comprises an acquisition module, a master control module, a data processing module and a display module. Through the precise design and closed-loop feedback of the whole process, the precision, efficiency and long-term adaptability of defect detection of the complex cutting workpiece are improved, and the industrial quality management and control requirements are met.
Owner:苏州艾克夫电子有限公司

Robot-assisted wound treatment method and system based on multi-modal image analysis

The invention provides a multi-modal image analysis-based robot-assisted wound treatment method and system, and relates to the technical field of robots, and the method comprises the steps: collecting a multi-modal image of a to-be-treated wound, determining an image registration result, obtaining a wound region image through a multi-scale fusion algorithm and wound region segmentation, and carrying out the type classification of wound tissues. A wound tissue type classification result is obtained; performing surrounding shooting on a wound area to obtain a wound multi-view image, registering subsequent depth maps frame by frame by taking a first frame of depth map as a reference, accumulating point cloud data, determining a wound three-dimensional point cloud, generating a wound three-dimensional reconstruction result by combining a curved surface evolution algorithm, and determining a wound parameter measurement result; based on the wound tissue type classification result and the wound parameter measurement result, a robot path planning algorithm is adopted, the optimal movement track of the robot is generated, the movement parameters of the robot are adjusted in real time through a robot control algorithm of vision and force feedback, and wound adjuvant therapy is completed.
Owner:THE FIRST MEDICAL CENT CHINESE PLA GENERAL HOSPITAL

Three-dimensional dynamic scene reconstruction method and apparatus, and storage medium

The present disclosure relates to the field of computer vision and discloses a three-dimensional dynamic scene reconstruction method and apparatus, and a storage medium. The three-dimensional dynamic scene reconstruction method comprises: acquiring synchronized videos of a plurality of viewpoints of a dynamic scene; computing matching points between video images of different viewpoints, and estimating intrinsic and extrinsic parameters of each camera; obtaining a Gaussian splatting point set {p0} on the basis of a sparse point cloud constructed according to the depth of each matching point; for the first image frame of each video, using {p0} to perform static training thereon, to obtain a Gaussian splatting point set {p}; for the remaining image frames, dividing {p} into a static point set {S} and a dynamic point set {D}, performing dynamic training on {D}, and constructing a dynamic Gaussian splatting point set {P} from {p}, {S}, and the final {D}; and, in view of the intrinsic and extrinsic parameters of each camera, rendering {P} using a Gaussian splatting rendering pipeline, to obtain rendered images at different moments from new viewpoints.
Owner:TSINGHUA UNIVERSITY

Self-localization and motion perception method and system based on deep learning

The invention relates to a self-localization and motion perception method based on deep learning, and the method comprises the following steps: multi-modal perception: collecting RGB frames and event streams through employing a DAVIS346 event camera, obtaining texture and depth information through employing an RGB-D camera, and supplementing 3D structure data through a laser radar; hybrid optical flow driven motion perception: adopting a double-branch architecture of an improved RAFT network and an event optical flow private network; multi-modal 3D detection and trajectory management: fusing multi-modal data based on VoxelNeXt-Lite to generate a 3D detection frame, filtering false detection by combining point cloud density clustering and an event density threshold, then constructing a space-time diagram associated trajectory through a Spatio-Temporal Graph Transformer, and optimizing pedestrian trajectory prediction continuity by using an LSTM (Long Short Term Memory) model perceived by a gait cycle; multi-view semantic graph matching: constructing a 3D semantic voxel map containing vertical features, calculating scene similarity in combination with top view NetVLAD features and deformable graph matching, and dynamically adjusting semantic weight by using a situation encoder and knowledge graph reasoning; and carrying out multi-sensor fusion and robust positioning.
Owner:JINGCHU UNIV OF TECH

Fabricated retaining wall defect identification method and system based on image identification

The invention relates to the field of earth wall defect recognition, and discloses an assembled retaining wall defect recognition method and system based on image recognition, and the method comprises the steps: obtaining multi-view image data of an assembled retaining wall, and constructing a defect recognition image data set in combination with a boundary detail enhancement mechanism and a region illumination compensation strategy; performing edge guide feature extraction on the defect identification image data set, and constructing an image deep feature model based on a boundary context fusion network; judging whether the response intensity change of the image deep feature model in the crack region reaches a preset threshold value or not through an edge response enhancement mechanism, and if yes, marking that the crack region has potential defects; utilizing a multi-scale morphological structure analysis method to carry out contrast perception optimization on the corrected crack area; and based on a defect identification result, combining a component positioning mechanism and component historical operation and maintenance data to perform severity grading evaluation on the defect. The method has the advantage of improving the sensitivity to the marginal area.
Owner:CHINA CONSTR SECOND ENG BUREAU LTD +1

Image rendering method and device based on Gaussian splashing, equipment, storage medium and program product

The invention discloses an image rendering method and device based on Gaussian splashing, equipment, a storage medium and a program product, and relates to the technical field of computer vision, and the method comprises the steps: obtaining a training image, selecting a reference visual angle of the training image, obtaining the multi-view stereoscopic depth of the training image under the reference visual angle through a multi-view stereoscopic model, and obtaining a multi-view stereoscopic depth of the training image under the reference visual angle; generating a multi-view three-dimensional point cloud through filtering fusion, inputting the multi-view three-dimensional point cloud into a three-dimensional Gaussian splash model, and initializing the model; performing forward mapping and loss calculation on the training image and the multi-view stereo depth to obtain mixed loss of the training image; the loss is returned to the three-dimensional Gaussian splash model, and the model is trained and updated; and giving a target visual angle and camera parameters corresponding to the target visual angle, performing image rendering under the target visual angle through the trained three-dimensional Gaussian splash model, and generating a target image under the target visual angle. According to the invention, through forward mapping, the problem of overfitting under a sparse view angle can be relieved.
Owner:PEKING UNIV SHENZHEN GRADUATE SCHOOL

Digital image calculation method and system for RGB-d camera multi-view matching based on variable template

Disclosed is a digital image calculation method and system for RGB-D camera multi-view matching based on a variable template, the method includes six steps: acquiring data, preprocessing point cloud data, performing feature point matching, re-registering a variable template, calculating point cloud data transformation relationships among large-view images, and performing point cloud fusion. A size of a non-adjacent image matching template is adjusted based on registration results of adjacent angles of view, and correct registration of feature points of images from non-adjacent angles of view is accordingly achieved, which improves matching accuracy, eliminates cumulative errors in image sets, and provides more accurate initial values for subsequent iterations of point cloud fusion, such that the number of iterations is reduced, and three-dimensional reconstruction of images is implemented.
Owner:SOUTHEAST UNIV

Diamond high-strength micro-powder quality detection method and system based on artificial intelligence

The invention relates to the technical field of quality monitoring, and discloses a diamond high-strength micro-powder quality detection method and system based on artificial intelligence. The method comprises the steps of obtaining a two-dimensional projection image sequence of diamond micro-powder particles, calculating a projection matrix based on camera calibration parameters and geometric constraints, obtaining a multi-view image data set of the particles, establishing a pixel-level corresponding relation, extracting three-dimensional space coordinates of the surfaces of the particles, and reconstructing dense point cloud data of the particles. Establishing a local coordinate system based on the dense point cloud data, determining attitude parameters of particles in a three-dimensional space, if the attitude parameters deviate from a normal range, performing attitude compensation processing to obtain standardized point cloud data, and performing three-dimensional grid model construction on the standardized point cloud data; and calculating geometrical characteristic parameters of the particles based on the three-dimensional grid model, performing defect detection on the surfaces of the particles, and generating a crystal integrity evaluation report of the particles. The quality detection accuracy of the diamond high-strength micro-powder particles is improved.
Owner:ZHECHENG HAOXIN SUPERHARD PROD CO LTD

Three-dimensional automatic modeling method for high-precision transformer substation

The invention discloses a three-dimensional automatic modeling method for a high-precision transformer substation. The method comprises the following steps: collecting laser point cloud data and multi-view pictures of the transformer substation; dense point cloud data registration, multi-view image camera parameter reconstruction, multi-view image projection and adaptive point cloud density control are carried out; approximating the point cloud data by using three-dimensional Gaussian distribution functions, summing all the three-dimensional Gaussian distribution functions to obtain a Gaussian distribution geometric field represented by the three-dimensional Gaussian distribution point cloud, and reconstructing and rendering a three-dimensional grid to obtain a three-dimensional grid model; setting constraint conditions of equipment on the basis of the three-dimensional grid model, and generating a three-dimensional equipment model, equipment coordinates and equipment classification names by using a volume segmentation algorithm and a three-dimensional marking algorithm; and converting the equipment model into a GIM model file, generating a PMS file from the equipment coordinate and the equipment classification name, and synchronizing the PMS file to a GIM and PMS 3.0 system. According to the method, the problems of low efficiency and inconsistent quality in the traditional manual modeling process can be effectively solved.
Owner:HUBEI CENT CHINA TECH DEV OF ELECTRIC POWER

Material intelligent transportation and safety monitoring system and method for shield construction

The invention relates to the technical field of tunnel engineering construction, and discloses an intelligent material transportation and safety monitoring system and method for shield construction, and the system comprises a visual perception unit, a sensor network module, an AI analysis center module, a safety decision module and a human-computer interaction interface. According to the invention, data acquisition is carried out through the visual perception unit and the sensor network module, multi-target detection operation is carried out on image frames through the AI analysis center module after target identification and track prediction, target types, space coordinates, contour boundaries and confidence coefficients are identified and extracted, and safety judgment and early warning output are carried out. According to the invention, by integrating the multi-view camera equipment and the UWB, GNSS and other sensors and adopting a deep learning target detection algorithm, high-precision identification and continuous tracking can be carried out on construction site personnel, equipment, segments and other key objects, and accurate input is provided for subsequent risk analysis.
Owner:CHINA RAILWAY 11TH BUREAU GRP CORP LTD +1