496 results about "Panorama" patented technology

The invention discloses a shielding complementing method based on a continuous streetscape panoramic image, and aims to solve the problem of information loss caused by shielding of dynamic objects (such as vehicles and pedestrians) in the existing streetscape image, and the method comprises the following steps: S1, recognizing and positioning a dynamic shielding object area in a continuous streetscape panoramic image sequence; s2, providing a continuous panoramic image-oriented feature extraction and matching algorithm (FDMPano), realizing robust feature retrieval and matching in a cross-view angle, and accurately positioning a reference image region which can be complemented; and S3, carrying out feature alignment and content mapping on the sheltered area based on a matching result, and generating an unsheltered panoramic image with consistent vision. According to the method, the internal relevance of continuous streetscape data is fully utilized, the occlusion area can be automatically completed with high quality, the integrity and availability of streetscape images are remarkably improved, and the method has wide application value in the fields of automatic driving, digital cities, virtual reality and the like.

The invention discloses an iron tower operation safety early warning system and method, and relates to the technical field related to intelligent safety early warning, and the system comprises a data obtaining unit which is used for obtaining Beidou three-dimensional coordinate data and an operation site panoramic image in real time; the operation scene model establishing unit is used for establishing a dynamic three-dimensional operation scene model; the prediction model building unit is used for tracking the motion trail of each operation target based on the coordinate data and building a prediction model fusing kinematics rules and machine learning; and the risk level judgment unit is used for carrying out risk level judgment according to the spatial position and the attribute characteristics of the intersection area and generating operation early warning information. The technical problems of insufficient safety early warning accuracy and timeliness caused by insufficient high-altitude operation target dynamic track monitoring precision and risk early warning lagging in the prior art are solved, and the purposes of accurately identifying the movement track intersection risk in real time, dynamically evaluating the safety level and improving the safety early warning efficiency are achieved. And the early warning accuracy and timeliness of the operation safety of the iron tower are improved.

The invention belongs to the technical field of visual angle follow-up vehicle panoramic look-around, and particularly relates to a visual angle follow-up vehicle panoramic look-around system based on dynamic prediction, which is characterized in that monocular vision and laser radar time sequence data are fused, and a dense and stable dynamic target depth sequence is generated through dynamic target initial perception, cross-modal time sequence alignment and inter-frame depth correlation modeling; through environment interaction modeling and target behavior intention prediction double-branch parallel processing, a dynamic self-adaptive accurate track is output in combination with a weighted fusion strategy, and the prediction weight dynamic adjustment requirement of a complex motion scene is adapted; after a virtual view angle image is preliminarily synthesized based on the predicted trajectory, deviation detection and coordinate dynamic correction are realized through inter-frame target consistency verification, and artifact area positioning and pixel-level restoration are synchronously completed; multi-modal preprocessing and algorithm tasks are deployed according to hardware, and a model lightweight optimization and inter-frame prediction result multiplexing strategy is combined, so that low-delay operation of the system in a high-resolution panoramic image output scene is ensured.

The invention discloses a road culvert inner wall damage image detection and traffic capacity evaluation method and system, and relates to the technical field of road engineering detection and computer vision, and the method comprises the steps: collecting multi-source data through an annular camera, a laser section scanner and a mileage encoder carried by a detection robot, and carrying out the panoramic expansion and time-space registration; using a multi-scale attention panoramic segmentation network to identify damages such as lining cracks, joint slab staggering, damage and chipping, steel bar exposure and water leakage; calculating the clearance size and the deposition thickness of the culvert by adopting an ellipse fitting method; according to the method, the culvert detection speed reaches 50 m / h, and the damage detection accuracy reaches 89% or above.

The invention relates to the technical field of three-dimensional Gaussian scene watermarking, in particular to a panoramic watermark processing method and device for a three-dimensional Gaussian scene, equipment and a medium. Determining the parameter sensitivity of each first Gaussian unit; screening a second Gaussian unit of which the corresponding parameter sensitivity is greater than a preset parameter sensitivity threshold from all the first Gaussian units; and embedding the copyright message in the second Gaussian unit in the three-dimensional Gaussian scene, thereby completing the embedding operation of the panoramic watermark. According to the embodiment of the invention, the parameter sensitivity of the first Gaussian unit is estimated through the two-dimensional original image and the first rendered image of different visual angles, so that the geometric structure characteristics of the three-dimensional scene are considered when the watermark is embedded, and the watermark information distortion is avoided.

The invention discloses a camera-based human body three-dimensional reconstruction method and system, and the method comprises the steps: collecting the multi-source data of an operation scene, generating a time-space correlation data set, carrying out the processing, and outputting a spliced panoramic image and six virtual visual angle plane images; processing the six virtual view angle plane images, the space-time association data set and internal and external parameters of the double-fisheye camera, and outputting an optimal view angle combination and an optimal view angle image corresponding to the optimal view angle combination; and finally, a continuous and complete human body three-dimensional point cloud model is generated and processed, a cooperative control instruction is output, and the point cloud is continuously updated. The method has the advantages of data collaborative elimination of blind areas, accurate reconstruction and good control effect.

The invention discloses a method for realizing intelligent sag measurement of a power transmission line by using a binocular depth camera, which comprises the following steps of: firstly, fixing the binocular camera on a rotary holder at the central position of two towers to complete camera calibration and epipolar correction; then, controlling the holder to rotate according to a fixed stepping angle, collecting a binocular image sequence covering the whole section of lead, and preprocessing the binocular image sequence; performing feature matching and image splicing by using an SIFT algorithm based on the left eye image sequence to generate a panorama and establish a panorama-local mapping relationship; thirdly, detecting an insulator and a spacer target in the panorama based on a Mask-RCNN model, accurately positioning key point coordinates of the insulator and the spacer target, and mapping the key point coordinates to an original local image; in the corresponding left and right local images, a semi-global matching (SGM) algorithm is adopted to calculate parallax and generate depth information, and then three-dimensional coordinates of a target point are obtained through conversion; and finally, performing catenary fitting according to the ordered three-dimensional point set, introducing a temperature and windage yaw dynamic correction model, and accurately calculating a sag value. According to the invention, non-contact, automatic and high-precision sag measurement is realized, the method is suitable for routing inspection of complex terrains and large-span power transmission lines, and the operation safety and efficiency are remarkably improved. The invention also provides a system, equipment and a medium for realizing the method.

An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene. The image capture device captures, while pointed in the second direction, a plurality of images at different exposures in a second FOV that overlaps the first FOV of the 360-degree scene. The depth information capture device and the image capture device are rotated by the drive train about the first axis from the second direction to a third direction. The depth information capture device, while being rotated from the second direction to the third direction, captures depth information for a second portion of the 360-degree scene. The image capture device, while pointed in the third direction, captures a plurality of images at different exposures in a third FOV that overlaps the second FOV of the 360-degree scene.

The invention provides a multi-view panoramic image indoor layout prediction method fusing semantics and planarity. The method comprises the following steps: step 1, carrying out three-dimensional semantic segmentation combined with three-dimensional point cloud reconstruction and a multi-view geometry and two-dimensional segmentation large model; step 2, obtaining a pure structured point cloud; step 3, multi-plane detection and classification; 4, extracting an initial contour; 5, generating a wall line based on plane fitting; step 6, performing multi-label graph segmentation guided by the two-dimensional contour and the wall surface; step 7, extracting a non-Manhattan ceiling line; and step 8, stretching the two-dimensional wall line along the vertical direction on the basis of the contour of the dimensional plane graph in combination with the vertical height of the room, generating an intersection line of the wall surface and the ceiling and an intersection line of the wall surface and the ground, and finally outputting a complete indoor three-dimensional vectorization layout model. According to the method, the layout integrity of the complex scene is improved, the boundary recovery precision of the occlusion area is improved compared with that of a traditional projection method, and the detection accuracy is improved by matching with multi-model RANSAC plane detection.

The invention discloses a panoramic situation awareness and early warning method, system, equipment and medium for real-time interaction between an optical storage and charging micro-grid and a power distribution network, and belongs to the technical field of situation awareness and early warning, and the method comprises the steps: building a data collection network covering the optical storage and charging micro-grid and the power distribution network, obtaining electrical quantity, environmental quantity and equipment state information, carrying out the preprocessing of the data, and carrying out the early warning of the real-time interaction of the optical storage and charging micro-grid and the power distribution network; pre-processed multi-source data is obtained; inputting the multi-source preprocessed data into an improved Kalman filtering algorithm to obtain fused state data; constructing a panoramic situation vector of the optical storage and charging microgrid and the power distribution network based on the fused state data, and obtaining a situation assessment result; inputting the situation assessment result into a hybrid prediction model composed of a long short-term memory network and a Bayesian network to generate a risk assessment result; constructing a multi-objective optimization model according to a risk assessment result, and outputting an intervention control signal; and performing operation monitoring and feedback updating based on the intervention control signal. According to the invention, the accuracy and real-time performance of situation identification are improved.

The invention discloses an SCRM customer intelligent portraying system and method based on multi-source data, and the system comprises a multi-source data collection and integration module which is used for collecting and cleaning the internal and external multi-source data of an enterprise; the client dynamic label engine is used for generating labels based on business rules and calculating dynamic weights based on data sources and recency; the client intelligent portrait generation and updating module generates a unified portrait through a multi-dimensional portrait model and a portrait fusion device and tracks version evolution; the interactive portrait application and feedback module provides visual display, intelligent early warning and strategy reaching functions and optimizes a label rule through a feedback closed loop; according to the method, internal and external multi-source data of an enterprise are integrated and uniformly coded, so that a data island phenomenon is broken, a multi-dimensional portrait model covering basic identities, transaction values, social behaviors and dynamic intentions is constructed, and a uniform customer panoramic view is formed.

The invention discloses a ship spherical global image splicing method and system based on image processing, and the method comprises the following steps: obtaining multi-camera images which are distributed at the top, the bottom and the annular direction, and executing camera calibration and distortion correction; performing hemispherical projection and cylindrical projection by using a hybrid projection link; feature point extraction and matching are carried out, and an initial registration relation between adjacent view fields is established; executing APAP gridding local registration of projection perception, and generating local homography by applying an anisotropic weight kernel consistent with the region projection direction to obtain a partition alignment result set; carrying out weighted fusion and stitching suppression on the overlapped region to generate a panoramic spliced image; and converting the panoramic spliced image into an interactive three-dimensional panoramic view. According to the method, mixed projection and projection perception APAP algorithms are fused, ship spherical surface global high-precision splicing and three-dimensional immersion display are achieved, and the method has the advantages of being small in distortion, high in precision and high in visibility.

The invention belongs to the technical field of computer vision and digital media, and discloses a dome-screen film production method and system based on a high-altitude aerial image. Projecting the multi-view aerial video sequence to a unified spherical coordinate system, and constructing a panoramic space with an overlapping region; performing non-rigid geometric deformation processing on the overlapping region of the panoramic space to generate an intermediate image with aligned pixels; calculating the fusion cost of each pixel point in the overlapping region in the intermediate image, and performing path search based on the fusion cost of each pixel point to generate a dynamic suture line; generating an image mask based on the dynamic suture line, performing multi-scale frequency domain adaptive fusion on the intermediate image by using the image mask to generate a fused panoramic image, and remapping the fused panoramic image into a projection format adaptive to dome screen playing to output; and the real reducibility and the manufacturing quality of the dome film are greatly improved.

The invention discloses a virtual reality roaming method and system based on a multi-view panoramic image model, and belongs to the technical field of computer vision and virtual reality. Through a multi-viewpoint panoramic image set, real-time generation of a high-quality panoramic image from a known viewpoint to any unknown viewpoint is realized based on a spherical projection viewpoint transformation algorithm. Modeling generation methods for a road scene and a region scene are respectively designed according to scene feature differences, so that scene representation with complete coverage is constructed. According to the system, adjacent viewpoints are quickly positioned through a spatial index mechanism, geometric mapping and multi-viewpoint weighted fusion are performed by using the spherical projection algorithm, and a smooth and continuous free viewpoint roaming picture is rendered in a virtual reality environment. According to the method, on the premise of ensuring high fidelity of the scene, real-time rendering is realized on common consumption-level hardware, and the coherence and the degree of freedom of immersive interactive experience are improved.

The invention discloses a dynamic shelter restoration method and system based on continuous streetscape panoramic images, and the method comprises the steps: firstly obtaining a to-be-restored target panoramic image A and a to-be-restored reference panoramic image B, and generating an original pixel-level shelter mask; secondly, extracting matching points among the panoramic images, realizing cross-view geometric alignment of the images, and obtaining a target perspective view C and a reference perspective view D through perspective re-projection; and then inputting the target perspective view C and the reference perspective view D into a three-dimensional reconstruction framework, and performing three-dimensional point cloud reimaging under the camera pose of the target perspective view C by using a depth inspection mechanism. And finally, carrying out image restoration on a three-dimensional point cloud re-imaging result, restoring to a panoramic coordinate system, splicing with an original panoramic image, and outputting a shielding-free panoramic image. According to the method, it is ensured that the repairing result conforms to the authenticity and geometric consistency of the geographic space, and the problems of overlapping conflicts and visual tearing during multi-view projection fusion are effectively solved.

The invention provides a panoramic fusion and AI change monitoring method and system based on a video image, and belongs to the technical field of computer vision and geographic information processing.The method comprises the steps that firstly, a road network, land data and a double-spectrum video of a target area are obtained, and a double-spectrum panoramic image is generated through cradle head posture correction fusion; secondly, constructing a road network plot topological graph, generating a space risk probability matrix by using a space-time diagram neural network, and generating semantic masks in combination with land categories; then, performing weighted product operation on the risk probability, the semantic mask and the infrared and visible light features of the panorama to generate an enhanced feature matrix; and finally, comparing the characteristic matrixes in historical periods to calculate differential distribution, and locking an area exceeding a threshold value as a target change area, thereby realizing accurate monitoring based on spatial-temporal logic driving. According to the method, adaptive weighted sensing of high-risk area changes can be realized, and the problems of false alarm and missing alarm caused by traditional full-graph unified threshold monitoring are effectively solved.

The invention discloses an obstacle distance measurement method and system based on panoramic tiled display. Four-way or six-way fisheye cameras are installed on a vehicle, images around a vehicle body are collected, 3D rendering splicing is carried out based on calibration data (internal parameters / external parameters), and a 360-degree panoramic aerial view image is generated. A user clicks two points of a screen through a display terminal, a system converts screen coordinates into 3D normalized vertex coordinates through viewport inverse transformation, relative coordinate differences are calculated and then expanded into homogeneous coordinates, the homogeneous coordinates are converted into physical coordinate differences in combination with a pre-stored rendering transformation matrix inverse matrix (generated by model / projection / view transformation combination), and the 3D normalized vertex coordinates are converted into 3D normalized vertex coordinates. And finally calculating the actual physical distance between the two points. The system supports dynamic refreshing of a ranging result and renders a distance marking line on a panoramic image. According to the method, through multi-camera calibration, coordinate space mapping and a matrix transformation algorithm, interactive obstacle distance measurement in a vehicle-mounted panoramic display scene is realized, and the method is suitable for intelligent driving, vehicle auxiliary driving and other scenes.

The invention belongs to the field of panoramic stitching digital image processing technologies and camera ISP technologies, and particularly relates to a chromatic aberration consistency control method based on front and rear end collaboration. The method comprises the following steps: 1, acquiring statistical information of multiple cameras; step 2, acquiring a current camera control parameter by adopting a front-end chromatic aberration consistency adjustment algorithm; 3, the current camera control parameters are issued to all the cameras, and all the cameras complete exposure imaging according to the current camera control parameters; step 4, acquiring an overlapped part image in each path of camera imaging; step 5, calculating a statistical histogram cumulative distribution function of overlapped part images in each path of camera imaging; step 6, calculating a histogram matching function according to the cumulative distribution function of the overlapped part images in each path of overlapped camera imaging, so that the histograms of the overlapped parts of the two images tend to be consistent; and step 7, according to the obtained histogram matching function, transforming the brightness channel of each pixel in the corresponding camera imaging to complete color difference consistency correction.

This application relates to the field of cargo stacking technology and discloses a cargo stack filling method and system based on image recognition. The method includes: acquiring panoramic images of cargo storage space using a drone equipped with a high-resolution camera; extracting cargo stack images using a deep learning model after image preprocessing, obtaining their main color tone, and generating an enhanced image with complementary color boundary lines; detecting stacking edges between goods based on boundary lines, and identifying the type, size, shape, and position of the goods; optimizing the stacking order by combining storage space size and filling strategy to formulate the best cargo stack filling scheme; calculating the remaining space based on real-time filling images, dynamically adjusting the scheme, and outputting the results through a visualization device. This application solves the problems of low space utilization, low manual efficiency, and poor stacking stability in traditional cargo stacking, and improves the utilization rate of warehouse space and the accuracy of operations.

The invention discloses a method, a system, a medium and equipment for panoramic display of underground facilities, and belongs to the technical field of augmented reality visualization. The method comprises the following steps: real picture data of a real camera in a target area is acquired in real time, and the real picture data of the real camera are acquired based on pose data of the real camera; synchronously adjusting the pose state of a virtual camera configured in the fused three-dimensional model; wherein the fused three-dimensional model is obtained by performing space alignment based on an underground facility three-dimensional model and a ground three-dimensional model; according to the pose state, performing perspective projection rendering and image matting processing on the fused three-dimensional model to obtain an underground facility image only containing a view angle corresponding to the current pose state; and carrying out picture fusion on the real picture data and the underground facility image to obtain a virtual-real fused perspective image, and displaying the virtual-real fused perspective image. By implementing the method and the device, the problem that the underground facility shielded by the ground cannot be accurately and stably displayed in a real-time picture of a common camera in the prior art can be solved.

This application provides a 3D reconstruction method, apparatus, device, and readable storage medium. An electronic device acquires multiple first images, each containing the background of a target scene and dynamic objects within that scene, with the sum of these first images capable of displaying a panoramic view of the target scene. The electronic device then performs masking processing on the regions containing dynamic objects in each of the first images to obtain an image set. Based on this image set, the background of the target scene is reconstructed to obtain a background point cloud, which is then used to generate a 3D reconstruction result of the target scene. This approach, by masking the regions containing dynamic objects in the first images of the target scene, eliminates the influence of feature point extraction and matching results on 3D coordinate estimation and camera extrinsic parameter estimation, ensuring successful reconstruction of the background point cloud of the target scene. This improves the success rate of 3D reconstruction and enhances the immersive conferencing experience.

The invention belongs to the technical field of intelligent equipment, and particularly relates to four-camera AI intelligent glasses which comprise a glasses frame, glasses legs, and a first camera and a second camera which are used for shooting original images, and further comprise built-in chips installed in the glasses legs, and the built-in chips comprise data input interfaces which are used for connecting the first camera and the second camera; the encoder extracts a first feature in the original image through a CNN (Convolutional Neural Network); the aggregation module is used for aggregating the first features through an attention mechanism and outputting global features; the first decoder is used for aggregating into a panoramic image according to the global features in combination with the spatial tensor; and the angle correction module is used for monitoring the bending angle of the glasses leg. According to the invention, after a plurality of angle images are acquired by different cameras, time alignment is carried out to synthesize the panoramic image, different decoders are learned to be configured for the different angle images to realize adaptive updating, and an alarm is given when deformation reaches a fatigue limit or a bending angle limit.

The application relates to a holographic image-based surgical auxiliary system, wherein an image recognition and ranging module is used for capturing panoramic images and obtaining relative position parameter information between each system specified point; a projection mechanism in an imaging glasses module is used for mapping a human body perspective image and the relative position parameter information between each system specified point to a lens on a glasses body; a visual angle image capturing mechanism is used for capturing a visual angle picture of the glasses body; and a master control module is used for adjusting the position and size of the human body perspective image projected to the lens by the projection mechanism in real time according to the panoramic images, the visual angle picture and the relative position parameter information between each system specified point, so as to ensure that the human body perspective image presented on the lens and the corresponding human body structure can be kept coincident in real time. The holographic image-based surgical auxiliary system has the characteristics of convenient operation, good practicability and effective assistance for precise implementation of surgery.

The embodiment of the invention provides a panoramic image processing method and device, equipment, a medium and a program product. The method comprises the following steps: acquiring a viewpoint coordinate corresponding to a panoramic image to be displayed, and determining a view coverage area in the panoramic image according to the viewpoint coordinate; a preset angle is obtained, a sampling area in the panoramic image is generated according to the preset angle and the view coverage area, and the similarity between the shape of the sampling area and the shape of the view coverage area meets a preset threshold value; and acquiring pixels in the sampling area according to a target resolution to obtain a target image corresponding to the panoramic image. According to the technical scheme, the sampling area is determined based on the viewpoint coordinates, the sampling area is sampled according to the target resolution, the target image meeting the watching expectation can be obtained, the target image replaces the panoramic image for transmission, and bandwidth consumption is reduced.

The application provides a pinhole image splicing true value acquisition and splicing method based on a heterogeneous camera combination. The acquisition method first symmetrically installs two pinhole cameras on a support, and installs an fisheye camera between the two pinhole cameras. Based on a double spherical camera model, the three cameras are calibrated to obtain the internal parameters and external parameters of the three cameras. The left eye pinhole view, the right eye pinhole view and the middle eye fisheye view of the target scene are simultaneously acquired by using the three cameras. The middle eye fisheye view is subjected to equirectangular projection. According to the internal parameters and external parameters of the three cameras, the left eye pinhole view and the right eye pinhole view are projected to the equirectangular projection view plane respectively, multi-camera coordinate system one is completed, and the splicing true value is obtained. The application has the core advantages of the hardware structure design and the heterogeneous camera image registration algorithm, can stably acquire images without seams and time sequence consistency, and provides strong support for the true value reference of the precision verification and model training of subsequent panoramic video splicing.

The invention discloses a target tracking method, electronic equipment and a storage medium. A panoramic image of a current application scene is collected by a first camera, a plurality of candidate targets in the scene are obtained through target detection, and a to-be-tracked target is automatically determined in combination with a recognition result of interaction actions of the candidate targets; and mapping the position of the to-be-tracked target in the panoramic image to a shooting coordinate system of the close-up camera based on double-shooting calibration information between the first camera and the second camera, driving the close-up camera to actively adjust the shooting direction, enabling the to-be-tracked target to quickly enter a shooting view field of the to-be-tracked target, and executing target tracking on the basis. According to the invention, the interaction target can be accurately selected from the panoramic view angle and can be stably and quickly switched to the close-up camera for continuous tracking, automatic switching of the target to be tracked from panoramic perception to close-up tracking is realized, the stability and continuity of the close-up tracking process are improved, and the tracking efficiency is improved. And the application requirements of intelligent shooting and automatic tracking in different scenes are met.

1. The name of the design product: night vision device (Goshawk). 2. The use of the design product: outdoor military and civilian dual-use light-weight panoramic low-light night vision device with upturning and side folding functions. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective drawing.

1. The name of the design product: micro-pressure oxygen cabin (high-transparency panoramic multifunctional sound insulation). 2. The use of the design product: for health conditioning, fatigue recovery, postoperative rehabilitation and high altitude reaction relief. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view. 5. Other circumstances that need to be explained: the A part is transparent material.

A power control system (1) is provided with: a panoramic camera (510) that detects objects around a power cable (200) that supplies power to an electric shovel (100) that operates using power; and an object detection calculator (520) that restricts the power supplied to the electric shovel (100) when the distance between the object detected by the panoramic camera (510) and the power cable (200) is within a predetermined range. As a result, it is possible to provide a power control system and a power control method capable of suppressing contact between an object and a power cable and enabling a work machine to operate more safely.