Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

653 results about "Stereopsis" patented technology

Stereopsis (from the Greek στερεο- stereo- meaning "solid", and ὄψις opsis, "appearance, sight") is a term that is most often used to refer to the perception of depth and 3-dimensional structure obtained on the basis of visual information deriving from two eyes by individuals with normally developed binocular vision. Because the eyes of humans, and many animals, are located at different lateral positions on the head, binocular vision results in two slightly different images projected to the retinas of the eyes. The differences are mainly in the relative horizontal position of objects in the two images. These positional differences are referred to as horizontal disparities or, more generally, binocular disparities. Disparities are processed in the visual cortex of the brain to yield depth perception. While binocular disparities are naturally present when viewing a real 3-dimensional scene with two eyes, they can also be simulated by artificially presenting two different images separately to each eye using a method called stereoscopy. The perception of depth in such cases is also referred to as "stereoscopic depth".

Concrete working performance measurement method and system based on multi-modal visual large model

The invention relates to a concrete working performance measurement method and system based on a multi-modal visual large model, and solves the problem that rapid detection of concrete working performance parameters is troublesome, and the method comprises the steps: based on the spatial semantic understanding capability of the multi-modal visual large model, combining a multi-view stereoscopic vision and structured light scanning technology, and calculating the working performance of concrete; reconstructing a three-dimensional geometric structure of the concrete slurry, extracting morphological characteristic parameters, and forming characteristic vectors; inputting the feature vectors into a pre-trained multi-task neural network, fusing the spatial-temporal features and combining a rheological algorithm to identify various working performance parameters; integrating identification results for at least three times by adopting integrated learning, and verifying parameters based on a fluid dynamics basic equation through a fluid simulation platform; and based on the verification result, generating a mix proportion optimization suggestion containing the material components. The method has the advantages that non-contact rapid measurement of concrete working performance parameters is achieved, precision and efficiency are improved, and mix proportion optimization suggestions are provided.
Owner:SHENZHEN UNIV

Control method and system for precise landing of unmanned aerial vehicle

A control method and system for precise landing of an unmanned aerial vehicle. The method comprises the following steps: on the basis of a multi-sensor fusion technique, using a lidar and a stereo vision algorithm to collect environmental data and perform primary processing, and generating comprehensive environmental perception data (step S1); on the basis of the comprehensive environmental perception data, using a digital elevation model algorithm to re-construct a three-dimensional terrain of a landing area, and generating a three-dimensional terrain model (step S2); on the basis of the three-dimensional terrain model, using an A* search path-planning algorithm to perform risk assessment and plan a safe landing path, and generating an optimized landing path (step S3); on the basis of the optimized landing path, using an adaptive control algorithm to adjust a flight attitude in real time by means of a fuzzy logic controller, and generating flight parameter adjustment (step S4); on the basis of the flight parameter adjustment, using machine vision and a decision tree algorithm to execute autonomous obstacle avoidance and emergency response, and generating a safe landing execution scheme (step S5); and on the basis of the safe landing execution scheme, using an ultrasonic sensor and a ground feedback system to confirm and fine-adjust a landing point, and completing final landing confirmation (step S6).
Owner:GUANGDONG VISION FIELD ROBOTIC TECH CO LTD

Automobile spoiler manipulator polishing system and polishing method

The invention relates to the field of grinding and polishing, in particular to an automobile spoiler mechanical arm grinding system and method.The automobile spoiler mechanical arm grinding system comprises a path planning module, a state monitoring module, a parameter compensation module and a waste collecting module which are in communication connection, and the path planning module is used for scanning a spoiler in real time through a visual sensor and dynamically adjusting a grinding path; the visual sensor is a 3D structured light sensor or a stereoscopic visual camera; the state monitoring module is used for monitoring the vibration state of the grinding head in real time through the vibration sensor and obtaining vibration abnormal data. The parameter compensation module is used for automatically adjusting grinding parameters according to the abnormal vibration data and adjusting a grinding head for grinding; the waste collecting module is used for collecting and treating dust and waste generated in the polishing process in a centralized mode. The polishing path can be precisely planned, the polishing quality is improved, the production efficiency is improved, the cost is reduced, and dust and waste materials are effectively treated.
Owner:DONGGUAN GOLDEN SUN PRECISION TECH CO LTD

Control method of operation type intelligent foot robot applied to electric power inspection

The invention discloses a control method of an operation type intelligent foot-type robot applied to electric power inspection, and relates to the technical field of electric power inspection robots, and the method comprises the following steps: carrying out the omnibearing scanning and detection of a surrounding environment based on a multi-mode sensor carried by the foot-type robot, so as to collect environment data, and carrying out the fusion of the collected environment data, wherein the multi-mode sensor comprises a front stereoscopic vision sensor, a rear stereoscopic vision sensor and a three-dimensional solid laser radar. Through the carried multi-mode sensor, all-directional scanning and detection of electric power facilities and the autonomous navigation capability of the robot are realized, and the SLAM technology is combined, so that the robot can carry out effective path planning and autonomous inspection in an unknown environment, collision between the robot and an obstacle is avoided, the damage risk is reduced, and the safety of the robot is improved. And the dependence on manpower is reduced, the inspection range is expanded, and the continuity and integrity of inspection are ensured.
Owner:ZHONGNENG XINGSHENG (XIANGHE) ELECTROMECHANICAL EQUIP CO LTD

Automatic loading method for truck based on deep learning and stereoscopic vision

The invention discloses an automatic loading method for a truck based on deep learning and stereoscopic vision. The automatic loading method comprises the following steps that S1, goods location pixel coordinates are obtained and converted into an AGV forklift coordinate system; s2, a driving track is calculated, a front station is generated, and the AGV forklift is guided to move; s3, collecting point cloud data, denoising, extracting features by adopting an improved Transform point cloud registration network, calculating three-dimensional feature points of goods locations and trays, and converting coordinates; s4, calculating a rotation adjustment amount and a displacement compensation parameter, optimizing a driving track and correcting a butt joint deviation; s5, adopting a self-adaptive local attention weighting strategy to match the target goods allocation with the tray slot, and correcting the pose; s6, the cargo stacking posture is adjusted, gravity center distribution is optimized, and the AGV forklift is controlled to complete cargo loading; and S7, exiting the loading area along the optimized track, recording data and optimizing a loading strategy. The goods allocation identification precision is improved, the loading path is optimized, manual intervention is reduced, the loading efficiency, stability and adaptability are improved, and the logistics automation level is enhanced.
Owner:HEFEI POLE THINK TANK INTELLIGENT EQUIP CO LTD

Self-adaptive teaching-free welding robot intelligent gas saving monitoring system

The invention provides a self-adaptive teaching-free welding robot intelligent gas saving monitoring system, which relates to the technical field of industrial robots, and comprises a three-dimensional sensing module used for identifying the workpiece material category through a multispectral sensor integrated with a welding gun of a welding robot, meanwhile, a stereoscopic vision camera and a line structure light scanning camera are used for obtaining three-dimensional point cloud data of the welding seam in real time; the parameter adjusting module is used for calling a heat conductivity coefficient database based on the three-dimensional point cloud data, and correcting the initial flow of the welding current, the arc voltage and the protective gas in real time; and the matching control module is used for calculating the arc length variable quantity based on the arc voltage, controlling the opening degree of the gas flow valve through a dynamic regulator, realizing dynamic matching of the gas flow and the changed arc length, and generating gas dynamic matching control parameters. Through cooperative operation of self-adaptive attitude compensation and real-time gas consumption monitoring, teaching-free accurate operation in the welding process is achieved, and intelligent control over gas consumption is improved.
Owner:福建明鑫机器人科技有限公司

Robust autonomous navigation and obstacle avoidance method for underwater detection robot

The invention discloses a robust autonomous navigation and obstacle avoidance method for an underwater detection robot, and relates to the technical field of underground space intelligent identification and navigation.The method comprises the steps that through the multi-sensor fusion technology, a three-dimensional point cloud data set and a depth image data set of an underground environment are synchronously collected through a sonar and a stereoscopic vision system; the method comprises the following steps: constructing original geometric morphology data of an underground space, providing basic information for subsequent data processing, constructing a dynamic updating mechanism according to an initial navigation path data set, monitoring underground environment change and structural state through real-time sensor data, and regularly updating risk level values. If the risk level change exceeds a preset range, triggering path recalculation to ensure adaptation to underground environment change; the robust autonomous navigation and obstacle avoidance method of the underwater detection robot has important application value in underground engineering fields such as mines and tunnels, and provides technical support for intelligent management and safe operation of underground space.
Owner:TIANFU YONGXING LAB

Four-eye structured light stereoscopic vision imaging method

The invention relates to the technical field of three-dimensional imaging, in particular to a four-eye structured light stereoscopic vision imaging method, which comprises the following steps of: arranging four cameras and synchronously acquiring multi-view image data with structured light stripes; carrying out image preprocessing and stripe code identification on the obtained four-view-angle structured light image data, and extracting structured light stripe center line positions and corresponding space projection information under each view angle; generating three-dimensional point cloud data of the high-precision target sample by using parallax calculation and a three-dimensional reconstruction algorithm, and completing spatial registration and filtering optimization of point cloud; fusing the point cloud and the light intensity data by combining the reflection intensity information of the multi-view structured light stripes to generate a composite data set containing space and spectral information; and constructing a dense parallax field and executing three-dimensional consistency verification, and generating a high-fidelity three-dimensional reconstruction model with a complete topological relation and sparse shielding compensation capability. According to the invention, the problems of insufficient view angle coverage, shielding area information loss, difficult edge structure matching and the like of traditional stereoscopic vision imaging can be solved.
Owner:CHAOLIAN AUTOMATION (SUZHOU) CO LTD

Monocular vision pose measurement method and system based on circular characteristic target spot

The invention discloses a monocular vision pose measurement method and system based on a circular feature target spot, and the method comprises the following steps: camera calibration, image collection, image preprocessing, and feature point detection and matching: employing Hough circle detection to extract the center two-dimensional pixel coordinate and radius of the circular feature target spot, obtaining a uniquely determined relationship between the feature target spots according to the circle center coordinates and the radius information; performing pose measurement, and obtaining a rotation matrix R and a translation vector T which are converted from a target coordinate system in each collected pose image to a camera coordinate system according to a PnP algorithm; and solving the relative pose. According to the method, a specially designed cooperative target containing five circular characteristic target spots is used as a target object, and a rapid detection algorithm realized according to target characteristics is combined, so that circle center matching sorting is realized, and the precision is improved. The method has the advantages of being simple in structure, simple in camera calibration, large in measurement view field, high in real-time performance and the like, and meanwhile the defects that the view field is small and stereo matching is difficult in stereo vision are overcome.
Owner:SHANGHAI INST OF TECH

Depth estimation method based on adaptive structured light

The invention belongs to the technical field of stereoscopic vision, and discloses a depth estimation method based on adaptive structured light. The method comprises the following steps: acquiring a camera visual angle RGB image in a scene that a projector is turned off, acquiring a camera visual angle coarse disparity map through a semi-global matching algorithm, generating a projector visual angle RGB image and a projector visual angle coarse disparity map through projection transformation, and inputting the images into an adaptive structured light generation module to generate an adaptive structured light projection pattern; the adaptive structured light projection pattern generates a camera visual angle structured light image through a physical perception differentiable imaging module; the parallax attention depth estimation module receives the camera visual angle RGB image and the camera visual angle structured light image and outputs a depth estimation result; and taking the depth error as a loss function, jointly training and optimizing the adaptive structured light generation module and the parallax attention depth estimation module, and performing depth estimation after optimization. The optimal structured light mode is dynamically generated according to the real-time information of the scene, and the problem that traditional fixed-mode structured light cannot adapt to scene changes is solved.
Owner:NORTHEASTERN UNIV CHINA

Wheel-foot robot

PendingCN119284001AIncrease working heightmove quicklyVehiclesArtificial general intelligenceWhole body
The invention discloses a wheel-foot robot, and relates to the technical field of robots, the wheel-foot robot comprises a head and neck assembly, a trunk assembly, two groups of upper limb assemblies, two groups of lower limb assemblies and two groups of wheel-foot moving bases, the wheel-foot robot is provided with stereoscopic vision, can sense the environment and recognize human beings, and two hands cooperatively execute operation tasks; precise torque sensors in the arm joints facilitate safe and sensitive interaction when physically cooperating with humans. The trunk is telescopic, and the working height can be increased. The whole robot has more than twenty degrees of freedom, has the movement functions of fast movement, agile obstacle avoidance, steady uphill and downhill, impact interference resistance and the like, is an ideal carrier for general artificial intelligence, and when the robot works in place, the jacking mechanism at the bottom of the wheel foot base can support the robot body, so that the robot can bear high-load or high-dynamic operation. The robot can be switched among a plurality of modes which are not limited to standing, squatting, moving and the like, and is suitable for a plurality of application scenes.
Owner:MALIBO (SHANGHAI) ROBOT CO LTD

Automatic weld joint alignment tolerance detection method fusing point cloud and image segmentation

The invention relates to the technical field of weld joint alignment tolerance detection of special equipment, spaceflight, bridges, ships, wind power and the like, such as containers, pipelines, boilers, recreation facilities, hoisting machinery, passenger ropeways and the like. The invention discloses an automatic weld joint alignment tolerance detection method fusing point cloud and image segmentation, which can quickly and accurately measure the alignment tolerance of a weld joint by combining binocular stereoscopic vision, AI and point cloud analysis technologies, and make up for the defects of the traditional detection method in efficiency and accuracy. The method comprises the following specific steps: shooting through a binocular structured light camera to obtain a grey-scale image and a point cloud image which are aligned; segmenting a welding seam on the grey-scale map, generating a position area mask according to the segmented welding seam, and dividing the actual object into an upper welding seam area, a welding seam area and a lower welding seam area; and according to the segmented welding seam, a welding seam boundary mask is extracted, the position mask and the boundary mask are mapped to a point cloud picture, and regional point cloud data and boundaries are obtained.
Owner:ANGELI (CHENGDU) INSTR CO LTD

Underwater concrete three-dimensional reconstruction method and system based on fusion of linear structured light and stereoscopic vision

The invention relates to the technical field of underwater concrete three-dimensional reconstruction, in particular to an underwater concrete three-dimensional reconstruction method and system based on linear structured light and stereoscopic vision fusion. The method comprises the steps of obtaining a depth map and a texture map of underwater concrete based on a line structured light module and a stereoscopic vision module, and obtaining a preliminary depth data sequence and a surface texture sequence; performing environment compensation and image enhancement on the depth data and the texture data to generate data after environment correction; based on the corrected data, performing registration and matching on the depth and texture data by using a multi-modal fusion algorithm to generate a fusion point cloud data model; motion compensation and deformation repair are carried out on the point cloud model, deformation and structure offset caused by water flow are corrected, and a repaired point cloud model is generated; the repaired point cloud is input into a three-dimensional model reconstruction engine, a high-precision underwater concrete three-dimensional model is generated, intelligent analysis is conducted on the surface of the model, and damage and structural integrity of the model are evaluated. The underwater concrete three-dimensional reconstruction method effectively improves the precision of underwater concrete three-dimensional reconstruction, solves the problem of model distortion in complex environments such as water flow and turbid water quality, and has efficient and accurate structure detection and maintenance functions.
Owner:JIALING RIVER TINGZIKOU WATER RESOURCES & HYDROPOWER DEV +1

Machine vision-based method for measuring distance between cross positions of carrier cables of rail contact network

The invention discloses a method and a system for measuring the distance between cross positions of carrier cables of a rail contact network based on machine vision, and relates to the technical field of measurement of the distance between the cross positions of the carrier cables of the rail contact network. A laser radar and an infrared sensor are used for collecting depth information and temperature distribution data, and a multi-view image and depth temperature data are obtained; collecting the multi-view image and the depth temperature data to a central processing unit through a high-speed data transmission channel to obtain an initial data set; preprocessing the initial data set to obtain a high-quality data set; based on a deep learning algorithm and the high-quality data set, constructing a prediction model of the carrier cable and the intersection point, inputting sample data in the high-quality data set, and outputting prediction results of the carrier cable and the intersection point; and based on prediction results of the carrier cables and the intersection points, three-dimensional model reconstruction is carried out on the intersection positions of the carrier cables in combination with stereoscopic vision and structured light technologies.
Owner:HEFEI UNIV OF TECH

Lunar soil test piece in-situ three-dimensional reconstruction method based on improved neural radiation field algorithm

The invention belongs to the field of computer vision, image processing and space engineering, and discloses a lunar soil test piece in-situ three-dimensional reconstruction method based on an improved neural radiation field algorithm, and the method comprises the steps: obtaining a multi-view image set of a lunar soil test piece, and carrying out the self-adaptive adjustment of lunar surface illumination; the pose of the high-resolution camera is calculated through multi-view stereoscopic vision, and a depth map is obtained; the method comprises the following steps: generating a neural coding volume based on a Vision Transform model, and extracting a multi-dimensional feature vector; generating a neural radiation field, and predicting rendering features of the volume points; carrying out micro-volume rendering, and carrying out loss feedback optimization by using color rendering, depth and illumination; performing grid extraction by using a moving cube algorithm to obtain a three-dimensional grid model; for feature extraction difficulty and reconstruction mismatching difficulty caused by lunar soil background texture similarity, the problem of low reconstruction precision under a lunar surface non-uniform illumination condition is effectively solved, and high-quality and high-precision in-situ rapid three-dimensional reconstruction of a lunar soil test piece is realized.
Owner:HUAZHONG UNIV OF SCI & TECH

Foundation pit displacement monitoring method and system based on machine vision and monitoring equipment

The invention relates to the technical field of foundation pit detection, and discloses a foundation pit displacement monitoring method and system based on machine vision and monitoring equipment. The method comprises the steps that a high-definition camera collects image data of a foundation pit area in real time, the collected image data are preprocessed, reference points in the image data are analyzed through an optical flow method, displacement of the reference points in a foundation pit is estimated, and three-dimensional position changes of the reference points are calculated through the stereoscopic vision technology and image matching. The system comprises an image acquisition module, an image preprocessing module, a displacement calculation module, a filtering optimization module, an anomaly detection and early warning module and a data storage module. The equipment comprises a high-definition monitoring camera, a data processing terminal, a storage unit, an alarm device and a communication module. According to the invention, through image acquisition of a multi-camera system and a stereoscopic vision technology, comprehensive monitoring of the displacement of the foundation pit is ensured, high-quality image data can be provided in various environments, and precise acquisition of three-dimensional depth information is realized in combination with stereoscopic vision.
Owner:CHIFENG BRANCH OF CHINA NATIONAL NUCLEAR LAND ECOLOGICAL TECHNOLOGY CO LTD

Optical positioning feedback control system in minimally invasive surgery of bile adipoma

The invention relates to the technical field of optical localization, in particular to an optical localization feedback control system in a minimally invasive surgery of bile adipoma. The system comprises the following steps: an image optimization module is used for scanning a full-band optical image in an operation cavity, performing adaptive contrast optimization and constructing a spectrum optimization image; the focus positioning module is used for performing accurate focus positioning on the spectrum optimization image and extracting a focus optical contour; the three-dimensional reconstruction module is used for performing structural feature point identification and three-dimensional reconstruction on the spectrum optimization image to construct a three-dimensional structure model; and the visual error compensation module is used for performing multi-angle optical ranging and stereoscopic visual error compensation on the optical contour of the focus to obtain a three-dimensional compensation positioning coordinate. According to the invention, through real-time accurate position positioning, the instrument response speed and the tissue identification precision are improved.
Owner:EYE & ENT HOSPITAL SHANGHAI MEDICAL SCHOOL FUDAN UNIV

Calibration and error correction method and system based on stereoscopic vision measurement system

The invention discloses a calibration and error correction method and system based on a stereoscopic vision measurement system, and relates to the technical field of measurement system optimization, and the method comprises the steps: carrying out the scanning of an object with a standard size, and collecting data points; calculating an error between a measured length and an actual length for each data point, calculating an average value and a standard deviation of all measured values, and excluding the measured values exceeding the errors; and calculating a calibration coefficient and offset to obtain corrected side length data, and dynamically adjusting the calibration coefficient and the offset. Through detailed algorithm steps and a closed-loop feedback control mechanism, the machine measurement system can realize automatic data collection, real-time error analysis and dynamic adjustment of calibration parameters. Therefore, the accuracy and the stability of measurement are improved, and the high efficiency and the reliability of the system in long-term operation are ensured. Through regular calibration and real-time error correction, the algorithms can significantly improve the overall performance of the measurement system.
Owner:HUANENG NUCLEAR ENERGY TECH RES INST CO LTD +1

Forest disaster detection method and device

The invention provides a forest disaster detection method and device, and belongs to the field of forest disaster monitoring, and the method comprises the steps: collecting an infrared image, a stereoscopic vision image and positioning data of a target forest region in real time; an ASSA module is introduced in the feature extraction stage of the YOLOv11, and an infrared image is input into the improved YOLOv11 for flame target recognition; recognizing the stereoscopic vision image through a smoke and fire recognition algorithm, and detecting flame and smoke targets; determining a fire detection result by combining the identification results of the flame target and the smoke target; under the condition that the fire disaster is determined to occur, an HITNet algorithm is adopted to carry out ignition point positioning through a stereoscopic vision image, and the geographic coordinates of a fire disaster point are determined based on positioning data; and sending alarm information based on the fire point geographic coordinates. Therefore, the capability of extracting the flame heat radiation characteristics of the tiny fire points is effectively enhanced, and the detection result of the forest fire is improved.
Owner:BEIJING INSTITUTE OF PETROCHEMICAL TECHNOLOGY +1

Rotor disc inclination angle measurement method based on binocular vision

The invention belongs to the technical field of helicopter model rotor tests, and particularly relates to a binocular vision-based rotor disc inclination angle measurement method. The method comprises the following steps: S1, erecting a binocular stereoscopic vision camera and an LED light source above a model rotor test bed, wherein the camera vertically and downwards shoots reflective targets adhered to a rotor hub and a support arm; a photoelectric sensor is installed right opposite to a rotating shaft of the model rotor wing test bed, a camera is triggered by using a TOP signal generated by the photoelectric sensor, and the orientation of an image shot by the camera is identified; s2, identifying a reflective target pasted on the rotor hub in the image shot by the camera, and calibrating the binocular camera to obtain a calibration matrix in combination with the relative position information of the known hub mark point; s3, determining three-dimensional coordinates of all propeller hub mark points and support arm mark points; and S4, fitting the three-dimensional coordinates of the marking points of the propeller hub into a plane calculation normal vector, fitting the three-dimensional coordinates of the same marking point on the four support arms in different directions into a plane calculation normal vector respectively, and obtaining the inclination angle of the rotor disc.
Owner:CHINA HELICOPTER RES & DEV INST

Unmanned aerial vehicle autonomous obstacle avoidance method based on deep learning and binocular vision

The invention relates to the technical field of unmanned aerial vehicle obstacle avoidance, and discloses an unmanned aerial vehicle autonomous obstacle avoidance method based on deep learning and binocular vision. According to the method, original data streams of a left view and a right view are acquired through a binocular vision acquisition terminal, and stereoscopic vision feature representation is extracted through parallel convolutional coding branches of a deep neural network model; inputting into a three-dimensional space reconstruction module to generate a dense depth map and an obstacle initial position coordinate set; the dynamic obstacle analysis engine calculates a dynamic threat evaluation index by combining real-time flight attitude parameters of the unmanned aerial vehicle, and the space-time trajectory prediction model calculates future moving path probability distribution of the obstacle according to the dynamic threat evaluation index; and fusing the distribution with preset navigation path planning data to generate a three-dimensional obstacle avoidance course correction vector, converting the three-dimensional obstacle avoidance course correction vector into a flight control instruction set, and downloading the flight control instruction set to an execution module. According to the method, the reliability and adaptability of autonomous obstacle avoidance of the unmanned aerial vehicle in a complex dynamic environment are improved, and a powerful guarantee is provided for safe navigation of the unmanned aerial vehicle.
Owner:SHANGHAI BOLI INTELLIGENT TECH CO LTD

Visual angle tracking grating stereo display system

The invention discloses a visual angle tracking grating stereo display system comprising a 3D camera grating display device used for obtaining viewer 3D information; the eyeball position tracking module is used for acquiring real-time spatial position coordinates of the eyes of the audience relative to the 3D camera; the pose calibration module is used for acquiring a spatial relationship between the 3D camera and the display; and the visual angle rendering and grating interlaced graph generation module is used for calculating the spatial position of the human eyes on the display screen and the mapping of each grating strip in a screen pixel coordinate system after acquiring the positions of the eyes and the relative poses of the display screen and the 3D camera, generating a grating stereoscopic display image suitable for the eyes, and sending the grating stereoscopic display image to a display to be output. According to the method and the device, the viewpoint self-adaptive three-dimensional display of the eyes of one or more audiences is realized, the calculation complexity is reduced, the three-dimensional vision consistency can be ensured, the picture which should be seen by the viewing angle can be accurately rendered, and the problem of blurring or 3D picture distortion is avoided.
Owner:SHANGHAI LANGSHU INTELLIGENT TECH CO LTD

Vision-driven multi-modal fusion lightweight semantic map construction method and system

The invention discloses a vision-driven multi-mode fusion lightweight semantic map construction method and system. The method comprises the following steps: synchronously acquiring a binocular image pair sequence, IMU data and GNSS data of a target area; based on the acquired multi-modal data, performing multi-sensor joint state estimation through a differential weighted fusion strategy, and outputting camera global pose and scene depth information; based on a current frame and a historical frame in the binocular image pair sequence, combining a camera global pose, extracting geometric prior auxiliary time sequence cross-frame semantic feature fusion through stereoscopic vision, and outputting a two-dimensional semantic segmentation result of the current frame; and back-projecting the two-dimensional semantic segmentation result into a lightweight global three-dimensional semantic map based on camera pose and scene depth information, and carrying out maintenance and updating through a voxelization statistical mechanism. Compared with a traditional dense point cloud map, the method has the light weight effect that the storage space is greatly reduced.
Owner:BEIHANG UNIV

Transmission tower deformation monitoring method and device and computer program product

The invention discloses a power transmission tower deformation monitoring method and device and a computer program product, and the method comprises the steps: obtaining a multi-angle collection image of a random speckle pattern on the surface of a power transmission tower; constructing an image sequence based on the multi-angle acquired images, reconstructing a three-dimensional displacement field on the surface of the power transmission tower by using a stereoscopic vision reconstruction algorithm, and exporting a strain tensor field; performing time sequence processing on the strain tensor field under a plurality of time nodes through a strain evolution analysis model of a continuous time sequence, and extracting a strain change trend of each preset structure part; carrying out space consistency mapping and weighted interpolation processing according to the strain change trends of the plurality of preset structure parts, and calculating to obtain the overall structural dependent variable of the power transmission tower; and S5, in combination with historical strain data and the current overall structural dependent variable, identifying an abnormal deformation area of the power transmission tower by comparing the spatio-temporal evolution mode of the strain tensor field. The method has the effect of improving the accuracy of deformation monitoring of the power transmission tower.
Owner:SHENZHEN POWER SUPPLY BUREAU

Three-dimensional modeling method and system for lunar lava duct

The invention belongs to the field of lunar exploration and in-situ resource utilization, and particularly discloses a lunar lava pipe three-dimensional modeling method and system, and the method comprises the steps: carrying out the fusion of multi-modal data of a lunar lava pipe, and obtaining a basic three-dimensional model; the multi-modal data comprises point cloud data collected by a laser radar, point cloud data collected by a surrounding device penetrating radar, a three-dimensional image collected by a stereoscopic vision camera and a thermal image collected by an infrared thermal imager; respectively inputting a complete area in the basic three-dimensional model into a generation model based on the CGAN and the VAE, and correspondingly obtaining two three-dimensional completion models; and carrying out weighted fusion on the two three-dimensional complementation models to obtain a complete three-dimensional model of the lunar lava pipeline. According to the method, the integrity and precision of the three-dimensional model of the lunar lava pipeline can be improved, and technical support is provided for deep detection of the lunar lava pipeline.
Owner:HUAZHONG UNIV OF SCI & TECH

Method and device for detecting surface defects of injection molded part based on double-model collaboration

The invention provides an injection molding part surface flaw detection method and device based on double-model collaboration, and the method comprises the steps: carrying out the local abnormal reflection feature analysis of a multi-view optical image collected on the surface of an injection molding part based on a first detection model, and obtaining a candidate flaw region; performing spatial positioning in the multi-view optical image based on the candidate flaw area to obtain a multi-view candidate image segment; performing surface geometric continuity analysis on the multi-view candidate image segments based on a second detection model to obtain a three-dimensional surface geometric consistency result; carrying out authenticity discrimination on the candidate flaw area based on a three-dimensional surface geometric consistency result to obtain a real flaw area; wherein the first detection model is used for capturing an optical response model of local abnormal reflection characteristics; the second detection model is a stereoscopic vision model for analyzing the geometric continuity of the multi-view lower surface. According to the invention, the false alarm rate of surface defect detection of the injection molded part under a complex surface condition is reduced.
Owner:SHENZHEN SUCCESS RAIN TECH CO LTD

Bar count visual identification automatic calculation system and method

The invention discloses a bar count visual identification automatic calculation system and method, the system comprises a stereo visual acquisition unit, a dynamic threshold adjustment unit, a geometric feature analysis unit, a data processing module and a man-machine interaction unit, and the method comprises the following steps: S01, image acquisition and preprocessing; s02, adjusting an environment self-adaptive threshold value; s03, bar geometric feature extraction; s04, the number of bars is calculated; s05, outputting a result, displaying the bar count obtained by calculation on an interface of a man-machine interaction unit, and storing a counting result and related data in a database at the same time; the beneficial effects of the invention are that a conventional visual counting system usually only depends on two-dimensional image information, recognition errors are easy to occur under the conditions of bar adhesion, surface reflection and the like, the scheme constructs a stereoscopic vision system through an industrial camera to obtain three-dimensional point cloud data, image textures are enhanced in combination with coding structured light projected by a structured light emitter, and the recognition accuracy is improved. And the spatial position and surface depth information can be obtained.
Owner:NANJING IRON & STEEL CO LTD

Multi-mode vehicle security monitoring method and system based on charging pile

The invention relates to a charging pile multi-mode vehicle security monitoring method and system, and the method comprises the steps: collecting vehicle contour point cloud, environment parameters and voltage fluctuation data through a stereoscopic vision sensor, a temperature and humidity sensor and a current sensor, and generating a multi-mode fusion data set through time-space synchronization; comprehensive scores of vehicle deformation, environment sudden change and voltage abnormity are calculated based on a dynamic weight fusion model, low-risk, medium-risk and high-risk three-level safety judgment results are generated in combination with a quantile threshold interval, and the environment adaptability defect of a traditional fixed rule is eliminated through a dynamic weight and an adaptive threshold; triggering a hierarchical control instruction according to a judgment result, and synchronously constructing a credible evidence chain containing a timestamp, an operation log and an encryption check code to ensure that the security event is traceable and the data is tamper-proof; and finally, aggregating multi-node user feedback through a federated learning framework, updating a model weight and a threshold interval in combination with a differential privacy technology, and realizing dynamic optimization of a false alarm rate while protecting user privacy.
Owner:ZHONGDE CENTURY (TIANJIN) NEW ENERGY TECHNOLOGY CO LTD +2

Real-time people stream visualization system based on optical flow method and stereoscopic vision technology

The invention discloses a real-time people stream visualization system based on an optical flow method and a stereoscopic vision technology. The system comprises the following functional units: a visual data acquisition unit for collecting visual data from an environment with dense people streams; the optical flow analysis and processing unit is used for carrying out motion state analysis and motion vector calculation on the key feature points of the human body; the stereoscopic vision processing unit is used for accurately predicting a target motion path; the data fusion and analysis unit is used for identifying advanced behaviors of individual movement; and the user interaction and visualization unit is used for displaying the comprehensive data obtained from the data fusion and analysis unit. The problems of insufficient positioning precision, poor real-time performance and limited data visualization capability in the existing people flow monitoring technology are solved. The system is designed to be used in crowded environments such as shopping malls, stations, public activity areas and the like, and aims to provide an accurate, real-time and multi-dimensional crowd monitoring and management tool for managers, operators and common customers.
Owner:NANJING COLLEGE OF INFORMATION TECH

PHC pipe pile perpendicularity measuring method based on dual-camera device with IMU module

The invention discloses a PHC tubular pile perpendicularity measuring method based on double-camera equipment with an IMU module, and the method comprises the steps: horizontally placing two cameras on the ground xOy, and adjusting the two cameras to enable the optical axes Ay and Bx of the two cameras to be perpendicular to each other; respectively reading the roll angles alpha 1 and alpha 2 of the two cameras by using an IMU module; the positions of the target pile body OT in the pictures shot by the two cameras are recognized respectively, and the inclination angles beta 1 and beta 2 of the target pile body OT in the pictures shot by the two cameras are obtained through calculation; the inclination angles theta 1 and theta 2 of the target pile body OT in the orthogonal projection planes SA and SB under the ground coordinate system Oxyz are obtained through the angle relation, and the perpendicularity of the pile body OT is obtained through calculation. Multi-view stereoscopic vision and dynamic structure analysis are adopted, real-time recognition and positioning of the target pile body are achieved, the camera coordinate system is calibrated in combination with the IMU, and the actual construction precision requirement of the pile foundation is effectively met.
Owner:STATE GRID JIANGSU ELECTRIC POWER ENG CONSULTING CO LTD