Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1034 results about "Fish eye" patented technology

Wharf sensing method and system based on data fusion of laser radar and camera

The invention relates to a wharf sensing method and system based on data fusion of a laser radar and a camera, and the method comprises the steps: firstly employing a fisheye camera to shoot a checkerboard calibration plate at multiple angles, employing a Zhang's calibration method to calculate an internal reference matrix and a distortion coefficient of the fisheye camera, and synchronously collecting the data of the laser radar and the camera in real time; the method comprises the following steps: performing distortion removal processing on a camera image, calculating an external parameter matrix between a laser radar and a camera through a feature extraction algorithm, a feature point matching algorithm and a nonlinear optimization algorithm, and performing data fusion through an internal parameter matrix, the external parameter matrix and a bilinear interpolation method to generate fusion point cloud data with color information; and finally, identifying a key target of the wharf by marking and training a CNN model, and calculating three-dimensional parameters of the key target by adopting a specific calculation method, so that a sailor can quickly distinguish the target in the fused point cloud data, the accuracy and efficiency of wharf environment perception are remarkably improved, and accurate environment perception and decision support are provided for ship berthing and departing operation.
Owner:SHANGHAI SHIP & SHIPPING RES INST CO LTD

Data processing method of intelligent cold stamping production line integrated with MES system

The invention discloses a data processing method of an intelligent cold stamping production line integrated with an MES system, and the method comprises the steps: S1, installing at least one fisheye lens for detecting a stamping workpiece, collecting data, preprocessing the data, and building a three-dimensional scene, S2, carrying out the further processing of the preprocessed data in S1 through a flexible sensor network, the method comprises the following steps: S1, carrying out cross-modal fusion and feature extraction on data, S3, transmitting the data extracted in S2 to a digital twinborn body for dynamic updating and prediction, S4, carrying out deformation with the assistance of quantum entanglement and carrying out over-distance early warning, and S5, carrying out data storage and knowledge management. According to the data processing method of the intelligent cold stamping production line integrated with the MES system, a digital twinborn dynamic updating and predicting technology is utilized, quantum-classical hybrid simulation modeling and reinforcement learning algorithms are combined, precise prediction and optimization adjustment can be conducted on mold abrasion, process parameters and the like, the production efficiency and the product quality are improved, and the production cost is reduced. The production cost and the energy consumption are reduced.
Owner:TIANJIN TAIZHENG MACHINERY

Method and apparatus for optical detection and analysis in a movement environment

Provided is a device and a corresponding method for optical recognition and analysis, in particular of bodies, body parts and / or joints of a person, surfaces and objects in a 3-dimensional movement area in real time, with one or more cameras with fisheye lens, which are arranged at a distance and position from the movement area specifically selected for the application, for determining 2D positions of the bodies, body parts and / or joints, surfaces and objects by means of camera images, at least one data processing unit being provided, with devices for calculating neural networks and artificial intelligence in real time, for applying several AIs on captured camera images, and with at least one interface for one or more audio / video feedback units for outputting data or audio / video feedback on the analysis results by means of the audio / video feedback unit.
Owner:AIRIS GMBH

Parking assisting method and system for automatic driving

The invention relates to the technical field of automatic driving, and discloses a parking assisting method and system for automatic driving. The method comprises the following steps: cascading and splicing a first fisheye image acquired by a main camera in a vehicle body and a second fisheye image acquired by a slave camera to obtain a panoramic image; performing parking space boundary identification and obstacle analysis on the panoramic image to obtain parking space boundary information and obstacle position information, and synchronously performing distance calculation on a radar echo signal of an ultrasonic sensor to obtain distance measurement data; and a parking environment map is created according to the parking space boundary information, the obstacle position information and the distance measurement data, path planning is carried out based on the parking environment map, a parking execution instruction is obtained, and the parking execution instruction is used for vehicle parking auxiliary control. According to the method, the view coverage range and the flexibility of the observation angle are expanded, and the execution precision and safety of parking auxiliary control are improved.
Owner:深圳市顺禾电器科技有限公司

Panoramic look-around auxiliary driving method and system based on machine vision

The invention provides a machine vision-based panoramic look-around auxiliary driving method and system, and the method comprises the steps: employing a plurality of fisheye cameras to obtain a plurality of first images around a special vehicle, obtaining a distortion model of the fisheye cameras, employing a polynomial model correction method to correct the first images through the distortion model to obtain second images, and obtaining the second images; a direct linear transformation algorithm is used to transform the pitch map of the second image to obtain third images, a weighted average algorithm is used to eliminate splicing gaps of all the third images to obtain a panoramic look-around image, a YOLOv5s-based multi-task perception algorithm is used to detect the target of the panoramic look-around image, the target comprises a drivable area segmentation result and a lane line segmentation result, and the target comprises a driving area segmentation result and a lane line segmentation result. And displaying the panoramic look-around image and the target in the panoramic look-around image. The method can completely display the fusion image of the virtual vehicle, the vehicle bottom and the surrounding road surface, intelligently recognizes the road scene information, eliminates the view blind area, and enhances the view of the driver of the special vehicle.
Owner:WUHAN UNIV

Vehicle surround view camera calibration method, system and device and computer medium

The invention discloses a calibration method, system and device for a vehicle around-view camera and a computer medium, and relates to the technical field of image processing, and the method comprises the steps: collecting a calibration plate image obtained after a calibration plate is shot by the around-view camera on a vehicle; projecting the calibration plate image to a world coordinate system to obtain a distorted image; selecting an initial angular point in the distorted image according to the calibration plate; projecting the initial angular point to a fisheye image coordinate system of a look-around camera to obtain a target angular point; according to the target angular point, generating an initial external parameter of the look-around camera; in the calibration plate image, extracting overlapped corner point parameters in the overlapped shooting area; and based on the initial external parameter, generating a target external parameter which enables the error between the overlapping angular point parameters to be minimum, and taking the target external parameter as the external parameter of the surround-view camera. According to the method, the extraction precision and robustness of the angular points are improved, the continuity and smoothness of the images shot by the surround view camera are improved, splicing gaps and dislocation phenomena are reduced, and the calibration result of the vehicle surround view camera is more accurate.
Owner:IMOTION AUTOMOTIVE TECH (SUZHOU) CO LTD

Image correction method and system based on nonlinear distortion distribution elliptical fisheye lens, and medium

The invention provides an image correction method and system based on a nonlinear distortion distribution elliptical fisheye lens, and a medium. The method comprises the following steps: establishing a nonlinear mixed distortion imaging model based on a mapping relation between image coordinates and a spherical direction; defining a distortion vector, and performing fitting processing on the distortion vector based on a two-dimensional B-spline function to obtain a distortion function; the method comprises the following steps: acquiring images in a five-surface three-dimensional angle calibration space based on an elliptical fisheye lens, analyzing lens imaging parameters, and generating parameter values of a distortion function; analyzing parameter values of the distortion function based on a nonlinear mixed distortion imaging model to generate calibration parameters, and remapping pixel points in the distorted image based on the calibration parameters; performing image reconstruction on the remapped distorted image to obtain a corrected image; improving the sampling density of a target area by constructing a nonlinear mixed distortion imaging model; the system adapts to complex monitoring environments such as galleries and entrances and exits; and spatial distortion is flexibly expressed through a B spline, so that the modeling capability is improved.
Owner:HANGZHOU HUICUI INTELLIGENT TECH CO LTD

Image processing apparatus, image processing method, and storage medium

There is provided an image processing apparatus comprising. An obtainment unit obtains a first circular fisheye image accompanied by a first missing region in which no pixel value is present. A generation unit generates a first equidistant cylindrical projection image by performing first equidistant cylindrical transformation processing based on the first circular fisheye image. The generation unit generates the first equidistant cylindrical projection image such that a first corresponding region corresponding to the first missing region has a pixel value in the first equidistant cylindrical projection image.
Owner:CANON KK

GNSS data quality prediction method and device based on fisheye camera, and medium

The invention provides a GNSS data quality prediction method and device based on a fisheye camera, and a medium, and belongs to the technical field of data processing, and the method comprises the steps: determining the satellite orbit information of a future time period with a to-be-evaluated observation station as a reference point based on ephemeris prediction; according to the fisheye sky image shot at the to-be-evaluated observation station and the satellite orbit information, determining satellite feature data of a future time period and the occlusion porosity of the future time period; respectively inputting the occlusion porosity of the future time period and at least part of satellite feature data of the future time period into a general prediction model and an observation station prediction model corresponding to the observation station to be evaluated for data quality evaluation, and obtaining a first data quality evaluation index and a second data quality evaluation index; and determining a data quality prediction result based on the first data quality evaluation index and the second data quality evaluation index. A general prediction model and an observation station exclusive prediction model are introduced to carry out double-model evaluation, and accurate prediction of GNSS observation data quality is realized.
Owner:CHINA INST OF WATER RESOURCES & HYDROPOWER RES

GNSS (Global Navigation Satellite System) observation environment complexity measurement method, device, equipment and medium

The invention relates to the technical field of GNSS observation environment evaluation, in particular to a GNSS observation environment complexity measurement method, device and equipment and a medium, and the method comprises the steps: obtaining a sky image of a target area through a fisheye camera, and carrying out the recognition of the sky image through an image processing algorithm, and obtaining a sky recognition result; calculating trajectories of all satellites based on almanac information, and obtaining an openness index of the target region in combination with a sky recognition result; gNSS observation data are obtained, and a quality index is calculated according to the GNSS observation data; and combining the openness index with the quality index through a gradient lifting regression algorithm, predicting the calculation precision, and converting the predicted calculation precision into environment complexity. According to the GNSS observation environment evaluation method, the machine learning algorithm is combined with the sky view and the data quality index, the evaluation accuracy of the GNSS observation environment under the complex environment is improved, and the GNSS observation environment evaluation method is suitable for GNSS observation environment evaluation under various complex terrain conditions.
Owner:CENT SOUTH UNIV

Blade interior autonomous crawling sensing method and system based on robot

The invention provides a robot-based blade interior autonomous crawling sensing method and system, and the method comprises the steps: carrying a multi-sensor array on a robot, the multi-sensor array comprises a binocular fisheye camera array and a ToF sensor array, controlling the robot to start from a path travel starting point, obtaining a panoramic depth image based on the multi-sensor array, and transmitting the panoramic depth image to the robot; recognizing an obstacle based on the panoramic depth image, constructing a three-dimensional point cloud map based on the obstacle, avoiding the obstacle based on the three-dimensional point cloud map, generating a feasible path in the blade, and enabling the robot to move based on the feasible path until the robot reaches a path travel terminal point or a minimum space in which the robot cannot pass. Autonomous crawling perception of the robot in the blade can be ensured, movement of the robot in the blade is ensured, and detection is realized.
Owner:WUHAN DITE ENERGY TECH CO LTD

Method and device for correcting central point of target in fisheye image without distortion, medium and product

The embodiment of the invention relates to the technical field of image processing, and discloses a method and equipment for correcting a central point of a target in a distorted fisheye image, a medium and a product. The method comprises the following steps: acquiring the width and height of a target detection frame of a target in an image, and the central point of the target detection frame; wherein the image is a fisheye camera image subjected to distortion removal processing; acquiring a pixel distance between the central point of the target detection frame and the central point of the image; determining a transverse adjustment proportion parameter and a longitudinal adjustment proportion parameter according to a predetermined secondary transformation coefficient and a pixel distance; determining the abscissa of the corrected target center point according to the abscissa of the center point of the target detection frame, the transverse adjustment proportion parameter and the width of the target detection frame; and according to the ordinate of the center point of the target detection frame, the longitudinal adjustment proportion parameter and the height of the target detection frame, determining the ordinate of the corrected target center point. By adopting the scheme, the recognition accuracy of the center position of the target can be improved.
Owner:TUS CLOUD CONTROL (BEIJING) TECH LTD

Coal mining machine positioning and visual analysis system under multi-algorithm optimized fisheye camera

The invention discloses a coal mining machine positioning and visual analysis system under a multi-algorithm optimized fisheye camera, and relates to the field of coal mining machine positioning and visual analysis. The deployment acquisition module is installed according to an optimization algorithm, has an intelligent function and acquires images in a multispectral manner; the preprocessing module corrects distortion by using an improved model and enhances an image in combination with multiple algorithms; the identification calculation module integrates multiple technologies to identify features of the coal mining machine and accurately position the coal mining machine; the tracking and positioning module fuses multi-algorithm tracking, and deep learning is used for predicting a trajectory during shielding; the visual analysis module analyzes the state of the coal mining machine through multiple technologies; and the transmission interaction module transmits data by using a fusion technology and provides multiple interaction modes. The method is accurate in positioning, the fisheye camera and the correction technology improve the positioning accuracy, and accurate tracking can be achieved when shielding is carried out; visual analysis is deep, and the state of the coal mining machine and environmental hidden dangers are monitored; data transmission is safe and efficient, and interaction is convenient; the system has strong anti-interference and self-optimization capabilities, can adapt to an underground environment, and improves the coal mining operation efficiency and safety.
Owner:CHANGZHOU ZUOAN ELECTRIC CO LTD

Basketball backboard interactions tracking and display system, apparatus, and method

A basketball backboard interaction tracking system that captures, processes, and visually communicates data related to basketball interactions for enhanced player engagement and training. The system includes two configurations: an initial configuration with a transparent glass backboard positioned in front of a display and a second, modular configuration without an integrated display. The initial configuration uses various sensor types, including fisheye cameras, light curtains, microphones, and infrared or ultrasonic sensors, to track basketball interactions, with real-time feedback displayed on the integrated screen or a mobile interface. The second configuration, optimized for environments without a display, includes sensor modules with pressure sensors, RFID readers, or sound-triangulating microphones. Both configurations incorporate a controller unit for processing sensor data, a cloud or on-premises server for data storage, at least one power supply, and a user interface for real-time feedback. This system supports interactive training, game statistics, and data analysis for skill improvement.
Owner:JUMPSHOT INC

Automatic parking obstacle detection method and device

The invention discloses an automatic parking obstacle detection method and device. A semantic segmentation model of each scene is trained by collecting multi-path look-around fisheye camera image sets of different scenes, so that a semantic segmentation model library is generated, and when parking is performed, a target semantic segmentation model is matched in the semantic segmentation model library based on a driving scene, so that the adaptability and accuracy of the semantic segmentation model in different scenes are improved, and the parking experience is improved. And the four fisheye images are subjected to semantic segmentation based on the four fisheye images and then spliced into a bird's-eye view angle, so that the problem that the bird's-eye view angle easily causes loss or distortion of obstacle information is avoided, an accurate travelable region boundary is provided, and the obstacle detection accuracy is improved.
Owner:SAIC GM WULING AUTOMOBILE CO LTD

Wafer pose recognition system and image acquisition device and image acquisition method thereof

The invention relates to a wafer pose recognition system and an image acquisition device and an image acquisition method thereof, the wafer pose recognition system comprises a support structure for supporting a wafer to be recognized and the image acquisition device arranged above the wafer to be recognized, and an image sensing module is arranged in the image acquisition device. A fisheye lens group or a negative lens is adopted to enlarge the visual field width of an image sensor, so that the image sensing module can obtain complete edge image information of a wafer in one-time imaging, the positioning efficiency is improved, an annular first light shielding plate and a circular second light shielding plate are arranged on an optical path of the lens to form an annular visual field in a matched mode, and the positioning precision is improved. The edge blurred part image and the middle too bright part image are physically excluded, the imaging quality in the annular view is improved, the clear and complete wafer positioning edge image can be obtained, the contour recognition precision during image recognition is improved, and the positioning accuracy is improved.
Owner:WUXI LEADPRO TECH CO LTD

Fisheye image processing method, electronic device, and computer-readable storage medium

This application provides a fisheye image processing method, an electronic device, and a computer-readable storage medium. The method includes: acquiring a fisheye image; generating a grayscale image according to the fisheye image; generating a first gradient image in a horizontal direction and a second gradient image in a perpendicular direction; generating an azimuthal image according to the first gradient image and the second gradient image; and determining an effective imaging area according to the azimuthal image. The anti-distortion correction for the fisheye camera is performed in the process of shooting images according to the effective imaging area of the fisheye camera, and thus the imaging area of the fisheye camera is accurately calibrated when the images are shot by the fisheye camera.
Owner:SHENZHEN BAICHUAN SECURITY TECH CO LTD

High-pixel confocal panoramic fisheye optical system and camera module applied by same

The utility model provides a high-pixel confocal panoramic fisheye optical system and a camera module applying the same, the high-pixel confocal panoramic fisheye optical system is mainly composed of seven lenses, the first lens has negative focal power, the object side surface of the first lens is a convex surface, and the image side surface of the first lens is a concave surface; the second lens has negative focal power, and the image side surface of the second lens is a concave surface; the third lens has negative focal power, the object side surface of the third lens is a concave surface, and the image side surface of the third lens is a convex surface; the fourth lens has positive focal power, and the object side surface of the fourth lens is a convex surface; the fifth lens has positive focal power, the object side surface of the fifth lens is a convex surface, and the image side surface of the fifth lens is a convex surface; the sixth lens has negative focal power, the object side surface of the sixth lens is a concave surface, and the image side surface of the sixth lens is a concave surface or a convex surface; the seventh lens has positive focal power, the object side surface of the seventh lens is a convex surface, and the image side surface of the seventh lens is a concave surface or a convex surface; through reasonable matching of the lens shape and the focal power, the lens has the advantages of high pixel, infrared confocal, ultra-wide angle and large aperture, the performance requirements of large aperture and high pixel are met, and the imaging effect of equipment matched with the system is further improved.
Owner:GUANGDONG HONGJING OPTOELECTRONICS TECHONLOGY CO LTD

Method and system to fine-tune extrinsic parameters of a fisheye lens applied to surround-view stitching

A method to fine-tune extrinsic parameters of a fisheye lens applied to surround view splicing is provided. Fisheye images are obtained from multiple fisheye lenses. Both sides of the fisheye images contain calibration boards. Initial extrinsic parameters are obtained based on the fisheye images. Multiple corner points of the calibration boards in the fisheye images are detected. The corner points are arranged so that the corner points are connected into a quadrilateral in sequence. The initial extrinsic parameters are multiplied by a fine-tuning value to obtain intermediate extrinsic parameters. The corner points are projected to a top-view projection by using the intermediate extrinsic parameters. The intermediate extrinsic parameters are adjusted according to the shape, size, and overlapping effect of the area surrounded by the corner points in the top-view projection.
Owner:VIA TECH INC

Three-dimensional target detection model training method, three-dimensional target detection method and equipment

The invention provides a three-dimensional target detection model training method, a three-dimensional target detection method and equipment, and the method comprises the steps: obtaining a sample image shot by a fisheye camera, and marking the three-dimensional attribute marking information of a to-be-detected target, comprising a first direction angle, a first division area to which the first direction angle belongs and a first deviation angle in the first division area. And inputting the sample image into the initial detection model, and obtaining three-dimensional attribute prediction information of the to-be-detected target, including a second direction angle, a second division area to which the second direction angle belongs and a second deviation angle in the second division area. And determining a loss function value based on the three-dimensional attribute prediction information and the three-dimensional attribute labeling information. And training the initial detection model based on the loss function value to obtain a three-dimensional target detection model. By marking the first division area to which the first direction angle belongs, the error of the predicted second direction angle is reduced, and the accuracy of the three-dimensional target detection model is improved.
Owner:CHENGDU TIANFU INVO TECHNOLOGY CO LTD

Distortion correction method and device for fisheye image

The invention discloses a distortion correction method and device for a fisheye image, and relates to the technical field of computer vision. Obtaining a query vector of the to-be-corrected fisheye image from the query vector set according to the distortion degree of the to-be-corrected fisheye image; according to the query vector of the to-be-corrected fisheye image, determining control conditions of the to-be-corrected fisheye image in multiple levels; the control condition of each level corresponds to each modulation block in the level correction network in sequence; and inputting the original features of the to-be-corrected fisheye image and the control conditions of the to-be-corrected fisheye image in each level into the level correction network, fusing the original features and the corresponding control conditions by using the controllable convolution modulation block, and carrying out correction on the to-be-corrected fisheye image in the controllable attention modulation block. And global enhancement is carried out on the features output by the controllable convolution modulation block through a control condition, and a distortion correction image of the fisheye image to be corrected is obtained. The method is high in generalization ability for different distortion conditions, and the distortion correction precision of the fisheye image can be improved.
Owner:SHAN XI YU LAN JIU ZHOU ZHI NENG GUANG DIAN KE JI YOU XIAN GONG SI

Car door collision reminding system and method based on fisheye camera image distortion correction

The invention discloses a car door collision reminding system and method based on fisheye camera image distortion correction, and relates to the technical field of car safety reminding. According to the system, scene images on the two sides of a car in the parking state are collected in real time through a fisheye camera, image calibration and distortion correction are carried out through an improved Harris corner detection algorithm, and the car door collision reminding system is obtained. In combination with a multi-task learning model of a convolutional neural network, the potential collision risk in the vehicle door opening process is analyzed in real time, the distance and height between an obstacle and a vehicle door are calculated through a signal processing module, a reminding module generates reminding signals of different grades, and the reminding signals are fed back to a driver in time through a vehicle display screen and a sound system. And the image display module marks the dangerous area and the dangerous level on the display equipment in real time. The system has wider visual angle coverage, higher detection precision and stronger environmental adaptability, effectively avoids the occurrence of vehicle door collision accidents, and is particularly suitable for narrow parking spaces, complex urban environments and high-density people flow areas.
Owner:RIVOTEK TECH (JIANGSU) CO LTD

Fisheye connection terminal and connector for PCB

The invention relates to the field of electronic devices, and discloses a fisheye connection terminal and a connector for a PCB. The fisheye connection terminal comprises a base part, two elastic arms, an insertion part and two groups of net-shaped cross-shaped reinforcing ribs, one ends of the elastic arms are connected with the base part, the two elastic arms are oppositely arranged to form a fisheye hole, the insertion part is connected with the other ends of the elastic arms, and the net-shaped cross-shaped reinforcing ribs are fixedly connected into the fisheye hole in a protruding mode towards the outside of the fisheye hole. According to the fisheye connection terminal, the retaining force of the fisheye connection terminal is improved by arranging the net-shaped cross-shaped reinforcing ribs in the fisheye holes, the stability of the fisheye connection terminal structure is kept in the extrusion deformation process, the net-shaped cross-shaped reinforcing ribs protrude outwards, and the center intersection points of the net-shaped cross-shaped reinforcing ribs make contact with the conductive holes in an attached mode; it is ensured that the fish-eye connection terminal does not incline in the insertion process, the contact stability is ensured, the resistance is improved and reduced, the large-current conductive requirement is met, and the circuit connection and signal transmission functions of a product are ensured.
Owner:TSP ELECTRONICS TECH(SHANGHAI) CO LTD

Texture point cloud-based berthing and leaving self-positioning method and system in intelligent ship

The invention relates to an intelligent ship berthing and leaving self-positioning method and system based on texture point clouds, and the method comprises the steps: firstly employing a fisheye camera to shoot a checkerboard calibration plate at multiple angles, employing a Zhang's calibration method to calculate an internal reference matrix and a distortion coefficient of the fisheye camera, and synchronously collecting the data of a laser radar and the camera in real time; the method comprises the following steps: carrying out orthodontic processing on a camera image, calculating an external parameter matrix between a laser radar and a camera through a feature extraction algorithm, a feature point matching algorithm and a nonlinear optimization algorithm, and carrying out data fusion through an internal parameter matrix, the external parameter matrix and a bilinear interpolation method to generate texture point cloud data with color information; the method comprises the following steps: performing texture point cloud registration through an improved NDT-color algorithm in cooperation with open-loop mileage estimation to preliminarily determine the position change of a ship, optimizing a graph model by using a closed-loop detection and graph optimization technology, generating an optimized global displacement vector, and further generating a wharf high-precision map containing color texture information. And real-time self-positioning of the ship in a wharf high-precision map is realized.
Owner:SHANGHAI SHIP & SHIPPING RES INST CO LTD

Scanning mapping method and device

The invention relates to a scanning mapping method and device, and belongs to the technical field of mobile mapping and three-dimensional reconstruction, the method is applied to a scanning mapping device, the device comprises a laser radar, an IMU and a fisheye camera, and the method comprises the following steps: obtaining point cloud data obtained by scanning of the laser radar at each moment, measurement data of the IMU and image data shot by the fisheye camera; determining pose data of the scanning and mapping device at each moment according to the point cloud data, the measurement data and the image data at each moment; performing coordinate conversion processing on the point cloud data at each moment according to the pose data at each moment to obtain coordinates of the point cloud data in a global coordinate system; and constructing a target map according to the coordinates of the point cloud data in the global coordinate system. The pose of the scanning mapping device is determined according to the observation data of the laser radar, the IMU and the fisheye camera, and the pose robustness can be improved. And mapping is carried out according to the pose, so that the mapping accuracy can be improved.
Owner:ZG TECH CO LTD

Wafer nanoscale defect detection system and method based on multi-mode and feature fusion

The invention discloses a wafer nanoscale defect detection system and method based on multi-mode and feature fusion, the system comprises a multi-band LED light source group, a CMOS camera, a telecentric imaging lens and a displacement platform, the multi-band LED light source group is arranged at the uppermost part, and the CMOS camera, the telecentric imaging lens and the displacement platform are sequentially arranged below the multi-band LED light source group; the multiband LED light source group comprises an angle gt; an incident light LED with the angle of 70 degrees, an incident light LED with the angle of 10-30 degrees, a coherent light source and a phase shift module; the CMOS camera shoots a wafer picture, and the telecentric imaging lens captures details on the surface of the wafer; the displacement platform bears the wafer and carries out displacement. According to the method, the limitation of two-dimensional detection is broken through, and on the premise of not sacrificing the detection speed, high-sensitivity, high-precision and quantifiable online automatic detection of fisheye, pinhole and segment difference defects is realized through an innovative optical system design, a quasi-three-dimensional morphology reconstruction technology and an advanced deep learning network architecture.
Owner:HANGZHOU HUICUI INTELLIGENT TECH CO LTD +1

Distortion correction method, device, equipment and storage medium for vehicle-mounted fisheye camera

The embodiment of the present invention discloses a method, device, equipment and storage medium for distortion correction of a vehicle-mounted fisheye camera. The method includes: obtaining first position information of key points in a calibration image; controlling a vehicle-mounted fisheye camera to collect the calibration image to obtain a distorted image, and extracting second position information of the key points in the distorted image; fitting the first position information and the second position information of the key points using a cubic B-spline curve fitting algorithm to obtain a correction relationship; obtaining the image to be corrected collected by the vehicle-mounted fisheye camera; and correcting the image to be corrected according to the correction relationship. The method for distortion correction of a vehicle-mounted fisheye camera provided by the embodiment of the present invention uses a cubic B-spline curve fitting algorithm to fit pixel points in a calibration image and pixel points in a distorted image to obtain a correction relationship, thereby performing distortion correction on the image collected by the fisheye camera according to the correction relationship, which can improve the accuracy of distortion correction.
Owner:CHINA FAW CO LTD

Method and device for generating a three-dimensional reconstruction of an environment around a vehicle

A computer implemented method for generating a three-dimensional reconstruction of an environment around a vehicle is provided. The method may include capturing multiple wide-angle images around the vehicle using multiple fisheye lens cameras mounted on the vehicle, creating a surround view image around the vehicle from the multiple captured images by generating one or more feature maps, and calculating a pose and depth estimate from the generated feature maps using at least one convolutional neural network. The method may also include detecting one or more objects in the multiple captured images, mapping one or more objects detected around the model of the vehicle to the created surround view image using the calculated pose and depth estimate; and constructing the three-dimensional reconstruction of the environment, using the surround view image and the mapped objects.
Owner:CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH

Multi-fisheye camera aerial view construction method and system for automatic driving

The invention relates to the technical field of vehicle visual perception, and particularly discloses a multi-fisheye camera aerial view construction method and system for automatic driving, and the method comprises the steps: carrying out the offline calibration of each fisheye camera based on a polynomial fisheye imaging model, constructing a pixel back projection lookup table, and carrying out the offline calibration of each fisheye camera; performing table lookup type distortion removal processing on the acquired fisheye image; extracting multi-region checkerboard angular points, and establishing a cross-view-angle corresponding point set; solving an initial homography matrix from each fisheye camera to the aerial view reference plane, constructing a joint objective function including a checkerboard re-projection error, an overlapping region alignment error and a physical scale constraint, and performing global joint optimization on all the homography matrixes; generating each path of aerial view sub-graph by adopting a reverse mapping strategy; according to the method, the calibration process is visual, the geometric accuracy, the real-time performance and the engineering transportability are high, and the method is suitable for automatic parking, a vehicle looking-around system and automatic driving environment perception.
Owner:JILIN UNIVERSITY

Anti-halo interference fisheye image effective area detection method

The invention discloses an anti-halo interference fisheye image effective area detection method, which performs modeling simulation on halo interference possibly existing in a fisheye image shooting process aiming at halo intensity, fuzzy degree, color, position and size factors, and constructs a fisheye image effective area detection model based on a deep neural network. The input of the model is a halo interference fisheye image, the output is the center coordinate and size of an effective area, and the anti-halo interference fisheye image effective area detection model comprises a fisheye image type identification module, an effective area identification module and an effective area parameter extraction module. The fisheye image effective area detection method provided by the invention has stronger robustness and higher detection precision for various halo interferences, can effectively solve the problems existing in the traditional method, and further improves the distortion parameter estimation precision and the distortion correction effect of the fisheye image.
Owner:NAT UNIV OF DEFENSE TECH