83 results about "Stereo cameras" patented technology

A pest control system is disclosed comprising an optical, computational, and monitoring subsystem, optionally mounted on a mobile platform. The optical system may include a neutralizing laser or multi-wavelength light source, discovery and detail cameras (optionally stereo), a beam-steering mechanism, tunable focus, and optional thermal or depth sensors. The processor, such as a GPU or FPGA, identifies insect or biological targets, adjusts laser focus by depth, and controls beam activation. A monitoring system verifies safety by detecting humans or other non-target entities using environmental and thermal cameras; if detected, laser firing is inhibited. The mobile platform may use wheels, propellers, tracks, or cables, with GPS and data links for remote control. A visible light pre-flash may induce a blink reflex before firing. In some embodiments, a scouting drone transmits target coordinates to the neutralization unit, enabling coordinated, efficient, and safe laser-based pest control.

The present disclosure is a data positioning apparatus including a stereo camera which acquires visual data corresponding to 2D and 3D, an inertial measurement unit which acquires inertia data corresponding to acceleration and angular velocity data, and a computing module which receives data acquired from the stereo camera and the inertial measurement unit and performs computation of a visual SLAM engine.

The invention relates to a method for determining the position and / or orientation of tools of construction machines in a construction area, comprising the steps of: attaching at least one stereo camera to at least one construction machine or to a movable carrier, such that the stereo camera can detect at least one detection region within the construction area, preferably a working region of the construction machine, providing at least one reference point, the position of which is known relative to a predefined 3D world coordinate system and which can be recognised in the images of the stereo camera, in the detection region of the at least one stereo camera, calibrating the at least one stereo camera on the basis of the detection of the at least one reference point and triangulation in order to ascertain a transformation between the 3D world coordinate system and a 2D image coordinate system of the at least one stereo camera, preparing a virtual digital 3D terrain model of the construction area by means of digital image processing, in particular stereoscopy, and image recognition on the basis of the detection of the construction area by means of the at least one stereo camera, and representing predetermined working positions and detected actual tool positions and / or actual tool inclinations of the tool of the at least one construction machine in the virtual digital 3D terrain model.

An image processing device 20 includes a communication unit 21 and a controller 22 (processor). The communication unit 21 acquires a standard image and a reference image captured by a stereo camera 10. The controller 22 calculates a disparity based on the standard image and the reference image. The controller 22 calculates, at each pixel position, a cost value representing a degree of difference for each pixel position between the standard image and each of multiple images obtained by displacing the reference image by multiple different deviation amounts in a direction corresponding to a baseline length direction of the stereo camera 10. The processor aggregates the cost values using dynamic programming and calculates a disparity for each pixel position based on the aggregated cost values for each different deviation amount. The multiple different deviation amounts are discrete values at uneven intervals.

System and method for a computer vision technique for contactless measurement of vehicle toe are disclosed herein. The method includes capturing with a stereo camera an image containing a vehicle's wheel, segmenting the image, determining a suitable circular component of the wheel and computing the angle of the wheel relative to the camera and, subsequently, to the body of the vehicle. The method includes repeating the process for a plurality of wheels and computing the toe angle of the vehicle based on the obtained results.

To provide an electronic apparatus, a program, and an information processing method capable of accurately measuring a position of a pedestrian.SOLUTION: An electronic device (10) includes a disparity data processing unit (11) that generates disparity data based on image data acquired from a stereo camera, a skeleton detection unit (12) that detects a skeleton of a person included in the disparity data, a center-of-gravity recognition unit (13) that recognizes a center of gravity of the person based on the skeleton of the person, an ROI setting unit (14) that sets an ROI including the center of gravity of the person for the disparity data, and a conversion unit (15) that converts a position of the center of gravity of the person into a position in a sensor coordinate system based on the disparity data in the ROI.SELECTED DRAWING: Figure 1

The application provides a tunnel vehicle positioning and trajectory tracking method, device and system, the method comprising: acquiring lane marking corner point coordinates in the tunnel; determining the coordinates and direction cosine matrix of the stereo camera in the tunnel based on the lane marking corner point coordinates; wherein a plurality of groups of stereo cameras are installed at equal intervals on the tunnel vault center line, and each group of stereo cameras comprises a main camera and an auxiliary camera located on both sides of the tunnel vault center line; determining the monitoring field of view of the stereo camera based on the coordinates and direction cosine matrix of the stereo camera in the tunnel; acquiring images captured by the stereo camera in the monitoring field of view, inputting each frame of image into a trained Swin Transformer model, and obtaining a vehicle detection result; and determining the position and motion trajectory of the vehicle based on the vehicle detection results of different frames of images. The application can solve the technical problem of low accuracy of tunnel vehicle positioning and trajectory tracking results.

A method and a system are disclosed for maintaining accuracy of a photogrammetry system comprising a stereo pair of cameras and characterized by calibration parameters determined at initialization, the system for tracking one of a touch probe and a 3D sensor, the method comprising in use, continuously detecting a presence of a reduced number of 3D target points comprising at least one pair of 3D target points selected in a group comprising at least two 3D target points; measuring image position data associated with the at least one pair of 3D target points of the reduced number of 3D target points; computing at least one updated calibration parameter using the measured image position data and corresponding reference distance data associated with the at least one pair of 3D target points of the reduced number of 3D target points; and updating at least one calibration parameter of the photogrammetry system.

A robotic surgical navigation system is disclosed. An example system includes a stereoscopic camera and a robotic arm having an end-effector connected to the camera. The system also includes a navigation computer that determines a first transformation between the stereoscopic camera and a target surgical site, a second transformation between the end-effector and a robotic base of the robotic arm, and a third transformation between the robotic base and the target surgical site. The navigation computer calculates a fourth transformation using the first, second, and third transformations. The fourth transformation represents a transformation between the end-effector and the stereoscopic camera. The navigation computer uses the transformations to determine coordinates for a view vector of the stereoscopic camera that are in a coordinate system of the robotic arm, thereby enabling movement of the robotic arm based on commands provided by an operator in relation to the view vector of the camera.

The invention belongs to the technical field of new view angle synthesis, and discloses a generalized method for joint optimization of structured light and a neural radiation field. Superposing a plurality of complex components with independent phases to generate structured light; the sampling factor is applied to the structured light, bicubic interpolation is used for sampling the structured light, and the process is irrelevant to depth information; simulating a light transmission process from the scene to be measured to the stereo camera by adopting geometrical optics; a view angle conversion operation is completed according to the depth image and the shielding image of the camera view angle, the structured light is distorted to a binocular view angle, and an active stereo image is obtained; the active stereo image and the RGB stereo image generate stereo image features and a three-dimensional feature body together through a feature extractor, and a renderer based on a neural radiation field is adopted to perform new view angle synthesis and geometric prediction; the whole process from the structured light to the nerve radiation field can be microprocessed, and joint optimization is carried out.

A stereo camera includes a first lens, a second lens, a first image sensor and a second image sensor. The first lens has a first nodal point and a first optical axis passing through the first nodal point. The second lens has a second nodal point and a second optical axis passing through the second nodal point. The first lens and the second lens are spaced apart along a lens arrangement direction. The first image sensor disposed corresponding to the first lens has a first photosensitive surface. The second image sensor disposed corresponding to the second lens has a second photosensitive surface. The first optical axis is parallel to the second optical axis. In the lens arrangement direction, a geometric center of the first photosensitive surface is offset from the first optical axis, and a geometric center of the second photosensitive surface is offset from the second optical axis.

A visualization system includes a housing assembly having a head unit configured to be at least partially directed towards a target site. An optical coherence tomography (OCT) module and a stereoscopic camera are located in the housing assembly. A controller is in communication with the OCT module and the stereoscopic camera. The controller is adapted to acquire left OCT data and right OCT data of the target site, via the OCT module, and synchronously acquire left camera data and right camera data of the target site, via the stereoscopic camera. The controller is adapted to generate volume-rendered images, including: first and second OCT images based on the OCT data and first and second camera images based on the camera data. The first and second OCT images and the first and second camera images have matching parallax.

A system includes a console assembly, a trocar assembly operably coupled to the console assembly, a camera assembly operably coupled to the console assembly having a stereoscopic camera assembly, and at least one rotational positional sensor configured to detect rotation of the stereoscopic camera assembly about at least one of a pitch axis or a yaw axis. The console assembly includes a first actuator and a first actuator pulley operable coupled to the first actuator. The trocar assembly includes a trocar having an inner and outer diameter, and a seal sub-assembly comprising at least one seal and the seal sub-assembly operably coupled to the trocar. The camera assembly includes a camera support tube having a distal and a proximal end, the stereoscopic camera operably coupled to the distal end of the support tube and a first and second camera module having a first and second optical axis.

Systems and methods related to visual guidance for improving autonomous navigation with row following corrections in stereo camera systems are disclosed herein. A visual positioning system may implement a method for navigating a vehicle. The method may comprise: receiving navigation coordinates defining a route comprising a straight path; detecting detected lines that are parallel to the straight path based on images received from at least one camera on the vehicle; accessing ground truth data; deriving vehicle coordinates from the ground truth data; determining a centerline in vehicle coordinates based on the detected lines; determining corrected vehicle coordinates based on the centerline in vehicle coordinates and the vehicle coordinates from the ground truth data; and generating control signals to navigate the vehicle along the route using the corrected vehicle coordinates. The visual positioning system may maintain localization accuracy and provide drift correction in the presence of poor GPS or radio localization.

An autonomy computing system and a method of an autonomous vehicle for rectifying stereo images includes a memory storing computer executable instructions and a processor coupled to the memory, the processor, upon execution of the computer executable instructions, configured to: receive an image pair captured using respective cameras in the stereo camera pair; predict a rotation matrix between the first image and the second image by: extracting a first feature map and a second feature map; applying positional feature enhancement on the feature maps to derive a pair of enhanced feature maps; computing a correlation volume across the enhanced feature maps; determining a set of likely matches between the enhanced feature maps; computing a predicted relative pose; and computing the rotation matrix. The system and method further include calibrating the stereo camera pair to rectify the first image and the second image based on the rotation matrix.

Indirect time-of-flight (i-ToF) image sensor pixels, i-ToF image sensors including such pixels, stereo cameras including such image sensors, and sensing methods to obtain i-ToF detection and phase detection information using such image sensors and stereo cameras. An i-ToF image sensor pixel may comprise a plurality of sub-pixels, each sub-pixel including a photodiode, a single microlens covering the plurality of sub-pixels and a read-out circuit for extracting i-ToF phase signals of each sub-pixel individually.

A method for deriving at least one item of information from images of a stereo camera. A resource-saving and at the same time accurate derivation of information from the images is achieved by alternately using and processing the images with methods of monocular image processing and deriving at least one item of information from the results. A motor vehicle comprising a stereo camera and comprising a control device which carries out the method, are also described.

The application belongs to the technical field of automatic assembly, and discloses an automatic assembly system and method for large nuts of a water turbine ball valve, which comprises a mechanical arm, an end effector and an intelligent nut tightening control system. The end effector is integrated with an electromagnet adsorption mechanism, a servo-driven rotating mechanism, a floating compensation mechanism and a visual recognition mechanism. Different specifications of nuts are adaptively grabbed by the electromagnet, sub-millimeter-level accurate positioning is realized by using a laser galvanometer stereo camera, and the assembly posture is automatically adjusted in combination with the floating compensation mechanism. The intelligent control system adopts a phased tightening strategy, realizes real-time monitoring through a torque sensor, and has a double protection mechanism. The application realizes the full automation of the assembly of large nuts of a water turbine ball valve, has the advantages of high assembly efficiency, accurate positioning precision, strong adaptability, reliable quality and the like, solves the problems of high labor intensity, many safety hazards and poor quality consistency in manual assembly, and significantly improves the assembly quality and efficiency of key components of a hydropower station.

The utility model provides an intelligent quality detection device for welding, which relates to the field of intelligent quality detection equipment for welding and comprises a detection platform, a base for lifting the detection platform, a protective cover fixed at the top of the base, a fixing mechanism and a three-jaw chuck for fixing a workpiece, the detection unit comprises a PLC (Programmable Logic Controller) fixed on the surface of the base and a display screen fixed on one side of the protective cover; the visual detection assembly and the three-dimensional detection assembly are combined, a CCD camera in the visual detection assembly can shoot images to obtain plane visual information of a welding part, a line laser scanner in the three-dimensional detection assembly can obtain three-dimensional contour information of the welding part, and the visual detection assembly and the three-dimensional detection assembly work cooperatively to achieve the effect of detecting the welding part. The defects of a single detection mode are overcome, the problems that a stereo camera is low in resolution and insufficient in precision are effectively solved, and therefore the welding quality detection precision is improved.

Method for generating a three-dimensional image (A, A2) of at least a partial section of a row of teeth (Z) using a stereo camera system (1) of an operating microscope (2), wherein the stereo camera system (1) comprises a first image acquisition device (5a) and a further image acquisition device (5b), wherein a. in an image (I5a) produced by the first image acquisition device (5a) and in an image (I5b) produced by the further image acquisition device (5b) a mirror image (S5a, S5b) is detected, which is provided by a mirror element (3) that is arranged in a detection area (4) of the stereo camera system (1) such that a mirror image of at least one part of the row of teeth (Z) can be imaged by the first and further image acquisition devices (5a, 5b), b. a pose (P) of the mirror element (3) is determined, c. the three-dimensional image (A, A2) is determined as a function of at least the imaged mirror images (S5a, S5b) and the pose (P) of the mirror element (3).

This invention relates to the field of robotics and discloses a visual spatial information-based intelligent latte art data acquisition system for robotic arms, including modules for visual acquisition, coordinate calibration, trajectory recording, processing, playback, evaluation, and online learning. The system utilizes a monocular wide-angle fisheye camera with auxiliary mirror components to construct a virtual stereo camera array, combining inertial data to achieve image anti-blurring acquisition. It employs a hardware timestamp-based alignment strategy to fuse multi-source heterogeneous data. The trajectory processing module calculates the relative transformation matrix between the two arms and uses null space optimization to generate joint trajectories. The trajectory playback module constructs a model predictive control framework, combining fluid state adaptive compensation and visual delay matching strategies to drive dual-arm collaboration. The online learning module updates control parameters in real time through a residual dynamics model. This invention solves the problems of data asynchrony and unmodeled dynamic interference in fluid manipulation, achieving high-precision acquisition and reproduction of latte art movements.

A cloud measuring system includes: a stereo camera capturing stereo images by cameras each changing pan and tilt angles; a camera control section controlling the pan and tilt angles to control imaging; a reception section receiving the stereo images; a matching coordinate acquisition section acquiring a feature point of an object in the stereo images, and acquiring, as matching coordinates, a combination of reference coordinates where the feature point is to be located in the images, and coordinates of the acquired feature point; a difference detection section acquiring a displacement amount of the feature point from the matching coordinates, acquiring direction difference amounts in pan and tilt directions from the displacement amount, and generating correction information; a correction processing section correcting the stereo images on the basis of the correction information; and a height estimation section estimating a cloud height on the basis of the corrected stereo images.

The mark-up apparatus includes a fiducial marking arrangement for being manually securely placed on a cable strain relief for visually distinctively marking the cable strain relief, a stereo camera for acquiring a live stereo video of an ultrasound scan probe scanning a patient's region of interest and a mark-up module for processing the live stereo video of the ultrasound scan probe scanning the patient's region of interest and overlaying navigation pointer mark-up(s) to the marked-up live video for instructing a human operator how to manipulate the ultrasound scan probe relative to the patient's region of interest.

Methods, apparatus, systems, and articles of manufacture are disclosed to calibrate a stereo camera. An example apparatus includes means for determining a motion grid between a first image and a second image captured by the stereo camera; means for determining a calibration value to calibrate the stereo camera based on a prior calibration value, a relative orientation between the first image and the second image based on the motion grid, and a metric indicative of calibration improvement; and means for estimating a depth based on the calibration value.

The invention relates to a method for determining the position and / or orientation of a tool of a construction machine in a construction area, comprising the following steps: attaching at least one stereo camera to at least one construction machine or a movable carrier, such that the stereo camera can detect at least one detection area, preferably at least one detection area within the construction area; the working area of the construction machine provides at least one reference point in the detection area of the at least one stereo camera, the position of which is known with respect to a predefined 3D world coordinate system and which can be distinguished in the image of the stereo camera. Calibrating the at least one stereo camera on the basis of the detection and triangulation of the at least one reference point in order to ascertain a transformation between a 3D world coordinate system and a 2D image coordinate system of the at least one stereo camera, and calibrating the at least one stereo camera on the basis of the detection of the construction region by means of the at least one stereo camera in order to ascertain the transformation between the 3D world coordinate system and the 2D image coordinate system of the at least one stereo camera. A virtual digital 3D topographic model of the construction region is prepared by means of digital image processing and image discrimination, in particular the digital image processing is stereoscopic, and representing a predetermined working position of a tool of the at least one construction machine and the detected actual tool position and / or actual tool tilt in the virtual digital 3D terrain model.

The present invention provides an automated system (100) and a method (300) for performing blood vessel imaging, 3D reconstruction and assisted intrusion using machine learning techniques comprising an imaging module (102) incorporating plurality of monochrome infrared stereo camera (104) with Near-Infrared Light (NIR) illumination (106); a robotic arm (108) to perform assisted intrusion with the feedback of a 3D reconstructed blood vessel; and a control unit (110) incorporating plurality of microprocessors with neural network to employ machine learning to control and automate 3D reconstruction and intrusion of blood vessel using machine learning techniques in real-time, wherein the neural network comprises of an image registration module, image library construction module, a training module, and a 3D reconstruction module.

Provided is an external environment recognition device that can expand the range of situations in which parallax error of a stereo camera can be corrected (adjusted) during vehicle travel. For a landmark identified, through fusion of a stereo camera 1 (including a parallax error-based distance measurement error) and a millimeter-wave radar 2, as corresponding to the same landmark, a parallax error correction amount for the stereo camera 1 is calculated using a high-precision distance detected by the millimeter-wave radar 2, and is integrated with a parallax error correction amount obtained using the stereo camera 1 alone. As a result, it is possible to achieve the effect of expanding the range of situations to which parallax error correction (adjustment) of the stereo camera 1 can be applied during vehicle travel.