Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

103 results about "Stereo camera" patented technology

A stereo camera is a type of camera with two or more lenses with a separate image sensor or film frame for each lens. This allows the camera to simulate human binocular vision, and therefore gives it the ability to capture three-dimensional images, a process known as stereo photography. Stereo cameras may be used for making stereoviews and 3D pictures for movies, or for range imaging. The distance between the lenses in a typical stereo camera (the intra-axial distance) is about the distance between one's eyes (known as the intra-ocular distance) and is about 6.35 cm, though a longer base line (greater inter-camera distance) produces more extreme 3-dimensionality.

Demonstration-free welding robot path planning system based on visual autonomous learning

The invention provides a teaching-free welding robot path planning system based on visual autonomous learning, and relates to the technical field of industrial welding, and the teaching-free welding robot path planning system comprises a pose compensation module which is used for arranging three infrared reflective mark points on the surface of a clamp base in an L shape, collecting original point clouds of the mark points and a workpiece by using a stereo camera, and preprocessing the point clouds; generating a pose compensation matrix based on the offset of the actual coordinate and the theoretical coordinate of the mark point, and outputting a de-noising point cloud data set and a compensation matrix; and the pose correction module is used for fitting a workpiece plane equation by adopting a random sampling consistency algorithm on the basis of the de-noised point cloud data set, acting a pose compensation matrix on the workpiece plane equation, correcting a pose error caused by clamp drifting, calculating a welding seam track end point coordinate and outputting a corrected welding seam pose parameter and a scanning pose instruction. According to the method, clamp drift can be compensated, weld joint poses can be corrected, three-dimensional features are extracted, a collision-free path is planned, and the welding precision, efficiency and automation degree are improved.
Owner:FUJIAN MINGXIN INTELLIGENCE TECH CO LTD

Multimodal shared telerobotic system and method for three-arm space robot

A multimodal shared telerobotic system and method for a three-arm space robot, the system at least includes a local-site system, a communication module, and a remote-site system, where the local-site system includes two force-feedback haptic devices for left and right hands, a microphone array, and upper computer software; the remote-site system includes two robotic arms provided with end-effectors, an observation arm with a stereo camera installed at an end thereof, two force sensors, a vision unit and lower computer software; an operator can control the two robotic arms of the robot outside a cabin for performing operations, and control the observation arm to obtain a better local view; and a multimodal telerobotic control method of pose control, voice control, and force control is integrated with the robot's autonomous control through a shared control algorithm.
Owner:SOUTHEAST UNIV

Information processing device and information processing method

Provided is an image generation device which detects an obstacle that is present in the surrounding space, on the basis of a captured image obtained by a stereo camera of a head-mounted display, and sets a boundary 72 of a play area in which a user wearing the head-mounted display is allowed to move. When a new obstacle is detected inside the play area, the image generation device generates tangent lines 82a and 82 from an observation point H on a floor surface to a contour 80 of the obstacle and uses the tangent lines and a portion which is a part of the contour 80 and which is between tangent points AB to set a new boundary 86 of the play area.
Owner:SONY INTERACTIVE ENTERTAINMENT LLC

A teaching-free welding robot path planning system based on visual autonomous learning

The present invention provides a teaching-free welding robot path planning system based on visual autonomous learning, which relates to the field of industrial welding technology. The system comprises: a posture compensation module for arranging three infrared reflective marking points in an L-shape on the surface of a fixture base, using a stereo camera to collect the original point cloud of the marking points and the workpiece, and preprocessing the point cloud; generating a posture compensation matrix based on the offset between the actual coordinates and the theoretical coordinates of the marking points, and outputting a denoised point cloud data set and the compensation matrix; a posture correction module for fitting the workpiece plane equation based on the denoised point cloud data set using a random sampling consistency algorithm, applying the posture compensation matrix to the workpiece plane equation, correcting the posture error caused by fixture drift, calculating the coordinates of the weld trajectory endpoints, and outputting the corrected weld posture parameters and scanning posture instructions. The present invention can compensate for fixture drift, correct weld posture, extract three-dimensional features, and plan a collision-free path, thereby improving welding accuracy, efficiency, and automation.
Owner:FUJIAN MINGXIN INTELLIGENCE TECH CO LTD

Stereo Camera System

A computer implemented method and associated control system for monitoring the operational use of an agricultural machine. Raw image data from a stereo camera system is processed through application of an epipolar image rectification to generate a rectified image data set. The rectified dataset is utilized to generate a disparity map indicative of depth within the image data, which is used as an input to one or more assisted or automated operational tasks for the agricultural machine.
Owner:AGCO INT GMBH

Method for capturing three-dimensional images with the aid of a stereo camera having two cameras, as well as method for producing a redundant image of a measurement object, and apparatus for carrying out the methods

For three-dimensional image capture with the aid of a stereo camera having two cameras, an image of a three-dimensional scene is first captured simultaneously with the two cameras. Characteristic signatures of scene objects within each captured image are determined and assigned to each other in pairs. Characteristic position deviations of the assigned signature pairs from each other are determined. The position deviations are filtered in order to select assigned signature pairs. Based on the selected signature pairs, a triangulation calculation is performed to determine depth data for the respective scene objects. A 3D data map of the captured scene objects within the captured image of the three-dimensional scene is then created. This results in a method for capturing three-dimensional images, which is well adapted for practical use, in particular, for capturing images to safeguard autonomous driving.
Owner:TRIPLEYE GMBH

Automatic ultrasonic scanning method and system

The invention relates to the technical field of medical equipment, and discloses an automatic ultrasonic scanning method and system. The automatic ultrasonic scanning method is applied to a scanning robot and specifically comprises the following steps that S101, image-mechanical arm registration is carried out on an ultrasonic image coordinate system and a mechanical arm end executor, a conversion relation from image pixel coordinates to a world coordinate system is established, hand-eye calibration is carried out on a stereoscopic vision camera and the scanning robot end executor, and a three-dimensional image is obtained; and solving a transformation matrix between the camera coordinate system and the scanning robot coordinate system, calculating rigid transformation between the stereo camera coordinate system C and the end effector coordinate system EE, and realizing unified mapping from the visual coordinates to the scanning robot coordinate system. According to the method, the deep learning image segmentation method is combined, and the TransUNet model can realize high-precision synchronous identification of various tissues such as muscles and bones, so that the segmentation effect and the identification accuracy of the image are remarkably improved.
Owner:SHENZHEN BEAUTIFUL RUBIKS CUBE ROBOT CO LTD

Object scale utilizing away-facing images

ActiveUS12670649B2Stereo cameraRadiology
Methods, systems, mobile devices, and non-transitory computer-readable mediums for determining a scale of an object with a mobile device. The mobile device includes at least one object-facing camera (e.g., a monocular camera) and an away-facing stereo camera system. Information captured using the away-facing stereo camera system is used to estimate relative pose information for determining the scale of the object in images captured by the object-facing camera. The proposed system leverages the scene images surrounding the mobile device to resolve scale ambiguity and calculate the absolute scale.
Owner:SNAP INC

Tracking of retinal traction through digital image correlation

A tracking system for quantifying retinal traction on a retina of a patient eye includes an indicator device, a stereo camera, and an electronic control unit (ECU). The stereo camera collects and outputs stereo image data. The ECU, which is in communication with the indicator device, executes a method by receiving the stereo image data from the stereo camera during an ophthalmic procedure and thereafter assigning tracking points as coinciding pixels within stereo image pairs. The ECU also automatically performs a digital image correlation (DIC) process using the stereo image pairs to ascertain relative motion of the tracking points, and associates relative motion of the tracking points with the retinal traction using a traction map. A numeric traction quotient is generated that is indicative of magnitude of retinal traction. The ECU executes a control action using the indicator device based on the numeric traction quotient.
Owner:ALCON INC

Stereo camera apparatus and method for generating a parallax image from low sensitivity and high sensitivity sub-pixel array

An imaging apparatus has a plurality of cameras, each including: an imaging device in which unit pixels are periodically arranged, the unit pixels including high sensitivity sub-pixels that output a first output value for a certain exposure amount and low sensitivity sub-pixels that output a second output value lower than the first output value for a certain exposure amount; a composition section that selects and outputs an output of the high sensitivity sub-pixels and an output of the low sensitivity sub-pixels when the exposure amount is smaller or larger than the predetermined exposure value, respectively; and an amplification section that amplifies and outputs an output of the composition section, and so that image signals of the high and low sensitivity sub-pixels in the same predetermined exposure values become the same between the plurality of cameras, corrects the image signals of the high and low sensitivity sub-pixels.
Owner:ASTEMO LTD

Method and apparatus for determining marker position and orientation - Patents.com

The method and apparatus for determining the position and orientation of a marker having encoded information includes acquiring images of the marker with a stereo camera. A center of the marker is determined, and then a position of the marker is determined based on the center of the marker. A number of vertices are then determined about the center of the marker. The number of vertices are used to determine the pitch, roll and orientation of the marker. The orientation of the marker is determined based on the pitch, roll and orientation of the marker. The method and / or apparatus for determining the position and orientation of a marker can be used in a range of applications for determining the position and orientation of an object on which the marker is placed.
Owner:TOPCON POSITIONING SYSTEMS INC

Test system for testing a LIDAR device

The invention relates to a test system for testing a LIDAR device (1), comprising a controller (5) for generating LIDAR information relating to a simulated LIDAR object based on a real object to be reproduced for a test process, wherein the LIDAR information includes at least one item of two-dimensional contour information and an item of depth information relating to a virtual distance of the simulated LIDAR object; comprising a LIDAR image generation device (6) for generating the simulated LIDAR object based on the LIDAR information; and comprising a LIDAR projection device (7) for projecting the simulated LIDAR object (9) onto a projection surface (8). The depth information is determined on the basis of a time component between the projection surface (8) and the LIDAR device (1) to be tested, which is defined by the controller (5). In one embodiment, a video image generation device can be provided, in order to generate a visible video image of at least one real object on the projection surface. The IR image which is not visible for people and which is projected by the LIDAR projection device is overlayed in a synchronised manner with a video image that is visible for people. In a variant, the test system is suitable for also testing a stereo camera, in addition to the LIDAR device, e.g. which is integrated in a vehicle to be checked, but can also be provided independently, yet in combination with the LIDAR device.
Owner:HORIBA EUROPE GMBH

3D reconstruction method for underwater damage of marine equipment based on vision and IMU fusion

The present invention provides a 3D reconstruction method for underwater damage of marine equipment based on vision and IMU fusion. The method includes the steps of performing, in an underwater environment, internal parameter calibration of the left and right cameras of a stereo camera and extrinsic parameter calibration between the left and right cameras of the stereo camera and a platform IMU; calibrating the extrinsic parameter matrices of the drive IMU coordinate system and the laser sensor coordinate system on each axis of the drive system; identifying and roughly locating the damaged area based on the 3D reconstruction of the underwater vision; planning an optimal path for the underwater mobile platform, performing local obstacle avoidance based on the 3D reconstructed point cloud, and controlling the underwater mobile platform to move near the damaged area; planning a trajectory for a drainage system and draining water using the drainage system; and determining the laser position of a laser sensor using drive IMU data to realize a precise 3D reconstruction of the damaged area based on the laser sensor data. This method provides a highly accurate 3D reconstruction of the damaged area, assisting other equipment in autonomous repair and improving the work efficiency of the marine equipment.
Owner:SOUTH CHINA UNIV OF TECH

Situational awareness systems and methods and micromobility platform

A system for providing situational awareness to a cyclist or other user of a micromobility vehicle comprises a stereo camera assembly and processing logic configured to determine, based on images acquired by the stereo camera assembly, a distance between the cyclist and an object of interest (e.g., a vehicle). The system is configured to determine a threat level of the object based one or more factors such as, e.g., a speed of the object and / or a category of the object. In some examples, the system includes a display and / or an audio indicator to convey information to the cyclist about detected threats. In some examples, the system is configured to produce an audio indication in response to a threat exceeding a threshold threat level. A software platform may be configured to store and / or process micromobility data gathered from one or more users.
Owner:VELIOS INC

Surroundings monitoring device and method for operating a surroundings monitoring device

An environmental monitoring device for vehicles comprises a stereo camera having two fisheye lenses, an image sensor device having at least two sensor regions for detecting optical signals from the fisheye lenses in one of the sensor regions each and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each have at least a first partial region corresponding to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second partial region corresponding to a second aperture angle within the maximum aperture angle of the respective fisheye lens, a processing unit for processing the image data signals output by the image sensor device and for providing the processed image data signals, wherein the processing unit is adjustable in order to, in particular at a respective time,to process the image data signals selectively according to only one of the partial areas, and a control unit for adjusting the processing unit.,
Owner:SICK AG

Freight object tracking method based on machine vision

The invention provides a freight object tracking method based on machine vision, and belongs to the technical field of logistics conveying object visual tracking, and the method comprises the steps: carrying out the barcode recognition, volume measurement and queue creation of a freight object, carrying out the volume measurement of the freight object through a line laser stereo camera on a conveying line, and creating a queue of the conveying line; acquiring multi-dimensional features of the freight objects and supplementing the multi-dimensional features into queue information of the freight objects; a plurality of main line detection points are configured on a main line of the conveying line, and a plurality of branch line detection points are configured on a plurality of branch lines respectively; the plurality of main line detection points track the motion trail of the freight object on the main line; when the freight object is about to be transferred from the main line to the branch line, the identified freight object is removed from the main line freight object queue and inserted into the tail part of the branch line freight object queue of the corresponding branch line; and the branch line detection point further tracks the freight object. And through video measurement and tracking of a plurality of links, the reliability and the accuracy of whole-process conveying of the material objects are improved.
Owner:LINGSHENG (WUHAN) TECHNOLOGY CO LTD

Camera calibration method, and stereo camera device

A camera calibration method for calibrating a camera that captures an image through a windshield includes acquiring a calibration image associated with a calibration object by imaging by the camera. A calibration object has a linear portion extending in one direction intersecting an optical axis of the camera through the windshield, and the calibration object is a wire or a bar. The method further includes extracting a first linear portion image corresponding to the linear portion from the calibration image. The method further includes correcting distortion of the calibration image by comparing the first linear portion image with a second linear portion image captured when the linear portion is imaged by the camera not through the windshield.
Owner:ASTEMO LTD

Multi-flash stereo camera for photo-realistic capture of small scenes

A method may include receiving a plurality of pairs of images of a scene captured by a camera, receiving a pose of the camera when each of the pairs of images of the scene were captured, determining depth values of the scene for each pair of images, and training a neural network to receive a pose of a camera with respect to the scene, and output a geometry of the scene and an appearance of the scene with respect to the pose. The plurality of pairs of images, the poses of the camera, and the depth values may be used as training data to train the neural network. The neural network may include a first component that receives the pose as input, and outputs the geometry of the scene and an embedding, and a second component that receives the embedding as input, and outputs the appearance of the scene.
Owner:CARNEGIE MELLON UNIV +2

Device and method for large deformation measurement and material property estimation of beam-shaped polymer materials using stereo camera

The present invention relates to a device and a method for large deformation measurement and material property estimation of beam-shaped polymer materials using a stereo camera and, more specifically, to a device and a method for large deformation measurement and material property estimation of beam-shaped polymer materials using a stereo camera, the device comprising: a fixing unit for fixing an end of an object; a linear stage for applying tension to a wire embedded in the object fixed to the fixing unit in a gravity direction; a load cell for measuring the tension applied to the wire; a stereo camera for photographing a deformation curve by deforming the object in accordance with the tension applied to the wire; a data collection unit for collecting tension data measured from the load cell; and a controller for controlling at least one of the linear stage or the stereo camera.
Owner:PUSAN NAT UNIV IND UNIV COOPERATION FOUND

Computer vision based wide-area snow / water level estimation using disparity map

Computer vision based, wide-area snow / water level estimation methods using disparity maps. In one embodiment our method provides rich depth-information using a stereo camera and image processing. Scene images at normal and snow / rain weather conditions are obtained by a double-lens stereo camera and a disparity map is generated from the scene images at left and right lenses using a self-supervised deep convolutional network. In another embodiment, our method uses a single point snow / water level sensor, a stationary monocular camera to measure snow / water levels covering a wide area.
Owner:NEC CORP

Service robots, especially robotic lawnmowers

UndeterminedDE102024212293A1ManipulatorStereo cameraEngineering
The invention relates to a camera-based service robot (1), in particular a robotic lawnmower (10), with a first camera module (112), in particular a front camera module (112a), preferably a stereo camera module (113). It is proposed that a second camera module (112), in particular a rear camera module (112b), preferably a stereo camera module (113), is structurally identical to the first camera module (112) and / or that the height (hv, hr) of the lenses (23a, 23b) of the camera modules (112) above a mounting or standing plane (104) of the service robot (1) is essentially the same, and / or that a camera module (112), preferably the front camera module (112a), is arranged in particular directly above a control or regulating unit (110) and / or that a camera module (112), preferably the rear camera module (112b), is arranged in particular directly above a battery pack compartment (12).
Owner:ROBERT BOSCH GMBH

A freight object tracking method based on machine vision

This invention proposes a machine vision-based freight object tracking method, belonging to the field of visual tracking technology for logistics conveying objects. The method includes barcode recognition, volume measurement, and queue creation for freight objects. After the freight objects pass through the conveyor line, their volume is measured by a linear laser stereo camera, and then a conveyor line queue is created. Multidimensional features of the freight objects are acquired and added to the freight object queue information. Several mainline detection points are configured on the main conveyor line, and several branch line detection points are configured on several branch lines. The mainline detection points track the movement trajectory of the freight objects on the main line. When a freight object is about to transfer from the main line to a branch line, the identified freight object is removed from the mainline freight object queue and inserted into the end of the branch line freight object queue of the corresponding branch line. The branch line detection points further track the freight object. Through video measurement and tracking at multiple stages, the reliability and accuracy of the entire material object transportation process are improved.
Owner:LINGSHENG (WUHAN) TECHNOLOGY CO LTD

Device for guiding six-axis collaborative robot to move through three-dimensional camera and laser

The invention discloses a device for guiding a six-axis collaborative robot to move through a three-dimensional camera and a laser, and the device comprises the six-axis collaborative robot (10) and a three-dimensional camera and laser combined device (20) which are installed on a support (1). The three-dimensional camera and laser combination device (20) further comprises a three-dimensional camera (2), a laser mounting rack (3) and at least two lasers. The three-dimensional camera (2) is rotatably mounted on the support (1) through a first multi-angle indexing table (5), the laser mounting rack (3) is rotatably mounted on the support (1) through a second multi-angle indexing table (6), and the laser is rotatably mounted on the laser mounting rack (3) through a multi-angle rotating table (7). The device provided by the invention can guide the robot to operate through real-time three-dimensional modeling, more accurately detect or calibrate an object, realize visibility and remote control, and is wide in application.
Owner:YAU LEE WAH CONSTRUCTION MATERIALS (HUIZHOU) COMPANY LIMITED

Information processing device and information processing method

A play area detection section of an image generation device detects a play area based on an image captured by a stereo camera of a head mounted display, and prompts a user to discern the play area. A play area edition section receives an editing operation for drawing a new boundary for the play area, and detects an edited play area. If the size of a circumscribing rectangle exceeds an upper limit, the play area edition section trims the play area along a cut line that is perpendicular to an adjustment axis x, and determines a final play area.
Owner:SONY INTERACTIVE ENTERTAINMENT LLC

A system and method for singulation control of pieces for logistics

The application provides a single-piece separation control system and method for logistics, which comprises a rack, a diffusion type material distribution conveying belt group, a differential speed material distribution conveying belt group and a centripetal conveying mechanism arranged in sequence along a material conveying direction, a diffusion type baffle is arranged on the diffusion type material distribution conveying belt group, the inlet to the outlet of the diffusion type baffle gradually expands, differential speed material distribution baffles are arranged in parallel on both sides of the differential speed material distribution conveying belt group, a contraction type baffle is arranged on the centripetal conveying mechanism, a binocular structured light intelligent stereo camera is arranged above the differential speed material distribution conveying belt group of the rack, and the differential speed material distribution conveying belt group is provided with array-distributed material distribution conveying units. Signals transmitted by the binocular structured light intelligent stereo camera are used to control the speed of each material distribution conveying unit to differentially separate materials.
Owner:HANGZHOU QIANJIN CONVEYING EQUIP CO LTD

System and method for a forestry vehicle

A system for measuring and analyzing a forest area, comprising at least one stereo camera, a camera control unit, a computing unit to receive data from the stereo camera and to compute the received data and to calculate and determine information based on the data, a display unit, configured to display the results to an operator of a forestry vehicle, the system being configured to be integrated in a forestry vehicle, wherein the information is any one of the following, the shape of a tree or stem, the type of tree, the bark or surface of a tree or stem, irregularities of a tree or stem, diameter of a tree or stem, density or basal area of a working area of the forestry vehicle.
Owner:DEERE & CO

Hot-rolled coil strapping line connecting robot

The hot-rolled coil strapping line connecting robot is arranged on one side close to the opening direction of the C-hook and is used for connecting the hot-rolled coil strapping line. It includes a horizontal linear module (1), a connecting wire feeding device (2), a circular moving device (3), a stereo camera (4), a strapping line connecting manipulator (5) and a lifting cylinder (6). The robot of the present invention has automated operation, simple structure, good reliability and high production efficiency; replacing the traditional manual operation mode can effectively reduce the casualty rate of production accidents and labor costs of workers; improving the firmness of strapping brings many conveniences to the transportation and storage of hot-rolled coils.
Owner:HEBEI UNIV OF SCI & TECH

Stereo camera device and calibration method

A stereo camera device includes: a storage unit that stores correlation information of a parallax error in a horizontal direction with respect to a vertical shift of a plurality of images respectively captured by a plurality of cameras through a refractile body that refracts light; a matching unit that matches the plurality of images obtained by the plurality of cameras capturing a same subject to obtain a vertical shift of the plurality of images; a parallax error estimation unit that estimates a parallax error of the plurality of images having been matched based on the vertical shift and the correlation information; and a distance calculation unit that corrects, using the parallax error, a parallax of the image having been matched.
Owner:ASTEMO LTD

Intelligent three-dimensional camera equipment based on 3D panoramic vision

The utility model belongs to the technical field of intelligent three-dimensional camera equipment, and discloses intelligent three-dimensional camera equipment based on 3D panoramic vision, which comprises a mounting seat and an equipment main body, the upper end surface of the mounting seat is rotatably connected with a rotating shaft I, the top end of the rotating shaft I is provided with a supporting seat, and the upper end surface of the supporting seat is provided with a mounting block; a supporting block is installed on the periphery of the second rotating shaft, a supporting plate is installed on the upper end face of the supporting block, a pair of sliding grooves is formed in the upper end face of the supporting plate, and a right-hand and left-hand thread lead screw is rotationally connected between the pair of sliding grooves; a pair of sliding blocks are in threaded connection with the peripheries, in the pair of sliding grooves, of the right-hand and left-hand thread lead screws, clamping blocks are installed on the upper end faces of the sliding blocks, and the equipment body is placed on the upper end face of the supporting plate and located between the pair of clamping blocks. The device is simple and reasonable in structure, novel in design, easy to operate, high in practicability and convenient to widely popularize and use.
Owner:ZHONGNAN UNIVERSITY OF ECONOMICS AND LAW