Single-Camera 3D Object Positioning From Image Geometry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies rely heavily on multiple sensors and hardware to obtain three-dimensional coordinate values for external objects, which can be costly and complex, whereas a method is needed to identify the position of external objects using only images from a camera.
Innovation Solution
An electronic device with a camera and processor that obtains two-dimensional coordinate values from an image, compensates for lens distortion, and uses extrinsic parameters to calculate three-dimensional coordinate values of external objects without requiring additional sensors like LiDAR or radar.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple sensors and hardware (LiDAR, ToF cameras) are used for accurate 3D object positioning, then measurement precision is improved, but device complexity and cost increase
Solution Approach 1:
The patent extracts and eliminates the need for additional sensing hardware (LiDAR, ToF cameras) from the system. It achieves 3D positioning using only the camera's existing 2D image data by applying geometric transformations and mathematical calculations, thereby reducing device complexity while maintaining positioning accuracy
Solution Approach 2:
The patent creates a virtual 3D representation of the external object by copying and transforming 2D coordinate information from the camera image into 3D space through mathematical modeling. This virtual 3D model enables accurate positioning without requiring physical 3D sensing hardware
2Measurement precision
If multiple sensors and hardware are used for accurate 3D object positioning, then measurement precision is improved, but cost increases
Solution Approach 1:
The patent makes the camera serve multiple functions: it not only captures 2D images for object recognition but also performs 3D positioning tasks. By enabling the single camera to handle both 2D and 3D functions through software algorithms, the system eliminates the need for separate 3D sensing hardware, thereby reducing manufacturing cost
Solution Approach 2:
The patent creates a virtual 3D representation of the external object by copying and transforming 2D coordinate information from the camera image into 3D space through mathematical modeling. This virtual 3D model enables accurate positioning without requiring physical 3D sensing hardware
3Device complexity
If only camera images are used for 3D object positioning, then device complexity is reduced, but measurement precision may deteriorate
Solution Approach 1:
The patent transforms 2D coordinate information from the camera image into 3D spatial coordinates through mathematical transformations. By applying dimensionality change techniques (converting 2D image coordinates to 3D world coordinates using camera parameters and geometric relationships), the system achieves accurate 3D positioning using only 2D camera data
Solution Approach 2:
The patent changes the parameters and representation of the coordinate system from 2D image space to 3D world space. By transforming coordinates, applying perspective projections, and using camera intrinsic/extrinsic parameters, the system extracts precise 3D position information from 2D images
Data Source
AI summary
An electronic device according to an embodiment may include a camera and a processor. The processor may be configured to obtain, from an image obtained using the camera, two-dimensional coordinate values representing vertices of a portion related to an external object. The processor may be configured to identify a first line extending along a reference direction on a reference plane included in the image and overlapping a first vertex of the vertices, and a second line connecting a reference point within the image and a second vertex of the vertices. The processor may be configured to, based on an intersection of the first line and the second line, obtain three-dimensional coordinate values representing each of vertices of a three-dimensional external space corresponding to the external object.