3D Pose Key Image Localization Using Mobile Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D modeling technologies require expensive hardware and are impractical for efficient creation and positioning of objects in augmented reality environments.
Innovation Solution
Utilizing existing mobile devices with cameras, accelerometers, and gyroscopes to create 3D models by generating salient point and RGB maps, and employing iterative methods for position determination within these models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If expensive 3D camera systems are used to create 3D models for augmented reality, then the quality and accuracy of position determination is improved, but the cost and device complexity increase significantly
Solution Approach 1:
The patent makes mobile devices perform multiple functions: they simultaneously capture images for 3D modeling, track position through visual features, and provide augmented reality content. The mobile device's camera and sensors serve dual purposes for both creating the 3D model and determining position within it, eliminating the need for separate expensive 3D camera systems.
Solution Approach 2:
The patent creates a digital copy of the environment through 3D modeling using visual features captured by the mobile device camera. This digital 3D model serves as a virtual representation that can be processed and analyzed without requiring physical 3D scanning hardware, enabling position determination through image comparison rather than direct spatial measurement.
2Manufacturing precision
If elaborate image processing techniques are used to create 3D models, then the quality of the 3D model is improved, but the processing time and computational requirements increase
Solution Approach 1:
The patent performs preliminary actions by continuously capturing images and pre-processing them during the user's movement through the environment. Visual features are extracted and the 3D model is constructed in advance, so that when position determination is needed, the model is already available for immediate comparison and matching, reducing real-time processing requirements.
Solution Approach 2:
The patent divides the 3D modeling process into segments: capturing individual images, extracting visual features from each image, constructing the 3D model from these features, and then using the segmented model for position determination. This segmentation allows parallel processing of multiple images and features, improving overall efficiency while maintaining model quality.
3Productivity
If continuous image capture is performed to create 3D models in real time, then the model availability for augmented reality is improved, but the energy consumption and data processing load increase
Solution Approach 1:
The patent uses periodic action by capturing images at regular intervals during user movement rather than continuously. The system processes a sequence of periodically captured images to construct the 3D model, which reduces the total number of images that need to be processed while still providing sufficient data for accurate modeling and real-time augmented reality application.
Data Source
AI summary
An apparatus and method for position determination in a 3D model of an environment and a computer-executed iterative method for position determination in a 3D model of an environment. The method includes the steps of: a) acquisition of camera, gyroscope and accelerometer data, b) determination of visual features from the acquired camera sensor data, c) creation of a current key image of the pose (PK) from the visual features and the gyroscope and accelerometer sensor data, d) addition of the key image of the pose (PK) to a database, and e) position determination by comparing the current key image of the posture (PK) with those of the database.