3D Model Generation via Device Motion Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of electronic devices face difficulties in navigating and generating three-dimensional models of objects or environments due to the limitations of two-dimensional displays, requiring manual input mechanisms and specialized equipment, which can be cumbersome and inaccessible to most users.

Innovation Solution

Incorporating motion-sensing components like accelerometers and gyroscopes into electronic devices to detect deterministic movements, allowing for automatic changes in displayed information, enabling three-dimensional navigation and model generation by correlating device movements with spatial relationships in recorded videos.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual input mechanisms are used for three-dimensional navigation, then control precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system uses the device's own motion sensors (accelerometer, gyroscope) to automatically detect user movements and translate them into navigation commands, eliminating the need for separate manual input mechanisms. The device serves itself by converting its physical movement into digital navigation actions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces mechanical input devices (mouse, keyboard, touchscreen buttons) with motion sensing technology. The accelerometer and gyroscope detect physical movements and convert them into navigation commands, substituting mechanical interaction with sensor-based automatic control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If specialized equipment is used for generating three-dimensional models, then manufacturing precision is improved, but ease of manufacture deteriorates

Engineering Contradiction:
Improvemodel generation precisionVSAvoidease of manufacture
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent makes the portable electronic device universal by enabling it to perform both viewing and generation of three-dimensional models using its built-in camera and motion sensors. The device can capture images, detect motion, and process data to create 3D representations without requiring specialized equipment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates a digital copy or representation of the physical three-dimensional object by capturing images from multiple angles and processing them through computational algorithms. This virtual model replicates the physical object's geometry and can be manipulated independently.

Inventive Principle:
Principle #26Copying

3Measurement precision

If multiple images from fixed positions are taken for three-dimensional representation, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvespatial relationship accuracyVSAvoidtime for model generation
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of taking discrete images from predetermined positions, the system continuously captures images while the device moves smoothly around the object. This continuous motion and capture process maintains constant useful action, reducing the total time required compared to stopping and positioning at multiple fixed points.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent introduces dynamic movement of the device around the object rather than static positioning. The motion sensors track the changing positions and orientations during movement, enabling the system to capture spatial relationships in a dynamic, flexible manner that reduces the number of required images and processing time.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive three-dimensional navigation and model generation without the need for manual input, making it accessible to a broader audience and simplifying the process of creating and interacting with three-dimensional representations.

Implementation Method 1

the electronic device can include a motion-sensing component (e.g., an accelerometer) operative to detect movements of the electronic device

Methodology Applied
Scientific EffectAcceleration: Accelerometer

Implementation Method 2

Incorporating motion-sensing components like accelerometers and gyroscopes into electronic devices to detect deterministic movements

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Data Source

PatentUS11989826B2Generating a three-dimensional model using a portable electronic device recording
Publication Date: 2024.05.21 APPLE INC
  • US11989826B2 patent drawing
  • US11989826B2 patent drawing
  • US11989826B2 patent drawing

AI summary

Systems and methods are provided for navigating a three-dimensional model using deterministic movement of an electronic device. An electronic device can load and provide an initial display of a three dimensional model (e.g., of an environment or of an object). As the user moves the electronic device, motion sensing components can detect the device movement and adjust the displayed portion of the three-dimensional model to reflect the movement of the device. By walking with the device in the user's real environment, a user can virtually navigate a representation of a three-dimensional environment. In some embodiments, a user can record an object or environment using an electronic device, and tag the recorded im and orientation of the programmable device relative to the three-dimensional object at the first time responsive to detection of movement ages or video with movement information describing the movement of the device during the recording. The recorded information can then be processed with the movement information to generate a three-dimensional model of the recorded environment or object.