3D Model Construction from Door-Angle Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Storage containers, especially refrigerators, face issues where obstructed items within the container cannot be inspected without opening the door, leading to inconvenience and unnecessary energy wastage due to temperature fluctuations, and remote inspection limitations.

Innovation Solution

A method and system that use an image sensor attached to a hinged door to capture images at various angular positions, constructing a 3D model of the contents using photogrammetry, allowing for obscured items to be viewed without opening the container and reducing energy consumption by maintaining the interior temperature.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a display unit shows an image of the interior volume of the storage container, then the user can inspect contents without opening the container, but obscured items cannot be viewed and the user must open the container which causes temperature rise and energy wastage

Engineering Contradiction:
Improveease of content inspectionVSAvoidvisibility of obscured items
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent transitions from 2D images to a 3D model of the storage container contents. By constructing a three-dimensional model from multiple images captured at different angular positions, the system enables users to view obscured items from different perspectives and angles, effectively adding a dimensional aspect to the inspection capability that resolves the visibility problem of obscured items.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the user opens the storage container to inspect obscured items, then all items become visible, but the interior temperature rises and electrical energy is wasted

Engineering Contradiction:
Improvevisibility of obscured itemsVSAvoidelectrical energy consumption
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The system performs preliminary action by capturing multiple images at different angular positions and constructing a 3D model in advance, before the user needs to inspect the contents. This preparatory work enables complete visibility of all items through the digital model, eliminating the need for the user to open the container and thereby preventing energy wastage from temperature fluctuations.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If multiple images are captured at different angular positions to create a 3D model, then obscured items become visible in the model, but the device complexity increases

Engineering Contradiction:
Improvevisibility of obscured itemsVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates a digital copy (3D model) of the storage container contents rather than requiring complex mechanical or optical systems to physically reveal all items. By capturing images at different angular positions and processing them into a 3D model, the system uses software-based copying to achieve complete visibility, which is simpler than alternative physical solutions.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to inspect contents without opening the storage container, reducing energy wastage and allowing remote inspection, with the 3D model providing a clear view of all items, including those obscured by others.

Implementation Method 1

receiving a plurality of images from an image sensor attached to a side of a hinged door facing an interior of a storage container, wherein each of the plurality of images is captured when the hinged door is at a corresponding one of a plurality of angular positions

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

constructing a three-dimensional, 3D, model of contents within the storage container from the plurality of images and the corresponding plurality of angular positions. The 3D model may be constructed using photogrammetry.

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS20240346766A1Modelling method and system, and storage container comprising the system
Publication Date: 2024.10.17 TOBII TECH AB
  • US20240346766A1 patent drawing
  • US20240346766A1 patent drawing
  • US20240346766A1 patent drawing

AI summary

A modelling method comprising receiving a plurality of images from an image sensor attached to a side of a hinged door facing an interior of a storage container, wherein each of the plurality of images is captured when the hinged door is at a corresponding one of a plurality of angular positions (θ) relative to the storage container, constructing a three-dimensional, 3D, model of contents within the storage container from the plurality of images and the corresponding plurality of angular positions.