3D Object Positioning via Multi-View Volume Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating accurate 3D models of scenes are time-consuming and prone to human error, as they require manual measurements, which is not feasible for applications like racing vehicles where each vehicle has unique dimensions and cannot afford extensive measurement time.

Innovation Solution

A method involving the use of light or physical markers projected onto the object, captured from multiple angles, where the scene is divided into volume portions visible in multiple images, allowing for accurate correspondence and position determination of markers, and subsequent bundle adjustment for enhanced accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual measurements are taken to generate accurate 3D models, then manufacturing precision is improved, but loss of time increases and productivity deteriorates

Engineering Contradiction:
Improve3D model accuracyVSAvoidtime for measurements
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical measurement systems with an automated optical/image processing system. Multiple images captured from different viewpoints are processed through correspondence establishment and bundle adjustment algorithms to automatically generate accurate 3D models, eliminating the need for manual measurements while maintaining high precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a digital copy (3D model) of the physical object through image processing. By capturing multiple images and establishing correspondences between volume portions across different viewpoints, the system generates an accurate digital representation without physical contact or manual measurement, thus saving time while preserving manufacturing precision.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If manual measurements are taken to generate accurate 3D models, then manufacturing precision is improved, but device complexity increases due to human involvement

Engineering Contradiction:
Improve3D model accuracyVSAvoidcomplexity of measurement process
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex manual measurement processes with an automated computer-based image processing system. The system automatically captures images from multiple viewpoints, establishes correspondences between volume portions, performs bundle adjustment, and generates 3D models, thereby reducing device complexity by eliminating human intervention while maintaining high precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-service by automatically processing the entire 3D modeling workflow without human assistance. The image processing apparatus autonomously captures images, establishes correspondences, performs calculations, and generates models, thereby simplifying the overall system complexity by removing the need for manual measurement tools and human operators.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If multiple images are captured from different viewpoints, then measurement precision is improved through correspondence establishment, but device complexity increases due to additional image processing requirements

Engineering Contradiction:
Improveposition determination accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the scene into discrete volume portions and processes each volume portion independently to establish correspondences across multiple images. This segmentation approach simplifies the complex task of matching features across viewpoints by breaking it down into manageable units, thereby improving measurement precision without proportionally increasing device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces volume portions as intermediary elements that facilitate correspondence establishment between multiple images. Each volume portion serves as a reference frame that appears in multiple images, acting as an intermediary to link different viewpoints. This intermediary approach simplifies the image processing complexity by providing structured reference points for automatic correspondence detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10410068B2Determining the position of an object in a scene
Publication Date: 2019.09.10 SONY GROUP CORP
  • US10410068B2 patent drawing
  • US10410068B2 patent drawing
  • US10410068B2 patent drawing

AI summary

A method of determining the position of an object in a scene, comprising: receiving captured images of the scene, each image being captured from a different field of view of the scene, wherein a portion of the scene with a volume comprises a detectable object, the volume is divided into volume portions, and each volume portion is within the captured field of view of at least two of the captured images so that an image of each volume portion appears in the at least two of the captured images; detecting, for each volume portion in each of the captured images within which an image of that volume portion appears, whether or not an image of one of the detectable objects in the scene is positioned within a distance of the position of the image of that volume portion, a correspondence between the images of the detectable objects detected in the at least two of the images is established, the correspondence indicating that the images of the detectable objects detected in the at least two of the images correspond to a single detectable object in the scene, and the position in the scene of that volume portion is established as a position in the scene of the single detectable object.