Mobile Terminal 3D Image Conversion via Infrared Structured Light

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional mobile terminals cannot obtain depth information for generating 3D images, as existing methods either have unstable 2D image stability due to patch-level measurement issues or are limited by high costs and power consumption of Time Of Flight sensors.

Innovation Solution

A mobile terminal equipped with a first camera for receiving 2D images, a light emitting unit with multiple light emitting device arrays to apply infrared light, and a second camera to receive reflecting light, which allows obtaining depth information and converting 2D images into 3D images using this information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If Time Of Flight sensors are used to obtain depth information, then depth measurement capability is improved, but device cost and power consumption increase significantly

Engineering Contradiction:
Improvedepth measurement capabilityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent introduces an infrared light emitter as an intermediary component that projects structured light patterns onto the target object. The first camera captures the reflected infrared light patterns, which contain depth information encoded through the light reflection. This intermediary approach enables depth measurement without requiring expensive Time Of Flight sensors, as the infrared light serves as a mediator to carry depth information from the object to the camera sensor.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system captures a 2D image of the infrared light pattern reflected from the object and processes it to create depth information. Instead of directly measuring depth with specialized sensors, the patent creates a copy of the light pattern information through the camera and derives depth data from this copied information through image processing algorithms, thereby avoiding the need for costly depth-sensing hardware.

Inventive Principle:
Principle #26Copying

2Ease of manufacture

If conventional 2D cameras are used without depth sensing, then device cost is reduced, but depth information cannot be obtained

Engineering Contradiction:
Improvedevice costVSAvoiddepth information
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The patent transforms 2D image data into 3D depth information by analyzing the distortion and reflection patterns of projected infrared light in the captured images. By introducing the infrared light dimension and analyzing how it interacts with the object's surface geometry, the system extracts depth information from what would otherwise be purely 2D visual data, effectively adding a third dimension to the camera's capabilities through computational methods.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If structured light patterns are projected for depth measurement, then depth resolution is improved, but 2D image stability deteriorates due to patch-level measurement issues

Engineering Contradiction:
Improvedepth resolutionVSAvoid2D image stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent merges the depth measurement function with the existing 2D camera system by using the same camera to capture both the infrared light patterns and the resulting depth information. Instead of using separate specialized sensors for depth that could compromise image stability, the system combines multiple functions (infrared detection, pattern recognition, and depth calculation) within the existing camera infrastructure, maintaining image stability while achieving depth resolution.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the conversion of 2D images to 3D images using infrared light, improving image stability and reducing power consumption, while being cost-effective compared to traditional methods.

Implementation Method 1

a light emitting unit including a plurality of light emitting device arrays and applying a light to a space corresponding to the received 2D image

Methodology Applied
Scientific EffectLight emitting: Light Emitting Diode

Implementation Method 2

a second camera receiving the light reflecting from the space

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11756262B2Mobile terminal, and 3D image conversion method thereof
Publication Date: 2023.09.12 LG ELECTRONICS INC
  • US11756262B2 patent drawing
  • US11756262B2 patent drawing
  • US11756262B2 patent drawing

AI summary

The present invention relates to a mobile terminal and a method for controlling same, the mobile terminal comprising: a camera for recording a video; a display unit for displaying a recording screen of the video being recorded through the camera; and a control unit for, when a portion of the video being recorded satisfies a video upload requirement of at least one video upload service that can be provided from the mobile terminal, controlling to display an item indicating the video upload services for which the requirement is satisfied. The present invention provides the effect of allowing a user to quickly recognize an SNS to which a recorded portion of a video currently being recorded in real time can be uploaded, and easily upload the recorded portion to the SNS.