Spectacle Lens Simulation Device Using Depth Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional simulation devices for spectacle lenses are limited in providing a realistic virtual experience as they rely on pre-created images or computer graphics, which can't accurately reflect distance variations, and struggle with real-time data acquisition due to high calculation loads and limitations in low contrast surface data.

Innovation Solution

A simulation device equipped with an imaging camera and a depth sensor that captures real-time images and depth information, using ray tracing and optical system analysis to create a simulation image that accurately reflects the view through a spectacle lens, allowing for dynamic response to the wearer's visual field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pre-created images or computer graphics are used for simulation, then the image formation can be performed with specified distance data, but the realistic experience is reduced and the visual field does not dynamically respond to the wearer

Engineering Contradiction:
Improvedistance data accuracyVSAvoidrealistic experience
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing distance information in a depth map before real-time simulation. The depth map is created in advance through stereo vision or other depth sensing methods, capturing the spatial structure of the environment. During real-time rendering, this pre-prepared depth data is directly utilized to determine refraction effects without requiring complex on-the-fly calculations, thus achieving both realistic dynamic response and computational efficiency

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a digital copy of the real-world environment through depth mapping and 3D reconstruction. Instead of using pre-created fictional images, the system captures actual spatial information from the real environment and creates a replicable digital model that can be dynamically rendered from different viewpoints while maintaining accurate distance relationships for optical simulation

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If stereo vision with multiple imaging cameras is used to acquire real-time images and distance data, then realistic images can be captured, but the calculation load increases significantly and low contrast surface data cannot be acquired

Engineering Contradiction:
Improverealistic image captureVSAvoidcalculation load
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential depth information from the complex stereo vision data processing. Instead of processing complete 3D point clouds or performing full scene understanding calculations, the system extracts depth values at specific pixel locations and stores them in a depth map. This extraction approach separates the critical distance data from unnecessary computational overhead, enabling real-time processing with reduced calculation load

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses disposable depth map data structures that are inexpensive to store and process. Rather than maintaining complex object models, semantic segmentations, or detailed 3D reconstructions, the system uses simple depth value arrays that can be quickly generated and discarded. These lightweight depth maps require minimal computational resources while providing sufficient information for refraction simulation

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Measurement precision

If distance data is acquired for each pixel using general distance measurement devices, then accurate depth information can be obtained, but the information processing capability required exceeds common simulator capacity

Engineering Contradiction:
Improvedepth information accuracyVSAvoidinformation processing capability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the image processing task by dividing the scene into discrete depth regions represented in a depth map. Each pixel or pixel group is assigned a depth value independently, allowing parallel processing and efficient memory access. This segmentation enables the system to handle high-resolution images with accurate per-pixel depth information without requiring excessive computational resources, as the data is organized in a structured grid format optimized for rendering pipelines

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a realistic virtual experience of spectacle lens wear with correct reflection of distance variations, reducing processing load and improving the accuracy of simulated images, suitable for real-time display and stereoscopic views.

Implementation Method 1

an imaging camera (13) which performs imaging in a visual field of the wearer

Methodology Applied
Scientific EffectPhotography: Photography

Implementation Method 2

an imaging camera (13) which performs imaging in a visual field of the wearer

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 3

a depth sensor (14) which acquires a depth image in the same view angle as an imaging result obtained by the imaging camera (13)

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Implementation Method 4

a simulation device for virtually displaying an image to be viewed through a spectacle lens by a wearer of the spectacle lens

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentEP2856931B1Simulation device
Publication Date: 2020.03.18 HOYA CORPORATION
  • EP2856931B1 patent drawingFigure 1(a)~1(b)
  • EP2856931B1 patent drawingFigure 2
  • EP2856931B1 patent drawingFigure 3

AI summary

There is provided a simulation device for virtually displaying an image to be viewed through a spectacle lens by a wearer of a spectacle lens, including: an imaging camera configured to perform imaging in a visual field of the wearer; a depth sensor configured to acquire a depth image in the same view angle as an imaging result obtained by the imaging camera; a data acquisition unit configured to acquire lens data of the spectacle lens; an image creation unit configured to create a simulation image on which a view of an image to be viewed through the spectacle lens is reflected, by applying image processing to the imaging result obtained by the imaging camera, based on the depth image and the lens data; and an image displayer configured to display and output the simulation image as an image to be viewed through the spectacle lens.