Mixed-Reality Imaging System Resolution Enhancement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed-reality devices suffer from poor resolution and clarity of visual content displayed on real-world objects, and inefficient localization techniques, leading to suboptimal user experience due to perspective disparities.

Innovation Solution

An imaging system comprising cameras and processors that capture, analyze, and process images to identify and enhance the resolution of visual content on real-world objects, accurately localizing them to provide high-resolution mixed-reality images with correct perspective.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional cameras and rendering equipment are used to capture and display visual content in mixed-reality environments, then the system remains simple and cost-effective, but the resolution and clarity of visual content deteriorate

Engineering Contradiction:
Improveresolution and clarity of visual contentVSAvoidcomplexity of imaging system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The imaging system is divided into multiple specialized components: capture cameras for acquiring visual content, processing circuits for enhancing resolution through image processing algorithms, and display elements for rendering. This segmentation allows each component to be optimized for its specific function, achieving high resolution without requiring every component to be complex

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary capture and processing of visual content at high resolution before display. By capturing and processing images in advance with specialized circuits, the system prepares high-resolution data that can be efficiently rendered, avoiding the need for complex real-time processing during display

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If tracker pucks or manual methods are used to localize real-world objects, then localization accuracy improves, but the ease of operation and scalability deteriorate

Engineering Contradiction:
Improvelocalization accuracyVSAvoidconvenience of localization process
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system enables real-world objects to self-localize through built-in sensors (cameras, GPS, accelerometers) that automatically determine position and orientation without requiring external trackers or manual input. This self-service approach maintains high localization accuracy while dramatically improving ease of operation and scalability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The localization system uses multi-functional sensors that serve multiple purposes: cameras capture both visual content and spatial information, GPS provides location data, and accelerometers measure motion. This universality allows accurate localization without adding specialized tracking equipment, making the system both precise and easy to operate

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If trackable markers are attached to movable real-world objects for localization, then localization capability is enabled, but the adaptability and user experience deteriorate due to perspective disparities

Engineering Contradiction:
Improvelocalization of movable objectsVSAvoidperspective accuracy
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system continuously captures visual content from the user's perspective and uses processing circuits to analyze and adjust the rendering based on detected perspective disparities. This feedback loop ensures that virtual content remains properly aligned with real-world objects even as they move, maintaining perspective accuracy without requiring markers on objects

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10665034B2Imaging system, display apparatus and method of producing mixed-reality images
Publication Date: 2020.05.26 VARJO TECH OY
  • US10665034B2 patent drawing
  • US10665034B2 patent drawing
  • US10665034B2 patent drawing

AI summary

An imaging system for producing mixed-reality images for display apparatus. The imaging system includes a camera and a processor communicably coupled to the camera. The processor is configured to control the camera to capture image of real-world environment; analyze the image to identify surface that displays visual content; compare the visual content displayed in the image with reference image of the visual content to determine size, position and orientation of the surface with respect to the camera; process the reference image of the visual content to generate processed image of the visual content; and replace the visual content displayed in the image with the processed image to generate mixed-reality image, wherein resolution of the processed image is higher than resolution of the visual content displayed in the image.