Projector-Based Mobile Interface Stitching for Expanded Display Area

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Small screen sizes and input methods of hand-held mobile devices hinder user experience by limiting the ability to display and interact with information effectively, as users desire larger display screens for easier interaction with their devices and other nearby devices.

Innovation Solution

A mobile device uses a projector to create a larger external projection area that functions as a touch or multi-touch user interface, allowing users to interact with the device and potentially connect with neighboring devices to create a combined seamless user interface, enhancing interaction and collaboration through stitching projection areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If hand-held mobile devices use small physical screens, then the device size remains compact and portable, but the display area and interaction capability are limited

Engineering Contradiction:
Improvedisplay areaVSAvoidsystem complexity
Core Design Contradiction:
Area of moving objectVSDevice complexity

Solution Approach 1:

The patent extends the user interface from the two-dimensional physical screen into the third spatial dimension by projecting the display onto external surfaces. The projector casts images onto walls, tables, or other nearby surfaces, effectively utilizing external space to expand the display area without increasing the physical dimensions of the mobile device itself.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary projection surface that acts as a mediator between the mobile device and the user. Instead of directly interacting with the small physical screen, users interact with the projected image on an external surface, which serves as an intermediate interface that bridges the gap between the compact device and the need for larger interaction area.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple mobile devices are used to create a combined user interface, then the interaction capability and display area are enhanced, but the system complexity and coordination requirements increase

Engineering Contradiction:
Improveinteraction capabilityVSAvoidsystem coordination
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple mobile devices into a unified collaborative system where each device projects its own interface onto a shared external surface. The projection areas of multiple devices overlap or adjacent on the external surface, creating a combined user interface that leverages the computational resources and display capabilities of all participating devices while presenting a cohesive interaction experience to the user.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides a larger interactive surface area, enabling users to perform complex operations and collaborate more effectively across multiple devices, improving the user experience by expanding the display and interaction capabilities beyond the physical screen limitations.

Implementation Method 1

uses a projector to illuminate a projection area external to the mobile device

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

uses the projection area as a user interface. The user interface can function as a touch screen or multi-touch screen and a user's interaction with the projection area can be captured by a camera of the mobile device

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentUS10452203B2Combined surface user interface
Publication Date: 2019.10.22 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10452203B2 patent drawing
  • US10452203B2 patent drawing
  • US10452203B2 patent drawing

AI summary

Techniques for utilizing two or more mobile devices equipped with projectors to generate a combined seamless user interfaces by stitching projection areas generated by the projectors.