Object Positioning on Shared Displays Using Camera Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional technologies lack precise control over the positioning of objects transmitted from individual devices to shared devices, limiting user interaction and flexibility in placing objects on shared displays.

Innovation Solution

Establishing a communication connection between individual and shared devices, allowing for the transmission and dynamic updating of object positions based on user or device movement, with the option to lock the position upon a triggering event, using sensors and position information to ensure precise placement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If default location storage is used on the receiving device, then the system complexity is reduced, but the user control over object positioning is limited

Engineering Contradiction:
Improveuser control over object positioningVSAvoidpositioning control mechanism
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system uses the receiving device's own sensors (camera, accelerometer, gyroscope) to automatically determine its position and orientation, eliminating the need for external positioning infrastructure. The device serves itself by capturing images of the shared display and using image processing to calculate its spatial relationship to the display, thereby achieving precise positioning control without adding external complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical positioning (physically moving the device or using buttons to drag objects) with automated optical and computational methods. The camera captures the shared display, image processing algorithms determine the device's orientation and position, and software automatically calculates the appropriate object placement, substituting mechanical user effort with optical sensing and computational processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual folder selection is used for data storage, then device compatibility is maintained, but the precision of object placement is reduced

Engineering Contradiction:
Improveobject placement precisionVSAvoiddevice compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary image processing system that acts as a mediator between the transmitting device and the shared display. This intermediary layer captures the shared display through the camera, processes the image to determine spatial relationships, and translates these relationships into precise object placement coordinates, thereby achieving high precision placement while maintaining compatibility across different device types through a universal image-based interface

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from two-dimensional folder selection interfaces to three-dimensional spatial positioning by utilizing the camera's ability to capture the physical orientation and position of the shared display. By adding the spatial dimension (using accelerometer and gyroscope data for tilt and rotation detection), the system achieves precise object placement in 3D space while maintaining broad device compatibility through standard sensor interfaces

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Extent of automation

If relative position tracking is implemented using infrared capture, then automatic device detection is achieved, but the flexibility of communication protocols is reduced

Engineering Contradiction:
Improveautomatic object positioningVSAvoidsensor and processing requirements
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent makes the camera serve multiple functions: it detects the shared display's presence, determines its position and orientation, captures its visual appearance, and provides feedback for positioning calculations. By making the camera a multi-functional sensor, the system achieves automatic positioning without requiring dedicated infrared or ultrasonic positioning hardware, thereby reducing overall device complexity while maintaining high automation

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple sensing functions (display detection, position tracking, orientation measurement) into a unified image processing approach. The camera captures a single image that contains information about the shared display's location and appearance, and the image processing system extracts all necessary positioning data from this single data source, merging multiple sensing operations into one integrated process that reduces complexity compared to using separate sensors for each function

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP2965164B1Causing specific location of an object provided to a device
Publication Date: 2019.12.18 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2965164B1 patent drawingFigure 1
  • EP2965164B1 patent drawingFigure 2
  • EP2965164B1 patent drawingFigure 3

AI summary

Techniques for causing a specific location of an object provided to a shared device. These techniques may include connecting the computing device with an individual device. The individual device may transmit the object to the shared device and displayed at an initial object position on a display of the shared device. The initial object position may be updated in response to movement of the individual device, and the object may be displayed at the updated object position on the display. The object position may be locked in response to a signal, and the object may be displayed at the locked object position.