Mobile Device Annotation on Shared Displays via Sensor Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional annotation systems require users to be physically close to the display for interaction, limiting collaboration in shared environments and reducing efficiency, especially when users need to frequently and ad-hoc annotate content.
Innovation Solution
A system allowing multiple users to annotate a shared display using their mobile devices, which register with a host device and use sensors like gyroscopes and accelerometers to position annotations on the display through gestures, eliminating the need for direct interaction with the display and enabling on-demand, real-time collaboration from anywhere in the room.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users directly touch or draw on the display surface, then annotation precision and interaction fidelity are improved, but user mobility and collaborative accessibility are limited
Solution Approach 1:
The patent introduces a camera as an intermediary device between the user and the display. The camera captures images of the display, and annotations are made on these captured images rather than directly on the display surface. This mediator enables users to annotate from a distance while maintaining annotation precision through image processing and coordinate mapping techniques.
Solution Approach 2:
The patent replaces the mechanical system of direct physical contact with the display surface with an optical system. Instead of touching the display, users capture images optically via camera and perform annotations on the captured image data. This substitution enables remote interaction while preserving annotation fidelity through digital image processing.
2Stability of the object's composition
If users remain at fixed positions to annotate, then interaction stability is improved, but real-time collaboration and ad-hoc annotation efficiency are reduced
Solution Approach 1:
The patent implements dynamic interaction by allowing users to move freely while capturing display images with mobile devices. The system dynamically adjusts coordinate mappings and transforms between the captured image coordinate system and the display coordinate system in real-time, enabling stable annotations despite user movement and changing camera positions.
Solution Approach 2:
The patent creates a universal annotation system that works across multiple devices and positions. The coordinate transformation framework enables any user with a mobile device to annotate the display from any location, making the system universally accessible while maintaining stability through real-time geometric transformations and calibration.
3Adaptability or versatility
If specialized annotation hardware is used, then annotation functionality is improved, but system complexity and cost increase
Solution Approach 1:
The patent makes mobile devices perform multiple functions: they serve as both the display viewer and the annotation input device. The camera captures display content, the device processes images, and the device transmits annotations back to the display system. This multi-functionality eliminates the need for specialized annotation hardware while maintaining full annotation capabilities.
Solution Approach 2:
The patent enables mobile devices to self-service the annotation function by using their existing cameras and processors. The devices automatically capture display images, perform coordinate transformations, and generate annotations without requiring external specialized hardware. The system leverages the self-contained capabilities of mobile devices to provide annotation functionality.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient, real-time, and collaborative annotation from multiple users without the need for specialized hardware, improving interaction fidelity and visibility of annotators, while maintaining the intuitive nature of direct interaction.
Implementation Method 1
position sensors include a gyroscope and accelerometer of the mobile device
Implementation Method 2
position sensors include a gyroscope and accelerometer of the mobile device
Implementation Method 3
position annotation of displayed content on the shared display using sensor data captured from the position sensor of the mobile device
Data Source
AI summary
Systems and methods use a mobile device to position an annotation of displayed content on a shared display coupled with a host device. Sensor data, such as gyroscope and accelerometer data, from the mobile device may be transmitted to the host device and used to generate the annotation. The sensor data may be preprocessed to smooth and fit the data to a parametric curve or shape prior to or after display on the shared display. The user of the mobile device may interact with the mobile device to further start and stop the annotation, as well as denote to animate the annotation.