Virtual Mouse Gesture Sensing Through Storefront Glass
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storefront displays are one-way communication systems, lacking interactive capabilities for passersby due to technological and financial challenges in integrating sensors and control data through glass, and existing solutions suffer from inferior image quality, vulnerability to vandalism, and limited interaction.
Innovation Solution
A system that uses a source of radiating energy, directionally sensitive sensors, and a processor to detect and interpret user gestures without touching the glass, allowing control of images and objects on a screen from outside, using structured light that passes through glass and is reflected back for accurate detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If sensors are placed outside the storefront window to enable interaction, then user interaction capability is improved, but sensors become exposed to the elements and vulnerable to vandalism
Solution Approach 1:
The patent uses glass as an intermediary medium that allows optical signals to pass through while physically separating and protecting the sensors. The sensors are placed inside the storefront behind the glass, yet can still detect user interactions through the glass surface, thus mediating between user access and sensor protection.
Solution Approach 2:
The patent replaces traditional mechanical touch sensors with optical sensing systems that can detect interactions through the glass medium. This substitution allows sensors to remain protected inside while still capturing user interactions optically through the glass surface.
2Adaptability or versatility
If capacitive touch-sensing systems are used on the inside of glass, then interaction is enabled, but users must physically touch the glass which reduces ease of use
Solution Approach 1:
The patent substitutes capacitive touch sensing with optical sensing that can detect hand gestures and movements through the glass without requiring physical contact. This allows users to interact with the display by waving or pointing their hands in the air, eliminating the need to touch the glass surface.
Solution Approach 2:
The glass surface serves as an intermediary that transmits optical signals from the user's hand gestures to the internal sensors, enabling contactless interaction while maintaining the physical barrier of the glass.
3Adaptability or versatility
If rear-projected images are used on film inside the glass, then display capability is achieved, but image quality suffers due to sunlight and reflections
Solution Approach 1:
Instead of projecting images from the inside of the glass outward (which causes reflections and poor visibility), the patent inverts the approach by using sensors inside to detect users and generating images that are displayed on the interior surface, making the display visible from the inside while sensing occurs through the glass.
Solution Approach 2:
The patent employs LED technology that can dynamically change color and intensity to create high-contrast, visually striking displays that are visible through the glass from the outside while being generated on the interior surface, avoiding the reflection issues of rear-projection.
4Reliability
If a closed system with monitor inside the window is used, then self-contained operation is achieved, but connection to other aspects of the window area is limited reducing versatility
Solution Approach 1:
The patent creates a multi-functional system where the same glass surface serves multiple purposes: as a protective barrier, as a transmission medium for optical signals, and as a display surface. The system can function as both a standalone interactive display and integrate with broader storefront systems including product information, advertising, and inventory management.
Solution Approach 2:
The system is designed to be dynamic and reconfigurable, allowing the display content and sensing zones to be programmatically adjusted. This enables the same hardware to serve different functions at different times, from retail product displays to promotional advertising to wayfinding information.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables two-way communication and interactive experiences for passersby, enhancing user engagement without exposing sensors to the elements, improving image quality, and allowing flexible placement of screens within the storefront.
Implementation Method 1
a source of radiating energy directed into a predefined area, at least one directionally sensitive sensor that detects the radiation when it's reflected off of an object within the predefined area
Data Source
AI summary
A system for interacting with a screen without touching it, comprising a source of radiating energy directed into a predefined area, at least one directionally sensitive sensor that detects the radiation when it's reflected off of an object within the predefined area, and a processor that calculates position and motion information of the object and generates therefrom image information, which it sends to a screen where it is displayed.