Contactless HCI via Body Outline Intersection Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional human-computer interaction techniques require hand-based operations, making it difficult for individuals with disabilities to perform computer interactions without physical contact.
Innovation Solution
A method and apparatus that acquire and display images in a blurring manner, detect differences between frames, recognize designated outlines, and trigger corresponding operations when these outlines intersect with designated areas on the screen, allowing for contactless human-computer interaction using body movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hand-based operations are used for human-computer interaction, then the operation method is simple and direct, but individuals with disabilities cannot perform contactless interactions
Solution Approach 1:
The patent replaces the mechanical hand-based input system with an optical recognition system that detects body movements (such as eye or mouth movements) to trigger computer operations. This substitution enables disabled individuals to interact with the computer without physical contact, directly addressing the accessibility issue while maintaining operational effectiveness through automated movement detection and recognition algorithms.
2Measurement precision
If images are displayed clearly for recognition, then the designated outline can be accurately detected, but the user cannot see the underlying interface elements
Solution Approach 1:
The patent applies local quality by displaying the captured image in a blurring manner specifically at the location where the designated outline (such as eye or mouth) is detected, while keeping the rest of the interface elements clear and visible. This selective blurring allows the system to maintain interface visibility for the user while still enabling accurate detection of the designated outline through the blurring effect that highlights movement differences.
Solution Approach 2:
The patent uses a semi-transparent blurred image as an intermediary layer that is superimposed on the interface. This intermediary layer allows the underlying interface elements to remain visible while providing the necessary visual feedback for movement detection. The blurred image acts as a mediator that simultaneously preserves interface visibility and enables accurate outline recognition through movement analysis.
Data Source
AI summary
A method for controlling triggering of a human-computer interaction operation and an apparatus are provided according to the embodiments of the disclosure. The method includes: acquiring images shot by a shooting device, and displaying the acquired images on a display screen in a blurring manner; detecting a difference between acquired images in each frame, recognizing a designated outline on the image according to the difference between acquired images in each frame, and calculating a location of the recognized designated outline on the display screen; and determining, in real time, whether the designated outline at the location on the display screen intersects with a designated area displayed on the display screen, and triggering an operation corresponding to the designated area if the designated outline at the location on the display screen intersects with the designated area displayed on the display screen.