Extended Screen Motion Control for Touchless AR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users cannot control the display of extended screens on terminal devices, which are virtual, through touch, as existing methods do not provide a solution for controlling these screens.
Innovation Solution
A method for controlling extended screens using motion data collected by a terminal device to determine a motion type, obtain corresponding control information, and control the extended screen accordingly, either on the terminal device or a wearable device like smart glasses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the extended screen is made virtual to expand display area, then the display area is increased, but the ease of operation deteriorates because touch control is no longer available
Solution Approach 1:
The patent replaces the mechanical touch control system with a motion recognition system. The terminal device uses motion sensors to detect user gestures (shaking, rotating, etc.) and converts these physical motions into control signals for the extended screen, eliminating the need for direct touch interaction with the virtual screen while maintaining intuitive control.
Solution Approach 2:
The patent introduces motion recognition technology as an intermediary between the user and the extended screen. Instead of directly touching the virtual screen, users perform physical gestures that are captured by motion sensors, processed through recognition algorithms, and translated into screen control commands, bridging the gap between physical interaction and virtual display control.
2Ease of operation
If motion-based control is implemented for extended screens, then the ease of operation is improved, but the device complexity increases due to additional motion sensing and processing requirements
Solution Approach 1:
The patent leverages the multi-functionality of existing terminal devices by utilizing their built-in motion sensors (accelerometers, gyroscopes) for both traditional functions and extended screen control. This approach avoids adding dedicated hardware while enabling motion-based interaction, reducing overall system complexity despite the enhanced control capability.
Solution Approach 2:
The terminal device uses its own existing motion sensing capabilities to control its extended screen, making the system self-sufficient. The device does not require external controllers or additional specialized hardware, as it leverages its inherent motion detection abilities to provide intuitive control for the virtual display.
Data Source
AI summary
The present disclosure provides an extended screen control method, and a computer-readable storage medium. The method comprises: obtaining control information corresponding to the extended screen, according to a motion type of the terminal device, in which the motion type of the terminal device is determined according to motion data collected by the terminal device; and controlling the extended screen according to the control information.


