Multi-Window Display Layout Using User Position and Voice Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-window display systems require manual adjustment of window size and position, leading to complex operations and poor user experience.
Innovation Solution
A multi-window display system that automatically adjusts window size and position based on user scenarios, using cameras and microphones to detect user location, language, distance, and information amount, and a foldable screen to optimize display layout.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual adjustment of window size and position is implemented, then user control over display layout is improved, but operation complexity increases and user experience deteriorates
Solution Approach 1:
The system automatically detects user scenarios through cameras and microphones, identifies user needs, and adjusts window layouts without manual intervention. The device serves itself by using environmental sensors to autonomously control display configuration, eliminating the need for users to manually drag control bars or touch adjustment controls.
Solution Approach 2:
The patent replaces manual mechanical interaction (dragging control bars, touching adjustment controls) with automated detection and control systems. Cameras capture user images, microphones collect sounds, and the processor analyzes this data to automatically adjust window positions and sizes, substituting physical user actions with sensor-based automated control.
2Adaptability or versatility
If fixed window positions and sizes are used, then device complexity is reduced, but adaptability to different user scenarios deteriorates
Solution Approach 1:
The window layout transitions from a static fixed configuration to a dynamic adaptive configuration. The system continuously monitors user scenarios through sensors and automatically adjusts window positions and sizes in real-time based on detected user needs, creating a flexible display system that adapts to changing conditions rather than remaining fixed.
Solution Approach 2:
The patent changes the parameters of window display (position, size) based on detected user scenarios. The processor analyzes user images and sounds to determine appropriate display configurations, dynamically adjusting window parameters to optimize the user experience for different scenarios such as video calls, messaging, or media playback.
3Ease of operation
If automated window adjustment is implemented, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The system segments the automated adjustment function into distinct modular components: camera modules for image capture, microphone modules for sound collection, processor units for scenario analysis, and display control units for window adjustment. This modular segmentation manages complexity by organizing functions into separate, manageable modules that work together cooperatively.
Solution Approach 2:
The patent implements a universal automated control system that handles multiple display adjustment tasks through a single integrated framework. The same sensor array (cameras and microphones) and processing logic serve multiple functions: detecting user presence, identifying scenarios, determining window layout requirements, and executing adjustments, thereby managing complexity through multi-functional integration.
Data Source
AI summary
Embodiments of this application provide a multi-window display terminal device and method. The terminal device includes: two displays and two cameras that are respectively located on different sides, a microphone, and a processor. The terminal device may determine a display used by a user by using images collected by the two cameras, to adjust a position of a window, so that a front-rear display technology of the display can be implemented. The terminal device may also determine a distance between the user and the terminal device by using the images collected by the two cameras, to adjust a size and/or position of the window based on the distance of the user. The terminal device may also collect a sound of the user by using the microphone, to identify the user's needs and adjust a size and/or position of the window based on the user's needs.