Transparent Display Speech Overlay for Face-to-Face AR Communication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing transparent displays do not effectively facilitate face-to-face communication through augmented reality when used by multiple users, as they lack the capability to accurately detect and display user gestures and speech in real-time.
Innovation Solution
A display device equipped with cameras and microphones to capture and analyze user images and sounds, along with a control circuit to determine speaking parties and generate augmented reality displays based on detected gestures and speech, allowing for real-time character and effect rendering on a transparent display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a transparent display is used in a face-to-face manner, then two users can view information and background simultaneously, but the system cannot accurately detect user positions and emotions to enhance communication
Solution Approach 1:
The system segments the detection tasks by using separate cameras for different users (first camera for first user, second camera for second user) and separate processing circuits (user coordinate calculation circuit, gesture detection circuit). This segmentation allows accurate position and gesture detection for each user independently, resolving the contradiction between maintaining transparent display functionality and achieving precise user state detection.
Solution Approach 2:
The patent introduces intermediary components (cameras, microphones, and various detection circuits) that mediate between the users and the transparent display system. These intermediaries capture user positions, gestures, and emotions, converting them into data that the control circuit can process to enhance communication, thus enabling accurate detection without compromising the transparent display's face-to-face communication capability.
2Adaptability or versatility
If augmented reality information is displayed on the transparent display, then communication is enhanced, but the system complexity increases due to multiple cameras and processing circuits
Solution Approach 1:
The transparent display serves multiple functions: it displays information to users, allows background visibility, and presents augmented reality elements like speech balloons and emotional effects. The control circuit integrates multiple detection functions (position, gesture, emotion recognition) into a single processing unit that coordinates all components, reducing overall system complexity while maintaining enhanced communication functionality.
Solution Approach 2:
The patent merges the detection and processing functions into an integrated control circuit that handles coordinates calculation, gesture detection, emotion recognition, and display control simultaneously. This consolidation combines multiple processing tasks into a unified system, managing the complexity of having multiple cameras and sensors while achieving sophisticated augmented reality communication capabilities.
3Ease of operation
If real-time detection and display of user information is implemented, then communication experience is enhanced, but processing time and computational load increase
Solution Approach 1:
The system continuously captures images and audio data in real-time using cameras and microphones, pre-processing this information before it needs to be displayed. The control circuit maintains ready-state detection capabilities for user positions and gestures, so when communication events occur, the information is already processed and can be displayed immediately, reducing perceived processing time while enhancing communication experience.
Data Source
AI summary
A display device includes a first camera that captures an image of a first viewer present in a first normal direction of a display surface of a transparent display, a second camera that captures an image of a second viewer present in a second normal direction of the display surface of the transparent display, the second normal direction being an opposite direction of the first normal direction, a microphone, and a control circuit that includes a user coordinate calculation circuit, a gesture detection circuit, a dictation circuit, and a drawing information generation circuit. The user coordinate calculation circuit specifies positions of the first viewer and the second viewer on the basis of the images from the first camera and the second camera. When the gesture detection circuit determines that the first viewer utters sound, the dictation circuit generates a character based on sound information from the microphone, and the generated character is displayed on the transparent display toward the second viewer by the drawing information generation circuit.