AR Speech Image Overlay for 3D Target Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to intuitively display supplementary images for spoken content at the correct three-dimensional positions in augmented reality, leading to confusion about which target is being supplemented.
Innovation Solution
An information processing system that acquires a speech image, generates a supplementary image based on spoken content, and controls its display at a two-dimensional position corresponding to the actual three-dimensional location of the target within the image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a supplementary image is displayed at a two-dimensional position in the speech image without considering three-dimensional position, then the display is simple and straightforward, but the user cannot intuitively recognize which target is being supplemented
Solution Approach 1:
The patent applies dimensionality change by mapping three-dimensional spatial information onto a two-dimensional display surface. The supplementary image is positioned at a two-dimensional location that corresponds to the three-dimensional position of the target object in the speech image, creating a spatial mapping relationship that preserves depth information in a flat display medium.
Solution Approach 2:
The patent introduces a positional correspondence mechanism as an intermediary between the three-dimensional target object and its two-dimensional representation. This mediator establishes the relationship between spatial position and display position, allowing the supplementary image to convey spatial information without requiring the user to understand complex 3D coordinates.
2Loss of information
If a supplementary image is displayed at a two-dimensional position corresponding to three-dimensional position, then target recognition becomes intuitive, but the display control becomes more complex
Solution Approach 1:
The system performs preliminary action by pre-establishing the correspondence relationship between three-dimensional target positions and two-dimensional display positions. This mapping is determined in advance based on the spatial arrangement of objects in the speech image, so that when the supplementary image needs to be displayed, the correct position is already known without requiring complex real-time calculations.
Solution Approach 2:
The patent applies parameter changes by transforming three-dimensional position parameters into two-dimensional display parameters. The system changes the dimensional parameters from (x, y, z) coordinates to (x', y') display coordinates while preserving the spatial relationship, thereby simplifying the display control process while maintaining intuitive target identification.
Data Source
AI summary
An information processing system includes one or plural processors configured to acquire a speech image including a speaking person, acquire a supplementary image for supplementing spoken content of the speaking person, the supplementary image being based on the spoken content and not being a text directly representing the spoken content, and perform a control of displaying the supplementary image at a two-dimensional position in the speech image corresponding to a three-dimensional position at which a target to be supplemented is present in the speech image.