Side-Mounted Infrared Camera 3D Display for Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional portable game apparatuses have difficulty displaying images captured in directions other than directly behind the display, making it hard for users to view images from cameras capturing images in other directions effectively.
Innovation Solution
Incorporating a camera that captures images in a side surface direction, an acquiring section to process the image, and a display controller that inclines and displays the image in a predetermined direction on the display, allowing users to easily view the image, recognize relative positions, and guide objects within the camera's range.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a camera captures an image in a back surface direction of the display, then the camera can be positioned behind the display, but the captured image is difficult for users to view effectively
Solution Approach 1:
The patent applies dimensionality change by transitioning from a 2D flat display to a 3D stereoscopic display. The image processing section generates left-eye and right-eye images with different perspectives, creating a three-dimensional effect that naturally presents side-surface captured images in an easily viewable format. This resolves the contradiction by using 3D visualization to make side-surface images intuitive without increasing operational complexity.
Solution Approach 2:
The patent changes the display parameters by switching from conventional 2D display mode to 3D stereoscopic display mode. The image processing section modifies image parameters (perspective, depth information) to create stereoscopic pairs, and the display section presents these with different viewing angles for left and right eyes. This parameter transformation makes side-surface images easily viewable while managing processing complexity through standardized 3D rendering techniques.
2Measurement precision
If a camera captures an image in a side surface direction, then the image reflects the actual spatial relationship, but the image appears distorted or uncomfortable for users to view
Solution Approach 1:
The patent uses 3D stereoscopic display to preserve and enhance spatial position accuracy. By generating left-eye and right-eye images with appropriate parallax, the system maintains accurate spatial relationships from side-surface capture while presenting them in a naturally viewable 3D format. The depth information inherent in side-surface imaging is preserved and made intuitively viewable through stereoscopic presentation.
Solution Approach 2:
The patent creates virtual copies of the captured image from different virtual camera positions. The image processing section generates multiple perspective views (left-eye and right-eye images) from the single side-surface capture, copying the scene from slightly different angles to create stereoscopic pairs. This copying approach preserves spatial accuracy while making the image comfortable for human viewing through natural binocular vision.
3Adaptability or versatility
If the camera is positioned to capture images in directions other than directly behind the display, then the camera can capture side surface objects, but the displayed image does not align with user's natural viewing expectation
Solution Approach 1:
The patent applies 3D stereoscopic presentation to maintain intuitive recognition for side-surface captured images. By providing depth information and appropriate perspective in the 3D display, the system preserves the intuitive spatial relationship even when the camera is positioned for side-surface capture. Users can naturally interpret the scene geometry and object positions through stereoscopic cues.
Solution Approach 2:
The patent employs asymmetric image processing to handle side-surface capture orientation. The image processing section applies different transformations to left-eye and right-eye images based on the side-surface capture geometry, creating asymmetric stereoscopic pairs that correctly represent the side-view spatial relationships. This asymmetric processing maintains intuitive recognition while accommodating flexible camera positioning.
Data Source
AI summary
An exemplary portable electronic apparatus includes a display provided at a front surface thereof and an infrared camera provided at a side surface thereof. A contour image indicating a contour of a hand of a user included in an image captured by the infrared camera, and a guide frame image indicating a region smaller than an imaging range of the infrared camera, are displayed on the display in perspective form such that the images are obliquely viewed images. Accordingly, it is made easy for the user to recognize the position of the hand in a side surface direction of the portable electronic apparatus, and thus the user can put their hand within a range suitable for a gesture input.