3D Camera Control via MIDI Interface
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D imaging methods, such as those using color filter glasses, shuttered glasses, and polarized glasses, face limitations including monochromatic or darker images, discomfort due to flickering, and the need for viewers to remove glasses or tilt their heads to manipulate 3D scenes, which disrupts the viewing experience.
Innovation Solution
A Musical Instrument Digital Interface (MIDI) controller is used to allow users to manipulate 3D camera parameters without taking their eyes off the scene, utilizing sliders, knobs, buttons, and sensors to control the 3D camera, while wearing glasses that filter left-eye and right-eye images for a seamless 3D experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If color filter glasses are used to present 3D images, then the 3D effect is achieved, but the image becomes monochromatic and darker
Solution Approach 1:
The patent segments the 3D image presentation into separate left-eye and right-eye images that are projected simultaneously but spatially separated. Each eye receives its designated image through corresponding polarized filters in the glasses, eliminating the need for color filtering while maintaining the 3D effect. This segmentation allows full-color images to be presented without the monochromatic limitation of anaglyph methods.
Solution Approach 2:
The patent transitions from color filter-based 3D presentation (which destroys color information) to polarized light-based presentation (which preserves color). By using orthogonal linear polarization states instead of complementary color filters, the system maintains full color while achieving binocular separation for the 3D effect.
2Illumination intensity
If shuttered glasses are used to present 3D images, then full color is achieved, but the images flicker causing discomfort
Solution Approach 1:
The patent eliminates periodic shuttering action and replaces it with continuous simultaneous projection of both left and right eye images. The temporal flickering is replaced by spatial separation, where both images are continuously present on the screen and continuously filtered by the polarized glasses, removing the flicker-induced discomfort while preserving full color.
3Illumination intensity
If polarized glasses are used to present 3D images, then full color and continuous images are achieved, but the viewer must keep head level to avoid image bleeding
Solution Approach 1:
The patent employs asymmetric circular polarization states (right-handed and left-handed circular polarization) instead of symmetric linear polarization. This asymmetry in polarization handedness creates a more robust separation mechanism that is less sensitive to head tilting, as circular polarization maintains its rotational symmetry and filtering effectiveness regardless of the viewer's head orientation.
4Adaptability or versatility
If conventional 3D control methods are used, then 3D scenes can be manipulated, but the viewer must remove glasses or tilt head causing disruption
Solution Approach 1:
The patent integrates multiple functions into the glasses system: the same polarized filters that enable 3D viewing also serve as the interface for control input. Sensors embedded in the glasses detect head movements and gestures, allowing the viewer to manipulate 3D scenes without removing the glasses or breaking the viewing experience. This multi-functionality resolves the contradiction between manipulation capability and viewing continuity.
Solution Approach 2:
The patent introduces sensors and processing systems as intermediaries between the viewer's natural head movements and the 3D scene manipulation. The glasses contain sensors that detect head orientation and movement, and a processing system that translates these movements into camera parameter adjustments. This intermediary layer allows intuitive control while maintaining continuous viewing without disruption.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and uninterrupted manipulation of 3D scenes in full color, maintaining viewer focus on the screen, reducing eye strain and time loss associated with head movement, and enhancing interaction in applications like 3D games and environments.
Implementation Method 1
The left-eye images and right-eye images displayed to viewers are typically polarized using different polarization schemes, and the polarized glasses are also polarized in the same manner. Linear polarization may be used. In this scheme, two images are projected onto a screen through orthogonal polarizing filters.
Data Source
AI summary
A method for efficiently manipulating 3D scenes recorded by a virtual camera using a computer system comprised of projectors, graphics accelerators, one or more CPUs, instances of 3D rendering software, and a MIDI interface, includes receiving from the MIDI controller camera parameters, defining left camera and right camera parameters based on the camera parameters, determining left and right images based upon left and right camera parameters, projecting left and right images, viewing left and right images, integrating left and right images to represent a 3D scene, manipulating the 3D scene until the user is satisfied, and storing the left and right camera parameters, and storing the left and right images.