Binaural horizontal perspective hands-on simulator

Abstract

The present invention hands-on simulator system discloses a three dimension display system comprising a three dimensional horizontal perspective display and a 3-D audio system such as binaural simulation to lend realism to the three dimensional display. The three dimensional display system can futher comprise a second display, together with a curvilinear blending display section to merge the various images. The multi-plane display surface can accommodate the viewer by adjusting the various images and 3-D sound according to the viewer's eyepoint and earpoint locations. The present invention hands-on simulator system can project horizontal perspective images into the open space and a peripheral device that allow the end user to manipulate the images with hands or hand-held tools.

Description

[0001] This application claims priority from U.S. provisional applications Ser. No. 60 / 576, 187 filed Jun. 1, 2004, entitled “Multi plane horizontal perspective display”; Ser. No. 60 / 576,189 filed Jun. 1, 2004, entitled “Multi plane horizontal perspective hand on simulator”; Ser. No. 60 / 576, 182 filed Jun. 1, 2004, entitled “Binaural horizontal perspective display”; and Ser. No. 60 / 576,181 filed Jun. 1, 2004, entitled “Binaural horizontal perspective hand on simulator” which are incorporated herein by reference. This application is related to co-pending application Ser. No. 11 / 098,681 filed Apr. 4, 2005, entitled “Horizontal projection display”; Ser. No. 11 / 098,685 filed Apr. 4, 2005, entitled “Horizontal projection display”, Ser. No. 11 / 098,667 filed Apr. 4, 2005, entitled “Horizontal projection hands-on simulator”; Ser. No. 11 / 098,682 filed Apr. 4, 2005, entitled “Horizontal projection hands-on simulator”; “Multi plane horizontal perspective display” filed May 27, 2005; “Multi pla...

AI Technical Summary

Benefits of technology

[0032] The present invention recognizes that the personal computer is perfectly suitable for horizontal perspective display. It is personal, thus it is designed for the operation of one person, and the computer, with its powerful microprocessor, is well capable of rendering various horizontal perspective images to the viewer. Further, horizontal perspective offers open space display of 3D images, thus allowing the hands-on interaction of the end users.

[0033] Thus the present invention discloses a multi-plane hands-on simulator system comprising at least two display surfaces, one of which displaying a three dimensional horizontal perspective images. The other display surfaces can display two dimensional images, or preferably three dimensional central perpective images. Further, the display surfaces can have a curvilinear blending display section to merge the various images. The multi-plane hands-on simulator can comprise various camera eyepoints, one for the horizontal perspective images, one for the central perspective images, and optionally one for the curvilinear blending display surface. The multi-plane display surface can further adjust the various images to accommodate the position of the viewer. By changing the displayed images to keep the camera eyepoints of the horizontal perspective and central perspective images in the same position as the viewer's eye point, the viewer's eye is always positioned at the proper viewing position to perceive the three dimensional illusion, thus minimizing viewer's discomfort and distortion. The display can accept manual input such as a computer mouse, trackball, joystick, tablet, etc. to re-position the horizontal perspective images. The display can also automatically re-position the images based on an input device automatically providing the viewer's viewpoint location. The multi-plane hands-on simulator system can project horizontal perspective images into the open space and a peripheral device that allow the end user to manipulate the images with hands or hand-held tools. Further, the display is also included three dimensional audio such as binaural simulation to lend realism to the three dimensional display.

Problems solved by technology

Ever since humans began to communicate through pictures, they faced a dilemma of how to accurately represent the three-dimensional world they lived in.

Sculpture was used to successfully depict three-dimensional objects, but was not adequate to communicate spatial relationships between objects and within environments.

However, the fact that there are a number of other types of perspectives is not well known.

Viewing the images at angle different from 90° would result in image distortion, meaning a square would be seen as a rectangle when the viewing surface is not perpendicular to the line of vision.

This is done because it is computationally expensive for the computer's hardware to generate the enormous number of 3D objects in a typical 3D application, the majority of which the end-user is not currently focused on.

3D central perspective projection, though offering realistic 3D illusion, has some limitations is allowing the user to have hands-on interaction with the 3D display.

Horizontal perspective images offer realistic three dimensional illusion, but are little known primarily due to the narrow viewing location (the viewer's eyepoint has to be coincide precisely with the image projection eyepoint), and the complexity involving in projecting the two dimensional image or the three dimension model into the horizontal perspective image.

Further, with much experience in viewing three dimensional depth cues from perpendicular images, viewers can tolerate significant amount of distortion generated by the deviations from the camera point.

In contrast, the creation of a horizontal perspective image does require much manipulation.

Making a horizontal drawing requires much effort and very time consuming.

Images