An auto-stereoscopic display system including a plurality of auto-stereoscopic display devices

Abstract

The present invention relates to an autostereoscopic display system configured to display a single virtual 3D environment on at least two autostereoscopic display devices for one or more observers, each of the autostereoscopic display devices defining a virtual window that enables an observer to experience a part of the virtual 3D environment. At least one virtual window is a movable virtual window that is movable within the virtual 3D environment by moving the autostereoscopic display device that defines the movable virtual window in the real world. In this way, the system of the present invention enables an observer to experience a part of the virtual 3D environment through the movable virtual window from a perspective that always corresponds to the actual position of the observer's eyes with respect to the virtual 3D environment.

Description

Technical Field

[0001] <Field of the Invention> The present invention relates to an autostereoscopic display system that displays a single virtual 3D environment on at least two autostereoscopic display (or autostereoscopic display) devices.

Background Art

[0002] <Background> An autostereoscopic display enables an observer (or viewer) to perceive a three-dimensional image of a three-dimensional environment without a dedicated eyewear device such as a headset, a head-mounted display, or glasses (or eyewear device). In particular, it is possible to adapt the three-dimensional image to the movement of the observer with respect to the display. For example, when an object in the foreground (or object) occludes the line of sight, the background object may become invisible to the observer due to motion parallax.

[0003] This can be achieved by using an eye tracking (or eye tracking) device in combination with a screen having a lenticular lens or a parallax barrier. This ensures that the autostereoscopic display can direct the left-eye image only to the left eye of the observer and the right-eye image only to the right eye of the observer at the same time. Some parts of the resulting stereoscopic image may appear in front of the display, while other parts may appear further away (behind the display) from the display. The absence of a dedicated eyewear device allows the observer to experience that they are physically present in the real world, while the autostereoscopic display forms a virtual window into another world, i.e., a truly believable virtual world that is also three-dimensional.

[0004] However, since the virtual window provides a view (or, field of view / view) only to a part of the virtual world, such a view of the virtual world can still be recognized as being limited. Furthermore, humans are characterized by a tendency to work and recreate in groups. Conventional autostereoscopic displays provide limited possibilities for experiencing a large virtual world and / or for participating in a virtual world with peers. In other words, conventional autostereoscopic displays can still be improved with respect to the immersive experience that can be provided to one or more observers.

Disclosure of the Invention

Problems to be Solved by the Invention

[0005] <Summary of the Invention> Accordingly, an object of the present invention is to provide an autostereoscopic display device that achieves a higher level of immersion for one or more persons in a virtual 3D environment. A specific object is to provide an enlarged view on a virtual 3D environment to a person. Also, a specific object is to involve (or, include / participate) a plurality of persons in a virtual 3D environment.

Means for Solving the Problems

[0006] Here, it has been found that one or more of these objects can be achieved by coupling a plurality of autostereoscopic display devices in a specific way.

[0007] Accordingly, the present invention relates to an autostereoscopic display system (1) configured to display a single virtual 3D environment (2) on at least two autostereoscopic display devices (3) for one or more observers (4), - Each autostereoscopic display device (3) defines a virtual window (5) that enables an observer (4) to experience a part of the virtual 3D environment (2), and this part is displayed on the autostereoscopic display device (3) as a stereoscopic image. - At least one virtual window (5) is a movable virtual window (5), which is movable within the virtual 3D environment (2) by moving the autostereoscopic display device (3) that defines the movable virtual window (5). - At least one of the observers (4) experiences a part of the virtual 3D environment (2) through the movable virtual window (5) from a viewpoint corresponding to the position of at least one of the observer's (4) eyes with respect to the virtual 3D environment (2).

[0008] In a preferred embodiment, the autostereoscopic display system - includes at least two autostereoscopic display devices (3), each autostereoscopic display device (3) 〇 has a display element (6) for displaying a stereoscopic image by directing a left-eye image towards the left eye of the observer (4) and a right-eye image towards the right eye of the observer for the autostereoscopic display device (3), 〇 and an eye tracker (7) for acquiring the position of the observer's (4) eyes with respect to the autostereoscopic display device (3). The at least two autostereoscopic display devices (3) - and a first means (11) for providing a virtual 3D environment (2) including at least two virtual windows (5), 〇 where each virtual window (5) is defined by the autostereoscopic display device (3) of the system. 〇 At least one virtual window (5) is a movable virtual window (5), and the movable virtual window (5) is movable within the virtual 3D environment (2) by moving an autostereoscopic display device (3) that defines the movable virtual window (5), the first means (11). - Second means (12) for obtaining the positions of at least two virtual windows (5) in the virtual 3D environment (2). - Third means (13) for obtaining the position of each eye of one or more observers (4) with respect to the virtual 3D environment (2), and - Fourth means (14) for generating a stereoscopic image of the virtual 3D environment (2) for display on each of at least two autostereoscopic display devices (3) viewed by a specific observer (4), wherein the stereoscopic image for each autostereoscopic display device (3) is 〇 Recorded by a virtual stereoscopic camera (8) disposed at the position of the eyes of a specific observer (4) of the autostereoscopic display device (3) with respect to the virtual 3D environment (2) as determined by the third means (13), and as a result, having a perspective (or viewpoint / perspective) corresponding to the position of the eyes of the specific observer (4) with respect to the virtual 3D environment (2). 〇 The fourth means, which can be displayed by a display element (6) of the autostereoscopic display device (3).

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Embodiments for Carrying Out the Invention

[0010] The drawings are not intended to limit the invention to the specific embodiments disclosed and described herein. The elements in the figures are shown for simplicity and clarity and are not necessarily drawn to scale; instead, emphasis is placed on clearly showing the principles of the invention. For example, the dimensions of some elements in the figures may be exaggerated relative to other elements to assist in understanding the various exemplary embodiments of the invention. In particular, the relative dimensions of an observer, an autostereoscopic display device, a virtual window, and a virtual 3D environment in a particular setting cannot be derived from the figures. Also, the drawings do not show the relative positions of different autostereoscopic display devices. Further, terms such as "first," "second," etc. in this specification, if any, are generally used to distinguish similar elements and are not necessarily used to describe a sequential or chronological order.

[0011] In the context of the present invention, the term "observer" means a person who consumes the content presented by the autostereoscopic display system according to the present invention. An observer can in particular observe (or view / watch / view) an autostereoscopic display device present in the system of the present invention, in which case the observer views a stereoscopic image (or movie). An observer can switch to viewing another display device, but in principle cannot view two devices simultaneously. In addition to viewing, an observer can also experience other sensory stimuli such as sound or tactile stimuli. However, for convenience, a person is thus referred to as an "observer," while at the same time, it is understood that, for example, the person can also be a "listener."

[0012] Furthermore, the observer is understood to be a real entity existing in the real world, such as a human male or female or an animal male or female. Throughout the text, references to the observer are made using male terms such as "he", "his", or "him". However, this is only for the purposes of clarity and brevity, and it is understood that female terms such as "she" and "her" apply equally.

[0013] Throughout the text, the term "3D" is used for brevity. This term means equivalent to the term "three-dimensional". For example, the terms "3D object" and "3D environment" mean "three-dimensional object" and "three-dimensional environment", respectively.

[0014] In the context of the present invention, the term "virtual 3D environment" means a three-dimensional environment that is artificially created and thus does not exist in reality. This typically consists of data contained in a storage device that can be read, modified, and displayed on a display means by computing means. The data includes a mapping of virtual elements existing within the virtual 3D environment in the sense that at least their 3D shapes and their mutual positioning within the environment are known. This enables a realistic display of the virtual 3D environment from different viewpoints. When displayed on an autostereoscopic display device, particularly an autostereoscopic display system according to the present invention, the observer can perceive the virtual 3D environment as a real 3D environment.

[0015] The virtual 3D environment does not necessarily have to be static, as it can evolve (or, develop / evolve) in the sense that it is affected by changes, for example, due to virtual objects moving relative to other virtual objects within the virtual 3D environment. The evolving 3D environment can evolve due to changes that are the result of predictable events programmed as part of the virtual 3D environment, or due to unpredictable events induced by the observer, for example, changes that are the result of the observer's reaction to events occurring within the virtual 3D environment.

[0016] In the context of the present invention, an eye tracker means a means for tracking the position of one or both eyes of an observer in time. The obtained sequential positions (or sequential position in time series) are related to the position of the tracking system that performs the tracking and ultimately to the position of the autostereoscopic display device.

[0017] In the context of the present invention, a virtual stereo camera is understood to have a certain position and orientation (6 degrees of freedom) in a virtual 3D environment. It generates image data representing a stereoscopic view (or stereoscopic view) of the virtual 3D environment from the perspective corresponding to its specific position and orientation in the virtual 3D environment. The virtual stereo camera has its position at the position of the observer's eyes and can be moved and / or re-oriented within the virtual 3D environment in response to the movement of the observer's head in the real world.

[0018] The virtual stereo camera is composed of two separate virtual cameras, similar to a physical stereo camera known in the art. The generated image data is left image data representing an image for the left eye and right image data representing an image for the right eye. Each of the two virtual cameras has the position of the observer's eyes and can move and / or change its orientation within the virtual 3D environment when the head of the viewer in the real world moves. In this way, the observer can define the position, direction, and viewing angle for generating the left and right image data.

[0019] The input for the two virtual cameras is provided, for example, by a memory containing a representation of the virtual 3D environment to be presented to the observer, such as the position and orientation of different elements within the virtual 3D environment. Other characteristics of the different elements, such as surface characteristics, mechanical behavior (e.g., applied when the elements collide), light reflection, etc., can also be provided by the memory.

[0020] Furthermore, the representation of the virtual 3D environment in the memory may be modifiable by inputs from the real world, such as the actions of an observer (e.g., pressing a virtual button placed within the virtual 3D environment, or firing a virtual bullet using a real or virtual gun at an element within the virtual 3D environment).

[0021] Where the position of an object within the environment (e.g., an autostereoscopic display device or a virtual window) is relevant, this means including the orientation of the object within that environment.

[0022] The system of the present invention comprises at least two autostereoscopic display devices. These have the function of displaying at least one observer with a single virtual 3D environment (i.e., one and the same virtual 3D environment), and each autostereoscopic display device functions as a virtual window into the virtual 3D environment. This means that the content displayed on the display element of the autostereoscopic display device is actually the part of the virtual 3D environment that would be seen if the display element were a real window and the virtual 3D environment were a real 3D environment. The equivalent in the real world relates to the viewfinder of a camera that displays the real world (the most similar being a viewfinder defined by an aperture that lacks only a lens or a display and that enables a cut - out view of the real world).

[0023] In this way, a single observer can perceive the virtual 3D environment as a real 3D environment that can be observed through at least two windows, and that can also be perceived as real (in practice, the observer will view only one of the screens at a time). Or for two or more observers, the virtual 3D environment can be perceived as a real 3D environment that can be observed through a window that each observer can perceive as real.

[0024] Both settings require that the relative positions of the different autostereoscopic display devices are known, which is achieved by a second means as further explained below. Both settings also require that the relative positions of each observer's eyes with respect to the virtual 3D environment are known, which is achieved by a third means as further explained below.

[0025] There is an additional requirement for an autostereoscopic display device that is movable (in the sense that its position can be changed in the real 3D environment). In order to account for its movement with respect to the virtual 3D environment, knowledge of its position and / or acceleration in the real 3D environment is constantly required. For example, just the relative movement of two movable autostereoscopic display devices (or a movable autostereoscopic display device) does not provide information about their respective movements with respect to the virtual 3D environment unless at least one of them has, for example, a known position and / or a known acceleration in the real 3D environment.

[0026] Once the relative positions of the different autostereoscopic display devices are known, it is sufficient to know the position and / or acceleration in the real 3D environment for only one of them. This could be, for example, a device that is stationary in the sense that it does not move with respect to the real 3D environment during a certain observer session.

[0027] Note that the expression "one and the same virtual 3D environment" does not necessarily mean that different virtual windows provide views of the same part or the same scene of the virtual 3D environment, but only from different angles. If there is sufficient separation between two different scenes, it is possible that neither of them will be seen simultaneously by two observers when each observer looks through their own virtual window.

[0028] Thus, each of the virtual windows can provide a good view of different scenes belonging to the same virtual 3D environment. For example, when a virtual 3D object moves through the virtual 3D environment from one scene to another, and is then sequentially observed by an observer through each virtual window, an increased sense of immersion for a single person in the virtual 3D environment can be achieved.

[0029] An increase in the sense of immersion for two or more people is also possible. For example, a first observer can initiate an action in a first scene that appears to the first observer as part of the virtual 3D environment, and this action causes an effect in a second scene that appears to the second observer. The first observer can, for example, generate virtual smoke in the first scene, which triggers a fire alarm that can be heard by both observers. When the smoke dissipates and reaches the second scene after a certain time, it becomes visible to the second observer as well.

[0030] Autostereoscopic display devices are known in the art, for example, from WO2013120785A2. An important component of the autostereoscopic display device in the system of the present invention is 1) a display element for displaying an autostereoscopic image to an observer, and 2) an eye tracker for tracking the position of the observer's eyes relative to the autostereoscopic display device.

[0031] The eye tracker comprises means for tracking the position of the observer's eyes relative to the autostereoscopic display device (more specifically, relative to the display element). It is generally a fixed part of the autostereoscopic display device in that it has a known position fixed relative to the display element. The acquired eye position information is used by a third means to track the position of the observer's eyes relative to the virtual 3D environment. As will be described in more detail below, the position of the virtual window in the virtual 3D environment is also used to achieve this.

[0032] The obtained eye position data may also be used to simultaneously direct the left-eye image towards the observer's left eye and the right-eye image towards the observer's right eye (importantly, as long as the left-eye image does not hit the right eye, it may be directed towards other areas, and the same applies to the right-eye image). However, the use of the eye position data is not essential for driving the autostereoscopic display device. In principle, it is also possible to achieve autostereoscopic viewing without an eye tracker.

[0033] The display element comprises means for displaying a stereoscopic image to an observer whose eyes are tracked by an eye tracker. Such display means comprises an array of pixels for generating a display output, and a parallax barrier or lenticular lens provided on the array so as to be able to direct the left image towards the observer's left eye and the right image towards the observer's right eye. The display element is driven by a processing unit that may be present within the autostereoscopic display device of the system. The processing unit may also be a central unit for simultaneously driving two or more display elements of the autostereoscopic display device of the system.

[0034] In the system of the present invention, one or more of the autostereoscopic display devices may be devices such as a desktop device or a wall-mounted device (e.g., a television, (desktop) computer monitor or laptop) where most of the real world is stationary during their use. However, they may also be portable devices such as a mobile phone, a tablet, or a game console that allow the observer to move (freely) within the real world.

[0035] However, the system of the present invention is configured to drive at least one autostereoscopic display device movable within a virtual 3D environment. Such a movable autostereoscopic display device also defines a movable virtual window, so that movement in the real world results in corresponding movement in the virtual world. In the system of the present invention, the movable autostereoscopic display device is driven during movement such that the viewer's field of view through the virtual window always has a perspective corresponding to the actual position of the viewer's eyes relative to the virtual 3D environment. The movable autostereoscopic display device may of course also have a stationary position during a viewer session.

[0036] The number of autostereoscopic display devices in the system of the present invention is not generally limited in principle. However, usually, the system of the present invention comprises from 2 to 25 autostereoscopic display devices, particularly from 2 to 10.

[0037] The number of virtual windows movable within the virtual 3D environment is not generally limited in principle. However, usually, the number of movable virtual windows is in the range from 1 to 25, particularly in the range from 2 to 10.

[0038] Figure 1 shows two schematic top views of the first embodiment of the present invention. It includes an upper view and a lower view in which the positions of two observers (4) and two autostereoscopic display devices (3) are different. This shows a schematic top view of the system (1) of the present invention and two observers (4). In the virtual 3D environment (9) represented in a two-dimensional form in Figure 1, the virtual 3D environment (2) is depicted as a rectangular box including two virtual windows (5) and two virtual scenes (10). Next to the virtual windows (5), there are two autostereoscopic display devices (3) (actually each virtual window (5) coincides with the device (3), but for clarity, their positions are shifted minimally in Figure 1). The stereoscopic image of the virtual 3D environment (2) is generated on the autostereoscopic display device (3) viewed by the observer (4) for each observer (4). Each of the two observers (4) views one of the two autostereoscopic display devices (3) and experiences the virtual 3D environment (2) displayed thereon. The positions and orientations of the two observers (4) in the lower view, as well as the two autostereoscopic display devices (3) in the real 3D environment (9), are different from those in the upper view. Both drawings show how the system responds in that the observed scene (10) changes its position in a similar way to what the observer (4) would expect when viewing the real environment through a real window. In other words, the scene (10) viewed by each observer (4) changes in accordance with the position of the observer (4). The changes in position and orientation in both views of Figure 1 are indicated by the arrows drawn next to the observer (4), next to the autostereoscopic display device (3), and next to the scene (10).

[0039] Figure 2 shows a second embodiment of the present invention. It displays a schematic top view of a setup including the system (1) of the present invention and a single observer (4). In the actual 3D environment (9) represented in a two-dimensional format in Figure 2, the virtual 3D environment (2) is depicted as a rectangular box including two virtual windows (5) and two virtual scenes (10). The virtual 3D environment (2) is provided by the first means (11). Immediately adjacent to the virtual windows (5), there are two auto-stereoscopic display devices (3) (in reality, each virtual window (5) coincides with a device (3), but for clarity, their positions are shifted minimally in Figure 2). Each auto-stereoscopic display device (3) comprises a display element (6) and an eye tracker (7). The observer (4) looks at one of the two auto-stereoscopic display devices (3) at a time and experiences the virtual 3D environment (2) displayed thereon. The second means (12) is configured to obtain the positions of at least two virtual windows (5) in the virtual 3D environment (2) by using the position of the corresponding auto-stereoscopic display device (3) in the actual 3D environment (9). The third means (13) is configured to obtain the position of the observer's (4) eyes with respect to the virtual 3D environment (2). The fourth means (14) is configured to generate a stereoscopic image of the virtual 3D environment (2) for display on the auto-stereoscopic display device (3) seen by the observer (4). The stereoscopic image is recorded by a virtual stereoscopic camera (8) positioned at the position of the observer's (4) eyes on the auto-stereoscopic display device (3). This is the position with respect to the virtual 3D environment (2) determined by the third means (13). Thus, the third means (13) and the virtual 3D environment (2) provide an input for the fourth means (14). As a result, the scene (10) is displayed to the observer (4) in a perspective that always corresponds to the actual position of the observer's (4) eyes with respect to the virtual 3D environment (2).

[0040] For clarity, in FIGS. 1 and 2, the number of lines of sight from the eyes to the virtual environment is reduced, and all appear from a single point in front of the head (rather than from each eye).

[0041] The system of the present invention includes first means for providing a virtual 3D environment. This first means typically includes a computer-readable medium (such as a memory) containing data representing the virtual 3D environment. It may also include a computer program containing instructions for modifying the virtual 3D environment.

[0042] The data representing the virtual 3D environment includes data representing at least two virtual windows, such that at least two virtual windows are part of the virtual 3D environment. Each of these virtual windows is defined by the autostereoscopic display device of the system. This essentially means that the display element of the autostereoscopic display device (in particular, the part that actually emits light to display an image to the observer, for example, the screen) coincides with the opening provided by the window. This coincidence forms a link between the virtual 3D environment and the real 3D environment. Any movement of the autostereoscopic display device within the real 3D environment is essentially converted into the movement of the corresponding virtual window within the virtual 3D environment. The first means takes this movement into account and provides the position of the virtual window within the virtual 3D environment. This includes its position relative to other elements within the virtual 3D environment and any changes therein due to the movement of the virtual window within the virtual 3D environment.

[0043] The virtual 3D environment made possible by the first means includes at least two virtual windows, at least one of which is movable within the virtual 3D environment by moving the autostereoscopic display device that defines the movable virtual window in the real world. The number of movable virtual windows may be more, for example, in the range of 1 to 25, particularly in the range of 2 to 10.

[0044] Preferably, all of the autostereoscopic display devices in the system of the present invention are movable (or, movable / movable) devices. This typically means that all virtual windows are movable virtual windows. The autostereoscopic display device may actually be stationary (e.g., during a particular observer session), but it is still advantageous for it to be a movable device. For example, it is convenient that the observer session can be started immediately after the autostereoscopic display device is placed in the desired position without having to perform a calibration procedure and without worrying about someone accidentally moving the autostereoscopic display device during the observer session. In other words, the first means may comprise means for providing a virtual 3D environment in which all virtual windows are movable virtual windows, i.e., virtual windows that are movable within the virtual 3D environment.

[0045] The virtual 3D environment that can be provided by the first means can comprise at least one virtual window that is not movable within the virtual 3D environment. In other words, the first means may comprise means for providing a virtual 3D environment that comprises at least one virtual window that is not movable within the virtual 3D environment. For example, when the system comprises two autostereoscopic display devices, only one of which is a movable device, the other one is not movable within the virtual 3D environment and thus qualifies as a stationary device.

[0046] Thus, the virtual 3D environment is provided by the first means that includes at least two virtual windows, one of which is movable. However, the first means does not provide the positions of these virtual windows when they are susceptible to changes induced by the observer within the virtual 3D environment. Thus, the second means is specifically directed to obtaining the positions of at least two virtual windows within the virtual 3D environment.

[0047] The input for this is typically formed by the positions of each of at least two autostereoscopic display devices in a real 3D environment. Eventually, as described above, each virtual window is defined by the autostereoscopic display device of the system, and any movement of such an autostereoscopic display device within the real 3D environment is converted into the movement of the corresponding virtual window within the virtual 3D environment.

[0048] For this purpose, the second means is preferably configured to utilize data representing the position and / or acceleration of at least two autostereoscopic display devices in a real 3D environment.

[0049] For example, the second means - data representing the position of a stationary autostereoscopic display device in a real 3D environment, and - data representing the position of one or more movable autostereoscopic display devices relative to the position of the stationary autostereoscopic display, is configured to be utilized in this way.

[0050] There are numerous ways to configure the second means to achieve this. A person skilled in the art knows how the positions of various autostereoscopic display devices can be obtained for the purpose of their functioning within the system. A person skilled in the art can achieve this by routine methods without inventive effort.

[0051] For example, in the system of the present invention, each autostereoscopic display can be equipped with one or more accelerometers and, optionally, one or more measuring devices selected from the group of gyroscopes and magnetometers. Using this instrumentation, all relative positions and velocities of different autostereoscopic display devices may be derived from the measured accelerations following an initial calibration. Such calibration is based, for example, on determining the initial relative velocity of the autostereoscopic display devices or on identifying common environmental features (persons, body parts, objects, corners between two walls) by cameras in different autostereoscopic display devices. The latter principle is known as "multi-camera feature correspondence", and for this purpose, the cameras of the eye tracker may be used, or different cameras specifically configured for this purpose may be used.

[0052] The principle of multi-camera feature correspondence may of course be used to continuously track the positions of different autostereoscopic display devices in a real 3D environment. For this purpose, one or more common environmental features (persons, body parts, objects, corners between two walls) may be identified by cameras in different autostereoscopic display devices. In that case, the position of each of the different autostereoscopic display devices can be obtained by associating it with such common environmental features. It is also possible to derive the relative positions of different autostereoscopic display devices. Since the eye tracker already exists in the autostereoscopic display device, the eyes may function as common environmental features.

[0053] The absolute position within the real 3D environment can also be determined by external measurement means arranged at a fixed position within the real 3D environment, away from the autostereoscopic display device (rather than by built-in devices such as accelerometers). For example, the measurement principle of such external measurement means depends on the Doppler effect (in sound or light), time of flight, or triangulation. For this purpose, the external measurement means can include a (ultra) sound source and / or an electromagnetic wave radiation source that can irradiate the autostereoscopic display device. The setting in which this is realized is, for example, a dedicated room for providing the observer with a high-quality virtual reality experience. This can include the positioning of a plurality of external measurement means that are stationary and can accurately obtain the relative position of the autostereoscopic display device.

[0054] The autostereoscopic display device being looked at by the observer functions as a virtual window for a part of the virtual 3D environment behind its window, and this virtual 3D environment is displayed on the display element of the autostereoscopic display device (in particular, on the screen of the display element). For correct display, (1) the position of the virtual window in the virtual 3D environment (including its orientation in the virtual 3D environment), and (2) the position of the observer's eyes relative to the autostereoscopic display device (and thus relative to the virtual window that coincides with the autostereoscopic display device) are considered. Combining both positions to reach the position of the observer's eyes relative to the virtual 3D environment is the function of a third means. This position is important because it is the position of a virtual stereoscopic camera that records the image of the virtual 3D environment, that is, the image continuously displayed on the display element of the autostereoscopic display device that the observer sees. In this way, the observer sees a virtual 3D environment that is precisely adapted to their position relative to this display element of the autostereoscopic display device, that is, having the correct perspective from their viewpoint.

[0055] Therefore, in the system of the present invention, the third means usually - The position of each observer's eyes relative to the position of the autostereoscopic display device as seen by each observer, obtained by the eye tracker of the autostereoscopic display device as seen by each observer, - The position of a virtual window in the virtual 3D environment (2), where this virtual window is defined by the autostereoscopic display device as seen by each observer and is the position of the virtual window obtained by the second means, and is configured to utilize this position.

[0056] The third means can acquire the eye positions for a virtual 3D environment not only for one observer but also for multiple observers. In fact, it provides this position to all observers of the system, that is, all observers whose eyes are in a position to be tracked by the eye tracker (if eye tracking is not yet possible or is no longer possible, the person does not qualify as an observer).

[0057] The system of the present invention is configured to display a single virtual 3D environment for at least one observer. However, preferably, it is for at least two observers, for example, 1 to 25 observers, particularly 1 to 10 observers. Typically, the number of observers is equal to the number of autostereoscopic display devices present in the system.

[0058] Given the state of the virtual 3D environment at a certain moment, it is necessary to prepare an image of this virtual 3D environment for display on each of the autostereoscopic display devices of the system as seen by a specific observer. Of course, this needs to be executed according to the specific perspective of each observer. The fourth means performs this function.

[0059] First, a virtual camera is placed at the position of each eye of the observer of each autostereoscopic display device, as determined by the third means (a combination (or assembly) of two such virtual cameras, i.e., one for each eye, and thus qualified as a virtual stereoscopic camera). Next, the virtual stereoscopic camera is caused to record a stereoscopic image of the virtual 3D environment, using data representing the virtual 3D environment. This recording always has a perspective that corresponds to the actual position of each eye of the observer with respect to the virtual 3D environment. Further, this recording can be displayed by the display element of the autostereoscopic display device on which the stereoscopic image of the virtual 3D environment was generated.

[0060] An advantage of the system of the present invention is that it enables the observer to experience and / or explore the virtual 3D environment through a window through which the observer can freely position himself / herself at his own discretion with respect to the virtual 3D environment. For example, by carrying a hand-held autostereoscopic display device, the observer can select which part of the virtual 3D environment he / she wishes to observe. The observer can walk around a particular virtual scene within the virtual 3D environment and thus observe the virtual scene from changing perspectives (e.g., from different angles). This can advantageously be applied to games in which multiple players view the same virtual environment.

[0061] The system of the present invention may also be applied in an office environment, where a plurality of autostereoscopic display devices are arranged on a desk or platform. For example, a designer or architect may wish to view their work in a three-dimensional virtual form. In another example, a student, worker, or researcher may wish to learn more about the 3D structure of an object, such as a molecular model, or a virtual 3D copy of a technical installation. In such applications, it may not be the main purpose to continuously move a movable virtual window relative to the object, but it can be very convenient to place different autostereoscopic display devices in random positions and be able to automatically and immediately provide a view in the correct perspective. This does not require any calibration effort from the observer, for example.

[0062] Also, in an office environment, a plurality of observers, such as two designers working together, or a teacher instructing / teaching students, can be included in the virtual 3D environment.

Claims

1. An autostereoscopic display system (1) configured to display a single virtual 3D environment (2) on at least two autostereoscopic display devices (3) for one or more observers (4), - Each of the autostereoscopic display devices (3) defines a virtual window (5) that enables an observer (4) to experience a part of the virtual 3D environment (2), and the part is displayed on the autostereoscopic display device (3), - At least one virtual window (5) is a movable virtual window (5) that is movable within the virtual 3D environment (2) by moving the autostereoscopic display device (3) that defines the movable virtual window (5) in the real world, - At least one of the observers (4) experiences the part of the virtual 3D environment (2) through the movable virtual window (5) from a perspective corresponding to the position of the at least one of the eyes of the observer (4) with respect to the virtual 3D environment (2). An autostereoscopic display system (1).

2. The system (1) is, - At least two autostereoscopic display devices (3), each autostereoscopic display device (3) having 〇 A display element (6) for displaying a stereoscopic image by directing a left-eye image towards the left eye of the observer and a right-eye image towards the right eye of the observer with respect to the observer (4) of the autostereoscopic display device (3), 〇 An eye tracker (7) for obtaining the position of the eyes of the observer (4) with respect to the autostereoscopic display device (3), and the at least two autostereoscopic display devices (3), - A first means (11) for providing a virtual 3D environment (2) including at least two virtual windows (5), 〇 Each virtual window (5) is defined by the autostereoscopic display device (3) of the system, 〇 At least one virtual window (5) is a movable virtual window (5), and the movable virtual window (5) can be moved within the virtual 3D environment (2) in the real world by moving the autostereoscopic display device (3) that defines the movable virtual window (5), the first means (11); - Second means (12) for obtaining the positions of the at least two virtual windows (5) in the virtual 3D environment (2); - Third means (13) for obtaining the position of each eye of the one or more observers (4) with respect to the virtual 3D environment (2); - Fourth means (14) for generating a stereoscopic image of the virtual 3D environment (2) for display on each of the at least two autostereoscopic display devices (3) viewed by a specific observer (4), wherein the stereoscopic image for each autostereoscopic display device (3) is 〇 Recorded by a virtual stereoscopic camera (8) arranged at the position of the eyes of the specific observer (4) with respect to the autostereoscopic display device (3) with respect to the virtual 3D environment (2) determined by the third means (13), and as a result, has a perspective corresponding to the position of the eyes of the specific observer (4) with respect to the virtual 3D environment (2); 〇 The fourth means, which can be displayed by the display element (6) of the autostereoscopic display device (3); The autostereoscopic display system (1) according to claim 1, comprising.

3. The autostereoscopic display system (1) according to claim 2, wherein the at least two autostereoscopic display devices (3) comprise one or more accelerometers and one or more measuring devices selected from the group consisting of a gyroscope and a magnetometer, optionally.

4. The autostereoscopic display system (1) according to claim 2 or 3, wherein the first means (11) comprises a computer-readable medium containing data representing the virtual 3D environment (2).

5. The autostereoscopic display system (1) according to any one of claims 2 to 4, wherein the first means (11) comprises a computer program containing instructions for modifying the virtual 3D environment (2).

6. The auto-stereoscopic display system (1) according to any one of claims 2 to 5, wherein the second means (12) is configured to utilize data representing the respective positions of the at least two auto-stereoscopic display devices (3) in the actual 3D environment (9).

7. The second means (12) is - data representing the position of the stationary auto-stereoscopic display device (3) in the actual 3D environment (9), and - data representing the positions of one or more movable auto-stereoscopic display devices (3) relative to the position of the stationary auto-stereoscopic display device (3), The auto-stereoscopic display device (1) according to any one of claims 2 to 6, which is configured to utilize the data.

8. The third means (13) is - the position of the eyes of each observer (4) relative to the position of the auto-stereoscopic display device (3) viewed by each observer (4), which is obtained by the eye tracker of the auto-stereoscopic display device (3) viewed by each observer (4), and - the position of the virtual window (5) in the virtual 3D environment (2) obtained by the second means (12), wherein the virtual window (5) is defined by the auto-stereoscopic display device (3) viewed by each observer (4), and the position of the virtual window (5) in the virtual 3D environment (2), The auto-stereoscopic display device (1) according to any one of claims 2 to 7, which is configured to utilize the data.

9. The number of virtual windows (5) movable within the virtual 3D environment (2) is in the range of 2 to 10. The auto-stereoscopic display system (1) according to any one of claims 1 to 8.

10. The auto-stereoscopic display system (1) according to any one of claims 1 to 9, wherein the auto-stereoscopic display system (1) includes 2 to 10 auto-stereoscopic display devices (3).

11. The autostereoscopic display system (1) according to any one of claims 1 to 10, configured to display a single virtual 3D environment to 1 to 10 observers (4).

12. The autostereoscopic display system (1) according to any one of claims 1 to 11, wherein the first means (11) comprises means for providing a virtual 3D environment (2), the virtual 3D environment (2) including at least one virtual window (5) that is not movable within the virtual 3D environment (2).

13. The autostereoscopic display system (1) according to any one of claims 1 to 11, wherein the first means (11) comprises means for providing a virtual 3D environment (2), and all virtual windows (5) are virtual movable windows (5) that are movable within the virtual 3D environment (2).

14. The autostereoscopic display system (1) according to any one of claims 1 to 13, wherein the at least two autostereoscopic display devices (3) are independently selected from the group consisting of a television, a desktop computer monitor, a laptop, a mobile phone, a tablet, and a game console.

Images