Display device

Abstract

The display device includes: a display; a processor; a user separation layer; and left and right image separation layers. The processor acquires user position information including position information of a first user according to output of the sensor acquiring the position information of the real space. Generating a right eye image and a left eye image of the first user based on the position information of the first user; generating a second user image of a second user; and controlling the display to display a display image including the right-eye image and the left-eye image of the first user and the second user image. The user separation layer is fixed to a surface of the display and separates the display image into a viewpoint of a first user and a viewpoint of a second user. The left and right image separation layer is fixed to a surface of the display and separates a display image into a right-eye image and a left-eye image.

Description

Technical Field

[0001] This technology relates to a display device that can be applied to stereoscopic display using binocular stereoscopic vision. Background Technology

[0002] Traditionally, stereoscopic display technology using binocular stereoscopic vision is known. Binocular stereoscopic vision achieves stereoscopic vision by displaying images with parallax to the user's right and left eyes. In recent years, display devices that can achieve stereoscopic vision using the naked eye by directly displaying images with parallax to the right and left eyes without the use of special glasses have attracted attention.

[0003] Patent Document 1 describes a display capable of enabling multiple viewers to simultaneously view two-dimensional and / or three-dimensional image data from multiple viewpoints. In this display, a high-refractive-index optical volume is provided above a structure (such as a cylindrical lens) that generates views according to angles. Therefore, the perception of the image popping off the screen is enhanced, and on-axis and off-axis images can be separated for each viewer (paragraphs

[0009] ,

[0010] , and

[0028] in Patent Document 1). Figure 1 and Figure 7 wait).

[0004] Patent Document 2 describes a glasses-free stereoscopic display device that provides multiple different stereoscopic views in different directions. In this device, for example, nine different views are displayed, and a viewer experiencing two consecutive views among the nine different views experiences a three-dimensional effect. It should be noted that the multiple different views are periodically repeated around the display. In view of this, the viewer's distance and speed are detected, and the number and order of viewing are changed according to the detection results. Therefore, for example, crosstalk, image blurring, reverse viewing, etc., are suppressed (paragraphs

[0037] ,

[0048] ,

[0057] ,

[0067] and

[0073] in the specification of Patent Document 2). Figures 7 to 9 wait).

[0005] Patent Document 3 describes a stereoscopic display showing multiple viewpoint images. In this stereoscopic display, the positions of multiple users are detected, and a target field of view is calculated for each user based on the detection results to allow for normal viewing of the three-dimensional image. Furthermore, the display order of the viewpoint images is selected such that the field of view when displaying multiple viewpoint images is closest to the target field of view. Therefore, the number of viewers within the field of view is maximized, thereby providing a comfortable viewing environment for stereoscopic video (paragraphs

[0026] ,

[0040] ,

[0043] , and

[0047] in Patent Document 1). Figure 6 , Figure 7 wait).

[0006] Citation List

[0007] Patent documents

[0008] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2021-516517

[0009] Patent Document 2: Japanese Unexamined Patent Application Publication No. 2015-515165

[0010] Patent Document 3: Japanese Patent Application Publication No. 2012-10086 Summary of the Invention

[0011] Technical issues

[0012] Stereoscopic displays utilizing binocular stereoscopic vision hold promise for applications in various fields, such as entertainment, education, and healthcare. Furthermore, the scope of applications is expected to expand by enabling multiple users to simultaneously share stereoscopic display content. On the other hand, the resolution may decrease depending on the method used to display the image achieving stereoscopic vision. Therefore, a technology is desired that allows multiple users to simultaneously view high-resolution images incorporating binocular stereoscopic vision.

[0013] In view of the above-mentioned circumstances, the purpose of this technology is to provide a display device that enables multiple users to simultaneously view high-resolution images, including binocular stereoscopic vision.

[0014] Solution to the problem

[0015] To achieve the aforementioned objectives, a display device according to an embodiment of the present technology includes: a display; a processor; a user separation layer; and a left-right image separation layer. The processor is configured to: obtain user position information including the position information of a first user based on the output of a sensor configured to obtain position information in real space; generate a right-eye image and a left-eye image of the first user based on the first user's position information; generate a second user image targeting a second user different from the first user; and control the display to display an image including the right-eye image, the left-eye image, and the second user image. The user separation layer is relatively fixed relative to the surface of the display and is configured to separate the display image into the viewpoint of the first user and the viewpoint of the second user. The left-right image separation layer is relatively fixed relative to the surface of the display and is configured to separate the display image into a right-eye image and a left-eye image.

[0016] In this display device, a display image is shown on the screen, comprising a right-eye image and a left-eye image of the first user generated based on the position information of the first user, and an image of the second user targeting the second user. Furthermore, the display image is separated into the viewpoints of the first user and the second user by a user separation layer, and further separated into right-eye and left-eye images by a left-right image separation layer. Utilizing these two layers, images can be distributed to multiple users, including the first and second users, and displayed on the screen without waste. Therefore, high-resolution images, including binocular stereoscopic vision, can be provided to multiple users simultaneously. Attached Figure Description

[0017] Figure 1 This is a schematic diagram illustrating an example of a first display device according to an embodiment of the present technology.

[0018] Figure 2 A schematic diagram illustrating an example of the functional configuration of a first display device.

[0019] Figure 3 This is a schematic diagram illustrating an example configuration of the display unit of a first display device.

[0020] Figure 4 This is a schematic diagram illustrating an example of beam control via a binocular separation layer.

[0021] Figure 5 This is a schematic diagram illustrating an example of beam control via a viewer separation layer.

[0022] Figure 6 This is a schematic diagram illustrating beam control via a first display device.

[0023] Figure 7 This is a schematic diagram illustrating an example configuration of a display unit for a single-person display device.

[0024] Figure 8 A block diagram illustrating an example configuration of a processor for a single-user display device.

[0025] Figure 9 This is a schematic diagram illustrating an example of stereoscopic display using a display device for a single person.

[0026] Figure 10 This is a schematic diagram illustrating an example of stereoscopic display using a display device for a single person.

[0027] Figure 11 A flowchart illustrating an example of operation of a display device for a single user.

[0028] Figure 12 A block diagram illustrating an example configuration of the processor of a first display device.

[0029] Figure 13 This is a schematic diagram illustrating an example of stereoscopic display via a first display device.

[0030] Figure 14 A flowchart illustrating an example of processor operation.

[0031] Figure 15 A schematic diagram illustrating the parameters of the binocular separation layer and the viewer separation layer.

[0032] Figure 16 This is a schematic diagram illustrating another example of the arrangement of the beam control layer.

[0033] Figure 17 This is a schematic diagram illustrating an example of the arrangement of the binocular separation layer and the viewer separation layer relative to a perspective display.

[0034] Figure 18 This is a schematic diagram illustrating another configuration example of a viewer separation layer.

[0035] Figure 19 This is a schematic diagram illustrating an example of the arrangement of the binocular separation layer and the viewer separation layer relative to a self-emissive display.

[0036] Figure 20 This is a schematic diagram illustrating an example of the striped pattern of the binocular separation layer and the viewer separation layer.

[0037] Figure 21 This is a schematic diagram illustrating an application example of a viewer separation layer capable of controlling the stripe pattern.

[0038] Figure 22 This is a schematic diagram illustrating another application example of a viewer separation layer capable of controlling the stripe pattern.

[0039] Figure 23 This is a schematic diagram illustrating beam control in the second display mode.

[0040] Figure 24 A flowchart illustrating an example of processor operation in a second display mode.

[0041] Figure 25 This is a schematic diagram illustrating, as a comparative example, image display via a display device for a single person.

[0042] Figure 26 This is a schematic diagram illustrating image display via a multi-view display device as a comparative example. Detailed Implementation

[0043] In the following description, embodiments according to the present technology will be described with reference to the accompanying drawings.

[0044] [Configuration of the first display device]

[0045] Figure 1 This is a schematic diagram illustrating an example of a first display device according to an embodiment of the present technology.

[0046] The first display device 100 is a device for displaying stereoscopic images to multiple users 1.

[0047] The first display device 100 is configured as a gaze-detection type light field display (LFD). For example, the first display device 100 detects the positions of a plurality of users 1 and generates a right-eye image and a left-eye image suitable for the position of each user 1. The right-eye image and the left-eye image are a pair of parallax images whose parallax depends on the positions of the left and right eyes of the user 1. Therefore, the first display device 100 generates a pair of parallax images for each of the plurality of users 1.

[0048] Furthermore, the first display device 100 displays a corresponding right-eye image facing each user 1's right eye and a corresponding left-eye image facing each user 1's left eye. Therefore, multiple users 1 can perceive the three-dimensional image 2 with their naked eyes using binocular stereoscopic vision. Moreover, the three-dimensional image 2 perceived by each user 1 is, for example, an image viewed from each user 1's viewing position.

[0049] exist Figure 1 In the example shown, a 3D object representing an apple is displayed to two users 1. In this case, the first display device 100 displays a right-eye image and a left-eye image of the apple facing each of the two users 1. Therefore, both users 1 are able to perceive a three-dimensional image 2 of the 3D object representing the apple as seen from each user 1's viewing position.

[0050] It should be noted that the images in this disclosure include both still images and moving images (videos) that change over time. Therefore, for example, a right-eye image and a left-eye image can also be represented as a right-eye video and a left-eye video. Furthermore, three-dimensional images can also be represented as stereoscopic videos.

[0051] The first display device 100 includes a housing portion 20, a viewpoint detection camera device 21, and a display unit 22. The housing portion 20 is the enclosure that houses the various units of the first display device 100 and is placed on a table or similar surface during use. The housing portion 20 is provided with an inclined surface that is tilted relative to the surface on which it is placed. The inclined surface of the housing portion 20 is the surface of the first display device 100 facing the user 1, and the viewpoint detection camera device 21 and the display unit 22 are provided thereon. It should be noted that the shape of the housing portion 20 is not limited. For example, a rectangular housing portion 20 without an inclined surface can be used.

[0052] The viewpoint detection camera device 21 is an imaging element that images the face of the observer 1 observing the display panel 23. The viewpoint detection camera device 21 functions as a sensor to obtain positional information in real space. Here, the captured image obtained by imaging the face of the user 1 is obtained as positional information in real space. The captured image, for example, is information indicating the position of the user 1's viewpoint in real space. For example, the viewpoint detection camera device 21 is appropriately arranged at a position where it can image the face of the user 1. Figure 1 In the middle, the viewpoint detection camera device 21 is arranged on the inclined surface of the housing part 20, at a position above the center of the display unit 22.

[0053] A digital camera device, including an image sensor such as a complementary metal-oxide-semiconductor (CMOS) sensor or a charge-coupled device (CCD) sensor, can be used as the viewpoint detection camera device 21. The specific configuration of the viewpoint detection camera device 21 is not limited, and for example, a multi-eye camera device such as a stereo camera device can be used. Furthermore, an infrared camera device that illuminates infrared light and captures infrared images, a ToF camera device used as a distance measurement sensor, or the like can be used as the viewpoint detection camera device 21.

[0054] Display unit 22 is a display unit that displays right-eye and left-eye images to multiple users 1. Display unit 22 is configured to display the corresponding right-eye image and corresponding left-eye image to the right and left eyes of each user 1. Display unit 22 is, for example, a rectangular panel in a plan view, and is arranged along the inclined surface of housing portion 20. By arranging display unit 22 in this inclined state, multiple users 1 can, for example, observe the stereoscopically displayed 3D object from both horizontal and vertical directions. It should be noted that display unit 22 does not need to be arranged inclined and can be arranged in any orientation, as long as display unit 22 enables user 1 to visually recognize the image. (See below for further details.) Figure 3 Describe the specific configuration of display unit 22.

[0055] Figure 2 This is a schematic diagram illustrating an example of the functional configuration of the first display device 100. The first display device 100 also includes a storage unit 23 and a processor 24.

[0056] Storage unit 23 is a non-volatile storage device, and for example, a solid-state drive (SSD) or a hard disk drive (HDD) is used. Storage unit 23 stores a control program 25 and content data 26. Control program 25 is a program that controls the overall operation of the first display device 100. Content data 26 is data about content including 3D objects, etc. Information about the three-dimensional shape, surface color, lighting direction, operation, etc., of the 3D objects is recorded as content data 26. In this embodiment, storage unit 23 corresponds to a computer-readable recording medium that records the program. Furthermore, control program 25 corresponds to a program recorded on the recording medium.

[0057] The processor 24 is an information processing device that controls the integrated operation of the first display device 100. The processor 24 has the hardware configuration required by a computer, such as a CPU and memory (RAM, ROM). The CPU loads the control program 25 stored in the storage unit 23 into the RAM and executes it to perform various types of processing.

[0058] For example, programmable logic devices (PLDs) such as field-programmable gate arrays (FPGAs) and other devices such as application-specific integrated circuits (ASICs) can be used as processor 24. Furthermore, for example, graphics processing units (GPUs) can be used as information processing devices 40.

[0059] The processor 24 obtains user position information, including the position information of user 1, based on the output (captured image) of the viewpoint detection camera device 21. Here, the position information of user 1 is, for example, information representing the position of user 1 in real space, and is typically the position of user 1's right eye (right eye coordinates) and the position of user 1's left eye (left eye coordinates). The processor 24 obtains the necessary position information of user 1 from among multiple users 1 as user position information.

[0060] Furthermore, the processor 24 generates multiple images for display to multiple users 1 using the first display device 100. These images are display images displayed on the display 30 of the display unit 22, which will be described later.

[0061] In the following text, it is assumed that a first user 1a and a second user 1b, different from the first user 1a, use the first display device 100. For example, it is assumed that... Figure 1 One of the two users 1 shown is the first user 1a, and the other is the second user 1b. It should be noted that this technique can also be applied to cases where there are three or more users 1.

[0062] The processor 24 obtains user position information, including the position information of the first user 1a, based on the output of the viewpoint detection camera device 21. Furthermore, the processor 24 generates a right-eye image and a left-eye image of the first user 1a based on the position information of the first user 1a. These images are parallax images that enable the first user 1a to perceive 3D objects stereoscopically, such as objects viewed from the position of the first user 1a.

[0063] Furthermore, the processor 24 generates a second user image targeting the second user 1b. The second user image is an image to be displayed to the second user 1b who is viewing the first display device 100 from a different position than the first user 1a.

[0064] In this embodiment, stereoscopic display using binocular stereoscopic vision is performed on the second user 1b and the first user 1a. Therefore, a parallax image (right-eye image and left-eye image) to be displayed to the second user 1b is generated as the second user image. Specifically, the processor 24 obtains the position information of the second user 1b based on the output of the viewpoint detection camera device 21. Furthermore, based on the position information of the second user 1b, the processor 24 generates the right-eye image of the second user 1b and the left-eye image of the second user 1b as the second user image.

[0065] The processor 24 controls the display 30 to display a display image including the right-eye image of the first user 1a, the left-eye image of the first user 1ab, and the image of the second user. Here, the display image is a group of images comprising multiple images. Furthermore, the process of controlling the display 30 to display the display image on the display 30 is, for example, the process of combining the images included in the display image and displaying the composite image on the display 30.

[0066] As described above, in this embodiment, the right-eye image of the second user 1b and the left-eye image of the second user 1b are generated as the second user image. Therefore, the display image to be displayed on the display 30 by the processor 24 includes two pairs of parallax images (the right-eye image of the first user 1a, the left-eye image of the first user 1a, the right-eye image of the second user 1b, and the left-eye image of the second user 1b).

[0067] The individual images included in the displayed image are combined in a manner that allows them to be visually recognized by the corresponding eye (right or left eye) of user 1, and the composite image is displayed on display 30. When combining the images, the position information of each user 1 is used.

[0068] In this way, the processor 24 generates a right-eye image and a left-eye image for each of the multiple users 1 (first user 1a and second user 1b). Then, the images are displayed on the display 30 according to the positions of the multiple users 1.

[0069] Figure 3 This is a schematic diagram showing an example configuration of the display unit 22 of the first display device 100. Figure 3 An example of a cross-sectional view of the display unit 22 is shown schematically. The display unit 22 includes a display 30, a binocular separation layer 35, and a viewer separation layer 36. The binocular separation layer 35 and the viewer separation layer 36 are beam control layers that control the direction (beam direction) of image light emitted from the display 30. Furthermore, the binocular separation layer 35 and the viewer separation layer 36 serve as viewpoint separation layers that respectively control the beam direction, thereby separating the viewpoints from which the image light arrives. Therefore, the display unit 22 can also be described as a display unit including the display 30 and multiple viewpoint separation layers.

[0070] Display 30 is a display element for displaying images and includes a display screen 31, a back surface 32, and a plurality of pixels. The display screen 31 and the back surface 32 are flat surfaces, and display 30 is configured as a flat panel display. It should be noted that... Figure 3 The illustration omits several pixels.

[0071] The display screen 31 is the surface on which an image is displayed. Image light constituting the image is emitted from the display screen 31. The back surface 32 is the surface on the side opposite to the display screen 31. The display screen 31 and the back surface 32 are generally rectangular. Although a display 30 with a horizontally elongated display screen 31 is used in the first display device 100, a display 30 with, for example, a vertically elongated display screen 31 or a square display screen 31 may also be used. Furthermore, the shape of the display screen 31, the number of pixels, etc., are not limited.

[0072] Multiple pixels are arranged in a grid pattern along the vertical and horizontal directions of the display screen 31. Each pixel provided on the display screen 30 corresponds to each pixel that constitutes the image. Furthermore, each of the multiple pixels emits image light with a color and intensity specified by the image data.

[0073] The vertical and horizontal directions of display screen 31 are mutually orthogonal directions within display screen 31, and are, for example, the up-down and left-right directions as seen from user 1. In the following text, the horizontal direction of display screen 31 will be referred to as the X-axis direction, and the vertical direction of display screen 31 will be referred to as the Y-axis direction. Furthermore, the direction orthogonal to display screen 31 (XY plane) will be referred to as the Z-axis direction. The Z-axis direction is the depth direction as seen from display screen 31. It should be noted that... Figure 3 The cross-sectional view shown is a schematic diagram illustrating a cross-section of the display unit 22 taken along the XZ plane.

[0074] The display 30 uses a see-through type display that modulates light from a backlight. In this case, the display 30 is composed of display elements such as a liquid crystal display (LCD) panel. Furthermore, the backlight is located on the side opposite to the display screen 31 (on the back surface 32 side of the display 30). It should be noted that... Figure 3 The backlight is not shown in the image.

[0075] Furthermore, for example, a self-emissive display that emits light from the display screen 31 can be used as the display 30. In this case, the display 30 is composed of display elements such as a display panel using organic light-emitting diodes (OLEDs) and other light-emitting diode (LED) elements, a plasma display panel (PDP), etc. Furthermore, a backlight is not required in the self-emissive display 30.

[0076] Figure 4 This is a schematic diagram illustrating an example of beam control via the binocular separation layer 35. Figure 4 The configuration of a display 30 with only display unit 22 and binocular separation layer 35 is schematically shown to illustrate the control of the light beam (image light 3) through binocular separation layer 35.

[0077] The binocular separation layer 35 is an optical element that controls the beam direction of the image light 3. It is fixed relative to the surface of the display 30 and configured to separate the displayed image into a right-eye image and a left-eye image. Here, the surface of the display 30 to which the binocular separation layer 35 is fixed is the display screen 31 or the back surface 32 of the display 30. In this embodiment, the binocular separation layer 35 corresponds to the left-right image separation layer.

[0078] The image will be separated into a right-eye image and a left-eye image. For example, the image displayed on monitor 30 (display screen 31) will be separated into an image seen by a person H (user 1) with their right eye 10R and an image seen with their left eye 10L. For example, as Figure 4 As shown, the binocular separation layer 35 controls the direction (beam direction) of the image light 3 emitted from the display screen 31, guiding the image light 3 output from some pixels to the right eye 10R of the person H, and guiding the image light 3 output from other pixels to the left eye 10L of the person H.

[0079] It should be noted that the right-eye image and left-eye image described in this article refer to images separated in such a way that the image light 3 emitted from the display 30 passes through the binocular separation layer 35, rather than parallax images targeted at a specific user 1.

[0080] Alternatively, separating the image displayed on the display 30 into images viewed by the right eye 10R and left eye 10L of person H can be described as dividing the field of view of person H's right eye 10R and left eye 10L. Here, the field of view is the area in which user 1 can appropriately visually recognize the image displayed on the display 30. The field of view depends on, for example, the design values ​​of the beam control layer (here, the binocular separation layer 35), the method of displaying the image through the display 30, etc.

[0081] For example, for a single display 30, a field of view (angle range) is set to enable appropriate visual recognition of two-dimensional images. The binocular separation layer 35 is an element that divides this field of view of the display 30 into a right-eye field of view 11R for the user to appropriately visually recognize the right-eye image (10R) and a left-eye field of view 11L for the user to appropriately visually recognize the left-eye image (10L). Figure 4 In the diagram, fields of view 11R and 11L are schematically shown using black arrows.

[0082] For example, the configuration and arrangement of the binocular separation layer 35 are set based on the central distance (pupil distance, etc.) between the right eye 10R and the left eye 10L of a typical person H. In this case, as described later, the fields of vision 11R and 11L are generated alternately and repeatedly along the horizontal direction (X-axis direction) (see...). Figure 25 (etc.). It should be noted that the configuration and arrangement of the binocular separation layer 35 are, for example, different from those of multi-view elements that separate the image on the display 30 into three or more types of images.

[0083] Figure 5 This is a schematic diagram illustrating an example of beam control via the viewer separation layer 36. Figure 5 The configuration of the display 30 with only the display unit 22 and the viewer separation layer 36 is schematically shown to describe the control of the light beam (image light 3) through the viewer separation layer 36.

[0084] The viewer separation layer 36 is an optical element that controls the beam direction of the image light 3. It is fixed relative to the surface of the display 30 and configured to separate the display image into a viewpoint Pa of a first user 1a and a viewpoint Pb of a second user 1b. Here, the surface of the display 30 to which the viewer separation layer 36 is fixed is the display screen 31 or the back surface 32 of the display 30. In this embodiment, the viewer separation layer 36 corresponds to the user separation layer.

[0085] In this disclosure, the viewpoint P of user 1 refers to the viewing position from which user 1 observes the display 30. For example, the center point between user 1's right eye 10R and left eye 10L is user 1's viewpoint P. Alternatively, the center point of user 1's face or head may also be considered as user 1's viewpoint P.

[0086] In the following text, user 1's viewpoint P may be referred to as observation viewpoint P. Furthermore, the point indicated by user 1's right-eye coordinates may be referred to as the right-eye viewpoint, and the point indicated by user 1's left-eye coordinates may be referred to as the left-eye viewpoint. It should be noted that the right-eye viewpoint and left-eye viewpoint are, for example, the position information of user 1 obtained from the output of the viewpoint detection camera device 21 mentioned above.

[0087] The image will be separated into the viewing viewpoint Pa of a first user 1a and the viewing viewpoint Pb of a second user 1b. For example, the image displayed on the monitor 30 (display screen 31) will be separated into an image seen by the first user 1a and an image seen by the second user 1b. For example, as... Figure 5 As shown, the viewer separation layer 36 controls the direction (beam direction) of the image light emitted from the display screen 31, guiding the image light output from some pixels to the viewing point Pa of the first user 1a, and guiding the image light output from other pixels to the viewing point Pb of the second user 1b.

[0088] Alternatively, separating the image displayed on the monitor 30 into images seen by the first user 1a and the second user 1b can be described as dividing the field of view for each user 1. That is, the viewer separation layer 36 is an element that divides the field of view of a single monitor 30 into a field of view 11a for the first user 1a and a field of view 11b for the second user 1b. Figure 5 In the diagram, the field of view 11a of the first user 1a and the field of view 11b of the second user 1b are schematically shown using black arrows.

[0089] This functionality can be achieved, for example, by configuring the viewer separation layer 36 so that different images are displayed at the observation positions of adjacent individuals H. Therefore, the configuration and arrangement of the viewer separation layer 36 can be set, for example, based on the spacing between people (personal distance, etc.). It should be noted that both the viewer separation layer 36 and the aforementioned binocular separation layer 35 are beam control layers, but their configurations and arrangements differ.

[0090] The binocular separation layer 35 and the viewer separation layer 36 are configured, for example, by barrier elements. The barrier elements are elements in which slits for transmitting light and barriers for suppressing light are arranged alternately (see...). Figure 13 (etc.). The slit portion is, for example, composed of a hole, a transparent component, etc. Furthermore, the barrier portion is, for example, composed of a light-blocking component. That is, the barrier element has a structure in which the transmission area (slit portion) and the light-blocking area (barrier portion) alternately repeat. This structure is, for example, similar to an element called a parallax barrier. The barrier element transmits a portion of the image light and blocks a portion of the image light, thereby controlling the image light.

[0091] Furthermore, the binocular separation layer 35 and the viewer separation layer 36 can be configured, for example, by cylindrical lenses. A cylindrical lens is a lens element in which multiple lenses are arranged corresponding to the pixel array of the display 30, and the image light is controlled by refracting the image light emitted from each pixel. For example, an element in which thin and long convex lenses are arranged adjacent to each other can be used as a cylindrical lens.

[0092] Both the binocular separation layer 35 and the viewer separation layer 36 can be constructed from barrier elements or from cylindrical lenses. Alternatively, the binocular separation layer 35 can be constructed from barrier elements, and the viewer separation layer 36 can be constructed from cylindrical lenses. Conversely, the binocular separation layer 35 can be constructed from cylindrical lenses, and the viewer separation layer 36 can be constructed from barrier elements.

[0093] like Figure 3 As shown, the display unit 22 includes a transparent base material 33 as a fixing member for fixing the display 30 by using the aforementioned binocular separation layer 35 and viewer separation layer 36. A first transparent base material 33a for fixing the binocular separation layer 35 and a second transparent base material 33b for fixing the viewer separation layer 36 are provided as the transparent base material 33.

[0094] The transparent base material 33 (first transparent base material 33a and second transparent base material 33b) is a plate-shaped component made of a transparent material such as glass or acrylic. For example, a transparent adhesive is used to fix the transparent base material 33 and each component (display 30, binocular separation layer 35, and viewer separation layer 36). Alternatively, the various units including the transparent base material 33 can be fixed together to adhere tightly to each other using frame-like fasteners or the like (not shown). The use of the transparent base material 33 can, for example, suppress deviations in the distance between the display 30 and the binocular separation layer 35 and between the display 30 and the viewer separation layer 36, and maintain each distance at an appropriate value.

[0095] In the following text, the side pointed to by the display screen 31 of the display 30 is referred to as the front side, and the side pointed to by the back surface 32 of the display 30 is referred to as the rear side. Figure 3 In the example shown, the viewer separation layer 36 is fixed to the front side (display screen 31 side) of the display 30 via a second transparent base material 33b. Furthermore, the binocular separation layer 35 is fixed to the front side of the viewer separation layer 36 via a first transparent base material 33a. That is, the display 30, the viewer separation layer 36, and the binocular separation layer 35 are arranged in the aforementioned order.

[0096] Figure 3The arrangement of the display unit 22 shown is for illustrative purposes only, and the order in which the display 30, viewer separation layer 36, and binocular separation layer 35 are arranged is not limited. For example, the order of the viewer separation layer 36 and binocular separation layer 35 can be reversed. Furthermore, for example, when using a display 30 that includes a backlight, either the viewer separation layer 36 or the binocular separation layer 35 can be arranged on the rear side (back side) of the display 30. This will be discussed later. Figure 17 Examples of the arrangement of display unit 22 are described below.

[0097] Figure 6 This is a schematic diagram depicting beam control via the first display device 100. Figure 6 The upper curve is a schematic diagram showing the intensity distribution of image light 3 separated by the viewer separation layer 36. Furthermore, Figure 6 The lower graph is a schematic graph showing the intensity distribution of the image light 3 separated by the binocular separation layer 35. The horizontal axis of each graph is the position of the viewpoint in the horizontal direction of the display 30, and the vertical axis represents the intensity (brightness) of the image light 3. Furthermore, in each graph, each peak corresponds to one image.

[0098] First, consider the case where image light 3 emitted from multiple pixels on display 30 passes through viewer separation layer 36. For example... Figure 6 As shown on the upper side, the image light 3 passing through the viewer separation layer 36 is separated into image light 3 traveling towards the viewing viewpoint Pa of the first user 1a and image light 3 traveling towards the viewing viewpoint Pb of the second user 1b. Therefore, a peak 12a centered on the viewing viewpoint Pa and a peak 12b centered on the viewing viewpoint Pb are generated. It should be noted that the pixels emitting the image light 3 constituting peaks 12a and 12b are substantially different pixels.

[0099] Next, consider the case where the image light 3, having passed through the viewer separation layer 36, further passes through the binocular separation layer 35. For example... Figure 6 As shown on the lower side, the image light 3 passing through the binocular separation layer 35 is separated into image light 3 traveling toward the right eye viewpoint PaR of the first user 1a and image light 3 traveling toward the left eye viewpoint PaL of the first user 1a, and image light 3 traveling toward the right eye viewpoint PbR of the second user 1b and image light 3 traveling toward the left eye viewpoint PbR of the second user 1b. Therefore, a peak 12aR centered on the right eye viewpoint PaR, a peak 12aL centered on the left eye viewpoint PaL, a peak 12bR centered on the right eye viewpoint PbR, and a peak 12bL centered on the left eye viewpoint PbL are generated.

[0100] Assume that peaks 12aR and 12aL corresponding to the first user 1a are obtained by separating peak 12a in the above curve. Furthermore, assume that peaks 12bR and 12bL corresponding to the second user 1b are obtained by separating peak 12b in the above curve. It should be noted that the pixels emitting image light 3 constituting peaks 12aR, 12aL, 12bR, and 12bL are substantially different pixels.

[0101] The above example illustrates the case where image light 3, having passed through viewer separation layer 36, passes through binocular separation layer 35. Conversely, a configuration can be used where image light 3, having passed through binocular separation layer 35, passes through viewer separation layer 36. Again, in this case, image light 3 that has passed through viewer separation layer 36 forms with... Figure 6 The lower side has four similar peaks 12 (peak 12aR, peak 12aL, peak 12bR, peak 12bL).

[0102] In this way, in addition to the beam control layer (binocular separation layer 35) that divides the field of view for the left and right eyes, the display unit 22 of the first display device 100 is also provided with a beam control layer (viewer separation layer 36) for dividing the field of view for each user 1. Furthermore, in the first display device 100, according to the viewing positions of the multiple users 1, the processor 24 performs signal processing for display control (panel control) on the display 30.

[0103] Therefore, different images can be provided to the eyes of multiple users. For example, in Figure 6 In this configuration, the pixels on display 30 are respectively assigned to the right and left eyes of the first user 1a and the right and left eyes of the second user 1b. Therefore, different images can be provided for the four viewpoints.

[0104] In this embodiment, by utilizing this, parallax images are presented to multiple users 1 respectively. For example, a pixel as peak 12aR is used as the pixel for displaying the right-eye image aR of the first user 1a. Similarly, a pixel as peak 12aL is used as the pixel for displaying the left-eye image aL of the first user 1a. Likewise, a pixel as peak 12bR is used as the pixel for displaying the right-eye image bR of the second user 1b. Furthermore, a pixel as peak 12bL is used as the pixel for displaying the left-eye image bL of the second user 1b. Therefore, multiple users 1 can simultaneously experience binocular stereoscopic vision through the same device (first display device 100).

[0105] Furthermore, in this configuration combining the binocular separation layer 35 with the viewer separation layer 36, each pixel on the display 30 is always assigned to either a right-eye image or a left-eye image for multiple users 1. This allows for efficient use of multiple pixels for image display without waste. Therefore, for example, the resolution of the image (right-eye image or left-eye image) displayed for each viewpoint can be increased. Thus, high-resolution binocular stereoscopic vision can be provided simultaneously to multiple users 1.

[0106] [Operation of a display device for a single user]

[0107] In the following text, before describing the operation of the first display device that supports multiple users 1, the operation of a display device for a single user will be described as a comparative example. Figure 7 This is a schematic diagram illustrating an example configuration of a display unit for a single-person display device. Figure 8 This is a block diagram illustrating an example configuration of a processor for a single-user display device. The single-user display device 120 is a stereoscopic display device targeting a user 1, and is configured as a gaze-detecting type LFD to display a three-dimensional image based on the position of the user 1 as the target.

[0108] like Figure 7 As shown, the display unit 122 of the display device 120 for a single user includes a display 30, a binocular separation layer 35, and a transparent base material 33. The binocular separation layer 35 is fixed to the display 30 via the transparent base material 33. Compared to the display unit 22 of the first display device 100, the display unit 122 has a configuration that only provides the binocular separation layer 35 and does not have a viewer separation layer 36.

[0109] Figure 8 The processor 124 shown in the single-person display device 120 is an information processing device that controls the operation of the entire single-person display device 120. The processor 124 includes a viewpoint detection unit 150, a right-eye image generation unit 151, a left-eye image generation unit 152, an output image generation unit 153, and a display control unit 154 as functional blocks.

[0110] The viewpoint detection unit 150 detects the coordinates of user 1's eyes (relative coordinates relative to display 30). Furthermore, the viewpoint detection unit 150 continuously detects the coordinates of user 1's eyes at constant intervals. For example, based on the output of a viewpoint detection camera device (not shown) that images user 1's face, the right eye coordinates (XR, YR, ZR) and left eye coordinates (XL, YL, ZL) of user 1 are calculated at constant intervals.

[0111] Based on the right-eye coordinates detected by the viewpoint detection unit 150, the right-eye image generation unit 151 generates an image (right-eye image R) that should be observed from the position of the user 1's right eye 10R. Furthermore, based on the left-eye coordinates detected by the viewpoint detection unit 150, the left-eye image generation unit 151 generates an image (left-eye image L) that should be observed from the position of the user 1's left eye 10L. The right-eye image R and the left-eye image L are the input images to the input-to-output image generation unit 153.

[0112] Based on the right-eye and left-eye coordinates of user 1, the output image generation unit 153 assigns the pixel value of either the right-eye image R or the left-eye image L to multiple pixels on the display 30. For example, for each pixel, the right-eye image R is assigned when a larger amount of light beam enters user 1's right eye 10R, or the left-eye image L is assigned when a larger amount of light beam enters user 1's left eye 10L. Therefore, a composite image combining the right-eye image R and the left-eye image L is generated. This composite image is the output image actually displayed on the display 30.

[0113] The display control unit 154 outputs the data of the output image (a composite image of the right eye image R and the left eye image L) generated by the output image generation unit 153 to the display 30, and causes the display 30 to display the output image.

[0114] Figure 9 and Figure 10 This is a schematic diagram illustrating an example of stereoscopic display via a display device 120 for a single person. Figure 9 and Figure 10 A schematic cross-sectional view along the XZ plane is shown of the display 30 constituting the display unit 122 and the binocular separation layer 35. Furthermore, a viewpoint detection camera 121 provided in the display device 120 for a single user is arranged to image the user 1. Figure 10 It shows that user 1 has already... Figure 9 The state shown is the state it moves to.

[0115] In the following text, the pixels of display 30 arranged along the X-axis direction (horizontal direction) are referred to as (p0, p1, ..., p13). Furthermore, as shown at the top of the diagram of display 30, the pixels of the right-eye image R are referred to as (R0, R1, ..., R13) and the pixels of the left-eye image L are referred to as (L0, L1, ..., L13), which correspond to the pixels (p0, p1, ..., p13) of display 30.

[0116] Figure 9The binocular separation layer 35 shown is a barrier element 16. The barrier element 16 is an element in which slits 17 and barrier portions 18 are arranged alternately. In this case, image light 3 emitted from the pixels of the display 30 only passes through the slits 17 of the barrier element 16. The spacing of the slits 17 (barrier portions 18) is a parameter according to the configuration of the binocular separation layer 35. It should be noted that a cylindrical lens can be used as the binocular separation layer 35.

[0117] Furthermore, d1 indicates the distance between the display 30 and the binocular separation layer 35 in the Z-axis direction (depth direction). Distance d1 is, for example, the distance from the display screen 31 of the display 30 to the surface of the binocular separation layer 35 pointing towards the display screen 31. Distance d1 is a parameter associated with the arrangement of the binocular separation layer 35.

[0118] The viewing distance D is typically set to the display device that implements binocular stereoscopic vision. The viewing distance D is, for example, the distance in the depth direction (Z-axis direction) of the three-dimensional image 2 that can be properly perceived by means of binocular stereoscopic vision. The viewing distance D is, for example, set to the distance to the display screen 31 of the monitor 30.

[0119] The slit spacing of the binocular separation layer 35 and the distance d1 to the display 30 are, for example, set such that the right-eye and left-eye images can be properly visually identified at positions separated by a viewing distance D set to a display device 120 for a single person.

[0120] User 1 views the display 30 through a slit 17 (eye-separation layer 35) designed to accommodate a viewing distance D. In this case, as... Figure 9 As shown, the pixels (p0, p1, ... p13) on the display 30 that are visible to the right eye 10R and the left eye 10L are as follows.

[0121] Pixels (p1, p3, p5, p7, p9, p11, p13) are visible to the right eye (10R).

[0122] Pixels (p0, p2, p4, p6, p8, p10, p12) are visible to the left eye (10L).

[0123] For example, pixels (R1, R3, R5, R7, R9, R11, R13) of the right-eye image R are assigned to pixels (p1, p3, p5, p7, p9, p11, p13) visible to the right eye 10R. Therefore, user 1 can view the right-eye image R through the right eye 10R. Similarly, pixels (L0, L2, L4, L6, L8, L10, L12) of the left-eye image L are assigned to pixels (p0, p2, p4, p6, p8, p10, p12) visible to the left eye 10L. Therefore, user 1 can view the left-eye image L through the left eye 10L. Thus, user 1 can perceive a three-dimensional image represented by the right-eye image R and the left-eye image L.

[0124] It should be noted that the correspondence between the pixels (p0, p1, ... p13) of the display 30 and the right eye 10R and left eye 10L changes depending on the user's position. For example, as Figure 10 As shown, assume user 1 moves horizontally. In this case, the pixels visible to the right eye 10R and the left eye 10L are as follows.

[0125] Pixels (p0, p2, p4, p6, p8, p10, p12) are visible for the right eye (10R).

[0126] Pixels (p1, p3, p5, p7, p9, p11, p13) are visible to the left eye (10L).

[0127] In this way, even if the correspondence changes, the right-eye coordinates (XR, YR, ZR) and left-eye coordinates (XL, YL, ZL) of user 1 have been detected by the viewpoint detection camera device 121, and therefore the pixels on the display 30 can be appropriately allocated. Thus, user 1 can also correctly perceive the three-dimensional image representing the right-eye image R and the left-eye image L at the moved position.

[0128] Figure 11 This is a flowchart illustrating an operational example of the display device 120 for a single user. Here, the series of images constituting the video displaying 3D content are referred to as video frames. First, a loop associated with the video frames is started (step 101). Assume the parameter of this loop is f. Video frame f represents the f-th frame.

[0129] The viewpoint detection unit 150 detects the right-eye coordinates (XR, YR, ZR) and left-eye coordinates (XL, YL, ZL) of user 1 based on the image captured by the viewpoint detection camera device 121 (step 102). Next, it generates a right-eye image R and a left-eye image L based on the detection results of the viewpoint detection unit 150 (step 103). Specifically, the right-eye image generation unit 151 generates a right-eye image R oriented towards the right-eye coordinates (XR, YR, ZR) for the f-th frame. Furthermore, the left-eye image generation unit 151 generates a left-eye image L oriented towards the left-eye coordinates (XL, YL, ZL) for the f-th frame.

[0130] For pixel P(j,i) of display 30, the parameter is set to start the Y-coordinate cycle from i (step 104), and the parameter is set to start the X-coordinate cycle from j (step 105). Next, the output image generation unit 153 determines the incident light amount of the beam (image light 3) from pixel P(j,i) to the right eye 10R and the left eye 10L (step 106). Here, it is determined whether the incident light amount to the left eye 10L is greater than the incident light amount to the right eye 10R.

[0131] It should be noted that the method for determining the amount of incident light is not limited. For example, based on a model including pixel P(j,i), the right eye 10R or the left eye 10L, and the slit 17, a simulation can be performed in advance to determine whether a larger amount of light beam from pixel P(j,i) enters the right eye 10R or the left eye 10L. This determination can be performed using a lookup table or similar method that records the simulation results. Furthermore, the amount of incident light can be determined by performing a simulation for each loop of video frame f.

[0132] If the incident light amount to the left eye 10L is greater than the incident light amount to the right eye 10R (yes in step 106), pixel L(j,i) of the left eye image L is assigned to pixel P(j,i) (step 107). Furthermore, if the incident light amount to the left eye 10L is equal to or less than the incident light amount to the right eye 10R (no in step 106), pixel R(j,i) of the right eye image R is assigned to pixel P(j,i) (step 108).

[0133] Upon completion of image allocation for pixel P(j,i), the X-coordinate cycle is determined (step 109). For example, if parameter j has not reached a predetermined value, the processing of step 105 and subsequent steps is repeated by incrementing the value of j by one. If parameter j has reached a predetermined value, the Y-coordinate cycle is determined (step 110). For example, if parameter i has not reached a predetermined value, the processing of step 104 and subsequent steps is repeated by incrementing the value of i by one.

[0134] When parameter i has reached a predetermined value, the allocation for all pixels P is completed. In this way, an output image is generated by allocating pixels of either the right-eye image R or the left-eye image L to all pixels P. In this case, the display control unit 154 outputs the output image to the display 30 for display (step 111). Therefore, the right-eye image R is displayed to the user 1's right eye 10R, and the left-eye image L is displayed to the left eye 10L. Thus, the user 1 can perceive the three-dimensional image in the f-th frame.

[0135] When the output image is displayed, the video frame loop is determined (step 112). For example, if there are remaining video frames, the processing of step 101 and subsequent steps is repeated by incrementing the value of f by one. Furthermore, if no video frames remain, the processing ends.

[0136] Through this process, in a single-person display device 120 that serves as a gaze-detection type LFD, pixels P(j,i) of the display 30 are assigned to either the right-eye image R or the left-eye image L. Therefore, for example, compared to a multi-view type displaying three or more types of images, the resolution per viewpoint is higher, and multiple pixels can be used efficiently without waste.

[0137] It should be noted that in the binocular separation layer 35 designed for a single person, the field of view 11R of the right eye 10R and the field of view 11L of the left eye 10L are consistent with the above reference. Figure 4 The described pupil distances are repeated at essentially the same intervals. Due to this area of ​​visual field repetition, other users 1 may see unexpected video. Therefore, in the case of multiple users 1 viewing the display device 120 for a single person, each user 1 perceives a common 3D image 2 or sees a parallax image that is reversed in the left-right direction.

[0138] [Functional Configuration of the First Display Device]

[0139] In the following text, the operation of the first display device 100 according to this embodiment will be described with reference to the operation of the display device 120 for a single person according to the comparative example mentioned above. Figure 12 This is a block diagram illustrating an example configuration of the processor of the first display device. The processor 24 includes a viewpoint detection unit 50, a right-eye image generation unit 51a, a left-eye image generation unit 52a, a right-eye image generation unit 51b, a left-eye image generation unit 52b, an output image generation unit 53, and a display control unit 54, which are function blocks.

[0140] The viewpoint detection unit 50 detects the binocular coordinates (relative coordinates relative to the display 30) of the first user 1a and the second user 1b. Furthermore, the viewpoint detection unit 50 continuously detects the binocular coordinates of the first user 1a and the second user 1b at constant intervals. For example, based on the output (captured image) of the viewpoint detection camera device, the right-eye coordinates (XaR, YaR, ZaR) and left-eye coordinates (XaL, YaL, ZaL) of the first user 1a are calculated at constant intervals. Similarly, based on the same captured image, the right-eye coordinates (XbR, YbR, ZbR) and left-eye coordinates (XbL, YbL, ZbL) of the second user 1b are calculated at constant intervals. In this embodiment, the right-eye and left-eye coordinates of the first user 1a (and the second user 1b) are user position information.

[0141] The right-eye image generation unit 51a and the left-eye image generation unit 52a are blocks that perform image generation processing for the first user 1a. Based on the right-eye coordinates (XaR, YaR, ZaR) of the first user 1a detected by the viewpoint detection unit 50, the right-eye image generation unit 51a generates an image (right-eye image aR) that should be observed from the position of the right eye 10R of the first user 1a. Furthermore, based on the left-eye coordinates (XaL, YaL, ZaL) of the first user 1a detected by the viewpoint detection unit 50, the left-eye image generation unit 52a generates an image (left-eye image aL) that should be observed from the position of the left eye 10L of the first user 1a.

[0142] The right-eye image generation unit 51b and the left-eye image generation unit 52b are blocks that perform image generation processing for the second user 1b. Based on the right-eye coordinates (XbR, YbR, ZbR) of the second user 1b detected by the viewpoint detection unit 50, the right-eye image generation unit 51b generates an image (right-eye image bR) that should be observed from the position 10R of the second user 1b's right eye. Furthermore, based on the left-eye coordinates (XbL, YbL, ZbL) of the second user 1b detected by the viewpoint detection unit 50, the left-eye image generation unit 52b generates an image (left-eye image bL) that should be observed from the position 10L of the second user 1b's left eye.

[0143] In this embodiment, the right-eye image aR, left-eye image aL, right-eye image bR, and left-eye image bL are display images shown on the display 30. Furthermore, these images are input images to the output image generation unit 53.

[0144] Based on the right-eye and left-eye coordinates of the first user 1a and the second user 1b, the output image generation unit 53 assigns the pixel values ​​of any one of the right-eye image aR, left-eye image aL, right-eye image bR, and left-eye image bL to multiple pixels on the display 30. Therefore, a composite image is generated that combines the four types of images included in the displayed image. This composite image is the output image actually displayed on the display 30.

[0145] The display control unit 54 outputs data about the output image (a composite image of the right-eye image aR, the left-eye image aL, the right-eye image bR, and the left-eye image bL) generated by the output image generation unit 53 to the display 30, and causes the display 30 to display the output image. In this way, the processor 24 generates a composite image (output image) that combines the images included in the display image based on the user's location information, and controls the display 30 to display the composite image.

[0146] [Operation of the first display device]

[0147] Figure 13 This is a schematic diagram illustrating an example of a stereoscopic display of the first display device 100. Figure 13 The illustration shows something similar to the above. Figure 9 The pixels (p0, p1, ..., p13) of the display 30 are arranged along the X-axis direction (horizontal direction). Here, the viewer separation layer 36 and the binocular separation layer 35 are arranged in the order described above on the lower side of the display screen 31, which serves as the display 30.

[0148] Furthermore, on the upper side of the display 30, the left-eye image aL and right-eye image aR of the first user 1a and the left-eye image bL and right-eye image bR of the second user 1b are schematically shown in the following order. In the following text, the pixels of the right-eye image aR corresponding to the pixels (p0, p1, ..., p13) of the display 30 are referred to as (aR0, aR1, ..., aR13), the pixels of the left-eye image aL are referred to as (aL0, aL1, ..., aL13), the pixels of the right-eye image bR are referred to as (bR0, bR1, ..., bR13), and the pixels of the left-eye image bL are referred to as (bL0, bL1, ..., bL13).

[0149] exist Figure 13 In this design, a barrier element 16 is used as the viewer separation layer 36. In the viewer separation layer 36, the spacing of the slits 17 (barrier portions 18) is determined by parameters based on the configuration of the viewer separation layer 36. It should be noted that a cylindrical lens can be used as the viewer separation layer 36.

[0150] Furthermore, d2 indicates the distance between the display 30 and the viewer separation layer 36 in the Z-axis direction (depth direction). Distance d2 is, for example, the distance from the display screen 31 of the display 30 to the surface of the viewer separation layer 36 pointing towards the display screen 31. Distance d2 is a parameter based on the arrangement of the viewer separation layer 36.

[0151] The slit spacing of the viewer separation layer 36 and its distance d2 from the display 30 are, for example, set such that the pixels visible to user 1 are different at positions separated by a viewing distance D set to the first display device 100. For example, when the first user 1a and the second user 1b are spaced apart by a predetermined distance, each parameter of the viewer separation layer 36 is set such that the pixels visible to each user 1 via the viewer separation layer 36 are different.

[0152] By setting a viewer separation layer 36, visible pixels and invisible pixels (occluded pixels) are generated for the first user 1a and the second user 1b, respectively. Figure 13 In the diagram, solid arrows indicate the path of a light beam visually identified as transmitting through the slit 17 of the viewer separation layer 36. Furthermore, dashed arrows indicate the path of a light beam that is blocked by the barrier 18 of the viewer separation layer 36, making it invisible. The portion marked "a" is associated with pixels visible to the first user 1a, and the portion marked "b" is associated with pixels visible to the second user 1b.

[0153] For example, the pixels (p0, p1, ... p13) on the display 30 that are visible to the first user 1a (or the second user 1b) are as follows.

[0154] Pixels (p0, p1, p2, p7, p8, p9, p10) are visible to the first user 1a.

[0155] Pixels (p3, p4, p5, p6, p11, p12, p13) are visible to the second user 1b.

[0156] In this way, the viewer separation layer 36 separates 1 pixel for each user. That is,

[0157] Viewer separation layer 36 separates the field of view for each user.

[0158] In addition, Figure 13 In this configuration, the binocular separation layer 35 is composed of a barrier element 16. However, this technology is not limited to this, and the binocular separation layer 35 may also be composed of a cylindrical lens. The binocular separation layer 35 of the first display device 100 may be configured, for example, similar to... Figure 9The binocular separation layer 35 shown is used in a single-person display device 120. Alternatively, the configuration of the binocular separation layer 35 (such as the spacing of the slits 17) can be adjusted according to the characteristics of the viewer separation layer 36.

[0159] Assume that a first user 1a and a second user 1b view the display 30 through a viewer separation layer 36 and a binocular separation layer 35 designed to be suitable for a viewing distance D. In this case, as... Figure 13 As shown, the pixels (p0, p1, ... p13) on the display 30 that are visible to the right eye 10R and left eye 10L of the first user 1a (or the second user 1b) are as follows.

[0160] Pixels (p1, p7, p9) are visible to the right eye 10R of the first user 1a.

[0161] Pixels (p0, p2, p8, p10) are visible to the left eye (10L) of the first user 1a.

[0162] Pixels (p3, p5, p11, p13) are visible to the right eye 10R of user 1b.

[0163] Pixels (p4, p6, p12) are visible to the left eye 10L of user 1b.

[0164] For example, pixels (aR1, aR7, aR9) of the right-eye image aR are respectively assigned to pixels (p1, p7, p9) visible to the right eye 10R of the first user 1a. Therefore, the first user 1a can view the right-eye image aR through the right eye 10R. Similarly, pixels (aL0, aL2, aL8, aL10) of the left-eye image aL are respectively assigned to pixels (p0, p2, p8, p10) visible to the left eye 10L of the first user 1a. Therefore, the first user 1a can view the left-eye image aL through the left eye 10L.

[0165] Furthermore, the pixels (bR3, bR5, bR11, bR13) of the right-eye image bR are respectively assigned to the pixels (p3, p5, p11, p13) visible to the right eye 10R of the second user 1b. Therefore, the second user 1b can view the right-eye image bR through the right eye 10R. Similarly, the pixels (bL4, bL6, bL12) of the left-eye image bL are respectively assigned to the pixels (p4, p6, p12) visible to the left eye 10L of the second user 1b. Therefore, the second user 1b can view the left-eye image bL through the left eye 10L.

[0166] Therefore, the first user 1a can perceive a three-dimensional image represented by the right eye image aR and the left eye image aL, and at the same time, the second user 1b can perceive a three-dimensional image represented by the right eye image bR and the left eye image bL.

[0167] It should be noted that the correspondence between the pixels (p0, p1, ... p13) of the display 30 and the positions of the eyes of the first user 1a and the second user 1b changes according to the position of each user 1, as in the case of the display device 120 for a single person. In this way, when the correspondence changes, the viewpoint detection camera device 21 detects the right-eye coordinates and left-eye coordinates of each user 1, and the pixels on the display 30 are assigned to any one of the right-eye image aR, left-eye image aL, right-eye image bR, and left-eye image bL. Therefore, even at a moved position, each user 1 can correctly perceive the three-dimensional image.

[0168] Figure 14 This is a flowchart illustrating an operational example of processor 24. (Refer to the above...) Figure 11 The described process is repeated for each video frame. Figure 14 The process is shown below. First, a loop associated with the video frames is started (step 201).

[0169] The viewpoint detection unit 50 performs viewpoint detection processing (step 202) related to the first user 1a and viewpoint detection processing (step 203) related to the second user 1b based on the captured image captured by the viewpoint detection camera device 21. It should be noted that the processes in steps 202 and 203 can be performed in reverse order or in parallel.

[0170] In step 202, the right eye coordinates (XaR, YaR, ZaR) and left eye coordinates (XaL, YaL, ZaL) of the first user 1a are detected based on the captured image. Furthermore, in step 203, the right eye coordinates (XbR, YbR, ZbR) and left eye coordinates (XbL, YbL, ZbL) of the second user 1b are detected based on the captured image.

[0171] Next, based on the detection results of the viewpoint detection unit 50, the image generation process for displaying to the first user 1a (step 204) and the image generation process for displaying to the second user 1b (step 205) are performed. It should be noted that the processes of steps 204 and 205 can be performed in reverse order or in parallel.

[0172] In step 204, the right-eye image generation unit 51a generates a right-eye image aR pointing to the right-eye coordinates (XaR, YaR, ZaR) of the first user 1a for the f-th frame. Furthermore, the left-eye image generation unit 52a generates a left-eye image aL pointing to the left-eye coordinates (XaL, YaL, ZaL) of the first user 1a for the f-th frame.

[0173] Furthermore, in step 205, the right-eye image generation unit 51b generates a right-eye image bR pointing to the right-eye coordinates (XbR, YbR, ZbR) of the second user 1b for the f-th frame. Additionally, the left-eye image generation unit 52b generates a left-eye image bL pointing to the left-eye coordinates (XbL, YbL, ZbL) of the second user 1b for the f-th frame.

[0174] When generating four input images (right-eye image aR, left-eye image aL, right-eye image bR, and left-eye image bL), the process of allocating each input image to the pixels of the display 30 is performed. First, for pixel P(j,i) of the display 30, the parameter is set to i to start the Y-coordinate loop (step 206), and the parameter is set to j to start the X-coordinate loop (step 207).

[0175] Next, the output image generation unit 53 determines the amount of incident light from the beam (image light 3) from pixel P(j,i) to the region of the first user 1a and the region of the second user 1b (step 208). This process is the process of associating pixel P(j,i) with the first user 1a or the second user 1b.

[0176] Here, it is determined whether the incident light amount to the region of the first user 1a is greater than the incident light amount to the region of the second user 1b. For example, the sum of the incident light amounts from the beam of light from pixel P(j,i) to the right eye 10R and left eye 10L of the first user 1a is calculated as the incident light amount to the region of the first user 1a. Furthermore, the sum of the incident light amounts from the beam of light from pixel P(j,i) to the right eye 10R and left eye 10L of the second user 1b is calculated as the incident light amount to the region of the second user 1b. These sums of incident light amounts are then compared.

[0177] Furthermore, for example, the regions of the first user 1a and the second user 1b can be virtually set, and the amount of incident light from the beam of light from pixel P(j,i) to these regions can be compared. In this case, the regions occupied by the face in the captured image, including regions of a predetermined size including the eyes, are used as the regions of the first user 1a (second user 1b).

[0178] For example, methods using the sum of incident light from both eyes or methods using the incident light from a virtual setting area can use pre-simulated results or can be simulated for each video frame. Furthermore, the method of associating the first user 1a or the second user 1b with pixel P(j,i) is not limited.

[0179] If the incident light amount to the region of the first user 1a is greater than the incident light amount to the region of the second user 1b (yes in step 208), pixel P(j,i) is associated with the first user 1a, and the incident light amounts to the right eye 10R and left eye 10L of the first user 1a are determined (step 209). Here, with respect to the first user 1a, it is determined whether the incident light amount to the left eye 10L is greater than the incident light amount to the right eye 10R.

[0180] If the amount of incident light to the left eye 10L of the first user 1a is greater than the amount of incident light to the right eye 10R (yes in step 209), pixel aL(j,i) of the left eye image aL is assigned to pixel P(j,i) (step 210). Furthermore, if the amount of incident light to the left eye 10L of the first user 1a is equal to or less than the amount of incident light to the right eye 10R (no in step 209), pixel aR(j,i) of the right eye image aR is assigned to pixel P(j,i) (step 211).

[0181] On the other hand, if the incident light amount to the region of the first user 1a is equal to or less than the incident light amount to the region of the second user 1b (no in step 208), pixel P(j,i) is associated with the second user 1b, and the incident light amounts to the right eye 10R and left eye 10L of the beam to the second user 1b are determined (step 212). Here, with respect to the second user 1b, it is determined whether the incident light amount to the left eye 10L is greater than the incident light amount to the right eye 10R.

[0182] If the incident light amount to the left eye 10L of the second user 1b is greater than the incident light amount to the right eye 10R (yes in step 212), pixel bL(j,i) of the left eye image bL is assigned to pixel P(j,i) (step 213). Furthermore, if the incident light amount to the left eye 10L of the second user 1b is equal to or less than the incident light amount to the right eye 10R (no in step 212), pixel bR(j,i) of the right eye image bR is assigned to pixel P(j,i) (step 214).

[0183] The determination processes in steps 209 and 212 are, for example, with... Figure 11 The determination process in step 106 shown is performed similarly. Furthermore, for example, in step 208, the calculation result can be used if the incident light amount to each user's right eye 10R and left eye 10L is calculated. Additionally, the method for determining the incident light amount to the right eye 10R and left eye 10L is not limited.

[0184] In this way, the output image generation unit 53 assigns the left eye image aL to pixel P(j,i) when the maximum amount of light beam enters the left eye 10L of the first user 1a, assigns the right eye image aR when the maximum amount of light beam enters the right eye 10R of the first user 1ab, assigns the left eye image bL when the maximum amount of light beam enters the left eye 10L of the second user 1b, and assigns the right eye image bR when the maximum amount of light beam enters the right eye 10R of the second user 1b.

[0185] Upon completion of image allocation for pixel P(j,i), the X-coordinate cycle is determined (step 215). For example, if parameter j has not reached a predetermined value, the processing of step 207 and subsequent steps is repeated by incrementing the value of j by one. If parameter j has reached a predetermined value, the Y-coordinate cycle is determined (step 216). For example, if parameter i has not reached a predetermined value, the processing of step 206 and subsequent steps is repeated by incrementing the value of i by one.

[0186] With parameter i having reached a predetermined value, the allocation for all pixels P is completed. Therefore, a composite image (output image) is generated that assigns pixels from any of the four input images (right-eye image aR, left-eye image aL, right-eye image bR, and left-eye image bL) to all pixels P. In this case, the display control unit 54 outputs the output image to the display 30 to display the output image (step 217).

[0187] Therefore, the right-eye image aR is displayed to the right eye 10R of the first user 1a, and the left-eye image aL is displayed to the left eye 10L of the first user 1a. Similarly, the right-eye image bR is displayed to the right eye 10R of the second user 1b, and the left-eye image bL is displayed to the left eye 10L of the second user 1b. Thus, the first user 1a and the second user 1b can simultaneously perceive the three-dimensional image in the f-th frame as viewed from each position.

[0188] When the output image is displayed, the video frame loop is determined (step 218). For example, if there are remaining video frames, the processing of steps 201 and subsequent steps is repeated by incrementing the value of f by one. Furthermore, if no video frames remain, the processing ends.

[0189] In this manner, in this embodiment, a right-eye image aR and a left-eye image aL for the first user 1a, and a right-eye image bR and a left-eye image bL for the second user 1b are generated, and a display mode (first display mode) is executed to cause the display 30 to display these images. Therefore, both users 1 can perceive a three-dimensional image as seen from each position.

[0190] Furthermore, in the first display device 100, pixels P(j,i) of the display 30 are always allocated to any one of the right-eye image aR, left-eye image aL, right-eye image bR, and left-eye image bL. That is, all pixels are used to display the parallax images of the first user 1a and the second user 1b, and no pixels are wasted. Therefore, high-resolution binocular stereoscopic vision can be provided to both users 1 simultaneously.

[0191] It should be noted that the above mainly describes the case where the number of users 1 in the first display mode is two. This technology is not limited to this, and the first display mode can also be adapted to three or more users 1. For example, in the case where the number of users 1 is three, in... Figure 14 The process includes detecting the viewpoint of a third user 1 and generating right-eye and left-eye images for that user 1. Furthermore, when allocating pixels P(j,i), as with two other users 1, the right-eye and left-eye images of the third user 1 can be appropriately displayed by determining the incident light amounts on the beam to the right eye 10R and left eye 10L of the third user 1. Moreover, for three or more users 1, similar processing can be added to simultaneously provide binocular stereo vision based on the position of each user 1.

[0192] [Parameters of binocular separation layer and viewer separation layer]

[0193] Figure 15 This is a schematic diagram showing the parameters of the binocular separation layer and the viewer separation layer. Figure 15 The barrier element 16 is schematically shown, which is arranged between the display 30 and the display screen 31 facing the display 30.

[0194] Barrier element 16 is an example of a beam control layer and a model representing binocular separation layer 35 or viewer separation layer 36. First, the field-of-view repetition interval Wn of barrier element 16 will be described. In the following text, each parameter is indicated by an index n. Parameters associated with binocular separation layer 35 are set to n = 1.

[0195] Furthermore, the parameters associated with the viewer separation layer 36 are set to n=2.

[0196] The barrier element 16 consists of alternating slit portions 17 and barrier portions 18 arranged in the horizontal direction (X-axis direction). Here, the barrier spacing of the barrier elements 16 is referred to as pn. The barrier spacing pn is the arrangement period of the barrier portions 18 (slit portions 17). For example, the interval between the center positions of adjacent slit portions 17 is the barrier spacing pn. Furthermore, the distance between the display 30 and the barrier element 16 in the depth direction (Z-direction) is dn. The distance dn corresponds to the distance d1 between the display 30 and the binocular separation layer 35 or the distance d2 between the display 30 and the viewer separation layer 36.

[0197] like Figure 15 As shown, observation point Q (right eye 10R or left eye 10L) is located at a position separated by viewing distance D. Here, it is assumed that there are four observation points (Q1, Q2, Q3, Q4) sequentially from the right side of the figure. For example, observation point Q1 is positioned in front of pixel P7 of display 30 via slit 17 (hereinafter referred to as first slit 17a). Therefore, pixel P7 can be seen from observation point Q1 through the center Ca of first slit 17a. Furthermore, pixels P6 and P8, which are obscured by barrier 18, cannot be seen from observation point Q1.

[0198] At observation point Q2, which is moved to the left from observation point Q1, pixel P5 can be seen through the center Cb of the second slit 17b to the left of the first slit 17a. It should be noted that pixels P6 and P7, which are obscured by the barrier 18, are not visible at observation point Q2. Furthermore, at observation point Q3, which is moved to the left from observation point Q2, pixel P6 can be seen through the center Cb of the second slit 17b. It should be noted that pixels P5 and P7, which are obscured by the barrier 18, are not visible at observation point Q3.

[0199] Furthermore, at observation point Q4, which is moved to the left from observation point Q3, pixel P7 can be seen through the center Cb of the second slit 17b. That is, as at observation point Q1, pixel P7 can be visually identified at observation point Q4. Based on this principle, the image (pixels) seen from observation point Q4 is the same as the image (pixels) seen from observation point Q1. This means that the field of view for viewing a specific image is repeated. In this case, the distance between observation point Q1 and observation point Q4 is the field of view repetition interval Wn.

[0200] like Figure 15 As shown, pixel P7, the center Ca of the first slit 17a, and the center Cb of the second slit 17b form a right-angled triangle with bases Ca to Cb. Furthermore, pixel P7, observation point Q1, and observation point Q4 form a right-angled triangle with bases Q1 to Q4. These right-angled triangles are congruent. Additionally, the distance between pixel P7 and Ca is the distance dn between the display 30 and the barrier element 16. The distance between Ca and Cb is the barrier spacing pn. The distance between pixel P7 and observation point Q1 is the viewing distance D. Furthermore, the distance between observation point Q1 and observation point Q4 is the aforementioned field-of-view repetition interval Wn. Therefore, the following expression holds true.

[0201] dn=(D / W)×pn (1)

[0202] For example, the distance dn between the display 30 and the barrier element 16 is determined according to expression (1) by setting the viewing distance D, the field repetition interval Wn, and the barrier spacing pn. Here, the barrier spacing pn is a parameter used to determine the resolution of the image visually recognized by the user 1, and is set, for example, to a value substantially the same as the pixel fineness (here, the size of the pixel in the horizontal direction). Therefore, the barrier spacing p1 of the binocular separation layer 35 and the barrier spacing p2 of the viewer separation layer 36 are advantageously set to relatively close values.

[0203] It should be noted that in the above Figure 13 For ease of understanding, the distance between the slits 17 in the viewer separation layer 36 (barrier spacing p2) is made sufficiently larger than the distance between the slits 17 in the binocular separation layer 35 (barrier spacing p1). In practice, both barrier spacing p1 and barrier spacing p2 are set to values ​​close to the size of pixels in the horizontal direction in the display 30.

[0204] Applying expression (1) to the binocular separation layer 35, when n=1, we obtain the following expression.

[0205] d1=(D / W1)×p1 (2)

[0206] Here, W1 is the field-of-view repetition interval in the binocular separation layer 35. The binocular separation layer 35 is configured for binocular separation of the visual field in a human. Here, the distance between the visual field of the right eye 10R and the visual field of the left eye 10L is, for example, set to a human's personal distance (approximately 6.5 cm). Furthermore, the visual fields of the right eye 10R and the left eye 10L are repeated in the horizontal direction. Therefore, the field-of-view repetition interval W1 in the binocular separation layer 35 is essentially twice the human's personal distance.

[0207] Furthermore, when expression (1) is applied to viewer separation layer 36, the following expression is obtained when n = 2.

[0208] d2=(D / W2)×p2 (3)

[0209] Here, W2 is the field-of-view repetition interval in the viewer separation layer 36. The viewer separation layer 36 is configured for each of the multiple users 1 to have a separate field of view. Therefore, the distance between the fields of view of adjacent users 1 is set, for example, to a person's personal distance (approximately 70 cm). Furthermore, the fields of view of adjacent users 1 are repeated in the horizontal direction. Therefore, the field-of-view repetition interval W2 in the viewer separation layer 36 is essentially twice the person's personal distance.

[0210] In this way, the field repetition interval W1 in the binocular separation layer 35 is compared with the field repetition interval W2 in the viewer separation layer 36, where W2 is sufficiently greater than W1 (W2 >> W1). On the other hand, as described above, the barrier spacing p1 of the binocular separation layer 35 and the barrier spacing p2 of the viewer separation layer 36 are set to relatively close values ​​(p1 ≈ p2).

[0211] Therefore, comparing the distances d1 and d2 according to expressions (2) and (3), d1 is a value greater than d2 (d1 ≥ d2). In this way, the distance d1 between the display 30 and the binocular separation layer 35 is advantageously greater than the distance d2 between the display 30 and the viewer separation layer 36. Thus, for example, the left and right fields of view can be appropriately separated for each user 1 without reducing the resolution.

[0212] For example, the distance d2 between the display 30 and the viewer separation layer 36 is set to a value of approximately several hundred micrometers, and the distance d1 between the display 30 and the binocular separation layer 35 is set to a value of approximately several millimeters.

[0213] It should be noted that the relationship between distance d1 and distance d2 is not limited to the case where the binocular separation layer 35 or the viewer separation layer 36 is composed of the barrier element 16, but also applies to the case where a cylindrical lens is used.

[0214] Incidentally, cylindrical lenses typically require a defined focal length. Therefore, it can be said that cylindrical lenses are difficult to use near the display 30. Conversely, since the barrier element 16 does not have limitations such as focal length, it can be positioned near the display screen 31 of the display 30. Given this, it can be said that the barrier element 16 is a component that easily increases the field-of-view repetition interval.

[0215] The distance d2 between the viewer separation layer 36 and the display 30 needs to be reduced because the field repetition interval W2 needs to be set to a relatively large value. Therefore, the viewer separation layer 36 is advantageously constructed from the barrier element 16. Thus, the function of separating the view of the user 1 can be introduced without increasing the thickness of the display unit 22.

[0216] On the other hand, the barrier element 16 can reduce the brightness of the image by blocking the light beam. Conversely, since it is an element that bends the light beam in a lenticular lens, the image can be displayed brightly. For example, since the distance d1 to the display 30 is relatively increased, the binocular separation layer 35 does not necessarily need to be composed of the barrier element 16. On the contrary, the use of the barrier element 16 may also reduce the brightness of the image. Therefore, the binocular separation layer 35 is advantageously composed of a lenticular lens. Therefore, the brightness of the image can be improved, and a bright stereoscopic display can be achieved due to binocular stereoscopic vision, etc.

[0217] [Example of the arrangement of binocular separation layer and viewer separation layer]

[0218] The above mainly describes the structure of arranging two beam control layers (eye separation layer 35 and viewer separation layer 36) on the display screen 31 side (front side) of the display 30. For example, in a see-through display 30 used with a backlight 38, the beam control layer may also be arranged on the back surface 32 side (rear side) of the display 30.

[0219] Figure 16 This is a schematic diagram illustrating another example arrangement of the beam control layer. Here, an example is given of a configuration where only the binocular separation layer 35 is used as the beam control layer. For example, this is the configuration shown in the reference above. Figure 9 Another configuration example of the display device 120 for a single user, as described above. Figure 16 In the display 30, on the back surface 32 side, a binocular separation layer 35 configured with a barrier element 16 and a backlight portion 38 are arranged in the order described above. Light emitted from the backlight portion 38 illuminates the back surface 32 of the transparent display 30 via the binocular separation layer 35. Therefore, image light 3 modulated for each pixel is emitted from the display screen 31 of the display 30.

[0220] The light entering the display 30 is light that is transmitted through the slit 17 of the binocular separation layer 35. For example, when light is emitted from the display 30, its direction of travel is also maintained. That is, when a pixel of the display 30 is seen from the user 1's right eye 10R (or left eye 10L), if the slit 17 exists along the extension of the line of sight (that is, if the backlight 38 is seen through the pixel), the image light 3 modulated in that pixel can be visually recognized. Conversely, if the barrier 18 exists along the extension of the line of sight that sees the pixel, light from the backlight 38 cannot reach it, and the image light 3 modulated by that pixel cannot be visually recognized.

[0221] By utilizing this property, the binocular separation layer 35 is able to allocate pixels of the display 30 to the user 1's right eye 10R and left eye 10L, and separate the image displayed on the display 30 into a right-eye image and a left-eye image. For example, in Figure 16 In the display 30, the pixels (p0, p1, ... p13) visible to the right eye 10R and the left eye 10L are as follows.

[0222] Pixels (p1, p3, p5, p7, p9, p11, p13) are visible to the right eye (10R).

[0223] Pixels (p0, p2, p4, p6, p8, p10, p12) are visible to the left eye (10L).

[0224] It should be noted that, Figure 16The case where the beam control layer is the binocular separation layer 35 has already been described, although the viewer separation layer 36 can be described similarly. Furthermore, the binocular separation layer 35 or the viewer separation layer 36 can be a barrier element 16 or a lenticular lens. In this way, when using a see-through device such as an LCD as the display 30, if the beam control layer is arranged on the rear side of the display 30 (e.g., the side opposite to the user 1 as seen from the display 30), a display device (LFD) can also be constructed. That is, the beam control layer can be arranged on the front or rear side of the see-through display 30.

[0225] Figure 17 This is a schematic diagram showing an example of the arrangement of the binocular separation layer 35 and the viewer separation layer 36 relative to the perspective display 30. Figure 17 The diagram schematically illustrates an example cross-sectional configuration of four display units 22a to 22d, each with a different arrangement of the binocular separation layer 35 and the viewer separation layer 36. Each of the display units 22a to 22d includes a backlight 38, a display 30, a binocular separation layer 35, and a viewer separation layer 36.

[0226] The backlight 38 is a light source that illuminates the display 30 and is configured to illuminate the entire back surface 32 of the display 30. The display 30 is a transparent display that modulates the light from the backlight 38, and is typically an LCD panel.

[0227] Furthermore, each of the display units 22a to 22d includes a first transparent base material 33a for fixing the binocular separation layer 35 and a second transparent base material 33b for fixing the viewer separation layer 36. The first transparent base material 33a and the second transparent base material 33b ensure the distance (d1 or d2) between the display 30 and each beam control layer. It should be noted that the backlight portion 38 is arranged at a certain interval relative to the laminate including the display 30 and the beam control layer. Alternatively, the backlight portion 38 can be fixed to the laminate using a transparent base material or the like.

[0228] In display units 22a and 22b, the display 30 is arranged between the viewer separation layer 36 and the binocular separation layer 35. That is, the display 30 is provided with a structure where it is sandwiched between two beam control layers. In this way, for example, the configuration of providing the beam control layers on the display screen 31 side and the back surface 32 side of the display 30 facilitates positioning or bonding to pixels. Therefore, the viewer separation layer 36 and the binocular separation layer 35 can be arranged accurately and easily relative to the display 30.

[0229] In display unit 22a, a viewer separation layer 36 is disposed between the display 30 and the backlight portion 38, and a binocular separation layer 35 is disposed on the side of the display 30 opposite to the backlight portion 38. More specifically, the viewer separation layer 36 is fixed to the back surface 32 of the display 30 via a second transparent base material 33b. Furthermore, the binocular separation layer 35 is fixed relative to the display screen 31 of the display 30 via a first transparent base material 33a. A structure similar to display unit 22a is easy to manufacture. In addition, since the foremost surface of display unit 22a pointing towards user 1 is the binocular separation layer 35, it can be constructed from a cylindrical lens. Therefore, a bright image with a slight blur can be displayed to user 1. It should be noted that the viewer separation layer 36 on the back surface 32 side is constructed from a barrier element. Therefore, separation of the field of view 11 for each user 1 can be easily achieved.

[0230] In display unit 22b, a viewer separation layer 36 is disposed on the side of display 30 opposite to the backlight portion 38, and a binocular separation layer 35 is disposed between display 30 and the backlight portion 38. More specifically, the viewer separation layer 36 is fixed relative to the display screen 31 of display 30 via a second transparent base material 33b. Furthermore, the binocular separation layer 35 is fixed to the back surface 32 of display 30 via a first transparent base material 33a. In a configuration similar to display unit 22b, the binocular separation layer 35 is disposed between display 30 and the backlight portion 38 at a relatively large distance (d1) from display 30. Therefore, for example, the overall thickness of display unit 22b can be reduced.

[0231] In display units 22c and 22d, two beam control layers are disposed on one side of the display 30. Specifically, a viewer separation layer 36 is arranged between the display 30 and the binocular separation layer 35. In this way, by disposing the beam control layers on one of the display screen 31 and the back surface 32 of the display 30, for example, a reduction in the thickness or size of the device can be achieved.

[0232] In display unit 22c, a binocular separation layer 35 is disposed on the side of display 30 facing the backlight portion 38. Furthermore, a viewer separation layer 36 is disposed between display 30 and binocular separation layer 35. More specifically, viewer separation layer 36 is fixed to the back surface 32 of display 30 via a second transparent base material 33b. Furthermore, binocular separation layer 35 is fixed to the rear side of viewer separation layer 36 via a first transparent base material 33a. In a configuration similar to display unit 22c, binocular separation layer 35 and viewer separation layer 36 are disposed between display 30 and backlight portion 38. Therefore, for example, the total thickness of display unit 22b can be made sufficiently small. Furthermore, in display unit 22c, the pixels of display 30 (display screen 31) displaying the image are located on the frontmost surface on the user 1 side, and there are no factors causing blurring on the optical path to user 1. Therefore, image blurring is greatly reduced, and a clear three-dimensional image can be perceived.

[0233] On display unit 22d, a binocular separation layer 35 is disposed on the side of display 30 opposite to the backlight portion 38. Furthermore, a viewer separation layer 36 is disposed between display 30 and binocular separation layer 35. More specifically, viewer separation layer 36 is fixed relative to the display screen 31 of display 30 via a second transparent base material 33b. Furthermore, binocular separation layer 35 is fixed to the front side of viewer separation layer 36 via a first transparent base material 33a. The configuration of display unit 22d is similar to that described above. Figure 3 and Figure 13 The configuration described. In such a configuration, since the binocular separation layer 35 is arranged on the foremost surface, a bright image with a slight blur can be displayed to the user 1, for example, in the display unit 22a.

[0234] [Controlled by the beam of the backlight]

[0235] Figure 18 This is a schematic diagram illustrating another configuration example of the viewer separation layer 36. Figure 18 The cross-sectional configuration of display units 22e and 22f is schematically shown on the upper and lower sides. In display unit 22e, a full-illumination backlight section 38a, a viewer separation layer 36, a see-through display 30, and a binocular separation layer 35 are arranged sequentially from the rear side. The full-illumination backlight section 38a is, for example, a light-emitting element that illuminates the entire surface of the display 30 as a light-emitting area 15. For example, Figure 17 The backlight unit 38 shown is basically a full-illumination type backlight unit 38a. Furthermore, the structure of the display unit 22e is, for example, similar to... Figure 17 The structure of the display unit 22a shown.

[0236] In the display unit 22f, a partial illumination type backlight unit 38b, a transparent type display 30, and a binocular separation layer 35 are arranged sequentially from the rear. The partial illumination type backlight unit 38b is a light-emitting element that points to some surfaces of the display 30 as light-emitting areas 15. Multiple light-emitting areas 15 are formed on the backlight unit 38b.

[0237] The pattern of the plurality of light-emitting areas 15 provided in the backlight section 38b is configured, for example, to resemble a stripe pattern formed by the slit portion 17 provided in the viewer separation layer 36 provided in the display unit 22e. That is, the area in the display unit 22e where the slit portion 17 is provided is the light-emitting area 15 of the backlight section 38 in the display unit 22f.

[0238] Therefore, since each light-emitting area 15 is a region that emits light, such as the slit portion 17, the backlight portion 38b serves as the viewer separation layer 36. In this case, an equivalent configuration to the display unit 22e is implemented in the display unit 22f. That is, the partially illuminated backlight portion 38b, configured to enable beam control, can replace the configuration of the fully illuminated backlight portion 38a combined with the barrier element 16 (here, the viewer separation layer 36).

[0239] In this way, in the display unit 22f, the viewer separation layer 36 includes multiple light-emitting areas 15 forming a striped pattern and illuminates the backlight portion 38b of the display 30 with light from the multiple light-emitting areas 15. Therefore, for example, since it is sufficient to illuminate only the necessary area, the power consumption of the device can be reduced. Furthermore, since the number of components is reduced, the assembly steps can be reduced.

[0240] It should be noted that, Figure 18 The configuration of the viewer separation layer 36 implemented by the partially illuminated backlight portion 38b has already been described, although the binocular separation layer 35 can also be implemented by the partially illuminated backlight portion 38b. Such a configuration can be applied, for example, to... Figure 17 The display unit 22b or display unit 22c in the middle.

[0241] [Self-emissive display]

[0242] Figure 19 This is a schematic diagram illustrating an example of the arrangement of the binocular separation layer and the viewer separation layer relative to a self-emissive display. (Construction) Figure 19 The display unit 22g shown is a self-emissive display that emits light from the display screen 31. A display panel composed of OLED, LED, or the like is used as the display 30s. In this case, a backlight is not required.

[0243] In addition to the display 30s, the display unit 22g also includes a viewer separation layer 36 and a binocular separation layer 35. For example... Figure 19As shown, the viewer separation layer 36 and the binocular separation layer 35 are arranged on the display screen 31 side of the display 30s. That is, when using a self-emissive display 30s, the beam control layer (viewer separation layer 36 or binocular separation layer 35) can be arranged only on the display screen 31 side.

[0244] Here, the distance d2 between the display 30 and the viewer separation layer 36 is also shorter than the distance d1 between the display 30 and the binocular separation layer 35. Therefore, the viewer separation layer 36 and the binocular separation layer 35 are arranged in the aforementioned order on the display screen 31 side of the display 30s. Thus, the direction of the image light 3 emitted from the display 30s can be appropriately controlled. Furthermore, the use of a self-emissive display 30s, for example, allows multiple users 1 to perceive three-dimensional images with clear bright and dark areas, etc.

[0245] [Example of striped pattern configuration]

[0246] Figure 20 This is a schematic diagram illustrating an example of the striped pattern of the binocular separation layer and the viewer separation layer.

[0247] Figure 20 Figures A and B schematically show plan views of the binocular separation layer 35 and the viewer separation layer 36 as seen from a direction orthogonal to the display screen 31 (XY plane) of the display 30 (Z-axis direction). It should be noted that the plan views of the binocular separation layer 35 and the viewer separation layer 36 are at different scales.

[0248] Furthermore, a plan view of the display 30 is shown together with the binocular separation layer 35 and the viewer separation layer 36. A plurality of pixels 13 are arranged in a grid pattern along the vertical (Y-axis) and horizontal (X-axis) directions of the display screen 31 in the display 30. For example, a single pixel 13 is composed of three types of sub-pixels 14 corresponding to RGB color light. Such pixels 13 are arranged in a grid pattern. It should be noted that the method of arranging the pixels 13 is not limited, and any arrangement method can be used.

[0249] The viewer separation layer 36 includes a first stripe pattern 28a for separating the displayed image. Here, the displayed image refers to the image displayed on the display 30. The first stripe pattern 28a is, for example, a pattern for separating the displayed image into images to be displayed separately to multiple users 1.

[0250] Furthermore, the binocular separation layer 35 includes a second stripe pattern 28b for separating the displayed image. The second stripe pattern 28b is, for example, a pattern for separating the displayed image into an image seen by the actual user 1 through the right eye 10R and an image seen by the actual user 1 through the left eye 10L.

[0251] The first stripe pattern 28a and the second stripe pattern 28b are patterns of striped regions with predetermined widths arranged periodically. When a barrier element is used as the viewer separation layer 36 or the binocular separation layer 35, the striped regions correspond to the areas where slit portions (or barrier portions) are provided. For example, in the first stripe pattern 28, the distance between the striped regions as seen in the X direction is the barrier spacing p1, and in the second stripe pattern 28, the distance between the striped regions as seen in the X direction is the barrier spacing p2. Furthermore, when a cylindrical lens is used as the viewer separation layer 36 or the binocular separation layer 35, the striped regions correspond to the areas where elongated convex lenses are provided.

[0252] In this embodiment, as viewed from a direction orthogonal to the display screen 31 (XY plane) of the display 30 (Z-axis direction), the direction of the first stripe pattern 28a intersects the direction of the second stripe pattern 28b. Here, the direction of the first stripe pattern 28a (and the second stripe pattern 28b) is the direction in which the striped area extends. Figure 20 In the diagram, the directions of the first stripe pattern 28a and the second stripe pattern 28b are schematically indicated by white arrows.

[0253] The viewer separation layer 36 and the binocular separation layer 35 are configured such that the directions of the various stripe patterns, as seen from the Z-axis direction, intersect each other, i.e., the directions are not parallel to each other. Because the directions of the stripe patterns are not parallel in this way, the generation of moire patterns, etc., can be suppressed.

[0254] Furthermore, the directions of the first stripe pattern 28a and the second stripe pattern 28b are arranged obliquely relative to the pixel array of the display 30. That is, the stripe patterns are not the same as the vertical direction (Y direction) or vertical direction (X direction) of the display screen 31. Therefore, the pixels 13 of the display 30 appear uniform across the entire screen. In addition, the generation of moiré patterns and the like between the display 30 and the viewer separation layer 36 (or binocular separation layer 35) can be suppressed.

[0255] exist Figure 20 In the example shown in A, the direction of the first stripe pattern 28a is a direction tilted to the opposite side of the direction of the second stripe pattern 28b, using the vertical direction (Y-axis direction) of the display screen 31 as a reference. For example, in Figure 20 In the viewer separation layer 36 shown on the right side of A, the direction of the first stripe pattern 28a is tilted from the upper right to the lower left in the figure, and this direction is obtained by tilting the Y-axis direction to the right. Furthermore, in Figure 20 In the binocular separation layer 35 shown on the right side of A, the direction of the second stripe pattern 28b is tilted from the upper left to the lower right in the figure, and is obtained by tilting the Y-axis direction to the left.

[0256] In this way, Figure 20 In A, the first fringe pattern 28a is tilted relative to the Y-axis in a direction opposite to that of the second fringe pattern 28b. In this combination of opposite directions, for example, the intersection angle between the individual fringe patterns becomes larger, and the generation of moiré patterns can be sufficiently suppressed. Furthermore, for example, since the image light 3 is sufficiently separated, high resolution can be achieved.

[0257] exist Figure 20 In the example shown in B, the direction of the first stripe pattern 28a is tilted relative to the vertical direction (Y-axis direction) of the display screen 31 on the same side as the direction of the second stripe pattern 28b. For example, in Figure 20 In diagram B, the directions of the first stripe pattern 28a and the second stripe pattern 28b both slope from the upper left to the lower right in the diagram, and are obtained by tilting the Y-axis direction to the left. It should be noted that the directions of the first stripe pattern 28a and the second stripe pattern 28b are not parallel.

[0258] In this way, Figure 20 In B, the first stripe pattern 28a and the second stripe pattern 28b are inclined in the same direction relative to the Y-axis. Even using this combination in the forward direction, the generation of moiré patterns can be suppressed by making the individual stripe patterns intersect each other.

[0259] In addition, the tilt angle of each stripe pattern is appropriately set (e.g., the smaller angle among the angles intersecting the Y-axis direction) based on a balance between horizontal resolution, vertical resolution, and the degree of moiré pattern.

[0260] [Control of the stripe pattern in viewer separation layer 36]

[0261] Figure 21 This is a schematic diagram illustrating an application example of a viewer separation layer 36 capable of controlling the stripe pattern. Figure 22 This is a schematic diagram illustrating another application example of the viewer separation layer 36, which is capable of controlling the stripe pattern. Figure 21 and Figure 22 In this design, an element capable of electrically controlling the stripe pattern is used as the viewer separation layer 36. Furthermore, the processor 24 controls the operation of the viewer separation layer 36. It should be noted that... Figure 21 and Figure 22 The image shows only the viewer separation layer 36 of the configuration of the first display device 100.

[0262] An LCD panel capable of controlling the transmissive and light-blocking areas is used as an element capable of electrically controlling the stripe pattern. In this case, the first stripe pattern 28a is formed by controlling the LCD panel to alternately generate striped transmissive areas that transmit light entering from the back surface and striped light-blocking areas that block light entering from the back surface. It should be noted that the LCD panel is an element different from the display 30 mentioned above.

[0263] Furthermore, a variable backlight unit capable of controlling the emitting light area and the non-emitting light area can be used as an element capable of electrically controlling the stripe pattern. In this case, the first stripe pattern 28a is formed by controlling the variable backlight unit to alternately generate stripe-shaped emitting and non-emitting areas. In the configuration using the variable backlight unit, a perspective display 30 (see...) is used. Figure 18 ).

[0264] exist Figure 21 In this configuration, the viewer separation layer 36 is configured to electrically control the opening and closing of the first stripe pattern 28. Here, the open state of the first stripe pattern 28 refers to the state in which the first stripe pattern 28 is formed in the viewer separation layer 36. In this case, the viewer separation layer 36 functions as a beam control layer for separating the image for each user 1. Furthermore, the closed state of the first stripe pattern 28 refers to the state in which the entire surface of the viewer separation layer 36 is a transmissive (or luminescent) region and the first stripe pattern 28 is not formed in the viewer separation layer 36. In this case, the viewer separation layer 36 does not function as a beam control layer.

[0265] In addition, Figure 21 In this process, processor 24 switches the first stripe pattern 28 on and off based on the number of users 1. For example, as... Figure 21 As shown on the right, the processor 24 controls the viewer separation layer 36 so that the first stripe pattern 28 is turned off when there is only one user 1. In this case, the first display device 100 no longer has the function of separating the image for each user 1, and all pixels of the display 30 can be allocated to one user 1. Therefore, the resolution of the right-eye image and the left-eye image can be improved, and one user 1 can perceive a high-resolution three-dimensional image.

[0266] In addition, for example, such as Figure 21 As shown on the left, the processor 24 controls the viewer separation layer 36 such that the first stripe pattern 28 is activated when there are two or more users 1. In this case, the first display device 100 is able to function as a separate image for each user 1, and enable each of the multiple users 1 to perceive a three-dimensional image by means of binocular stereoscopic vision.

[0267] exist Figure 22In this configuration, the viewer separation layer 36 is configured to electrically control the direction of the first stripe pattern 28. By controlling the direction of the first stripe pattern 28, the display position of the image separated for each user 1 can be controlled, for example.

[0268] Therefore, the processor 24 controls the viewer separation layer 36 based on user location information to change the orientation of the first stripe pattern 28. The user location information is information indicating the location of a plurality of users 1 using the first display device 100, and is, for example, as referenced above. Figure 12 The description is obtained by the viewpoint detection unit 50. The user position information includes the coordinates of each user 1's right eye 10R and left eye 10L, the position of each user 1's face, etc. The processor 24 controls the direction of the first stripe pattern 28 based on the positional relationship of the multiple users 1 indicated by this information, and displays a separate image for each user 1.

[0269] For example, in Figure 22 On the left, two users 1 are arranged horizontally (Y-axis direction). In this case, the direction of the first stripe pattern 28 is set vertically (X-axis direction). That is, when multiple people are arranged horizontally, a barrier is formed that is alternately aligned horizontally. Therefore, the display position of the image separated for each user 1 is a different position in the horizontal direction, and different images can be displayed to the two users 1 aligned horizontally.

[0270] In addition, Figure 22 On the right side, two users 1 are aligned vertically (X-axis direction). That is, when multiple people are arranged vertically, barriers are alternately formed vertically. In this case, the direction of the first stripe pattern 28 is set to the horizontal direction (Y-axis direction). Therefore, the display position of the image separated for each user 1 is a different position in the vertical direction, and different images can be displayed to the two users 1 aligned vertically.

[0271] For example, if other users 1 are viewing the screen behind one user 1, the horizontal positions of each user 1's face can be almost identical. In such a case, as... Figure 22 On the left, even when the image is separated in the horizontal direction, each user 1 sees the same image. On the other hand, as... Figure 22 On the right side, by separating the image in the vertical direction, for example, users 1 on the upper side and users 1 on the lower side can perceive a three-dimensional image representing the display target (3D object, etc.) as seen from different angles of elevation.

[0272] In other respects, the method for controlling the first stripe pattern 28 of the viewer separation layer 36 is not limited. For example, the interval and width of the first stripe pattern 28 can be set according to the distance from user 1 and the number of users 1. Therefore, for example, even if the position of user 1 or the number of users 1 changes, each user 1 can be made to perceive the three-dimensional image appropriately.

[0273] [Second Display Mode]

[0274] The foregoing primarily describes a display mode (first display mode) in which right-eye and left-eye images are generated for each of the multiple users 1 and these images are displayed on the display 30. The first display device 100 may operate in a display mode different from the first display mode.

[0275] Figure 23 This is a schematic diagram depicting beam control in a second display mode. The second display mode is, for example, a display mode in which a parallax image (left-eye image and right-eye image) is displayed to one of a plurality of users 1 using the first display device 100, and a two-dimensional image is displayed to the other users 1. In this disclosure, a two-dimensional image can be considered as an image used for non-stereoscopic viewing or for 2D viewing that does not include a parallax image.

[0276] In the following text, it is assumed that user 1, to whom the parallax image is displayed, is first user 1a. First user 1a is, for example, the primary user of the first display device 100, and is user 1 who can see three-dimensional images by means of binocular stereoscopic vision, i.e., user 1 performing 3D viewing. Figure 23 In the diagram above, the first user 1a is schematically shown at the center.

[0277] Furthermore, assume that the user 1 to whom the 2D image is displayed is the second user 1b. The second user 1b is a different user 1 from the first user 1a, and is the user 1 performing the 2D viewing. It should be noted that the 2D image is an example of the second user's image. For example, in the case of two users 1, the user 1 who is not the first user 1a is designated as the second user 1b. Furthermore, in the case of three or more users 1, all users 1 other than the first user 1a are described as second users 1b. Figure 23 In the diagram, three users 1, acting as second user 1b, are schematically shown to the right and left of the first user 1a.

[0278] Figure 23 The upper curve is a schematic diagram showing the intensity distribution of image light 3 separated by the viewer separation layer 36. Furthermore, Figure 23 The lower curve is a schematic diagram showing the intensity distribution of the image light 3 separated by the binocular separation layer 35.

[0279] exist Figure 23 In the upper curve, three peaks are formed by the image light 3 separated by the viewer separation layer 36. The central peak 12a, for example, is formed by the image light 3 traveling toward the viewing viewpoint Pa of the first user 1a. Furthermore, the peak 12b formed to the left of peak 12a and the peak 12b' formed to the right of peak 12a are formed by image light 3 other than that traveling toward peak 12a. The center positions of peaks 12b and 12b' are, for example, positions separated from the viewing viewpoint Pa by a predetermined distance (personal distance, etc.).

[0280] Furthermore, peaks 12b and 12b' are formed by repeating the field of view at predetermined intervals through the viewer separation layer 36. Therefore, the pixels emitting the image light 3 constituting peaks 12b and 12b' are the same pixels. It should be noted that the pixels emitting the image light 3 constituting peaks 12a and 12b (or peaks 12b') are substantially different pixels.

[0281] exist Figure 23 In the lower curve diagram, the image light 3, which consists of peaks 12a, 12b, and 12b' in the upper curve diagram, is separated by the binocular separation layer 35 into two peaks corresponding to each person's right eye 10R and left eye 10L. For example, peak 12a is separated into peak 12aR centered on the right eye viewpoint PaR of the first user 1a and peak 12aL centered on the left eye viewpoint PaL of the first user 1a. Furthermore, peak 12b is separated into peak 12bR on the right and peak 12bL on the left, and peak 12b' is separated into peak 12bR' on the right and peak 12bL' on the left.

[0282] The pixel representing peak 12aR, one of the peaks separated by the binocular separation layer 35, is used as the pixel for displaying the right-eye image aR of the first user 1a. Furthermore, the pixel representing peak 12aL is used as the pixel for displaying the left-eye image aL of the first user 1a. Therefore, the first user 1a is able to perform binocular stereoscopic vision using both the right-eye image aL and the left-eye image bL.

[0283] On the other hand, in the second display mode, a two-dimensional image C is displayed to a second user 1b, who is a user 1 other than the first user 1a, without displaying a parallax image. That is, the pixels of peak 12bR and peak bL (peak 12bR' and peak bL') are used as the pixels for displaying the two-dimensional image C. Therefore, the second user 1b, located on both sides of the first user 1a, perceives the same two-dimensional image C with both their right eye 10R and left eye 10L.

[0284] In this way, in the second display mode, a 2D viewing area for the second user 1b is formed on both sides of the area where the first user 1a performs 3D viewing. Then, a stereoscopic display (3D viewing) is provided for the first user 1a, and a planar display (2D viewing) is provided for an unspecified number of users 1 (second users 1b) surrounding the first user 1a. Therefore, it becomes possible to provide binocular stereoscopic vision for a single person and naturally display two-dimensional images for an unspecified number of other people. It should be noted that the angular range of the field of view separated by the viewer separation layer 36 (here, approximately 33.6°) is the angular range achieved through either 3D or 2D viewing.

[0285] Figure 24 This is a flowchart illustrating an example of the operation of processor 24 in the second display mode.

[0286] First, a loop associated with the video frame is started (step 301). Next, the viewpoint detection unit 50 performs viewpoint detection processing associated with the first user 1a based on the captured image captured by the viewpoint detection camera device 21 (step 302). Through this processing, the right eye coordinates (XaR, YaR, ZaR) and left eye coordinates (XaL, YaL, ZaL) of the first user 1a are detected.

[0287] For example, the viewpoint detection unit 50 detects the user 1 closest to the center among multiple users 1 as the first user 1a. Furthermore, the user 1 designated as the first user 1a can be selected from the captured image via a predetermined GUI, for example. Additionally, the first detected user 1 can be selected as the first user 1a. Moreover, the method for selecting the first user 1a is not limited. It should be noted that in the second display mode, viewpoint detection processing for the second user 1b other than the first user 1a is not performed.

[0288] Based on the detection results of the viewpoint detection unit 50, an image generation process for displaying to the first user 1a is performed (step 303). In this process, the right-eye image generation unit 51a generates a right-eye image aR pointing to the right-eye coordinates (XaR, YaR, ZaR) of the first user 1a for the f-th frame. Furthermore, the left-eye image generation unit 52a generates a left-eye image aL pointing to the left-eye coordinates (XaL, YaL, ZaL) of the first user 1a for the f-th frame.

[0289] Next, the image generation process for displaying to the second user 1b is performed (step 304). Specifically, the processor 24 generates a two-dimensional image C as the second user image. This process is performed, for example, by a two-dimensional image generation unit (not shown) provided in the processor 24. It should be noted that, for example, the location information of the second user 1b is not required in the two-dimensional image C generation process.

[0290] Here, some examples of two-dimensional images C will be described. Examples of two-dimensional images C may include images with a fixed viewpoint and no motion parallax. For example, this is a two-dimensional image of a 3D object viewed from a fixed viewpoint (e.g., a viewpoint set in front of the display unit 22, etc.). Therefore, since the viewpoint of the image displayed to the second user 1b is fixed, a stable viewing experience can be provided.

[0291] Furthermore, an image of the primary 3D viewer's (first user 1a's) eye can be used as another example of the 2D image C. That is, the 2D image C is either the right-eye image aR of the first user 1a or the left-eye image aL of the first user 1a. In this case, the image displayed to the second user 1b coordinates with the movement of the first user 1a's viewpoint, and the second user 1b can share the field of view (view of view) seen by the first user 1a. Moreover, since the image generated in step 303 can be used directly, the amount of rendering processing can be reduced, etc.

[0292] Furthermore, an image at the central viewpoint of the primary 3D viewer's (first user 1a's) eyes can be used as another example of a two-dimensional image C. That is, two-dimensional image C is a central viewpoint image with the center between the right eye 10R and the left eye 10L of the first user 1a as the viewpoint. For example, the coordinates of this central viewpoint are calculated based on the right and left eye coordinates of the first user 1a obtained in step 302. Then, an image representing a 3D object as seen from the central viewpoint is generated as two-dimensional image C. Therefore, the second user 1b can share the frontal field of view of the first user 1a.

[0293] In this way, while moving in sync with the viewpoint of the first user 1a, the nearby second user 1b can also grasp the image from the perspective viewed by the first user 1a. Therefore, for example, the following application is anticipated: in an application where the field of view of the attending physician (first user 1a) in the medical field or the like is simultaneously visually recognized by other staff members (second user 1b).

[0294] It should be noted that, in the case of movement synchronized with the viewpoint of the first user 1a, the second user 1b may experience motion sickness from watching the video because they are viewing an image unrelated to their own viewpoint. Therefore, using a two-dimensional image C at a fixed viewpoint provides a more stable viewing experience without needing to know the field of view of the first user 1a.

[0295] Furthermore, examples of the two-dimensional image C are not limited to those mentioned above. For instance, an image unrelated to the image displayed to the first user 1a (e.g., a black and white image) can be a two-dimensional image C. In this case, there is no need to render the two-dimensional image C, and the image processing load can be significantly reduced. Additionally, the two-dimensional image C mentioned above can be switched and used as needed.

[0296] When generating three input images (right-eye image aR, left-eye image aL, and two-dimensional image C), the pixel of display 30 is assigned a process for each input image. First, for pixel P(j,i) of display 30, the parameter is set to i, and the Y-coordinate loop begins (step 305), and the parameter is set to j, and the X-coordinate loop begins (step 306).

[0297] Next, the output image generation unit 53 determines the amount of incident light from pixel P(j,i) to the region of the first user 1a (step 307). This process determines the association between pixel P(j,i) and the first user 1a. Here, it is determined whether the amount of incident light from the image light 3 from pixel P(j,i) to the region of the first user 1a is equal to or greater than a predetermined amount. For example, the sum of the incident light amounts from the beam of light from pixel P(j,i) to the right eye 10R and left eye 10L of the first user 1a is calculated as the amount of incident light to the region of the first user 1a. It is then determined whether the sum of the incident light amounts is equal to or greater than a predetermined amount.

[0298] If the amount of incident light to the region of the first user 1a is equal to or greater than a predetermined amount (yes in step 307), pixel P(j,i) is associated with the first user 1a, and the amount of incident light to the right eye 10R and left eye 10L of the first user 1a is determined (step 308). Here, with respect to the first user 1a, it is determined whether the amount of incident light to the left eye 10L is greater than the amount of incident light to the right eye 10R.

[0299] If the amount of incident light to the left eye 10L of the first user 1a is greater than the amount of incident light to the right eye 10R (yes in step 308), pixel aL(j,i) of the left eye image aL is assigned to pixel P(j,i) (step 309). Furthermore, if the amount of incident light to the left eye 10L of the first user 1a is equal to or less than the amount of incident light to the right eye 10R (no in step 308), pixel aR(j,i) of the right eye image aR is assigned to pixel P(j,i) (step 310).

[0300] On the other hand, if the amount of incident light to the area of ​​the first user 1a is less than a predetermined amount (no in step 307), pixel P(j,i) is used as the pixel for displaying the image to the second user 1b. That is, pixel C(j,i) of the two-dimensional image C is assigned to pixel P(j,i) (step 311).

[0301] Upon completion of image allocation for pixel P(j,i), the X-coordinate cycle is determined (step 312). For example, if parameter j has not reached a predetermined value, the processing of step 306 and subsequent steps is repeated by incrementing the value of j by one. If parameter j has reached a predetermined value, the Y-coordinate cycle is determined (step 313). For example, if parameter i has not reached a predetermined value, the processing of step 305 and subsequent steps is repeated by incrementing the value of i by one.

[0302] With parameter i having reached a predetermined value, the allocation for all pixels P is completed. Therefore, a composite image (output image) is generated that assigns pixels from any of the three input images (right-eye image aR, left-eye image aL, and two-dimensional image C) to all pixels P. In this case, the display control unit 54 outputs the output image to the display 30 to display the output image (step 314).

[0303] Therefore, the right-eye image aR is displayed to the right eye 10R of the first user 1a, and the left-eye image aL is displayed to the left eye 10L of the first user 1a. Thus, the first user 1a can perceive a three-dimensional image as seen from the position of the first user 1a in the f-th frame. Furthermore, a two-dimensional image C is displayed to both eyes of another user (the second user 1b) located around the first user 1a. Therefore, for example, the second user 1b can share the field of view of the first user 1a and observe 3D objects seen by the first user 1a from a fixed viewpoint.

[0304] When the output image is displayed, the video frame loop is determined (step 315). For example, if there are remaining video frames, the processing of step 301 and subsequent steps is repeated by incrementing the value of f by one. Furthermore, if no video frames remain, the processing ends.

[0305] In this way, in this embodiment, a display mode (second display mode) is executed to generate a right-eye image aR and a left-eye image aL for the first user 1a, as well as a two-dimensional image C targeting the second user 1b, and to display these images on the display 30. Therefore, while one user 1 perceives a three-dimensional image, surrounding users 1 visually recognize the two-dimensional image C. In this way, by setting the 2D image (the same image for both eyes) to be displayed to viewers other than the primary viewer, those other than the primary viewer can view an image as in a conventional 2D display.

[0306] [Switching display modes]

[0307] The method for switching display modes will be described below. In this embodiment, the processor 24 switches and executes multiple display modes based on the number of users 1. This process is performed, for example, by a control unit (not shown) provided in the processor 24.

[0308] For example, the viewpoint detection unit 50 obtains the number of users 1 based on the output of the viewpoint detection camera device 21. In this case, for example, it counts the number of people in the captured image who are facing forward and whose facial area is larger than a certain size. Alternatively, any method for obtaining the number of users 1 can be used. When the number of users 1 is detected, a display mode is selected based on the number of users 1, and the image to be displayed on the display 30 is controlled.

[0309] Multiple display modes include the first and second display modes mentioned above. The first display mode is one in which right-eye and left-eye images are generated for the first user 1a and the second user 1b, respectively, and these images are displayed on the display 30. Therefore, the first display mode can be described, for example, as a 3D display mode for two people. The second display mode is one in which right-eye and left-eye images are generated for the first user 1a, and two-dimensional images are generated for the second user 1b, and these images are displayed on the display 30. The second display mode can be described, for example, as a single-person 3D display and a multi-person 2D display mode. Furthermore, various display modes can be provided as described below.

[0310] By switching the displayed image based on the number of users 1 detected by the viewpoint detection camera device 21, it is possible to avoid, for example, a situation where the images seen by others appear mixed, i.e., crosstalk. Furthermore, power consumption can be reduced by omitting unnecessary image generation processing, and high-speed image generation processing can be achieved. Specific display mode control modes A to F will be described below.

[0311] Control mode A is a method of switching the first display mode when a second person is substantially detected in the second display mode. That is, processor 24 executes the second display mode when there is only one user 1, and executes the first display mode when there are two users 1. Therefore, for example, a parallax image for the second person is not generated until two users 1 are present, thus reducing the processing load.

[0312] Control mode B is a method that essentially sets a first display mode and switches to a second display mode when there are three or more users 1. That is, when there are two or fewer users 1, the processor 24 executes the first display mode, and when there are three or more users 1, it executes the second display mode. Therefore, for example, whenever there are two or fewer users 1, a parallax image for both users is always generated, allowing each user 1 to perceive a high-resolution 3D image at any time. Furthermore, when there are three or more users, a common 2D image is displayed to all users except the primary user 1. Therefore, even when the number of users 1 increases, crosstalk can be suppressed, and a natural viewing experience can be provided.

[0313] Control mode C is essentially a method that sets up a third display mode that only performs 2D display and switches to the display mode each time a person is detected. Here, the third display mode refers to a display mode that only generates a predetermined two-dimensional image and displays that predetermined two-dimensional image on the display 30. In other words, it is a display mode without any parallax images, and it is a 2D display mode in which the first display device 100 operates as a 2D display. For example, when the number of users 1 is zero, the processor 24 executes the third display mode. That is, when no user 1 is detected, the same two-dimensional image is presented at all viewpoints and no parallax images are generated. Therefore, unnecessary image generation processing can be eliminated, and power consumption can be significantly reduced.

[0314] Furthermore, in control mode C when there is only one user 1, a fourth display mode is executed, which presents only the parallax image of the first user 1a as the primary viewer. In this case, since parallax images for other viewpoints are generated, the processing load can be reduced. Additionally, when there are two users 1, a first display mode is executed, and parallax images for both users are generated. Furthermore, when there are three users 1, a second display mode is executed, and parallax images and a two-dimensional image for a single user are generated. In this way, by finely switching the display mode according to the number of users 1, the processing load of image processing is suppressed, and the power consumption of the device can be reduced, for example.

[0315] Control mode F is a method for generating and displaying disparity images to all users when there are three or more users 1. In this method, the position information of each user 1 is detected each time a user 1 is added, and a disparity image for each user 1 is generated using this result. In this case, the larger the number of users 1, the lower the resolution of the disparity image (3D image) that can be displayed. With a large number of users 1, a 3D image can be perceived simultaneously. Furthermore, the control method for switching display modes is unrestricted.

[0316] Although the number of users 1 is obtained from the output of the viewpoint detection camera device 21 in the above description, other methods can also be used. For example, the number of users 1 can also be obtained from information input via a predetermined input device. For example, a touch screen, mouse, keyboard, controller, etc., integrated into the display 30 can be used as the input device.

[0317] Furthermore, User 1 can manually set the number of people supported by the first display device 100 via a predetermined user interface (UI). Therefore, for example, a display mode based on the number of supported people can be selected regardless of the actual number of Users 1. Additionally, when multiple Users 1 are detected, a specific number of N people can be selected from the UI. Therefore, the optimal display mode can always be executed for a specific number of N people.

[0318] In the first display device 100 according to this embodiment, a display image is displayed on the display 30, comprising a right-eye image aR and a left-eye image aL of the first user 1a generated based on the position information of the first user 1a, and a second user image (a right-eye image bR and a left-eye image bL of the second user 1b, or a two-dimensional image C). Furthermore, the display image is separated into the viewpoint of the first user 1a and the second user 1b by a viewer separation layer 36, and further separated into a left-eye image and a right-eye image by a binocular separation layer 35. Using these two layers, images can be distributed to multiple users 1, including the first user 1a and the second user 1b, and displayed on the display 30 without any loss. Therefore, high-resolution images including binocular stereoscopic vision can be provided simultaneously to multiple users 1.

[0319] Figure 25 This is a schematic diagram depicting, as a comparative example, image display via a display device intended for a single user. Figure 25 In the diagram, a graph illustrating the brightness of image light 3 schematically shows the state of repetitive fields of view in a display device for a single user. The fields of view 11R for the right eye 10R and 11L for the left eye 10L are indicated by black arrows. It should be noted that the multiple peaks included in each field of view each represent the distribution of image light from individual pixels.

[0320] In the display device 120 for a single user, the field of view 11R of the right eye 10R and the field of view 11L of the left eye 10L are alternately repeated by a binocular separation layer 35. The field of view repetition interval (the range indicated by the dashed arrow) is the distance obtained by adding the fields of view 11R and 11L. Therefore, all pixels can be assigned to either the right eye 10R or the left eye 10L of the viewer whose viewpoint is detected. This method can provide a high-resolution 3D video experience, but there is a problem that the viewer is limited to one person. For example, if other viewers around the main viewer are viewing the screen, due to the repetition of the fields of view, the left-eye image may be displayed to the right eye 10R of the other viewers, and the right-eye image may be displayed to the left eye 10L. In this way, other viewers may see unexpected images.

[0321] Figure 26 This is a schematic diagram depicting an image display using a multi-view display device, which can serve as a comparative example. The multi-view type is a display method that displays multiple viewpoint images 19 at constant angular intervals to achieve the perception of a three-dimensional image. Figure 26 The image displays six viewpoint images 19. For example, two viewpoint images 19 that are adjacent to each other are used as the right eye image and the left eye image.

[0322] In multi-view display devices, for example, the number of viewpoint images is fixed, and it is necessary to allocate light beams other than those entering the actual viewer's eyes to the pixels of the display panel. For example, in Figure 24 In this scenario, one viewer is viewing the left-hand viewpoint image 19, while the other viewer is viewing both right-hand viewpoint images 19. Conversely, since there is no viewer, the two viewpoint images 19 in the center are wasted. In this way, by utilizing a multi-viewpoint type, the number of pixels can be used efficiently, and the resolution of each viewpoint can be reduced.

[0323] In the first display device 100 according to this embodiment, in addition to a binocular separation layer 35 that separates the image displayed on the display 30 into a left-eye image and a right-eye image, a viewer separation layer 36 is also provided that separates the image displayed on the display 30 into multiple viewpoints of users 1. For example, in the case of only the binocular separation layer 35, the left and right fields of view are repeated, such as... Figure 25 As shown. However, by providing a viewer separation layer 36, the field of view separated by the binocular separation layer 35 can be further separated for each user 1.

[0324] Using this configuration, different images can be provided to the eyes of multiple users 1 respectively. Therefore, for example, binocular stereoscopic vision can be simultaneously achieved on the same screen for multiple users 1. Furthermore, display modes can be implemented, such as displaying a stereoscopic image to one user 1 and a two-dimensional image to another user 1. In this way, using this technology, the images displayed to the eyes of multiple users 1 can be independently controlled, and various display modes can be implemented.

[0325] Furthermore, by combining the viewer separation layer 36 and the binocular separation layer 35, all pixels on the display 30 can be allocated to multiple users 1. That is, the first display device 100 does not display images that each user 1 cannot visually recognize (images no one is seeing), and the pixels of the display 30 can be used without waste. Therefore, for example, compared to multi-view types, the resolution of each viewpoint is greatly improved, and a high-resolution 3D viewing experience can be achieved, etc.

[0326] <Other Implementation Methods>

[0327] This technology is not limited to the implementation methods mentioned above, and can be implemented in various other ways.

[0328] The viewpoint detection camera device has been described above as an example of a sensor for detecting a user's location information. This technology is not limited to this, and any sensor capable of detecting a user's location information can be used. For example, distance measurement sensors such as ToF cameras, stereo cameras, or LiDAR can be used. Furthermore, position sensors such as GPS and motion sensors such as IMUs can be used. In this case, the user's location information can be obtained by communicating with a sensor installed on a portable terminal (smartphone, etc.) owned by the user.

[0329] In the foregoing, the information processing method according to this technology is executed by a processor mounted on a first display device. This technology is not limited thereto, and the information processing method and program according to this technology can be executed by the processor in cooperation with another computer capable of communicating with it via a network or the like, and the processor according to this technology can be configured.

[0330] In other words, the information processing methods and programs according to this technology can be executed not only in computer systems consisting of a single computer, but also in computer systems in which multiple computers operate collaboratively. It should be noted that in this disclosure, a system refers to a group of multiple components (devices, modules (parts), etc.), and it is not important whether all components are housed in the same housing. Therefore, both multiple devices housed in a single housing and interconnected via a network, and a single device having multiple modules housed in a single housing, are systems.

[0331] The execution of information processing methods and programs according to this technology by a computer system includes, for example, the following two scenarios: a single computer performs tasks such as acquiring user location information, displaying images (e.g., right-eye and left-eye images of a first user and an image of a second user), and controlling a display for displaying the images; and different computers perform the corresponding processing. Furthermore, performing the corresponding processing by a predetermined computer includes having another computer perform some or all of these processes and obtain results.

[0332] In other words, the information processing methods and procedures based on this technology can also be applied to cloud computing configurations where multiple devices share and collaborate over a network to process a single function.

[0333] At least two features of the present technology described above can be combined. That is, the various features described in the various embodiments can be arbitrarily combined across the various embodiments. Furthermore, the various effects mentioned above are merely exemplary and not limiting, and may provide other effects.

[0334] In this disclosure, "same," "equal," "orthogonal," etc., are concepts that include "substantially the same," "substantially equal," "substantially orthogonal," etc. For example, it also includes states included within a predetermined range (e.g., ±10%) based on "completely identical," "completely equal," "completely orthogonal," etc.

[0335] It should be noted that this technology can also be configured as follows.

[0336] (1) A display device, comprising:

[0337] monitor;

[0338] The processor is configured to:

[0339] User location information, including the location information of the first user, is obtained based on the output of a sensor configured to obtain location information in real space.

[0340] Generate the right eye image and the left eye image of the first user based on the first user's location information.

[0341] Generate a second user image, which targets a second user different from the first user, and

[0342] The control display shows an image including the right eye image of the first user, the left eye image of the first user, and the image of the second user;

[0343] A user separation layer, which is fixed relative to the surface of the display and configured to separate the display image into the viewpoints of a first user and a second user; and

[0344] The left and right image separation layer is relatively fixed relative to the surface of the display and is configured to separate the display image into a right-eye image and a left-eye image.

[0345] (2) The display device according to (1), wherein,

[0346] processor

[0347] The location information of the second user is obtained based on the sensor output, and

[0348] The second user's right eye image and the second user's left eye image are generated based on the second user's location information as the second user image.

[0349] (3) The display device according to (1), wherein,

[0350] The processor generates a two-dimensional image as a second user image.

[0351] (4) The display device according to (3), wherein,

[0352] The two-dimensional image is either the right-eye image of the first user or the left-eye image of the first user.

[0353] (5) The display device according to (3), wherein,

[0354] A two-dimensional image is a central viewpoint image located between the right eye and the left eye of the first user.

[0355] (6) The display device according to at least one of (1) to (5), wherein,

[0356] The processor generates a composite image by combining the images included in the displayed image based on the user's location information, and controls the display to show the composite image.

[0357] (7) The display device according to at least one of (1) to (6), wherein,

[0358] The distance between the display and the left and right image separation layers is greater than the distance between the display and the user separation layer.

[0359] (8) The display device according to (7) further includes

[0360] The backlight section projects light onto the display, in which...

[0361] The display is a perspective display that modulates light from the backlight and is positioned between the user separation layer and the left and right image separation layers.

[0362] (9) The display device according to (8), wherein,

[0363] The user separation layer is arranged between the display and the backlight, and

[0364] The left and right image separation layers are arranged on the side of the display opposite to the backlight.

[0365] (10) The display device according to (7), wherein,

[0366] The user separation layer is positioned between the display and the left and right image separation layers.

[0367] (11) The display device according to (10) further includes

[0368] The backlight section projects light onto the display, in which...

[0369] A display is a transmissive display that modulates light from a backlight.

[0370] The user separation layer and the left and right image separation layers are arranged between the display and the backlight.

[0371] (12) The display device according to (7), wherein,

[0372] A monitor is a self-emissive display that emits light from its screen.

[0373] The user separation layer and the left and right image separation layers are arranged on one side of the display screen.

[0374] (13) The display device according to (7), wherein,

[0375] The user separation layer consists of barrier elements arranged alternately between slits that transmit light and barriers that suppress light.

[0376] The left and right image separation layer is composed of cylindrical lenses.

[0377] (14) The display device according to at least one of (1) to (13), wherein,

[0378] The user separation layer includes multiple light-emitting areas that form a striped pattern and illuminate the backlight of the display with light from the multiple light-emitting areas.

[0379] (15) The display device according to at least one of (1) to (14), wherein,

[0380] The user separation layer includes a first stripe pattern for separating the displayed image.

[0381] The left and right image separation layer includes a second stripe pattern for separating the displayed images, and

[0382] As seen from a direction orthogonal to the display screen, the direction of the first stripe pattern intersects the direction of the second stripe pattern.

[0383] (16) The display device according to (15), wherein,

[0384] The display includes multiple pixels arranged in a grid pattern along the vertical and horizontal directions of the screen, and

[0385] The direction of the first stripe pattern is tilted relative to the vertical direction of the display screen on the same side as the direction of the second stripe pattern.

[0386] (17) The display device according to (16), wherein,

[0387] The display includes multiple pixels arranged in a grid pattern along the vertical and horizontal directions of the screen, and

[0388] The direction of the first stripe pattern is tilted relative to the vertical direction of the display screen on the side opposite to the direction of the second stripe pattern.

[0389] (18) The display device according to at least one of (15) to (17), wherein,

[0390] The user separation layer can electrically control the direction of the first stripe pattern, and

[0391] The processor controls the user separation layer based on user location information to change the direction of the first stripe pattern.

[0392] (19) The display device according to at least one of (15) to (18), wherein,

[0393] The user separation layer can electrically control the opening or closing of the first stripe pattern, and

[0394] The processor controls the user separation layer so that the first stripe pattern is turned off when there is only one user.

[0395] (20) The display device according to at least one of (1) to (19), wherein,

[0396] The processor switches and executes multiple display modes based on the number of users.

[0397] (21) The display device according to (20), wherein,

[0398] Multiple display modes include

[0399] First display mode: Generates the right-eye image and left-eye image of the first user, as well as the right-eye image and left-eye image of the second user, and displays these images on the monitor.

[0400] Second display mode: Generate the right eye image and left eye image of the first user, as well as a two-dimensional image targeting the second user, and display these images on the monitor.

[0401] (22) The display device according to (21), wherein,

[0402] processor

[0403] The second display mode is executed when there is only one user.

[0404] The first display mode is executed when there are two users.

[0405] (23) The display device according to (21), wherein,

[0406] processor

[0407] The first display mode is executed when the number of users is equal to or less than two, and the second display mode is executed when the number of users is equal to or greater than three.

[0408] (24) The display device according to at least one of (21) to (23), wherein,

[0409] The plurality of display modes includes a third display mode, which generates only a predetermined two-dimensional image and causes the display to show the predetermined two-dimensional image.

[0410] The processor executes the third display mode when there are zero users.

[0411] (25) The display device according to at least one of (20) to (24), wherein,

[0412] The processor obtains the number of users based on the output of the sensors, or based on information input via a predetermined input device.

[0413] List of reference numerals

[0414] 1a First User

[0415] 1b Second User

[0416] 2. Three-dimensional image

[0417] 10L Left eye

[0418] 10R Right eye

[0419] 16 Barrier Elements

[0420] 21 Viewpoint Inspection Camera Device

[0421] 22, 22a to 22g display units

[0422] 30, 30s display

[0423] 31 Display screen

[0424] 35 Bilateral separation layer

[0425] 36. Viewer Separation Layer

[0426] 38 Backlight section

[0427] 100 First display device

Claims

1. A display device, comprising: monitor; The processor is configured to: User location information, including the location information of the first user, is obtained based on the output of a sensor configured to obtain location information in real space. Generate the right eye image and the left eye image of the first user based on the first user's location information. Generate a second user image, the second user image targeting a second user different from the first user, and Control the display to show an image including the right eye image of the first user, the left eye image of the first user, and the image of the second user; A user separation layer, which is fixed relative to the surface of the display and configured to separate the displayed image into the viewpoint of the first user and the viewpoint of the second user; as well as A left-right image separation layer, which is fixed relative to the surface of the display and configured to separate the displayed image into a right-eye image and a left-eye image.

2. The display device according to claim 1, wherein, The processor The location information of the second user is obtained based on the output of the sensor, and Based on the location information of the second user, the right eye image and the left eye image of the second user are generated as the second user image.

3. The display device according to claim 1, wherein, The processor generates a two-dimensional image as the second user image.

4. The display device according to claim 3, wherein, The two-dimensional image is either the right eye image of the first user or the left eye image of the first user.

5. The display device according to claim 3, wherein, The two-dimensional image is a central viewpoint image with the viewpoint centered between the right eye and the left eye of the first user.

6. The display device according to claim 1, wherein, The processor generates a composite image by combining the images included in the displayed image based on the user's location information, and controls the display to show the composite image.

7. The display device according to claim 1, wherein, The distance between the display and the left and right image separation layers is greater than the distance between the display and the user separation layer.

8. The display device according to claim 7, further comprising: The backlight section illuminates the display, wherein, The display is a perspective display that modulates light from the backlight and is arranged between the user separation layer and the left and right image separation layers.

9. The display device according to claim 8, wherein, The user separation layer is disposed between the display and the backlight unit, and The left and right image separation layers are arranged on the side of the display opposite to the backlight section.

10. The display device according to claim 7, wherein, The user separation layer is arranged between the display and the left and right image separation layers.

11. The display device according to claim 10, further comprising: The backlight section illuminates the display, wherein, The display is a see-through display that modulates light from the backlight section, and The user separation layer and the left and right image separation layers are arranged between the display and the backlight.

12. The display device according to claim 7, wherein, The display is a self-emissive display that emits light from a screen, and The user separation layer and the left and right image separation layer are arranged on one side of the display screen of the monitor.

13. The display device according to claim 7, wherein, The user separation layer is composed of barrier elements arranged alternately with slits for transmitting light and barriers for suppressing light. The left and right image separation layer is composed of cylindrical lenses.

14. The display device according to claim 1, wherein, The user separation layer includes multiple light-emitting areas forming a striped pattern and illuminates the backlight portion of the display with light from the multiple light-emitting areas.

15. The display device according to claim 1, wherein, The user separation layer includes a first stripe pattern for separating the displayed image. The left and right image separation layer includes a second stripe pattern for separating the displayed image, and As viewed from a direction orthogonal to the display screen, the direction of the first stripe pattern intersects the direction of the second stripe pattern.

16. The display device according to claim 15, wherein, The display includes a plurality of pixels arranged in a grid pattern along the vertical and horizontal directions of the display screen, and The direction of the first stripe pattern is tilted relative to the vertical direction of the display screen on the same side as the direction of the second stripe pattern.

17. The display device according to claim 16, wherein, The display includes a plurality of pixels arranged in a grid pattern along the vertical and horizontal directions of the display screen, and The direction of the first stripe pattern is tilted relative to the vertical direction of the display screen on the side opposite to the direction of the second stripe pattern.

18. The display device according to claim 15, wherein, The user separation layer can electrically control the direction of the first stripe pattern, and The processor controls the user separation layer based on the user location information to change the direction of the first stripe pattern.

19. The display device according to claim 15, wherein, The user separation layer can electrically control the opening or closing of the first stripe pattern, and The processor controls the user separation layer such that the first stripe pattern is turned off when there is only one user.

20. The display device according to claim 1, wherein, The processor switches between multiple display modes based on the number of users.

21. The display device according to claim 20, wherein, The plurality of display modes include First display mode: Generate the right eye image and left eye image of the first user, as well as the right eye image and left eye image of the second user. And cause the display to show these images, and Second display mode: Generate the right eye image and the left eye image of the first user, as well as a two-dimensional image targeting the second user, and display these images on the display.

22. The display device according to claim 21, wherein, The processor The second display mode is executed when there is only one user. The first display mode is executed when there are two users.

23. The display device according to claim 21, wherein, The processor The first display mode is executed when the number of users is equal to or less than two, and The second display mode is executed when the number of users is equal to or greater than three.

24. The display device according to claim 21, wherein, The plurality of display modes includes a third display mode, which generates only a predetermined two-dimensional image and causes the display to show the predetermined two-dimensional image. The processor executes the third display mode when there are zero users.

25. The display device according to claim 20, wherein, The processor obtains the number of users based on the output of the sensor, or based on information input via a predetermined input device.

Images