Information processing device, information processing method, and program

Abstract

The information processing device (30) is provided with: a designation unit (331) which designates a viewpoint position of a viewer of a display device (10) which reproduces light rays emitted from a three-dimensional object; a setting unit (332) which uses the viewpoint position designated by the designation unit (331) as a reference to set an area in which the viewer can stereoscopically view the three-dimensional object; and a display control unit (333) which performs control so that the display device (10) emits a group of light rays which enables the three-dimensional object to be stereoscopically viewed from within the area set by the setting unit (332) and which prevents the three-dimensional object from being stereoscopically viewed from outside the area.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. Background Art

[0002] Some conventional display devices implement stereoscopic image display. Patent Document 1 discloses an image display system including an image display device that displays a stereoscopic image by using a light reproduction method.

[0003] Citation List

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2008-146221 Summary of the Invention

[0006] Problems to be solved by the present invention

[0007] In the conventional technology described above, motion parallax is achieved in all three-dimensional directions using a light regeneration method. Therefore, it is difficult to simplify the configuration of the device that regenerates light in all three-dimensional directions. Furthermore, the light regeneration device regenerates light in all three-dimensional directions, and therefore, depending on the processing performance of the device, an unnatural image may be visually perceived.

[0008] Therefore, the present disclosure proposes an information processing device, an information processing method, and a program that enable a stereoscopic image to be visually recognized by using light even if a processing load related to emission of light is reduced.

[0009] Solution to the problem

[0010] In order to solve the above-mentioned problem, an information processing device according to an embodiment of the present disclosure includes: a designation unit, which specifies the viewpoint position of an observer of a display device, which reproduces light rays emitted by a three-dimensional object; a setting unit, which sets an area so that the observer can view the three-dimensional object stereoscopically by using the viewpoint position specified by the designation unit as a reference; and a display control unit, which performs control to cause the display device to emit a group of light rays so that the three-dimensional object can be viewed stereoscopically from inside the area set by the setting unit, and so that the three-dimensional object cannot be viewed stereoscopically from outside the area.

[0011] Furthermore, an information processing method according to an embodiment of the present disclosure is an information processing method performed by an information processing apparatus that controls a display device that reproduces light emitted by a three-dimensional object. The information processing method includes: specifying a viewpoint position of an observer of the display device; setting an area that enables the observer to stereoscopically view the three-dimensional object using the specified viewpoint position as a reference; and controlling the display device to emit a set of light rays that enables stereoscopic viewing of the three-dimensional object from within the set area and prevents stereoscopic viewing of the three-dimensional object from outside the area.

[0012] In addition, a program according to an embodiment of the present disclosure causes an information processing device that controls a display device that reproduces light emitted by a three-dimensional object to perform the following steps: a step of specifying a viewpoint position of an observer of the display device; a step of setting an area by using the specified viewpoint position as a reference, the area enabling the observer to view the three-dimensional object stereoscopically; and a step of performing control to cause the display device to emit a group of light rays, the group of light rays enabling the three-dimensional object to be viewed stereoscopically from inside the set area and preventing the three-dimensional object from being viewed stereoscopically from outside the area. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a diagram showing a schematic configuration of a display system including an information processing apparatus according to the embodiment.

[0014] Figure 2 is a diagram showing an example of the configuration of an information processing apparatus according to the embodiment.

[0015] Figure 3 is a diagram for explaining viewpoint positions in the information processing apparatus according to the embodiment.

[0016] Figure 4 is a diagram showing the relationship between areas and rays that the information processing apparatus according to the embodiment has set by using the viewpoint position as a reference.

[0017] Figure 5 1 is a diagram for explaining a group of rays reproduced by the information processing apparatus according to the embodiment.

[0018] Figure 6 is a diagram for explaining an example of the relationship between rays, images, and viewpoint positions in the information processing apparatus according to the embodiment.

[0019] Figure 7 is a flowchart illustrating an example of a processing procedure performed by the information processing apparatus according to the embodiment.

[0020] Figure 8is a diagram for explaining the relationship between light, images, and viewpoint positions in the information processing apparatus according to the embodiment.

[0021] Figure 9 It is a diagram for explaining the relationship between rays, areas, and viewpoint positions in the information processing apparatus in modification (1) of the embodiment.

[0022] Figure 10 It is a diagram for explaining the relationship between rays, areas, and viewpoint positions in the information processing apparatus in modification (2) of the embodiment.

[0023] Figure 11 It is a diagram for explaining the relationship between rays, areas, and viewpoint positions in the information processing device in modification (3) of the embodiment.

[0024] Figure 12 It is a diagram for explaining the relationship between light, images, and viewpoint positions in the information processing device in the modification (4) of the embodiment.

[0025] Figure 13 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing apparatus. DETAILED DESCRIPTION

[0026] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. Note that in each embodiment described below, the same parts are denoted by the same reference numerals, and thus repeated descriptions are omitted.

[0027] (Example)

[0028] [Overview of Display System According to Embodiment]

[0029] Figure 1 is a diagram showing a schematic configuration of a display system including an information processing apparatus according to the embodiment. Figure 1 The display system 100 shown enables an observer 200 to visually recognize a three-dimensional object in a stereoscopic manner by using a group of light rays emitted from a display device 10. The display system 100 includes the display device 10, a measuring device 20, and an information processing device 30. The information processing device 30 can communicate with the display device 10 and the measuring device 20.

[0030] The display device 10 is a light field display that reproduces light that has been emitted by a three-dimensional object. The display device 10 of the light field scheme is a device that enables the observer 200 to visually recognize stereoscopic videos, etc. with the naked eye without using special glasses. For example, a three-dimensional object to be visually recognized emits light in various directions. Light refers to light obtained by reflecting sunlight, lighting, etc. People, etc. recognize the object in three dimensions by grasping the light that has been emitted by the three-dimensional object. The display device 10 reproduces the light that has been emitted by the three-dimensional object in a simulated manner, so that the three-dimensional object can be viewed in three dimensions. Under the control of the information processing device 30, the display device 10 reproduces the light that has been emitted by the three-dimensional object according to a scheme for reproducing the light that has been emitted by the three-dimensional object. As the display device 10, for example, a well-known device that reproduces light according to a panel stacking scheme, a projector array scheme, a parallax barrier / lens array scheme, etc. can be used.

[0031] For example, the display device 10 may use a light regeneration scheme that is capable of changing the area where light is to be reproduced by performing signal processing. In this embodiment, a case where a display using a panel stacking scheme is used as an example of the display device 10 is described. The display device 10 can change the light emitted from the pixels by, for example, changing the values ​​of multiple pixels of the liquid crystal panel 11.

[0032] The measuring device 20 is arranged on the upper part of the display device 10 in a manner capable of measuring the position of the eye 201 of the observer 200 observing the display device 10. As the measuring device 20, for example, a single device or a combination of an RGB camera, an IR camera, a depth camera, an ultrasonic sensor, etc. can be used. The measuring device 20 can perform measurements all the time or can perform measurements periodically. The measuring device 20 sends measurement information indicating the measurement results to the information processing device 30 in a wireless or wired communication manner. The measurement results include, for example, the following information, which can identify the position, distance, etc. of the observer 200's head, left eye or right eye 201, etc. in the space where the liquid crystal panel 11 can be visually recognized. The measurement results include, for example, images of the observer 200's left eye or right eye 201, etc.

[0033] [Configuration of Information Processing Apparatus According to Embodiment]

[0034] Figure 2 is a diagram showing an example of the configuration of the information processing device 30 according to the embodiment. Figure 2The information processing device 30 shown in FIG is, for example, a dedicated or general-purpose computer. The information processing device 30 includes a communication unit 31, a storage device 32, and a control unit 33. The information processing device 30 is, for example, provided outside the display device 10, but this is not restrictive. For example, the information processing device 30 may be incorporated into the display device 10. The control unit 33 of the information processing device 30 is electrically connected to the communication unit 31 and the storage device 32.

[0035] The communication unit 31 has a function of communicating with the display device 10 and the measuring device 20 directly or via a network. The communication unit 31 is a communication device that can perform wired or wireless communication, for example. The communication unit 31 outputs information received from the display device 10 and the measuring device 20 to the control unit 33. The communication unit 31 transmits information, signals, etc. input from the control unit 33 to the display device 10, the measuring device 20, etc. Note that the communication unit 31 may include a connector, for example, for connecting to a cable, etc.

[0036] The storage device 32 stores various types of data and programs. The storage device 32 is implemented, for example, by a semiconductor memory element such as RAM or flash memory, or a storage device such as a hard disk or optical disk. The storage device 32 stores the measurement results of the measuring device 20 in a time-series manner. The storage device 32 stores image data 32A, setting data 32B, and the like to be reproduced by the display device 10. The image data 32A includes, for example, information indicating a set of images when an observer observes a three-dimensional object from all angles. The setting data 32B includes, for example, information regarding the area and coordinates set for the observer's eye 201. The setting data 32B includes, for example, information for setting the area using the viewpoint position as a reference.

[0037] The control unit 33 controls the information processing device 30. The control unit 33 includes various processing units, namely, a designation unit 331, a setting unit 332, a display control unit 333, and a detection unit 334. In the present embodiment, the various processing units of the control unit 33 (including the designation unit 331, the setting unit 332, the display control unit 333, and the detection unit 334) are implemented, for example, by a central processing unit (CPU), a microcontroller unit (MCU), or the like, which executes a program stored in the information processing device 30 by using a random access memory (RAM) or the like as a work area. In addition, for example, the various processing units can be implemented by an integrated circuit such as an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA).

[0038] The specifying unit 331 specifies the viewpoint position of the observer 200 of the display device 10 displaying the three-dimensional object. The specifying unit 331 specifies the viewpoint position based on, for example, the measurement results of the measuring device 20 acquired via the communication unit 31. The specifying unit 331 can specify the viewpoint position using various known techniques. For example, the specifying unit 331 specifies information related to the position of the observer 200's eyes 201 and the distance from the measuring device 20 based on the measurement results of the measuring device 20, and then specifies the viewpoint positions of the observer 200's left and right eyes based on the specified information. The viewpoint position indicates the position in the viewpoint coordinate system set for the observer 200. Furthermore, the specifying unit 331 can specify the direction of the observer's right eye's line of sight based on, for example, a captured image of the observer's right eye and its positional relationship to the right eye. Similarly, the specifying unit 331 can specify the direction of the observer's left eye's line of sight based on a captured image of the observer's left eye and its positional relationship to the left eye.

[0039] The specifying unit 331 can specify the position of the liquid crystal panel 11 to be visually recognized based on the position of the eye 201 of the observer 200. The specifying unit 331 can include the specified accuracy of the viewpoint position of the observer 200 in the specified result. For example, if the position of the eye 201 of the observer 200 cannot be determined based on an image, etc., and the viewpoint position has been estimated based on the position and shape of the observer 200's head, etc., the specifying unit 331 can include information indicating low specified accuracy in the specified result. For example, if the accuracy of the measuring device 20 includes uncertainty and has a certain probability distribution, the specifying unit 331 can specify the position, range, etc. where the viewpoint is likely to be located by using the probability as a weight. The specifying unit 331 then stores the specified viewpoint position of the observer 200 in the storage device 32 and also outputs the viewpoint position to the setting unit 332.

[0040] Setting unit 332 uses the viewpoint position specified by specifying unit 331 as a reference to set an area that enables observer 200 to view a three-dimensional object stereoscopically. Setting unit 332 sets an area around the viewpoint position that enables observer 200 to view the three-dimensional object stereoscopically even if the viewpoint position of observer 200 is slightly off. For example, setting unit 332 can set an area with a pre-set size using the viewpoint position of observer 200 as a reference. For example, setting unit 332 can set an area that changes depending on observer 200 using the viewpoint position of observer 200 as a reference. For example, setting unit 332 can set an area that surrounds observer 200's eye 201 with the viewpoint position as the center. This area includes, for example, a plane or a three-dimensional space. For example, setting unit 332 can set an area with a size that changes depending on the display capabilities of display device 10, the specifications of information processing device 30, etc. For example, the setting unit 332 may set a first region having a wider range when the observer 200 tends to move the viewpoint more frequently, and may set a second region having a size smaller than that of the first region when the observer 200 tends to move the viewpoint less frequently. The setting unit 332 then stores information indicating the set regions in the storage device 32 and also outputs the region information to the display control unit 333.

[0041] In this embodiment, the setting unit 332 has been described as setting two areas corresponding to the left and right eyes of the observer 200. However, this is not restrictive. For example, the setting unit 332 may set a single area that includes both the left and right eyes of the observer 200. For example, if reproducing light rays from either the left or right eye of the observer 200 is sufficient, the setting unit 332 may set an area that uses the viewpoint position of one eye 201 as a reference. Furthermore, the setting unit 332 may reduce the number of rays to be reproduced by imposing restrictions on the size, dimensions, etc. of each area.

[0042] The display control unit 333 controls the display device 10 to emit a set of light rays that enables stereoscopic viewing of a three-dimensional object from within the area set by the setting unit 332, and that prevents stereoscopic viewing of the three-dimensional object from outside the area. In other words, the display control unit 333 enables the observer 200 to visually recognize the three-dimensional object by using light rays from the set of light rays emitted from the display device 10 that pass through the interior of the area. For example, the display control unit 333 may control the display device 10 to successively emit different light rays toward the interior of the area. The display control unit 333 may employ a scheme that changes the area in which the light rays are to be reproduced by performing signal processing. For example, the display control unit 333 calculates what value each pixel of the display device 10 should output and controls the display device 10 based on the calculation result. As a result, the display device 10 regenerates the pixel value from the display control unit 333 and emits light rays corresponding to the pixel value. Note that an example of calculating pixel values ​​will be described later.

[0043] Furthermore, the display control unit 333 compares the group of rays passing through the area from the display device 10 with the group of virtual rays intended to reproduce the three-dimensional object, and reflects the comparison result in the group of rays to be emitted by the display device. The display control unit 333 simulates rays passing through the area from the group of rays emitted by the display device 10, compares the simulated rays passing through the area with the group of virtual rays, and causes the display device 10 to emit a group of rays based on pixel values ​​that minimize errors. For example, the display control unit 333 performs a simulation to obtain a group of rays passing through the area in the current state and a group of virtual rays to be reproduced, and then compares them. If a difference is found as a result of the comparison, the display control unit 333 determines a pixel value that eliminates the difference.

[0044] The detection unit 334 detects movement of the viewpoint of the observer 200. For example, the detection unit 334 compares the viewpoint position specified by the specification unit 331 with the previous viewpoint position. If these viewpoint positions are different from each other or the amount of viewpoint movement is greater than or equal to a threshold value, the detection unit 334 detects that the viewpoint has moved. For example, the detection unit 334 compares the viewpoint position specified by the specification unit 331 with the area set by the setting unit 332. If the viewpoint position is outside the area or outside the near area, the detection unit 334 detects that the viewpoint has moved.

[0045] The configuration example of the information processing apparatus 30 according to this embodiment has been described above. Figure 2 The described configuration is merely an example, and the configuration of the information processing apparatus 30 according to the present embodiment is not limited to this example. The functional configuration of the information processing apparatus 30 according to the present embodiment can be flexibly changed according to specifications or operations.

[0046] [Method of Reproducing Light by Performing Signal Processing According to an Embodiment]

[0047] Figure 3 3 is a diagram for explaining viewpoint positions in the information processing device 30 according to the embodiment. Figure 3 The xy coordinate system shown defines plane coordinates on the surface of the liquid crystal panel 11 of the display device 10. The xy coordinate system is an example of a display coordinate system. The xy coordinate system has an x-axis in the horizontal direction along the long side of the liquid crystal panel 11 of the display device 10, and a y-axis in the vertical direction along the short side of the liquid crystal panel 11. The st coordinate system is a coordinate system that passes through the left eye and right eye 201 of the observer 200 separated from the display device 10 by a distance d and is parallel to the xy coordinate system. The st coordinate system is an example of a viewpoint coordinate system. The st coordinate system is a plane coordinate defined at the depth of the viewpoint of the observer 200 separated from the display device 10 by a distance d. The st coordinate system has an s-axis in the horizontal direction and a t-axis in the vertical direction.

[0048] In a three-dimensional space, two plane coordinates (xy coordinate system and st coordinate system) have been defined, and therefore, all rays propagating around in the space can be represented. For example, a ray passing through a point (x', y') in the xy coordinate system and a point (s, t) in the st coordinate system is represented as R(x', y', s, t). In the following description, in the description of distinguishing the coordinate positions of the left eye and the right eye 201 from each other, the point (s l , t l ) and point (s r , t r ).

[0049] Next, define the correspondence between the light rays transmitted around in space and the pixels of the display device 10. The display device 10 can adopt, for example, a panel stacking scheme, a projector array scheme, a parallax barrier / lens array scheme, etc. The correspondence between the light rays and the pixels of the display device 10 changes according to the scheme, and therefore in this embodiment, the details of the correspondence are not described for the sake of generality. Then, assuming that the pixel set of the display device 10 is P, the transformation function from the above P to the light rays is defined as f(P), and assuming that the correspondence between each light ray and the pixel of the display device 10 is expressed as formula (1). Formula (1) indicates that if R(x', y', s, t) is obtained, f(P) is obtained, and if f(P) is obtained, R(x', y', s, t) is obtained.

[0050] R(x, y, s, t) <=> f(P) Formula (1)

[0051] Next, faithful reproduction of only the specified light rays is formulated as an optimization problem. Assume that in the viewpoint position measured by the measuring device 20, the position coordinate of the left eye is point (s l , t l ), and the position coordinates of the right eye are point (s r , t r ). If it is assumed that the range in which light is to be reproduced is a range of ±r from the position of each of the left and right eyes 201, the optimization problem is expressed as formula (2).

[0052] [Formula (2)]

[0053]

[0054] In formula (2), R(x, y, s, t) is the brightness value of the light to be reproduced given as input. X and Y correspond to the horizontal width and vertical width of the liquid crystal panel 11 in the xy coordinate system, respectively. In other words, formula (2) is an optimization problem that makes it possible to optimize all the light rays that pass through (x: [0, X], y: [0, Y]) on the liquid crystal panel 11 and pass through the peripheral area of ​​the left eye (s: [s l -r,s l +r],t:[t l -r,t l +r]) or the peripheral area of ​​the right eye (s: [s r -r,s r +r],t:[t r -r,t r The error between the light reproduced by the display device 10 and the light to be reproduced in the light group of [R] is minimized.

[0055] The solution to the optimization problem is obtained according to a technique based on a gradient effect. Specifically, the information processing device 30 simulates the light that will be reproduced in the current state (step S1). Then, the information processing device 30 compares the light group to be reproduced given as input and calculates the error (step S2). Then, if the error is less than or equal to a specific value, the information processing device 30 terminates the calculation. If the error exceeds a specific value, the information processing device 30 updates the pixel value in such a way that the error becomes smaller, and the processing returns to step S1. Then, the information processing device 30 can update the pixel value only in the area E which is the peripheral area of ​​the viewpoint of the observer 200 by reflecting the finally obtained pixel value P' of the display device 10 in the display device 10. l and E r In other words, by using the viewpoint position of the observer 200 as a reference, the region E l and E rThis serves as a region that enables the observer 200 to stereoscopically view a three-dimensional object.

[0056] Figure 4 is a diagram showing the relationship between the area and the rays that the information processing apparatus 30 according to the embodiment has set by using the viewpoint position as a reference. Figure 4 In FIG. 1 , the stu coordinate system has an s-axis indicating a horizontal direction, a t-axis indicating a vertical direction, and a u-axis indicating a depth. Depth refers to a direction toward the display device 10 .

[0057] exist Figure 4 In the example shown, the information processing device 30 has already obtained the viewpoint position EP of the left eye of the observer 200 by using l Set area E as a reference l In this case, the information processing device 30 directs the light beam group L from the point (x', y') in the xy coordinate system of the liquid crystal panel 11 toward the region E. l The light group L is such that it can be emitted from the area E l The light group L includes the light rays passing through the area E. l The light of the interior.

[0058] Furthermore, the information processing device 30 may or may not allow light to travel from the point (x', y') of the liquid crystal panel 11 toward the region E. l For example, the information processing device 30 may emit a light group that does not allow a three-dimensional object to be viewed stereoscopically and indicates the same image. Figure 4 In the example shown, the light and region E corresponding to the right eye of the observer 200 are omitted for simplicity of description. r However, similarly to the left eye, the information processing apparatus 30 causes the display device 10 to face the area E. r Emitting ray groups.

[0059] exist Figure 4 In the example shown, it has been described that the information processing apparatus 30 sets the cubic space as the area E. l For example, the information processing device 30 may set a substantially spherical space or a plane as the region.

[0060] Figure 5 is a diagram for explaining a group of rays reproduced by the information processing apparatus 30 according to the embodiment. For example, compared to a parallax scheme for visually recognizing an object as if it were popped out or located at the back, the display device 10 of the light field scheme makes the object visually recognized as if it were present inside the display device 10. Figure 5In the reference example Ex, the light field reproduction device 300 emits multiple light rays emitted from a three-dimensional image representing an apple. To expand the horizontal viewing angle of stereoscopic vision, the light field reproduction device 300 is required to emit the multiple light rays to be reproduced over a wide range. For example, to emit 100 light rays, the display device 10 is required to simultaneously display 100 images. Therefore, to reproduce light rays in all three dimensions, the light field reproduction device 300 must have high resolution capable of simultaneously displaying video from hundreds to thousands of viewpoints, or it must be a large-scale device.

[0061] The information processing apparatus 30 according to the embodiment limits the light group L to be reproduced by the display device 10 to the peripheral area of ​​the viewpoint position EP of the observer 200, as shown in FIG. Figure 5 By doing so, the information processing device 30 can prevent the visibility from being reduced due to the movement of the observer 200, and can also reduce the number of rays of the ray group L to be reproduced. Then, as Figure 5 As shown in the mode M2, the display device 10 can emit the light group L for stereoscopic vision only to the peripheral area of ​​the viewpoint position EP of the observer 200, and emit light that makes stereoscopic vision impossible to perform to an area different from the peripheral area.

[0062] [Relationship between Light and Observer in Display Device According to Embodiment]

[0063] Figure 6 is a diagram for explaining an example of the relationship between light, images, and viewpoint positions in the information processing device 30 according to the embodiment. Figure 6 In the example shown, the display device 10 displays an image G. The image G includes, for example, a moving image, a still image, or the like. The image G is an image including a vehicle located behind and a person located in front of the vehicle. The image G is an image for reproducing the light emitted by the vehicle and the person. Then, in the observer 200 observing the display device 10, the viewpoint position EP of the left eye l Located at point (2, t) on the s-axis of the st coordinate system, and the viewpoint position EP of the right eye r Located at point (6, t) on the s-axis of the st coordinate system. Note that Figure 6 In the example shown, to simplify the description, the coordinates on the t-axis of the st coordinate system are fixed.

[0064] The information processing apparatus 30 causes the specifying unit 331 to specify the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l and EP r The information processing device 30 causes the setting unit 332 to set the corresponding viewpoint position EP by using l and EP r Set area E as a referencel and E r Specifically, the information processing device 30 uses the viewpoint position EP of the left eye l The point (2, t) is used as the center (reference) and the range from point (1, t) to point (3, t) is set as region E. l Then, the information processing device 30 uses the viewpoint position EP of the right eye r The area from point (5, t) to point (7, t) is set as region E with point (6, t) as the center. r In this case, the information processing apparatus 30 performs control so that the display device 10 emits the image data from the area E. l and E r The image G is viewed stereoscopically from the interior of the area E, and the image G is not viewed stereoscopically from the interior of the area E. l and E r The light group L of the image G is viewed stereoscopically from the outside.

[0065] For example, the display device 10 causes a light group L including light rays L1, L2, and L3 and a light group L including light rays L5, L6, and L7 to be emitted. Light ray L1 is a light ray indicating an image G1 in a case where the observer 200 performs visual recognition from the point (1, t). Light ray L2 is a light ray indicating an image G2 in a case where the observer 200 performs visual recognition from the point (2, t). Light ray L3 is a light ray indicating an image G3 in a case where the observer 200 performs visual recognition from the point (3, t). Light ray L5 is a light ray indicating an image G5 in a case where the observer 200 performs visual recognition from the point (5, t). Light ray L6 is a light ray indicating an image G6 in a case where the observer 200 performs visual recognition from the point (6, t). Light ray L7 is a light ray indicating an image G7 in a case where the observer 200 performs visual recognition from the point (7, t). Note that the images G1 , G2 , G3 , G5 , G6 , and G7 are respectively different images from each other in the case of being observed from different viewpoints from each other, and are respectively images indicated by different rays that have been emitted by a vehicle and a person.

[0066] exist Figure 6 In the example shown, the observer 200 can stereoscopically view the vehicle and the person by visually recognizing the image G2 with the left eye and visually recognizing the image G6 with the right eye. Then, in the observer 200, for example, assuming that the viewpoint position EP of the left eye l The camera has moved to point (1, t), and the viewpoint of the right eye is EP r The image G1 has been moved to the point (5, t) on the s-axis of the st coordinate system. In this case, the observer 200 can stereoscopically view the vehicle and the person by using the left eye to visually recognize the image G1 and the right eye to visually recognize the image G5. Then, in the observer 200, for example, assuming that the viewpoint position EP of the left eye is lThe camera has moved to point (0, t), and the viewpoint of the right eye is EP r has moved to the point (4, t) on the s-axis of the st coordinate system. In this case, the viewpoint position EP of the left eye l Moved to area E l , and therefore the observer 200 cannot visually recognize the light group in which the light indicating the image G has been reproduced. In addition, the viewpoint position EP of the right eye r Moved to area E r , and thus the observer 200 cannot visually recognize the light group in which the light indicating the image G has been reproduced. As a result, it becomes difficult for the observer 200 to stereoscopically view the image G of the display device 10.

[0067] Next, refer to Figure 7 An example of a processing procedure of the information processing apparatus 30 according to the embodiment is described. Figure 7 is a flowchart illustrating an example of a processing procedure performed by the information processing apparatus 30 according to the embodiment. Figure 7 The processing procedures shown in FIG. 1 are implemented by the control unit 33 of the information processing device 30 executing the program.

[0068] like Figure 7 As shown, the control unit 33 of the information processing apparatus 30 specifies the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l and EP r (Step S101) For example, the control unit 33 acquires measurement information from the measurement device 20 via the communication unit 31, and specifies the viewpoint position EP of the observer 200 based on the measurement information. l and EP r The control unit 33 functions as the specifying unit 331 by executing the process of step S101. When the process of step S101 has terminated, the process of the control unit 33 proceeds to step S102.

[0069] The control unit 33 uses the viewpoint position EP l and EP r For reference, the area E corresponding to the left eye and the right eye 201 of the observer 200 is set. l and E r (Step S102) For example, the control unit 33 specifies the areas E corresponding to the left and right eyes 201 by using various known techniques. l and E r , and will indicate area E l and E rThe area information of is stored in the storage device 32. By executing the process of step S102, the control unit 33 functions as the setting unit 332. When the process of step S102 has terminated, the process of the control unit 33 proceeds to step S103.

[0070] The control unit 33 controls the display device 10 to emit a light group that passes through the set area (step S103). For example, the control unit 33 determines the pixel value of the display device 10 for emitting the light group to be reproduced based on the image data 32A of the storage device 32, and issues an instruction to the display device 10 to display based on the pixel value. As a result, the display device 10 emits the light group based on the pixel value indicated by the instruction. When the processing of step S103 is terminated, the control unit 33 proceeds to step S104.

[0071] The control unit 33 specifies the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l and EP r (Step S104) Then, the control unit 33 calculates the viewpoint position EP based on the specified viewpoint position EP. l and EP r and the previous viewpoint position EP l and EP r Detect the movement of the viewpoint position (step S105). For example, after the designated viewpoint position EP has been detected l and EP r With the previous viewpoint position EP l and EP r When the difference between the two is a viewpoint movement amount greater than or equal to the threshold, the control unit 33 detects the viewpoint position EP l and EP r For example, at the specified viewpoint position EP l and EP r With the previous viewpoint position EP l and EP r Different, and the specified viewpoint position EP l and EP r Located near Area E l and E r In the case of external, the control unit 33 detects the viewpoint position EP l and EP r The control unit 33 functions as a detection unit 334 by executing the process of step S105. The control unit 33 stores the detection result including whether the movement of the viewpoint position has been detected, the viewpoint position EP at which the movement has been detected, and the position of the viewpoint EP at which the movement has been detected in the storage device 32. l and EP r etc., and the process proceeds to step S106.

[0072] The control unit 33 determines whether the viewpoint position EP has been detected based on the detection result of step S105. l and EP r The control unit 33 has determined that the viewpoint position EP has not been detected. l and EP r In the case of movement (No in step S106), the viewpoint of the observer 200 has not moved, and therefore the process proceeds to step S113 described later. In addition, when the control unit 33 determines that the viewpoint position EP has been detected l and EP r In the case of movement (YES in step S106), the processing proceeds to step S107.

[0073] The control unit 33 uses the viewpoint position EP after the movement l and EP r For reference, the area E corresponding to the left eye and the right eye 201 of the observer 200 is set. l and E r (Step S107) The control unit 33 functions as the setting unit 332 by executing the process of step S107. When the process of step S107 has terminated, the process of the control unit 33 proceeds to step S108.

[0074] The control unit 33 simulates the current group of rays passing through the set area (step S108). For example, the control unit 33 performs a simulation in which a transformation is performed from a set P of pixel values ​​already displayed on the display device 10 or updated pixel values ​​into a group of rays, and the correspondence between each ray and a pixel of the display device 10 is calculated. In the simulation, for example, the correspondence between each ray and a pixel of the display device 10 is calculated according to the method for reproducing rays described above. When the control unit 33 has stored the simulation results in the storage device 32, the process proceeds to step S109.

[0075] The control unit 33 compares the current light group with the virtual light group to be reproduced and calculates the error (step S109). For example, the control unit 33 calculates the light passing through the area E based on the image data 32A of the storage device 32. l and E r The virtual ray group to be reproduced is obtained. The control unit 33 then compares the current ray group calculated in step S108 with the virtual ray group and calculates an error. For example, as the degree of match between the current ray group and the virtual ray group increases, the control unit 33 calculates a smaller error, and as the degree of match decreases, the control unit 33 calculates a larger error. When the process of step S109 is terminated, the control unit 33 proceeds to step S110.

[0076] The control unit 33 determines whether the error satisfies a change condition (step S110). The change condition includes, for example, a condition such as a threshold value or a range for determining a change in the light group. If the control unit 33 has determined that the error satisfies the change condition (yes in step S110), the process proceeds to step S111. The control unit 33 updates the pixel values ​​of the display device 10 in such a manner that the error becomes smaller (step S111). For example, the control unit 33 determines the pixel values ​​of the display device 10 for causing the light group to be reproduced to be emitted based on the image data 32A of the storage device 32, and performs the update. When the process of step S111 has terminated, the process of the control unit 33 returns to step S108, which has been described above, and the process of step S108 and subsequent processes continues.

[0077] In addition, in the case where the control unit 33 determines that the error does not satisfy the change condition (No in step S110), the process proceeds to step S112. The control unit 33 reflects the error corresponding to the area E in the display device 10. l and E r For example, the control unit 33 issues an instruction to the display device 10 for displaying based on the pixel value updated in step S111. As a result, the display device 10 directs the light beam group based on the pixel value indicated by the instruction toward the moved area E. l and E r Then, when the process of step S112 has been terminated, the process of the control unit 33 proceeds to step S113.

[0078] The control unit 33 determines whether the processing will be terminated (step S113). For example, in the case where the power of the display device 10 that has received the termination request from the observer 200 or the like has been turned off, the control unit 33 determines that the processing will be terminated. In the case where the control unit 33 has determined that the processing will not be terminated (No in step S113), the processing returns to step S104 that has been described, and the processing procedures of step S104 and subsequent processing are continued. In addition, in the case where the control unit 33 has determined that the processing will be terminated (Yes in step S113), Figure 7 The processing shown in is terminated.

[0079] exist Figure 7 In the illustrated processing procedure, the control unit 33 functions as the display control unit 333 by executing the processing of step S103 and step S108 to step S112.

[0080] [Operation of Display System According to Embodiment]

[0081] Next, refer to Figure 8An example of the operation of the display system 100 according to the embodiment is described. Figure 8 is a diagram for explaining the relationship between light, images, and viewpoint positions in the information processing apparatus 30 according to the embodiment. Figure 8 In the example shown, the display device 10 displays Figure 6 The image G shown in Figure 8 In the scene SN1 shown, the viewpoint position EP of the left eye of the observer 200 observing the display device 10 is l The point (2, t) is located on the s-axis of the st coordinate system, and the viewpoint position EP of the right eye is r The point (6, t) is located on the s-axis of the st coordinate system. Figure 8 In the example shown, to simplify the description, the coordinates on the t-axis of the st coordinate system are fixed.

[0082] In the scene SN1, the information processing apparatus 30 causes the specifying unit 331 to specify the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l and EP r The information processing device 30 causes the setting unit 332 to set the corresponding viewpoint position EP by using l and Ep r Set area E as a reference l and E r Specifically, the information processing device 30 uses the viewpoint position EP of the left eye l The point (2, t) is used as the center (reference) and the range from point (1, t) to point (3, t) is set as region E. l Then, the information processing device 30 uses the viewpoint position EP of the right eye r The area from point (5, t) to point (7, t) is set as region E with point (6, t) as the center. r In this case, the information processing apparatus 30 performs control so that the display device 10 emits the image data from the area E. l and E r The image G is viewed stereoscopically from the interior of the area E, and the image G is not viewed stereoscopically from the interior of the area E. l and E r The light group L of the image G is viewed stereoscopically from the outside.

[0083] In the scene SN1, the observer 200 stereoscopically views the vehicle and the person by recognizing the image G2 with the left eye and recognizing the image G6 with the right eye. In this state, the observer 200 sets the viewpoint position EP of the left eye to l Move from point (2, t) to point (3, t), and change the viewpoint position of the right eye to EP r Move from point (6, t) to point (7, t).

[0084] In scene SN2, the observer 200 has set the viewpoint position of the left eye to EP l and the right eye's viewpoint position EP r Move to area E respectively l Point (3, t) and region E r In this case, the observer 200 stereoscopically views the vehicle and the person by recognizing the image G3 offset from the point (2, t) using the left eye vision and recognizing the image G7 offset from the point (6, t) using the right eye vision.

[0085] In the scene SN2, the information processing apparatus 30 causes the specifying unit 331 to specify the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l is point (3, t), and the viewpoint position EP r The information processing device 30 causes the detection unit 334 to detect the viewpoint position EP of the left eye. l has moved from point (2, t) to point (3, t), and the viewpoint position EP of the right eye r has moved from point (6, t) to point (7, t). The information processing device 30 causes the setting unit 332 to set the corresponding viewpoint position EP by using l and EP r Set area E as a reference l ' and E r Specifically, the information processing device 30 uses the viewpoint position EP of the left eye l The point (3, t) is used as the center (reference) and the range from point (2, t) to point (4, t) is set as region E. l Then, the information processing device 30 takes the viewpoint position EP of the right eye as the r The area from point (6, t) to point (8, t) is set as region E with point (7, t) as the center. r The information processing device 30 compares the current light group L with the virtual light group to be reproduced and calculates an error. The information processing device 30 updates the pixel value of the display device 10 in such a manner that the error becomes smaller.

[0086] In the scene SN3, the information processing device 30 reflects the updated pixel value in the display device 10. In other words, the information processing device 30 performs control so that the display device 10 emits the pixel value that can be updated from the area E. l ' and E r 'The image G is viewed stereoscopically from the interior, and it is not possible to see from the area E l ' and E r As a result, the display device 10 is directed toward the deviation area E. l and Er Area E l ' and E r 'A ray group L' including the rays L2, L3 and L4 of the images G2, G3 and G4 and a ray group L' including the rays L6, L7 and L8 of the images G6, G7 and G8 are emitted.

[0087] In the scene SN3, the observer 200 stereoscopically views the vehicle and the person by visually recognizing the image G3 with the left eye and visually recognizing the image G7 with the right eye. l and EP r Having moved, the observer 200 can also stereoscopically view the image G by using the light groups L and L′ of the display device 10 .

[0088] As described above, the information processing device 30 according to this embodiment causes the designation unit 331 to designate the viewpoint position EP of the observer 200, and then causes the setting unit 332 to set an area E in which the observer 200 can stereoscopically view a three-dimensional object, using the viewpoint position EP as a reference. The information processing device 30 causes the display control unit 333 to control the display device 10 to emit a set of light rays that enables stereoscopic viewing of the three-dimensional object from within the area E set by the setting unit 332, but prevents stereoscopic viewing from outside the area E. By doing so, it is sufficient for the information processing device 30 to cause the display device 10 to emit a set of light rays that enables stereoscopic viewing of the three-dimensional object toward the interior of the area E set to correspond to the viewpoint position EP of the observer 200. As a result, the range in which the light rays of the three-dimensional object are reproduced can be limited. Therefore, even while the processing load associated with emitting light rays is reduced, the information processing device 30 can enable the observer 200 to visually recognize a stereoscopic image using the light rays emitted by the display device 10. Furthermore, the area E can be set using the viewpoint position of the observer 200 as a reference. Even if the viewpoint position is slightly off, the information processing device 30 can enable the observer 200 to visually recognize a stereoscopic image by setting the area E according to the movement of the observer 200's head. In other words, by using the group of light rays emitted by the display device 10 to the restricted area E, the information processing device 30 can provide the observer 200 with a depth perception similar to that obtained when light rays are emitted omnidirectionally. Furthermore, even without using a display device that can emit light omnidirectionally, the information processing device 30 can achieve a reproduction range with a wide field of view and a wide depth.

[0089] Furthermore, the information processing apparatus 30 calculates the pixel value of the display device 10 for emitting the light rays L passing through the interior of the region E toward the observer 200, and causes the display control unit 333 to control the display device 10 based on the pixel value. By doing so, the pixel value of the display device 10 for only the region E is calculated, and therefore, the information processing apparatus 30 can control the display device 10 based on the pixel value. As a result, in the information processing apparatus 30, the processing load for controlling the display device 10 is reduced, and this makes it possible to reduce the cost of the display system.

[0090] Furthermore, when the detection unit 334 detects movement of the viewpoint EP of the observer 200, the information processing device 30 causes the setting unit 332 to set an area E using the moved viewpoint EP as a reference. Once the setting unit 332 has set the area E based on the viewpoint's movement, the information processing device 30 causes the display control unit 333 to control the display device 10 to emit a group of light rays L that enables stereoscopic viewing of a three-dimensional object from within the area E. By doing so, the information processing device 30 resets the area E based on the detection of the movement of the viewpoint EP of the observer 200 and causes the display device 10 to emit the group of light rays L toward the moved area E. As a result, the information processing device 30 can adjust the area E based on the movement of the viewpoint EP of the observer 200 to adjust the observer's focus and maintain stereoscopic vision. Consequently, a decrease in visibility can be prevented.

[0091] Furthermore, when the detection unit 334 detects movement of the viewpoint position EP from the inside to the outside of the region E, the information processing device 30 causes the setting unit 332 to set the region E using the post-movement viewpoint position EP as a reference. By doing so, when the viewpoint position EP of the observer 200 located inside the region E has moved toward the outside of the region E, the information processing device 30 can reset the region E using the post-movement viewpoint position EP as a reference. As a result, even if the viewpoint position EP has moved outside the region E, the information processing device 30 can reset the region E and maintain the stereoscopic vision performed by the observer 200. Consequently, a decrease in visibility can be prevented.

[0092] Furthermore, when the setting unit 332 has set the area E in accordance with the movement of the viewpoint position EP, the information processing device 30 compares the current ray group L passing through the area E with the virtual ray group for reproducing the three-dimensional object, and reflects the comparison result in the ray group L to be emitted from the display device 10. By doing so, when the area E has been reset, the information processing device 30 can reflect the result of the comparison between the current ray group L and the virtual ray group in the ray group L to be emitted from the display device 10. As a result, it is sufficient for the information processing device 30 to control the display device 10 based on the result of the comparison between the current ray group L and the virtual ray group. This makes it possible to reduce the processing load associated with controlling the ray group L to be emitted from the display device 10.

[0093] Furthermore, the information processing apparatus 30 calculates the current light group L that passes through the area E from the display device 10. If the error between the calculated current light group L and the virtual light group satisfies the change condition, the light group L to be emitted from the display device 10 is changed so that the error becomes smaller. By doing so, the information processing apparatus 30 can change the light group L to be emitted from the display device 10 based on the error between the current light group L and the virtual light group. Consequently, it is sufficient for the information processing apparatus 30 to control the display device 10 based on the error between the current light group L and the virtual light group. This makes it possible to reduce the processing load associated with controlling the light group L to be emitted from the display device 10.

[0094] The above embodiment has described an example, and various changes and applications can be made. For example, the information processing device 30 according to the embodiment can be based on the viewpoint position EP of the observer 200. l and EP r Various areas are set according to the movement status of the observer, the number of observers 200, etc.

[0095] [Variation (1) of the embodiment]

[0096] Figure 9 : is a diagram for explaining the relationship between rays, regions, and viewpoint positions in the information processing device 30 in the modification (1) of the embodiment. Figure 9 In the example shown, the display device 10 displays Figure 6 The image G shown in Figure 9 In the example shown, in the observer 200 observing the display device 10, the viewpoint position EP of the left eye l The point (2, t) is located on the s-axis of the st coordinate system, and the viewpoint position EP of the right eye is r The point (6, t) is located on the s-axis of the st coordinate system. Figure 9 In the example shown, to simplify the description, the coordinates on the t-axis of the st coordinate system are fixed.

[0097] The information processing apparatus 30 causes the specifying unit 331 to specify the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l and EP r The information processing device 30 causes the setting unit 332 to set the viewpoint position EP on the s axis by using l and EP r The range from point (1, t) to point (7, t) is set as region E with the center of the image as a reference. Then, the information processing apparatus 30 causes the display control unit 333 to perform control so that the display device 10 emits a light group L that enables the image G to be stereoscopically viewed from inside the region E and disables the image G from being stereoscopically viewed from outside the region E. By doing so, the display device 10 causes the light group L including the light rays L1, L2, L3, L4, L5, L6, and L7 to be emitted toward the region E.

[0098] exist Figure 9 In the example shown, the observer 200 can stereoscopically view the vehicle and the person by visually recognizing the image G2 with the left eye and visually recognizing the image G6 with the right eye. Then, in the observer 200, for example, assuming that the viewpoint position EP of the left eye l The camera has moved to point (1, t), and the viewpoint of the right eye is EP r The image G1 has been moved to the point (5, t) on the s-axis of the st coordinate system. In this case, the observer 200 can stereoscopically view the vehicle and the person by using the left eye to visually recognize the image G1 and the right eye to visually recognize the image G5. Then, in the observer 200, for example, assuming that the viewpoint position EP of the left eye is l The camera has moved to point (0, t), and the viewpoint of the right eye is EP r has moved to the point (4, t) on the s-axis of the st coordinate system. In this case, the viewpoint position EP of the left eye l Moved to area E l , and therefore the observer 200 cannot visually recognize the light group in which the light indicating the image G has been reproduced. In addition, the viewpoint position EP of the right eye r Moved to area E r , and thus the observer 200 cannot visually recognize the light group in which the light indicating the image G has been reproduced. As a result, it becomes difficult for the observer 200 to stereoscopically view the image G of the display device 10.

[0099] As described above, the information processing apparatus 30 according to the embodiment causes the setting unit 332 to set the viewpoint position EP including both eyes of the observer 200 that has been specified by the specifying unit 331. l and EP rBy doing so, the information processing device 30 can obtain the single area E of the viewpoint position EP by using l and EP r A single area E is set as a reference. As a result, the light group L is reproduced in the single area, and thus the information processing device 30 can further reduce the processing load.

[0100] [Variation (2) of the embodiment]

[0101] Figure 10 : is a diagram for explaining the relationship between rays, regions, and viewpoint positions in the information processing apparatus 30 in the modification (2) of the embodiment. Figure 10 In the example shown, the display device 10 displays Figure 6 The image G shown in Figure 10 In the example shown, in the observer 200 observing the display device 10, the viewpoint position EP of the left eye l The point (2, t) is located on the s-axis of the st coordinate system, and the viewpoint position EP of the right eye is r The point (6, t) is located on the s-axis of the st coordinate system. Figure 10 In the example shown, to simplify the description, the coordinates on the t-axis of the st coordinate system are fixed.

[0102] exist Figure 10 In the example shown, the observer 200 points his head to the right-hand side in front of the display device 10. In this case, the measurement device 20 outputs measurement information indicating that the left eye of the observer 200 can be measured but the right eye cannot be measured to the information processing apparatus 30.

[0103] The specifying unit 331 of the information processing device 30 specifies the viewpoint position EP of the left eye of the observer 200 l is point (2, t), and the viewpoint position EP of the right eye is estimated based on point (2, t) r , and thus the specifying unit 331 specifies the viewpoint position EP r In this case, the designation unit 331 compares the low precision of the designation of the right eye with the viewpoint position EP. r and the viewpoint position EP of the observer 200 l and EP r Output to setting unit 332.

[0104] The setting unit 332 of the information processing device 30 sets the viewpoint position EP based on the viewpoint position EP specified by the specifying unit 331. l and EP r The area E having different sizes is set with the accuracy l and E r For example, the setting unit 332 takes the viewpoint position EP of the left eye asl The point (2, t) is used as the center (reference) and the range from point (1, t) to point (3, t) is set as region E. l Then, the viewpoint position EP of the right eye r The designation accuracy of the right eye is low, and therefore the setting unit 332 sets the area E of the right eye to r Set the area E larger than the left eye l Specifically, the setting unit 332 sets the viewpoint position EP of the right eye. r The area from point (4, t) to point (8, t) is set as region E with point (6, t) as the center. r .

[0105] The display control unit 333 performs control so that the display device 10 emits a signal that can be viewed from the area E. l and E r The image G is viewed stereoscopically from the interior of the area E, and the image G is not viewed stereoscopically from the interior of the area E. l and E r Specifically, the display control unit 333 causes the display device 10 to face the area E. l The light group L including the light L1, L2 and L3 is emitted and directed to the area E. r The light group L' including the light rays L4, L5, L6, L7 and L8 is emitted. As a result, the observer 200 can stereoscopically view the vehicle and the person by recognizing any one of the images G1 to G3 using the left eye vision and any one of the images G4 to G8 using the right eye vision.

[0106] As described above, the information processing apparatus 30 according to the embodiment is configured to process the viewpoint position EP based on the viewpoint position EP that has been specified by the specifying unit 331. l and EP r The area E having different sizes is set with the accuracy l and E r By doing so, regions E having sizes different from each other are set. l and E r , and thus the information processing apparatus 30 can cause the display device 10 to emit light suitable for the area E l and E r As a result, even if the orientation of the head of the observer 200 changes or moves, the information processing device 30 can adjust the focus of the observer 200 and maintain stereoscopic vision. Therefore, it is possible to prevent degradation of visibility.

[0107] Note that at the viewpoint position EP of both eyes of the observer 200 l and EP rIf the designation accuracy of both is low, the information processing device 30 in the modification (2) of the embodiment may select the area E as l and E r Both are set to be wider than the area E in the case where the specified accuracy is high l and E r Alternatively, the information processing device 30 may set a value including the viewpoint position EP l and EP r A single area for both.

[0108] [Variation (3) of the embodiment]

[0109] Figure 11 : is a diagram for explaining the relationship between rays, regions, and viewpoint positions in the information processing apparatus 30 in the modification (3) of the embodiment. Figure 11 In the example shown, the display device 10 displays Figure 6 The image G shown in Figure 11 In the scene SN11 shown, the observer 200 is observing the display device 10 in a stationary state. In other words, the viewpoint position EP of the observer 200 is l and EP r In the static state with a small range of movement. In the observer 200, the viewpoint position EP of the left eye l Located at point (2, t) on the s-axis of the st coordinate system, and the viewpoint position EP of the right eye r Located at point (6, t) on the s-axis of the st coordinate system. Note that Figure 11 In the example shown, to simplify the description, the coordinates on the t-axis of the st coordinate system are fixed.

[0110] In the scene SN11, the information processing apparatus 30 causes the specifying unit 331 to specify the viewpoint position EP of the observer 200 based on the measurement information of the measurement device 20. l and EP r The information processing device 30 causes the setting unit 332 to set the corresponding viewpoint position EP by using l and EP r For reference, set the region E where the observer 200 is in a stationary state. l and E r Specifically, the information processing device 30 uses the viewpoint position EP of the left eye l The point (2, t) is used as the center (reference) and the range from point (1, t) to point (3, t) is set as region E. l Then, the information processing device 30 uses the viewpoint position EP of the right eye r The area from point (5, t) to point (7, t) is set as region E with point (6, t) as the center. rIn this case, the information processing apparatus 30 performs control so that the display device 10 emits the image data from the area E. l and E r The image G is viewed stereoscopically from the interior of the area E, and the image G is not viewed stereoscopically from the interior of the area E. l and E r The light group L of the image G is viewed stereoscopically from the outside.

[0111] In the scene SN12, the observer 200 is observing the display device 10 in a moving state. In other words, the viewpoint position EP of the observer 200 is l and EP r In the moving state with a large moving range, the viewpoint position EP of the left eye of the observer 200 is l From the point (2, t) on the s-axis of the st coordinate system, the viewpoint position EP of the right eye moves in the right direction. r Move in the right direction from the point (6, t) on the s-axis of the st coordinate system.

[0112] In the scene SN12, the information processing device 30 causes the specifying unit 331 to specify the viewpoint position EP of the observer 200 in the moving state based on the measurement information of the measuring device 20. l and EP r The information processing device 30 causes the setting unit 332 to set the corresponding viewpoint position EP at the designated time point by using l and EP r For reference, a region E extending in the right direction is set l ' and E r Specifically, the viewpoint position EP l and EP r The moving direction is the right direction, and therefore the information processing device 30 calculates the viewpoint position EP of the left eye by using l Point (2, t) is used as a reference, and the range from point (1, t) to point (4, t) is set as region E. l Then, the information processing device 30 uses the viewpoint position EP of the right eye r Point (6, t) is used as a reference, and the range from point (5, t) to point (8, t) is set as region E. r '. In other words, the information processing device 30 sets the following area E l ' and E r ', which has an area E greater than that in the static state l and E r A wider range and a shape corresponding to the direction of movement. At the viewpoint position EP l and EP rWhen the information processing device 30 is moving, the area E is set to be wide in the moving direction and narrow in the direction opposite to the moving direction. l ' and E r In this case, the information processing apparatus 30 performs control so that the display device 10 emits a signal that can be transmitted from the area E l ' and E r 'The image G is viewed stereoscopically from the interior, and it is not possible to see from the area E l ' and E r 'The light group L' of the external stereoscopically viewed image G.

[0113] Thereafter, when the viewpoint position EP of the observer 200 l and EP r When the scene SN11 has become stationary, the information processing device 30 causes the setting unit 332 to use the corresponding viewpoint position EP in the stationary state. l and EP r For reference, set the region E where the observer 200 is in a stationary state. l and E r .

[0114] As described above, the viewpoint position EP is detected by the detection unit 334. l and EP r In the case of movement of the viewpoint position EP, the information processing apparatus 30 according to the embodiment causes the setting unit 332 to set the l and EP r Area E at rest l ' and E r 'Large area E l ' and E r By doing so, the information processing device 30 sets the viewpoint position EP l and EP r The area E corresponding to the moving state l ' and E r ', and can make the display device 10 emit suitable for area E l ' and E r As a result, the information processing device 30 can avoid the viewpoint position EP during the movement. l and EP r Deviation area E l ' and E r ', which results in a situation where stereoscopic vision cannot be performed. Therefore, degradation of visibility can be prevented.

[0115] The information processing device 30 in the modification (3) of the embodiment can be configured to process the image according to the viewpoint position EP. l and EP rThe moving speed changes the area E to be set l and Er size, shape, etc. In addition, the information processing device 30 can estimate the viewpoint position EP l and EP r When the moving speed is high, the information processing device 30 can optimize the area E by slightly weighting the wide range, and can set the area E. l and EP r When the moving speed is low, the information processing device 30 can optimize the region E by weighting it at a medium level compared to the narrow range when the moving speed is high. l and EP r In the static situation, the information processing device 30 may optimize the region E by weighting the narrower range more heavily.

[0116] [Variation (4) of the embodiment]

[0117] A case is described where the information processing apparatus 30 in the modification (4) of the embodiment reproduces light ray groups for a plurality of observers 200 .

[0118] Figure 12 : is a diagram for explaining the relationship between light, image, and viewpoint position in the information processing device 30 in the modification (4) of the embodiment. Figure 12 In the example shown, the display device 10 displays Figure 6 The image G shown in Figure 12 In the illustrated example, two observers 200 that are side by side in the s-axis direction of the st coordinate system are observing the display device 10 .

[0119] The detection unit 334 of the information processing device 30 detects the viewpoint positions EP of the two observers 200A and 200B based on the measurement information of the measurement device 20. l and EP r The setting unit 332 of the information processing device 30 sets four areas ES1, ES2, ET1, and ET2 corresponding to the multiple observers 200. The areas ES1 and ES2 correspond to the viewpoint position EP of the observer 200A, respectively. l and EP r The regions ET1 and ET2 correspond to the viewpoint position EP of the observer 200B. l and EP rThe display control unit 333 of the information processing device 30 controls the display device 10 to emit light groups LS1, LS2, LT1, and LT2. These light groups LS1, LS2, LT1, and LT2 enable stereoscopic viewing of three-dimensional objects from within the four areas ES1, ES2, ET1, and ET2 set by the setting unit 332, and disable stereoscopic viewing of three-dimensional objects from outside the four areas ES1, ES2, ET1, and ET2. Therefore, the observer 200A can stereoscopically view the vehicle and the person by visually recognizing the light groups LS1 and LS2. The observer 200B can stereoscopically view the vehicle and the person by visually recognizing the light groups LT1 and LT2.

[0120] As described above, when the detection unit 334 has detected the viewpoint positions EP of the plurality of observers 200A and 200B l and EP r When the information processing device 30 in the variation (4) of the embodiment causes the setting unit 332 to set four areas ES1, ES2, ET1, and ET2 corresponding to the multiple observers 200, respectively. The information processing device 30 performs control so that the display device 10 emits light groups LS1, LS2, LT1, and LT2 corresponding to the four areas ES1, ES2, ET1, and ET2. By doing so, when the multiple observers 200A and 200B observe the display device 10, the information processing device 30 can cause the light groups LS1, LS2, LT1, and LT2 suitable for the four areas ES1, ES2, ET1, and ET2 of the observers 200A and 200B to be emitted. As a result, the information processing device 30 can limit the range in which the light of the three-dimensional object will be reproduced. This makes it possible to reduce the processing load related to the emission of light compared to the case where the light is emitted omnidirectionally. In addition, the information processing device 30 can provide the multiple observers 200A and 200B with a sense of depth similar to that in the case where the light is emitted omnidirectionally.

[0121] Note that, although the information processing apparatus 30 in the modification (4) of the embodiment has been described as setting four areas ES1, ES2, ET1, and ET2 for the multiple observers 200A and 200B, this is not restrictive. For example, the information processing apparatus 30 may set a single area for each of the multiple observers 200A and 200B, or may set a single area corresponding to both the multiple observers 200A and 200B.

[0122] Note that the modification (1) to the modification (4) of the embodiment may be applied to the information processing apparatus 30 in another modification, or may be combined.

[0123] [Hardware Configuration]

[0124] This can be achieved, for example, by having Figure 13The computer 1000 of the illustrated configuration realizes the information processing apparatus 30 according to the above-described embodiment and its modifications (1) to (4). A description will be provided below by using the information processing apparatus 30 according to the embodiment as an example. Figure 13 1 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the information processing apparatus 30. The computer 1000 includes a CPU 1100, a RAM 1200, a read-only memory (ROM) 1300, a hard disk drive (HDD) 1400, a communication interface 1500, and an input / output interface 1600. The respective units of the computer 1000 are connected via a bus 1050.

[0125] The CPU 1100 operates based on the program stored in the ROM 1300 or the HDD 1400 and controls each unit. For example, the CPU 1100 expands the program stored in the ROM 1300 or the HDD 1400 in the RAM 1200 and executes processing corresponding to each type of program.

[0126] The ROM 1300 stores a boot program (eg, a basic input and output system (BIOS)) executed by the CPU 1100 when the computer 1000 is activated, programs depending on the hardware of the computer 1000 , and the like.

[0127] HDD 1400 is a computer-readable recording medium that non-temporarily records a program executed by CPU 1100 , data used by the program, etc. Specifically, HDD 1400 is a recording medium that records an information processing program according to the present disclosure, which serves as an example of program data 1450 .

[0128] The communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (eg, the Internet). For example, the CPU 1100 receives data from another device via the communication interface 1500 or transmits data generated by the CPU 1100 to another device.

[0129] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. In addition, the CPU 1100 sends data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. In addition, the input / output interface 1600 can be used as a medium interface for reading a program recorded in a predetermined recording medium (medium). The medium is, for example, an optical recording medium such as a digital versatile disk (DVD), a magneto-optical recording medium such as a magneto-optical disk (MO), a magnetic tape medium, a magnetic recording medium, a semiconductor memory, or the like.

[0130] For example, when the computer 1000 is used as the information processing device 30 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the designation unit 331, the setting unit 332, the display control unit 333, the detection unit 334, and the like by executing the program loaded into the RAM 1200. In addition, the program according to the present disclosure or the data in the storage device 32 is stored in the HDD 1400. Note that the CPU 1100 reads the program data 1450 from the HDD 1400 and executes the program data 1450. However, in another example, these programs may be acquired from another device via the external network 1550.

[0131] While the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to the above examples. It is apparent that a person skilled in the art can conceive of various variations or modifications without departing from the technical concepts described in the claims, and it should be understood that such variations or modifications fall within the technical scope of the present disclosure.

[0132] In addition, the effects described here are only exemplary or illustrative, not restrictive. In other words, in addition to or in place of the above effects, the technology according to the present disclosure can exhibit other effects that are obvious to those skilled in the art based on the description provided herein.

[0133] Furthermore, a program for causing hardware such as a CPU, ROM, or RAM incorporated in a computer to implement a function similar to the configuration that the information processing apparatus 30 has may be generated, and a computer-readable recording medium recording the program may also be provided.

[0134] In addition, the individual steps in the process performed by the information processing device 30 herein are not always required to be performed in a time series in the order described in the flowchart. For example, the individual steps in the process performed by the information processing device 30 may be performed in an order different from the order described in the flowchart, or may be performed in parallel.

[0135] Furthermore, the information processing device 30 of this embodiment can cause the observer 200 to perceive a sense of depth in the display device 10, but this is not restrictive. For example, the information processing device 30 can reproduce the light field surrounding the viewpoint of the observer 200, and thus the information processing device 30 can also be used to correct the vision of the observer 200. In this case, the information processing device 30 stores vision information related to the vision of the observer 200 in the storage device 32, etc., and the display control unit 333 controls the display device 10 to emit a set of light rays corrected based on the vision information toward the aforementioned area. Targets of vision correction include, for example, myopia, hyperopia, and astigmatism.

[0136] In addition, in this embodiment, the information processing device 30 has been described as being provided outside the display device 10, but this is not restrictive. For example, the information processing device 30 may be incorporated into the display device 10 or the measuring device 20. For example, the information processing device 30 may be implemented by an information processing server or the like that can communicate with the display device 10.

[0137] Furthermore, the information processing apparatus 30 according to this embodiment can be used, for example, in a head-mounted display (HMD). For example, the information processing apparatus 30 can realize an HMD capable of adjusting focus by using the display device 10 in the display panel of the HMD and combining it with gaze tracking (eye tracking).

[0138] (Effect)

[0139] The information processing device 30 includes: a designation unit 331, which specifies the viewpoint position of the observer of the display device, which reproduces the light emitted by the three-dimensional object; a setting unit 332, which sets the area E that enables the observer 200 to stereoscopically view the three-dimensional object by using the viewpoint position specified by the designation unit 331 as a reference; and a display control unit 333, which performs control so that the display device 10 emits a light group L that enables the three-dimensional object to be stereoscopically viewed from the inside of the area E set by the setting unit 332, and that prevents the three-dimensional object from being stereoscopically viewed from the outside of the area.

[0140] By doing so, it is sufficient for the information processing device 30 to cause the display device 10 to emit a set of light rays that enable stereoscopic viewing of a three-dimensional object into an area E that has been set to correspond to the viewpoint position EP of the observer 200. This results in a limited range for the light rays of the three-dimensional object to be reproduced. Therefore, even if the processing load associated with emitting light rays is reduced, the information processing device 30 can enable the observer 200 to visually perceive a stereoscopic image using the light rays already emitted by the display device 10. Furthermore, the area E can be set using the viewpoint position of the observer 200 as a reference. Even if the viewpoint position deviates slightly, the information processing device 30 can enable the observer 200 to visually perceive a stereoscopic image by setting the area E according to the movement of the observer 200's head. In other words, by using the light rays that the display device 10 has already emitted into the limited area E, the information processing device 30 can provide the observer 200 with a similar sense of depth as would be achieved if light rays were emitted omnidirectionally. Furthermore, even without using a display device that can emit light omnidirectionally, the information processing device 30 can achieve a reproduction range with a wide viewing area and a wide depth.

[0141] In the information processing apparatus 30 , the display control unit 333 calculates pixel values ​​used by the display device 10 to emit the light rays L passing through the inside of the area E toward the observer 200 , and controls the display device 10 based on the pixel values.

[0142] By doing so, the pixel values ​​of the display device 10 are calculated only for the region E, and therefore, the information processing apparatus 30 can control the display device 10 based on the pixel values. As a result, the processing load of controlling the display device 10 is reduced in the information processing apparatus 30, and this makes it possible to reduce the cost of the display system 100.

[0143] The information processing apparatus 30 further includes a detection unit 334 that detects movement of the viewpoint position of the observer 200. When the detection unit 334 has detected movement of the viewpoint position, the setting unit 332 sets the area E by using the viewpoint position after the movement as a reference. When the area E according to the movement of the viewpoint has been set by the setting unit 332, the display control unit 333 controls the display device 10 to emit a light group L that enables stereoscopic viewing of a three-dimensional object from within the area E.

[0144] By doing so, the information processing device 30 resets the area E based on the detection of the movement of the viewpoint position of the observer 200, and can cause the display device 10 to emit the light group L toward the moved area E. As a result, the information processing device 30 can adjust the area E based on the movement of the viewpoint position of the observer 200 to adjust the focus of the observer 200, and can maintain stereoscopic vision. Therefore, it is possible to prevent a decrease in visibility.

[0145] In the information processing device 30 , when the detection unit 334 has detected the movement of the viewpoint position from the inside to the outside of the region E, the setting unit 332 sets the region E by using the viewpoint position after the movement as a reference.

[0146] By doing so, when the viewpoint position of the observer 200 located inside the area E has moved toward the outside of the area E, the information processing device 30 can reset the area E by using the viewpoint position EP after the movement as a reference. As a result, even if the viewpoint position has moved outside the area E, the information processing device 30 can reset the area E and can maintain the stereoscopic vision performed by the observer 200. Therefore, it is possible to prevent a decrease in visibility.

[0147] In the information processing device 30, when the area E for movement according to the viewpoint position has been set by the setting unit 332, the display control unit 333 compares the current light group L passing through the area E with the virtual light group for reproducing the three-dimensional object, and reflects the comparison result in the light group L to be emitted from the display device 10.

[0148] By doing so, when the area E has been reset, the information processing apparatus 30 can reflect the result of comparing the current light group L with the virtual light group in the light group L to be emitted from the display device 10. As a result, it is sufficient if the information processing apparatus 30 controls the display device 10 based on the result of comparing the current light group L with the virtual light group. This makes it possible to reduce the processing load associated with controlling the light group L to be emitted from the display device 10.

[0149] In the information processing apparatus 30, the display control unit 333 calculates the current light group L that passes through the area E from the display device 10. When the error between the calculated current light group L and the virtual light group satisfies the change condition, the light group L to be emitted from the display device 10 is changed so that the error becomes smaller.

[0150] By doing so, the information processing apparatus 30 can change the light group L to be emitted from the display device 10 according to the error between the current light group L and the virtual light group. As a result, it is sufficient if the information processing apparatus 30 controls the display device 10 according to the error between the current light group L and the virtual light group. This makes it possible to reduce the processing load associated with controlling the light group L to be emitted from the display device 10.

[0151] In the information processing device 30 , the setting unit 332 sets a single area E including the viewpoint positions of both eyes of the observer 200 that has been specified by the specifying unit 331 .

[0152] By doing so, the information processing device 30 can set the single area E by using the viewpoint positions of both eyes of the observer 200 as a reference. As a result, the ray group L is reproduced in the single area, and thus the information processing device 30 can further reduce the processing load.

[0153] In the information processing device 30 , the setting unit 332 sets the regions E having sizes different from each other based on the accuracy of the viewpoint position that has been specified by the specifying unit 331 .

[0154] By doing so, the information processing device 30 sets the areas E of different sizes, enabling the display device 10 to emit light groups L suitable for the areas E. As a result, even if the orientation of the observer 200's head changes or moves, the information processing device 30 can adjust the focus of the observer 200 and maintain stereoscopic vision. Therefore, it is possible to prevent a decrease in visibility.

[0155] In the information processing device 30 , in a case where movement of the viewpoint position has been detected by the detection unit 334 , the setting unit 332 sets the area E that is larger than the area E in a case where the viewpoint position is stationary.

[0156] By doing so, the information processing apparatus 30 sets the area E according to the movement state of the viewpoint position of the observer 200, and can cause the display device 10 to emit the light group L suitable for the area E. As a result, the information processing apparatus 30 can avoid a situation where stereoscopic vision cannot be performed due to the viewpoint position deviating from the area E during movement, and can prevent a reduction in visibility.

[0157] In the information processing device 30, the detection unit 334 detects the viewpoint positions of multiple observers 200, the setting unit 332 sets multiple areas E corresponding to the multiple observers 200 respectively, and the display control unit 333 performs control so that the display device emits a light group L that enables three-dimensional objects to be stereoscopically viewed from inside the multiple areas E set by the setting unit 332, and prevents three-dimensional objects from being stereoscopically viewed from outside the multiple areas E.

[0158] By doing so, when multiple observers 200 are observing the display device 10, the information processing device 30 can cause light groups L to be emitted that are appropriate for the multiple areas E of the multiple observers 200. As a result, the information processing device 30 can limit the range within which the light rays of a three-dimensional object will be reproduced. This reduces the processing load associated with emitting light rays compared to when emitting light rays omnidirectionally. Furthermore, the information processing device 30 can provide multiple observers 200 with a sense of depth similar to that obtained when emitting light rays omnidirectionally.

[0159] The information processing method of the information processing device 30 is an information processing method performed by the information processing device 30 that controls the display device 10 that reproduces the light emitted by the three-dimensional object, and the information processing method includes: a step of specifying the viewpoint position of the observer 200 of the display device 10; a step of setting an area E by using the already specified viewpoint position as a reference, which area E enables the observer 200 to view the three-dimensional object stereoscopically; and a step of performing control to cause the display device 10 to emit a light group L, which light group L enables the three-dimensional object to be viewed stereoscopically from the inside of the already set area E and makes it impossible to view the three-dimensional object stereoscopically from the outside of the area E.

[0160] By doing so, in the information processing method, it is sufficient for the information processing device 30 to cause the display device 10 to emit a set of light rays, enabling stereoscopic viewing of a three-dimensional object, into an area E that has been set to correspond to the viewpoint position EP of the observer 200. As a result, in this information processing method, the range in which the light rays of the three-dimensional object are reproduced can be limited. Thus, even though the processing load associated with emitting light rays is reduced, the observer 200 can visually perceive a stereoscopic image by using the light rays already emitted by the display device 10. Furthermore, in this information processing method, the area E can be set using the viewpoint position of the observer 200 as a reference. Even if the viewpoint position deviates slightly, the area E is set according to the movement of the observer 200's head, enabling the observer 200 to visually perceive a stereoscopic image. In other words, in this information processing method, by using the set of light rays already emitted by the display device 10 into the limited area E, the observer 200 can be provided with a sense of depth similar to that obtained when light rays are emitted omnidirectionally. Furthermore, in the information processing method, even without using a display device that can omnidirectionally emit light, a reproduction range with a wide viewing area and a wide depth can be achieved.

[0161] A program causes an information processing device 30 that controls a display device 10 that reproduces light rays emitted by a three-dimensional object to perform the following steps: a step of specifying a viewpoint position of an observer 200 of the display device 10; a step of setting an area E by using the already specified viewpoint position as a reference, the area E enabling the observer 200 to view the three-dimensional object stereoscopically; and a step of performing control to cause the display device 10 to emit a light group L, the light group L enabling the three-dimensional object to be viewed stereoscopically from inside the already set area E and preventing the three-dimensional object from being viewed stereoscopically from outside the area E.

[0162] By doing so, the program enables the information processing device 30 to limit the range within which the light rays of a three-dimensional object will be reproduced. Thus, even if the processing load associated with the emission of light by the information processing device 30 is reduced, the observer 200 is enabled to visually recognize a stereoscopic image by using the light rays already emitted by the display device 10. Furthermore, the program enables the information processing device 30 to set an area E using the viewpoint position of the observer 200 as a reference. Even if the viewpoint position deviates slightly, the observer 200 is enabled to visually recognize a stereoscopic image by setting the area E according to the movement of the observer 200's head. In other words, by using the set of light rays that the display device 10 has already emitted into the restricted area E, the program can provide the observer 200 with a sense of depth similar to that obtained when light rays are emitted omnidirectionally. Furthermore, even without using a display device that can emit light omnidirectionally, the program can achieve a reproduction range with a wide field of view and a wide depth.

[0163] Note that the configurations described below also fall within the technical scope of the present disclosure. (1)

[0165] An information processing device, comprising:

[0166] a specifying unit that specifies a viewpoint position of an observer of a display device that reproduces light rays that have been emitted by the three-dimensional object;

[0167] a setting unit that sets a region that enables the observer to stereoscopically view a three-dimensional object by using the viewpoint position that has been specified by the specifying unit as a reference; and

[0168] A display control unit controls the display device to emit a light group that enables the three-dimensional object to be stereoscopically viewed from inside the area set by the setting unit and disables the three-dimensional object from being stereoscopically viewed from outside the area. (2)

[0170] According to the information processing device described in (1) above,

[0171] The display control unit calculates pixel values ​​of a group of light rays emitted by the display device toward the observer through the interior of the area, and controls the display device based on the pixel values. (3)

[0173] The information processing device according to (1) or (2) above, further comprising:

[0174] a detection unit that detects movement of the viewpoint position of the observer,

[0175] wherein, when the detection unit has detected a movement of the viewpoint position, the setting unit sets the area by using the viewpoint position after the movement as a reference, and

[0176] When the area according to the moved viewpoint position has been set by the setting unit, the display control unit performs control to cause the display device to emit a group of rays that enables the three-dimensional object to be stereoscopically viewed from inside the area. (4)

[0178] According to the information processing device described in (3) above,

[0179] Here, when the detection unit has detected a movement of the viewpoint position from the inside of the area to the outside of the area, the setting unit sets the area by using the moved viewpoint position as a reference. (5)

[0181] According to the information processing device described in (3) or (4) above,

[0182] When an area that moves according to the viewpoint position has been set by the setting unit, the display control unit compares the current light group passing through the area with the virtual light group expected to reproduce the three-dimensional object, and reflects the comparison result in the light group to be emitted from the display device. (6)

[0184] According to the information processing device described in (5) above,

[0185] The display control unit calculates the current light group passing through the area from the display device, and when the error between the calculated current light group and the virtual light group satisfies the change condition, changes the light group to be emitted from the display device in a manner that makes the error smaller. (7)

[0187] The information processing device according to any one of (1) to (6) above,

[0188] The setting unit sets a single area including a plurality of viewpoint positions of both eyes of the observer specified by the specifying unit. (8)

[0190] The information processing device according to any one of (1) to (7) above,

[0191] Here, the setting unit sets the plurality of areas having sizes different from each other based on the accuracy of the viewpoint position that has been specified by the specifying unit. (9)

[0193] According to the information processing device described in (3) above,

[0194] Here, in a case where movement of the viewpoint position has been detected by the detection unit, the setting unit sets a larger area than the area in a case where the viewpoint position is stationary. (10)

[0196] According to the information processing device described in (3) above,

[0197] The detecting unit detects a plurality of viewpoint positions of the plurality of observers.

[0198] The setting unit sets a plurality of the areas, wherein each area corresponds to each of the plurality of observers, and

[0199] The display control unit performs control so that the display device emits a light group that enables the three-dimensional object to be stereoscopically viewed from inside the multiple areas set by the setting unit and disables the three-dimensional object from being stereoscopically viewed from outside the multiple areas. (11)

[0201] An information processing method, performed by an information processing apparatus that controls a display device that reproduces light emitted by a three-dimensional object, the information processing method comprising:

[0202] a step of specifying a viewpoint position of an observer of the display device;

[0203] a step of setting an area that enables the observer to stereoscopically view the three-dimensional object by using the designated viewpoint position as a reference; and

[0204] A step of controlling the display device to emit a light group that enables the three-dimensional object to be stereoscopically viewed from inside the area that has been set and disables the three-dimensional object from being stereoscopically viewed from outside the area is performed. (12)

[0206] A program causing an information processing apparatus that controls a display device that reproduces light rays emitted by a three-dimensional object to execute the following steps:

[0207] a step of specifying a viewpoint position of an observer of the display device;

[0208] a step of setting an area that enables the observer to stereoscopically view the three-dimensional object by using the designated viewpoint position as a reference; and

[0209] A step of controlling the display device to emit a light group that enables the three-dimensional object to be stereoscopically viewed from inside the area that has been set and disables the three-dimensional object from being stereoscopically viewed from outside the area is performed. (13)

[0211] A display system comprising:

[0212] a display device that reproduces light that has been emitted by a three-dimensional object; and

[0213] an information processing apparatus that controls the display device,

[0214] Wherein, the information processing device includes:

[0215] a designating unit that designates a viewpoint position of an observer of the display device;

[0216] a setting unit that sets a region that enables the observer to stereoscopically view a three-dimensional object by using the viewpoint position that has been specified by the specifying unit as a reference; and

[0217] A display control unit controls the display device to emit a light group that enables the three-dimensional object to be stereoscopically viewed from inside the area set by the setting unit and disables the three-dimensional object from being stereoscopically viewed from outside the area.

[0218] Reference Signs List

[0219] 10 Display Devices

[0220] 11 LCD panel

[0221] 20 Measuring equipment

[0222] 30 Information processing device

[0223] 31 Communication Unit

[0224] 32 Storage Devices

[0225] 33 Control Unit

[0226] 200 Observers

[0227] 331 Designated Unit

[0228] 332 Setting Unit

[0229] 333 Display Control Unit

[0230] 334 Detection Unit

[0231] Area E

[0232] EP viewpoint position

[0233] L Light Group

Claims

1. An information processing device, comprising: a specifying unit that determines that a viewpoint of an observer of a stereoscopic display device is at a first viewpoint position in a three-dimensional space, the stereoscopic display device being configured to reproduce light rays of a three-dimensional object; a setting unit that sets a stereoscopic area that allows the observer to stereoscopically view the three-dimensional object to the first viewpoint position and sets a non-stereoscopic area outside the stereoscopic area; a display control unit configured to control the stereoscopic display device to emit a light group representing a stereoscopic image of the three-dimensional object into the interior of the stereoscopic area and toward the observer, the light group including a plurality of light rays, wherein the plurality of light rays respectively correspond to different pixel values, and the display control unit controls the stereoscopic display device to emit a light group representing a non-stereoscopic image; and a detection unit that detects movement of the viewpoint of the observer, wherein When the detection unit detects movement of the viewpoint from the first viewpoint position to a second viewpoint position different from the first viewpoint position, the setting unit sets the stereoscopic area and the non-stereoscopic area based on the second viewpoint position and sets the stereoscopic area to the second viewpoint position, and the display control unit regenerates the pixel values ​​of the multiple light rays based on the detection of the movement of the observer's viewpoint.

2. The information processing device according to claim 1, in, When the detection unit has detected the movement of the viewpoint from the inside of the stereoscopic area to the non-stereoscopic area, the setting unit sets the stereoscopic area to the position of the viewpoint after the movement.

3. The information processing device according to claim 1, in, The display control unit controls the stereoscopic display device to change the emitted light group based on a comparison between a current light group corresponding to the first viewpoint position and a virtual light group corresponding to the second viewpoint position.

4. The information processing device according to claim 3, in, The display control unit controls the stereoscopic display device to change the emitted light group to reduce an error between the current light group and the virtual light group.

5. The information processing device according to claim 1, in, The setting unit sets a single stereoscopic area including a left-eye viewpoint position and a right-eye viewpoint position of the observer as the stereoscopic area; and The display control unit controls the stereoscopic display device to emit a group of light rays representing the stereoscopic image so that the three-dimensional object can be stereoscopically viewed from inside the single stereoscopic area and cannot be stereoscopically viewed from outside the single stereoscopic area. The information processing device according to claim 1 , in, The viewpoint of the observer includes a first viewpoint and a second viewpoint, The stereoscopic area includes a first stereoscopic area and a second stereoscopic area corresponding to the first viewpoint and the second viewpoint respectively. wherein the specified accuracy of the first stereoscopic region is less than the specified accuracy of the second stereoscopic region, and Wherein, the size of the first three-dimensional area is larger than that of the second three-dimensional area.

7. The information processing device according to claim 1, in, The setting unit sets a stereoscopic area larger than the stereoscopic area in a case where the viewpoint is stationary, in a case where movement of the viewpoint has been detected by the detection unit.

8. The information processing device according to claim 1, in, The observers include a first observer and a second observer, The three-dimensional area set by the setting unit includes a first three-dimensional area and a second three-dimensional area corresponding to the first observer and the second observer respectively. The setting unit sets the non-stereoscopic area between the first stereoscopic area and the second stereoscopic area, and The non-stereoscopic area does not include a light group that allows the first observer and the second observer to view the three-dimensional object in a stereoscopic manner.

9. An information processing method, the information processing method being performed by an information processing apparatus configured to control a stereoscopic display device for reproducing light for a three-dimensional object, the information processing method comprising: Determining that a viewpoint of an observer of the stereoscopic display device is at a first viewpoint position in a three-dimensional space; setting a stereoscopic area that allows the observer to stereoscopically view the three-dimensional object to the first viewpoint position and setting a non-stereoscopic area outside the stereoscopic area; controlling the stereoscopic display device to emit a light group representing a stereoscopic image of the three-dimensional object toward the inside of the stereoscopic area and toward the observer, the light group including a plurality of light rays, wherein the plurality of light rays respectively correspond to different pixel values; and controlling the stereoscopic display device to emit a light group representing a non-stereoscopic image; detecting movement of the viewpoint of the observer; When movement of the viewpoint from the first viewpoint position to a second viewpoint position different from the first viewpoint position is detected, setting the stereoscopic area and the non-stereoscopic area based on the second viewpoint position, and setting the stereoscopic area to the second viewpoint position; as well as The pixel values ​​of the plurality of light rays are regenerated based on detection of movement of the viewpoint of the observer.

10. A computer-readable recording medium storing a program, the program causing an information processing apparatus configured to control a stereoscopic display device for reproducing light for a three-dimensional object to execute the following steps: Determining that a viewpoint of an observer of the stereoscopic display device is at a first viewpoint position in a three-dimensional space; setting a stereoscopic area that allows the observer to stereoscopically view the three-dimensional object to the first viewpoint position and setting a non-stereoscopic area outside the stereoscopic area; The stereoscopic display device is controlled to emit a light group representing a stereoscopic image of the three-dimensional object into the interior of the stereoscopic area and toward the observer, the light group including a plurality of light rays, wherein: The plurality of light rays respectively correspond to different pixel values; and controlling the stereoscopic display device to emit a group of light rays representing a non-stereoscopic image; detecting movement of the viewpoint of the observer; When movement of the viewpoint from the first viewpoint position to a second viewpoint position different from the first viewpoint position is detected, setting the stereoscopic area and the non-stereoscopic area based on the second viewpoint position, and setting the stereoscopic area to the second viewpoint position; as well as The pixel values ​​of the plurality of light rays are regenerated based on detection of movement of the viewpoint of the observer.

Images