Information processing device, program, and information processing method

Abstract

[Problem] To provide an information processing device, a program, and an information processing method that enable stereoscopic display of 3D models that have excellent visibility through spatial reproduction display. [Solution] An information processing device according to the present technology is equipped with a viewpoint position determination unit, a region-of-interest identification unit, a display space acquisition unit, and a display control unit. The viewpoint position determination unit determines a viewpoint position for a 3D model in 3D content to be presented by spatial reproduction display that allows for stereoscopic display of the 3D model. The region-of-interest identification unit identifies a region of interest including at least a part of the 3D model. The display space acquisition unit acquires the size of a display space for displaying the 3D model. If the 3D model included in the region of interest is taken as a 3D model of interest, the display control unit modifies the position of the 3D model of interest with respect to the viewpoint position so that said position is within the display space, on the basis of the viewpoint position, the region of interest, and the size of the display space, and causes the 3D model to be stereoscopically displayed by the spatial reproduction display.

Description

[Technical Field]

[0001] The present technology relates to an information processing device, a program, and an information processing method for controlling a 3D model that is stereoscopically displayed by a spatial reproduction display. [Background technology]

[0002] A spatial reproduction display is a display that presents a right-eye image and a left-eye image with parallax to a user viewing the display, enabling a stereoscopic display of a 3D model with the naked eye. The user can perceive the 3D model as if it actually exists within a specific display space. For example, Patent Document 1 discloses a technology for controlling a stereoscopically displayed 3D model, which adjusts the position of the 3D model to the same depth position as the display surface where there is no difference between the images for the left and right eyes (no parallax) in order to improve the visibility of the 3D model. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-070286 Summary of the Invention [Problem to be solved by the invention]

[0004] As described above, spatial reproduction displays stereoscopically display 3D models in a specific display space. However, depending on the positioning and viewpoint of the 3D model, the 3D model may protrude from the display space, which may cause the user to feel uncomfortable or reduce the three-dimensional effect of the 3D model. The configuration described in Patent Document 1 takes into consideration adjustment of the depth position to match the display surface, but is unable to correct protrusion from the display space.

[0005] In view of the above circumstances, an object of the present technology is to provide an information processing device, a program, and an information processing method that are capable of stereoscopically displaying a 3D model with excellent visibility using a spatial reproduction display. [Means for solving the problem]

[0006] In order to achieve the above object, an information processing device according to the present technology includes a viewpoint position determination unit, an attention area identification unit, a display space acquisition unit, and a display control unit. The viewpoint position determination unit determines a viewpoint position relative to a 3D model in 3D content presented by a spatial reproduction display capable of stereoscopically displaying the 3D model. The attention area specifying unit specifies an attention area that includes at least a portion of the 3D model. The display space acquisition unit acquires the size of a display space for displaying the 3D model on the spatial reproduction display. When the 3D model included in the attention area is designated as the attention 3D model, the display control unit changes the position of the attention 3D model relative to the viewpoint position within the display space based on the viewpoint position, the attention area, and the size of the display space, and causes the spatial reproduction display to display the 3D model in stereoscopic view.

[0007] The display control unit may change the position of the 3D model of interest within the display space by reducing the distance between the viewpoint position and the 3D model of interest at a first ratio, and may reduce the size of the 3D model of interest at a second ratio that is the same as the first ratio.

[0008] The display control unit may change the position of the 3D model of interest within the display space by reducing the distance between the viewpoint position and the 3D model of interest at a first ratio, and may reduce the size of the 3D model of interest at a second ratio so that the entire 3D model of interest fits within the display space.

[0009] The display control unit may reduce the distance between the viewpoint position and the 3D model at the first ratio, and reduce the size of the 3D model at the second ratio.

[0010] The viewpoint position determining unit may move the viewpoint position in response to an operation input by a user.

[0011] The attention area specifying unit may move the attention area in response to an operation input by a user.

[0012] The viewpoint position determining unit may move the viewpoint position as time passes.

[0013] The attention area specifying unit may move the attention area as time passes.

[0014] The display control unit may generate a 2D image by projecting the 3D model located outside the display space onto a surface of the display space, and cause the spatial reproduction display to display the 2D image.

[0015] The display control unit may generate the 2D image by projecting the 3D model located between the viewpoint position and the display space onto a surface of the display space on the viewpoint position side.

[0016] The display control unit may perform blurring on the original 2D image.

[0017] The viewpoint position determination unit may determine the viewpoint position to be a viewpoint position specified in the 3D content.

[0018] The viewpoint position determination unit may set the viewpoint position as the viewpoint position by moving the viewpoint position specified in the 3D content so that the display space is positioned on a straight line connecting the viewpoint position and the 3D model of interest.

[0019] The attention area specifying unit may specify an attention area specified in the 3D content as the attention area.

[0020] The attention area specifying unit may specify the attention area based on a result of detecting a user's gaze point.

[0021] The attention area specifying unit may specify the attention area based on an arrangement of the 3D model.

[0022] The display control unit may generate a model image for the right eye and a model image for the left eye, which are parallax images of the 3D model as seen from the viewpoint position, and display the model image for the right eye and the model image for the left eye on the spatial reproduction display, thereby stereoscopically displaying the 3D model.

[0023] The display control unit may change the orientation of the 3D model according to a result of detecting the user's viewpoint.

[0024] In order to achieve the above object, a program according to the present technology causes an information processing device to operate as a viewpoint position determination unit, an attention area identification unit, a display space acquisition unit, and a display control unit. The viewpoint position determination unit determines a viewpoint position relative to a 3D model in 3D content presented by a spatial reproduction display capable of stereoscopically displaying the 3D model. The attention area specifying unit specifies an attention area that includes at least a portion of the 3D model. The display space acquisition unit acquires the size of a display space for displaying the 3D model on the spatial reproduction display. When the 3D model included in the attention area is designated as the attention 3D model, the display control unit changes the position of the attention 3D model relative to the viewpoint position within the display space based on the viewpoint position, the attention area, and the size of the display space, and causes the spatial reproduction display to display the 3D model in stereoscopic view.

[0025] In order to achieve the above object, the information processing method according to the present technology includes: In 3D content presented by a spatial reproduction display capable of stereoscopically displaying a 3D model, determining a viewpoint position relative to the 3D model; identifying a region of interest that includes at least a portion of the 3D model; obtaining a size of a display space for displaying the 3D model on the spatial reproduction display; If the 3D model included in the attention area is the attention 3D model, the position of the attention 3D model relative to the viewpoint position is changed within the display space based on the viewpoint position, the attention area, and the size of the display space, and the 3D model is displayed stereoscopically on the spatial reproduction display. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a schematic diagram of a spatial representation display system according to an embodiment of the present technology; [Figure 2] FIG. 2 is a schematic diagram of a spatial reproduction display provided in the spatial reproduction display system. [Figure 3] 3 is a schematic diagram of a 3D model displayed by the spatial reproduction display. FIG. [Figure 4] FIG. 2 is a block diagram of an information processing device included in the spatial reproduction display system. [Figure 5] FIG. 2 is a schematic diagram showing a specified viewpoint position in three-dimensional content. [Figure 6] FIG. 1 is a schematic diagram showing the relationship between a specified viewpoint position in three-dimensional content and a 3D model displayed by a spatial reproduction display. [Figure 7] 3 is a schematic diagram showing a display viewpoint position determined by a viewpoint position determination unit included in the information processing device. FIG. [Figure 8] 3 is a schematic diagram showing an attention area identified by an attention area identifying unit included in the information processing device. FIG. [Figure 9] 3 is a schematic diagram showing an attention area identified by an attention area identifying unit included in the information processing device. FIG. [Figure 10]3 is a schematic diagram showing an attention area identified by an attention area identifying unit included in the information processing device. FIG. [Figure 11] 10 is a schematic diagram showing a method of determining whether or not a change process is performed by a change process execution determination unit included in the information processing device. FIG. [Figure 12] 10A and 10B are schematic diagrams illustrating changes in the position and size of a 3D model of interest performed by a 3D model control unit included in the information processing device. [Figure 13] 10A to 10C are schematic diagrams illustrating specific examples of changes in the position and size of a 3D model of interest by the 3D model control unit. [Figure 14] FIG. 10 is a schematic diagram illustrating the size reduction of a 3D model of interest by the 3D model control unit. [Figure 15] 10A to 10C are schematic diagrams illustrating specific examples of changes in the position and size of a 3D model by the 3D model control unit. [Figure 16] 10A to 10C are schematic diagrams illustrating specific examples of changes in the position and size of a 3D model by the 3D model control unit. [Figure 17] 10A to 10C are schematic diagrams illustrating specific examples of changes in the position and size of a 3D model by the 3D model control unit. [Figure 18] 10A to 10C are schematic diagrams illustrating specific examples of changes in the position and size of a 3D model by the 3D model control unit. [Figure 19] 4 is a flowchart showing an operation of the information processing device. [Figure 20] 10A and 10B are schematic diagrams illustrating the change in position and size of a 3D model of interest by the 3D model control unit. [Figure 21] FIG. 10 is a schematic diagram showing the positional relationship between a specified viewpoint position and a 3D model of interest. [Figure 22] FIG. 10 is a schematic diagram showing the positional relationship between a specified viewpoint position and a 3D model of interest. [Figure 23] FIG. 10 is a schematic diagram showing the positional relationship between a specified viewpoint position and a 3D model of interest. [Figure 24] 10 is a schematic diagram showing movement of a display viewpoint position relative to a specified viewpoint position by a viewpoint position determination unit included in the information processing device. FIG. [Figure 25] FIG. 2 is a schematic diagram illustrating generation of a 2D image by a display control unit included in the information processing device. [Figure 26] FIG. 4 is a schematic diagram illustrating generation of a 2D image by the display control unit. [Figure 27] FIG. 4 is a schematic diagram illustrating generation of a 2D image by the display control unit. [Figure 28] 4A to 4C are schematic diagrams illustrating blurring processing of a 2D image performed by the display control unit. [Figure 29] 10A and 10B are schematic diagrams illustrating supplementary displays by the display control unit. [Figure 30] 10A and 10B are schematic diagrams illustrating supplementary displays by the display control unit. [Figure 31] 10A and 10B are schematic diagrams illustrating supplementary displays by the display control unit. [Figure 32] 10A and 10B are schematic diagrams illustrating supplementary displays by the display control unit. [Figure 33] 10A and 10B are schematic diagrams illustrating supplementary displays by the display control unit. [Figure 34] 3A and 3B are schematic diagrams illustrating resizing of the display space of the spatial reproduction display. [Figure 35] FIG. 2 is a block diagram showing a hardware configuration of the information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0027] A spatial reproduction display system according to an embodiment of the present technology will be described.

[0028] [Configuration of spatial reproduction display system] 1 is a schematic diagram of a spatial reproduction display system 100 according to this embodiment. As shown in the figure, the spatial reproduction display system 100 includes a spatial reproduction display 110 and an information processing device 120. The spatial reproduction display 110 and the information processing device 120 are connected by wire or wirelessly, and may be connected via a network. Furthermore, the information processing device 120 may be configured integrally with the spatial reproduction display 110.

[0029] [Configuration of spatial reproduction display] 2 is a perspective view of the spatial reproduction display 110. The spatial reproduction display 110 is a display that provides a stereoscopic display of a 3D model M. The spatial reproduction display 110 is a stationary device that is placed on, for example, a table or the like, and can stereoscopically display the 3D model M that constitutes video content or the like to a user viewing the spatial reproduction display 110.

[0030] The spatial reproduction display 110 may be a light field display. A light field display is a display that dynamically generates left and right parallax images according to the position of the user's viewpoint. By displaying these parallax images toward the user's left eye and right eye, respectively, a stereoscopic display is realized with the naked eye.

[0031] Specifically, the spatial reproduction display 110 includes a housing 111, a camera 112, a display panel 113, and a lenticular lens 114, as shown in Fig. 2. The housing 111 is a housing that houses each component of the spatial reproduction display 110, and has an inclined surface 115. The inclined surface 115 is configured to be inclined with respect to a mounting surface on which the spatial reproduction display 110 is placed. The camera 112 and the display panel 113 are arranged on the inclined surface 115.

[0032] Camera 112 is an imaging element that captures an image of the face of a user viewing display panel 113. Camera 112 is appropriately placed at a position where it can capture an image of the user's face, for example. In FIG. 2, camera 112 is placed at a position above the center of display panel 113 on inclined surface 115. As camera 112, for example, a digital camera equipped with an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor is used. The specific configuration of camera 112 is not limited, and for example, a multi-lens camera such as a stereo camera may be used. Furthermore, camera 112 may be an infrared camera that captures an infrared image by irradiating infrared light, a ToF camera that functions as a distance measurement sensor, or the like.

[0033] The display panel 113 is a display element that displays parallax images for stereoscopically displaying the 3D model M. The display panel 113 is, for example, a rectangular panel in a planar view, and is disposed on the inclined surface 115 described above. That is, the display panel 113 is disposed in an inclined state when viewed from the user. This allows the user to view the 3D model M even when viewing the display panel 113 from, for example, the horizontal or vertical direction.

[0034] The display panel 113 may be, for example, a display element such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or an organic EL (Electro-Luminescence) panel. The area on the display panel 113 where the parallax images are displayed becomes the display area 116 of the spatial reproduction display 110. In FIG. 2, the display area 116 is schematically illustrated as an area surrounded by thick black lines.

[0035] The lenticular lens 114 is attached to the surface (display area 116) of the display panel 113 and is a lens that refracts light rays emitted from the display panel 113 only in a specific direction. The lenticular lens 114 has a structure in which, for example, elongated convex lenses are arranged adjacent to each other, and is arranged so that the extension direction of the convex lenses coincides with the up-and-down direction of the display panel 113. A two-dimensional image consisting of left and right parallax images divided into strips in accordance with the lenticular lens 114 is displayed on the display panel 113. By appropriately configuring this two-dimensional image, it is possible to display corresponding parallax images toward the left and right eyes of the user.

[0036] The spatial reproduction display 110 can realize stereoscopic display by a lenticular lens system in which a lenticular lens 114 is provided that controls the output direction for each display pixel of the display panel 113. Other systems for realizing stereoscopic display in the spatial reproduction display 110 are not limited to this. For example, a parallax barrier system in which a shielding plate is provided for each set of display pixels to separate the light rays incident on each eye may be used. Alternatively, a polarization system in which parallax images are displayed using polarized glasses or the like, or a frame sequential system in which parallax images are switched for each frame using liquid crystal glasses or the like may be used.

[0037] The spatial reproduction display 110 is capable of stereoscopically displaying at least one 3D model M using left and right parallax images displayed in the display area 116 of the display panel 113. Hereinafter, the parallax images for the left eye and right eye representing each 3D model M will be referred to as a left eye model image and a right eye model image. The left eye model image and the right eye model image are, for example, a pair of images of a certain 3D model M viewed from positions corresponding to the left eye and right eye. Therefore, the display area 116 displays as many pairs of left eye model images and right eye model images as there are 3D models M. In this way, the display area 116 is an area where pairs of left eye model images and right eye model images generated for each 3D model M corresponding to the user's left eye and right eye are displayed.

[0038] On the spatial reproduction display 110, a 3D model M is stereoscopically displayed within a preset space. Hereinafter, this space will be referred to as a display space 117. In FIG. 2, the space corresponding to the display space 117 is schematically illustrated using dotted lines. FIG. 3 is a schematic diagram showing the 3D model M visually recognized by a user U. As shown in the figure, the user U viewing the spatial reproduction display 110 can recognize that the 3D model M exists on the front and back sides of the display area 116 by viewing the model image for the left eye and the model image for the right eye displayed in the display area 116, and can recognize that the 3D model M actually exists in the display space 117.

[0039] Furthermore, the spatial reproduction display 110 can detect the viewpoint of the user U using the camera 112 and generate a model image for the left eye and a model image for the right eye according to the detection result. As a result, when the user U moves their viewpoint by moving their head, the orientation of the 3D model M changes accordingly, allowing the user to perceive it as if they were actually looking at the 3D model M. Note that the spatial reproduction display 110 can also generate a model image for the left eye and a model image for the right eye so that the 3D model M can be viewed stereoscopically when the display area 116 is viewed from the front, without performing viewpoint detection.

[0040] The display space 117 may be a rectangular parallelepiped space in which the left and right short sides of the display area 116 are diagonal lines of the opposing surfaces. Each surface of the display space 117 is set to be parallel to or perpendicular to the arrangement surface on which the spatial reproduction display 110 is arranged. This makes it easier to recognize, for example, the front-to-back directions, the up-to-down directions, the bottom surface, etc. of the display space 117. The shape of the display space 117 is not limited, and can be set arbitrarily depending on, for example, the use of the spatial reproduction display 110.

[0041] [Configuration of information processing device] 4 is a block diagram showing the configuration of the information processing device 120. As shown in the figure, the information processing device 120 includes a 3D content storage unit 121, a viewpoint position determination unit 122, an attention area identification unit 123, a display space acquisition unit 124, a change processing execution determination unit 125, a 3D model control unit 126, a user viewpoint detection unit 127, and a rendering unit 128. The 3D model control unit 126 and the rendering unit 128 are collectively referred to as a display control unit 129. These components of the information processing device 120 are functional configurations realized by cooperation between hardware and software.

[0042] The 3D content storage unit 121 stores 3D content. The 3D content is content that includes at least information about a 3D model M, and the information about the 3D model M includes the shape and arrangement of the 3D model M. The 3D content also includes a "specified viewpoint position." Figure 5 is a schematic diagram showing the 3D model M and the specified viewpoint position P.

[0043] Figure 5 shows a 3D model M. The creator of the 3D content can add camera work to the 3D model M so that the user can view the 3D model M from the intended viewpoint. Camera work refers to a function in which a designated viewpoint position P, designated by the content creator, moves automatically to change the viewing angle of the 3D model M.

[0044] 5, the specified viewpoint position P is indicated by a seat S, and the 3D model M photographed by a camera C fixed relative to the seat S is the 3D model M as seen from the specified viewpoint position P. When the 3D model M as seen from the specified viewpoint position P is displayed on the spatial reproduction display 110, the user can visually recognize changes in the angle of the 3D model M as seen from the specified viewpoint position P as the specified viewpoint position P moves. In addition, the user U can also slightly change the viewing angle of the 3D model M by moving their head, using the specified viewpoint position P as a base.

[0045] 6 is a schematic diagram showing a change in the 3D model M depending on the specified viewpoint position P. In FIG. 6(a), when the specified viewpoint position P is viewpoint position P1 that is a certain distance from the 3D model M, the user U views the 3D model M1 on the spatial reproduction display 110 as shown in FIG. 6(b). When the specified viewpoint position P is viewpoint position P2 that is farther away from the 3D model M than viewpoint position P1 as shown in FIG. 6(a), the user U views the 3D model M2 on the spatial reproduction display 110 as shown in FIG. 6(b). Because the 3D model M2 is displayed on the spatial reproduction display 110 as being smaller than the 3D model M1 and with a small parallax, the user U can perceive the 3D model M2 as being located farther away than the 3D model M1.

[0046] The viewpoint position determination unit 122 determines a "display viewpoint position." The display viewpoint position is a viewpoint position relative to the 3D model M, and the 3D model M viewed from the display viewpoint position is displayed on the spatial reproduction display 110. FIG. 7 is a schematic diagram showing the display viewpoint position T. The viewpoint position determination unit 122 can determine the display viewpoint position T based on the specified viewpoint position P acquired from the 3D content storage unit 121.

[0047] Specifically, the viewpoint position determination unit 122 can set the specified viewpoint position P as the display viewpoint position T, as shown in FIG. 7(a). Furthermore, the viewpoint position determination unit 122 can set a viewpoint position different from the specified viewpoint position P as the display viewpoint position T, as shown in FIG. 7(b). The viewpoint position determination unit 122 may move the display viewpoint position T in response to an operation input by the user or the passage of time. The viewpoint position determination unit 122 supplies the determined display viewpoint position T to the change process execution determination unit 125 and the 3D model control unit 126.

[0048] The attention area specifying unit 123 specifies a "attention area." The attention area includes at least a part of the 3D model M, and is an area that the user should pay attention to. FIGS. 8 to 10 are schematic diagrams showing an attention area R. Note that in the following drawings, the 3D model M is shown by a plurality of cylinders. As shown in FIG. 8, the attention area R can be an area that includes one 3D model M. Hereinafter, of the 3D models M, the 3D model M included in the attention area R will be referred to as the attention 3D model M. R 9, the region of interest R may include a plurality of 3D models M, or may include all of the 3D models M, as shown in FIG.

[0049] The attention area R can be designated by the creator of the 3D content and stored in the 3D content storage unit 121, and the attention area identification unit 123 can acquire the attention area R from the 3D content storage unit 121. The attention area identification unit 123 supplies the identified attention area R to the change processing execution determination unit 125 and the 3D model control unit 126.

[0050] The display space acquisition unit 124 acquires the size (hereinafter referred to as display space size) of the display space 117 (see FIG. 2) on the spatial reproduction display 110. The display space size is the actual size of the display space 117, which is determined by the size and tilt angle of the display area 116. The display space acquisition unit 124 acquires the display space size from a registry or the like of the spatial reproduction display 110, and supplies the acquired display space size to the change processing execution determination unit 125 and the 3D model control unit 126.

[0051] The change process execution determination unit 125 determines whether or not to execute change process by the 3D model control unit 126. The change process execution determination unit 125 determines whether or not to execute change process based on the display viewpoint position T, the attention area R, and the size of the display space 117. Specifically, the change process execution determination unit 125 determines whether or not to execute change process based on the attention 3D model M R When viewed from the display viewpoint position T, the 3D model of interest M R This can be determined by whether the entire image fits into the display space 117.

[0052] 11A and 11B are schematic diagrams showing a determination method by the change process execution determination unit 125. FIG. 11A shows a 3D model of interest M R 11(b) and 11(c) show the case where the 3D model of interest M R 11(a), the change processing execution determination unit 125 can determine that "change processing should not be executed" when the 3D model M does not fit completely into the display space 117. Furthermore, as shown in FIGS. 11(b) and 11(c), the change processing execution determination unit 125 can determine that "change processing should be executed" when the 3D model M does not fit completely into the display space 117. The change processing execution determination unit 125 supplies the determination result to the 3D model control unit 126.

[0053] The 3D model control unit 126 calculates the attention 3D model M for the display viewpoint position T based on the display viewpoint position T, the attention area R, and the display space 117. RThe position of the 3D model M is changed to within the display space 117. R Change the size of the 3D model M before changing the position and size. R Featured 3D Model M R1 The 3D model of interest after the position and size change is M R Featured 3D Model M R2 Let's say.

[0054] Figure 12 shows the 3D model M R 12(a) is a schematic diagram showing the position and size change of the 3D model of interest M R1 is located outside the display space 117, and the display viewpoint position T and the target 3D model M R1 The distance between the two points is shown as distance L1. R2 is located in the display space 117, and the display viewpoint position T and the 3D model of interest M R2 The distance between the display viewpoint position T and the 3D model of interest M is shown as distance L2. R The distance between the viewing point T and the 3D model M R The distance between the center of gravity of the

[0055] The 3D model control unit 126 determines the display viewpoint position T and the 3D model of interest M R The distance is reduced by the first ratio to focus on the 3D model M R Change the position of the display space 117 and select the 3D model M R The second ratio can be the same as the first ratio. Specifically, the 3D model control unit 126 reduces the size of the 3D model M by a second ratio. R The distance between the target 3D model M is reduced from L1 to L2 as shown in Fig. 12(b). R The position of the 3D model M is changed within the display space 117. Furthermore, the 3D model control unit 126 changes the position of the 3D model M at the ratio (L2 / L1). R1 Scaled and featured 3D model M R2 Therefore, the first ratio and the second ratio are both the ratio (L2 / L1).

[0056] Figure 13 shows the 3D model M R As shown in the figure, the display viewpoint position T and the target 3D model M R1 When the distance between them is L1, the 3D model M R1 The size of the 3D model M is expressed as "2*L1*tanθ". R2 The size can be changed to "2*L2*tanθ" which is "2*L1*tanθ" multiplied by the ratio (L2 / L1).

[0057] Usually, the spatial reproduction display 110 has an optimum viewing distance and viewing angle recommended by the device manufacturer, and the distance L2 can be determined as a fixed value based on the viewing distance. Also, the viewing angle can be basically assumed to be in front of the device. As described above, the 3D model control unit 126 controls the 3D model of interest M R The position and size of the image can be changed.

[0058] Furthermore, the 3D model control unit 126 calculates the attention 3D model M by another calculation method using the display viewpoint position T, the attention area R, and the size of the display space 117. R2 Specifically, the 3D model control unit 126 calculates the position and size of the 3D model M R2 The ratio can be set so that the entire image fits into the display space 117.

[0059] FIG. 14 is a schematic diagram showing an example of this calculation method. As shown in FIG. 14(a), R2 Even if you move it to a position of distance L2 and reduce it by the ratio (L2 / L1), the focus 3D model M R2 In some cases, the entirety of the 3D model M may not fit in the display space 117. In this case, the 3D model control unit 126 determines the display viewpoint position T and the 3D model M. R2 The distance between them is kept as distance L2, and the 3D model M R2 Featured 3D model size M R2are reduced at a ratio such that the entire image can fit into the display space 117. Therefore, in this case, the first ratio is the ratio (L2 / L1), and the second ratio is a ratio smaller than the ratio (L2 / L1).

[0060] Furthermore, the 3D model control unit 126 determines the target 3D model M R Also pay attention to 3D Model M other than 3D Model M R Similarly, the position and size can be changed. That is, the 3D model control unit 126 can reduce the distance between the display viewpoint position T and the 3D model M at a first ratio, and reduce the size of the 3D model M at a second ratio. Note that the distance between the display viewpoint position T and the 3D model M can be the distance between the display viewpoint position T and the center of gravity of the 3D model M.

[0061] 15 to 18 are schematic diagrams showing changes in the position and size of the 3D model M by the 3D model control unit 126. In FIG. 15, one of the 3D models M is an attention 3D model M R As shown in the figure, the 3D model control unit 126 displays the 3D model M of interest in the display space 117. R2 Featured 3D model M R The ratio of the distance to the display viewpoint position T is calculated, and the 3D model M is reduced by that ratio.

[0062] 16 is a schematic diagram showing another example of changing the position and size of the 3D model M by the 3D model control unit 126. As shown in the figure, one of the 3D models M is an attention 3D model M R , and Fig. 15 is the 3D model of interest M R The 3D model control unit 126 controls the display space 117 to display the 3D model M of interest. R2 Featured 3D model M R The ratio of the distance between the display viewpoint position T and the target 3D model M is calculated, and the 3D model M is reduced by that ratio. R Since the positions of the 3D model M and the 3D model M are different, the manner of changing the position and size of the 3D model M is also different.

[0063] 17 is a schematic diagram showing another example of changing the position and size of a 3D model M by the 3D model control unit 126. As shown in the figure, a plurality of 3D models M are displayed in the same manner as the focus 3D model M R If so, the 3D model control unit 126 displays the 3D model M of interest in the display space 117. R2 Featured 3D model M R The ratio of the distance between the display viewpoint position T and the 3D model M is calculated, and the 3D model M is reduced by that ratio. R If the entirety of the 3D model M does not fit into the display space 117, R The 3D model is further reduced in size so that the entirety of the image fits into the display space 117.

[0064] 18 is a schematic diagram showing another example of changing the position and size of the 3D model M by the 3D model control unit 126. As shown in the figure, all the 3D models M are changed in position and size by the 3D model control unit 126. R If so, the 3D model control unit 126 displays the 3D model M of interest in the display space 117. R2 Featured 3D model M R The ratio of the distance between the display viewpoint position T and the 3D model M is calculated, and the 3D model M is reduced by that ratio. R If the entirety of the 3D model M does not fit into the display space 117, R The 3D model is further reduced in size so that the entirety of the image fits into the display space 117.

[0065] In this way, the 3D model control unit 126 calculates the target 3D model M for the display viewpoint position T. R Change the position of the display space 117 and focus on the 3D model M R The 3D model control unit 126 changes the size of the 3D model M R 3D Model M other than the above is also noteworthy. R The 3D model control unit 126 supplies the result of the change process of the 3D model M, that is, the position and size of the 3D model M after the change, to the rendering unit 128.

[0066] The user viewpoint detection unit 127 detects the viewpoint of the user U. The user viewpoint detection unit 127 performs image processing on the image captured by the camera 112, and can detect the viewpoint of the user U in real time. The user viewpoint detection unit 127 supplies the viewpoint detection result to the rendering unit 128.

[0067] The rendering unit 128 performs rendering of the 3D model M to generate a model image for the left eye and a model image for the right eye. Based on the result of the change processing of the 3D model M supplied from the 3D model control unit 126, the rendering unit 128 performs rendering on the 3D model M after the change processing. At this time, the rendering unit 128 performs rendering by reflecting the viewpoint detection result supplied from the user viewpoint detection unit 127, and can change the orientation of the 3D model according to the user's viewpoint position. The rendering unit 128 supplies the generated model image for the left eye and model image for the right eye to the display panel 113, and causes the display panel 113 to display them.

[0068] The information processing device 120 has the above-described configuration. Note that the configuration of the information processing device 120 is not limited to the above-described one, and may have the following configuration.

[0069] In the above description, the attention area identification unit 123 acquires the attention area R specified in the 3D content holding unit 121, but the attention area identification unit 123 may also identify the attention area R based on the user's viewpoint detection result. Specifically, the attention area identification unit 123 acquires the viewpoint detection result from the user viewpoint detection unit 127, and can set the area the user is gazing at as the attention area R.

[0070] Furthermore, the attention area identification unit 123 may acquire, from the cloud or the like, attention areas set by multiple users viewing the same 3D content, and identify the attention area R based on the acquired attention areas. This allows the attention area R to reflect the intentions of multiple users. Furthermore, the attention area identification unit 123 may identify the attention area R according to the arrangement of the 3D models M, for example, by setting an area where the 3D models M are concentrated as the attention area R.

[0071] Furthermore, although the rendering unit 128 performs rendering by reflecting the viewpoint detection result supplied from the user viewpoint detection unit 127, the rendering may be performed based only on the position and size of the 3D model M supplied from the 3D model control unit 126 without reflecting the viewpoint detection result in the rendering.

[0072] [Operation of information processing device] The following describes the operation of the information processing device 120. FIG.

[0073] When an instruction to display the 3D model M is given, the display space acquisition unit 124 acquires the display space size (see FIG. 2) (St101). The display space acquisition unit 124 supplies the acquired display space size to the change process execution determination unit 125 and the 3D model control unit 126.

[0074] Next, the viewpoint position determination unit 122 determines the display viewpoint position T (see FIG. 7) (St102). The viewpoint position determination unit 122 can set the specified viewpoint position P acquired from the 3D content storage unit 121 or a viewpoint position obtained by moving the specified viewpoint position P as the display viewpoint position T. The viewpoint position determination unit 122 supplies the display viewpoint position T to the change process execution determination unit 125 and the 3D model control unit 126.

[0075] Next, the attention area identification unit 123 identifies the attention area R (see FIGS. 8 to 10) (St103). The attention area identification unit 123 may acquire the attention area R from the 3D content storage unit 121, or may identify the attention area R from the user's viewpoint detection result or the arrangement of the 3D model M. The attention area identification unit 123 supplies the attention area R to the change process execution determination unit 125 and the 3D model control unit 126.

[0076] Next, the change process execution determination unit 125 determines whether or not to execute the change process by the 3D model control unit 126 (St104). R1 This can be determined by whether the entire image fits into the display space 117 (see FIG. 11).

[0077] Featured 3D Model M R1 If the entire 3D model M does not fit into the display space 117 (Step 104: Yes), the 3D model control unit 126 changes the position and size of the 3D model M (see FIG. 12) and R The 3D model control unit 126 then supplies the changed position and size of the 3D model M to the rendering unit 128. R1 If the entirety of the 3D model M fits into the display space 117 (St104: No), the 3D model control unit 126 supplies the position and size of the 3D model M to the rendering unit 128 without executing any change processing.

[0078] Next, the user viewpoint detection unit 127 detects the user's viewpoint position (St106) and supplies the detected viewpoint position to the rendering unit 128. Next, the rendering unit 128 performs rendering based on the position and size of the 3D model M supplied from the 3D model control unit 126 (St107). The rendering unit 128 may also perform rendering based on the position and size of the 3D model M and the viewpoint position supplied from the user viewpoint detection unit 127. Thereafter, the information processing device 120 repeatedly executes the above steps St102 to St107. As a result, the 3D model M is displayed on the spatial reproduction display 110, and the 3D model of interest M R is placed in the display space 117.

[0079] The 3D model control unit 126 controls the 3D model M R1 However, the modification process of the 3D model M may be executed regardless of the determination result of the modification process execution determination unit 125. In this way, the 3D model control unit 126 can execute the modification process of the 3D model M of interest. R2 can be moved to the center of the display space 117.

[0080] [Effects of the spatial reproduction display system] As described above, the spatial reproduction display system 100 uses the 3D model M R1 If the 3D model M R1 Change the position and size of the featured 3D model M R2 is placed in the display space 117. As a result, the user can select the 3D model M of interest located in the display space 117. R2 can be viewed in stereoscopic view.

[0081] Suppose a user U is interested in a 3D model M that is outside the display space 117. R When you look at it, you may feel something is wrong or the 3D model M R On the other hand, the spatial reproduction display system 100 avoids such a situation and displays the 3D model M with excellent visibility. R It is possible to present the user U and the featured 3D model M R The ease of interaction and the featured 3D model M R It is possible to improve the three-dimensional effect of the image.

[0082] In addition to 3D content created for spatial reproduction displays, 3D content also includes existing 3D content such as CG (computer graphics) animations and games. The spatial reproduction display system 100 can also display a 3D model M of interest in a 3D model space created for existing 3D content. R can be placed in the display space 117. This makes it possible to improve the ease of interaction and the sense of depth even with existing 3D content.

[0083] [About moving the display viewpoint and area of ​​interest] The spatial reproduction display system 100 displays the 3D model M of interest as described above. R is located in the display space 117. Here, the spatial reproduction display system 100 displays the 3D model M RWhen presenting an image in which the 3D model M gradually moves away from the display viewpoint position T, the display viewpoint position T is gradually moved away from the 3D model M.

[0084] Figure 20 shows the user U and the 3D model M R Assuming that a user U is viewing the spatial reproduction display 110 from an optimal viewing position in front of the spatial reproduction display 110, the 3D model of interest M R1 20, the user U moves the attention 3D model M outside the display space 117. R1 In such cases, by applying this technology, the 3D model of interest M R Even if the distance between the display viewpoint position T and the target object is gradually increased, the user can still see the 3D model M in the display space 117 as shown in FIG. R2 can be perceived as always existing.

[0085] Furthermore, in CG animation and 3D computer games, a virtual camera is placed in a virtual space in which a 3D model is placed, and camerawork is added to express the 3D model as a 2D image. When such 3D content is displayed on the spatial reproduction display 110, the original 3D content is not designed to fit entirely within the display space 117, but visibility can be improved by fitting as much of the content as possible within the display space 117.

[0086] In such a case, since the designated viewpoint position P that is set in advance in the 3D content is the viewpoint position specified by the creator, this designated viewpoint position P can be set as the display viewpoint position T. Furthermore, the attention area identification unit 123 sets the attention area R within the angle of view when the content is viewed from the display viewpoint position T, thereby making it possible to apply the present technology.

[0087] The attention area specifying unit 123 can set an attention area R within the angle of view seen from the display viewpoint position T as shown in FIG. 20, and thereby the attention 3D model M R2are displayed in the display space 117. The viewpoint position determination unit 122 can move the display viewpoint position T over time, and the attention area identification unit 123 can move the attention area R over time. By moving one or both of the display viewpoint position T and the attention area R over time, it is possible to express camerawork and improve the visibility of the content, such as presenting the development of an important story within the display space 117.

[0088] Furthermore, in 3D content where camerawork has been added in advance, such as CG animation or 3D computer games, the designated viewpoint position P, which is the viewpoint position designated by the content creator, is not always oriented horizontally, but may be oriented diagonally downward or upward relative to the horizontal direction. Note that the horizontal direction here is the virtual horizontal direction within the 3D content. Figure 21 shows the relationship between the user U and the 3D model of interest M. R1 1 is a schematic diagram showing a state in which the designated viewpoint position P is pointing diagonally downward.

[0089] The orientation of such a specified viewpoint position P and the focus 3D model M R1 22 and 23 show the relationship between the display space 117 and the 3D model M. R 21, when the designated viewpoint position P is directed diagonally downward, as shown in FIG. 22, when the user U views the spatial reproduction display 110 from the front, the 3D model of interest M appears in the display space 117. R2 In addition, depending on the orientation of the designated viewpoint position P, the 3D model M of interest may not be displayed within the field of view of the display space 117 as shown in FIG. R1 may not be located.

[0090] In this way, when the designated viewpoint position P is not oriented in the horizontal direction, the viewpoint position determination unit 122 can move the display viewpoint position T from the designated viewpoint position P. FIG. 24 is a schematic diagram showing a method for changing the position and orientation of the display viewpoint position T. As shown in FIGS. 24(a) and 24(b), the viewpoint position determination unit 122 moves the target 3D model MR1 24(c), the display viewpoint position T is moved to a position horizontal to the midpoint A of the target 3D model M, and the display viewpoint position T is directed in the horizontal direction. R1 The display space 117 is moved to be positioned on the line connecting the 3D model M R2 can be placed in the display space 117.

[0091] Note that the information processing device 120 may move one or both of the display viewpoint position T and the attention area R over time as described above, but may also move one or both of the display viewpoint position T and the attention area R in response to an operational input by the user. Specifically, the viewpoint position determination unit 122 can move the display viewpoint position T in response to an operational input by the user, and the attention area identification unit 123 can move the attention area R in response to an operational input by the user.

[0092] [About 2D display of 3D models] As described above, the spatial reproduction display system 100 displays the 3D model M R2 is located within the display space 117, but there may be a case where a 3D model exists between the display viewpoint position T and the display space 117.

[0093] FIG. 25 is a schematic diagram showing a user U, a display space 117, and a 3D model M. As shown in the figure, the 3D model M R2 is located within the display space 117, and the 3D model M3 is located from the inside to the outside of the display space 117. Furthermore, the 3D model M4 is located between the display space 117 and the display viewpoint position T. If the spatial reproduction display system 100 displays the 3D model M as is, the user U will see the cross section (inside) of the 3D model M3.

[0094] Here, the display control unit 129 can generate a 2D image in which the 3D model M located outside the display space 117 is projected onto the surface of the display space 117. Fig. 26 is a schematic diagram showing the generation of a 2D image by the 3D model control unit 126. As shown in the figure, the display control unit 129 generates an image G1 in which the 3D model M3 is projected onto the surface 117a of the display space 117, and an image G2 in which the 3D model M4 is projected onto the surface 117a.

[0095] This allows the user to view images G1 and G2 instead of 3D models M3 and M4, and prevents the user from viewing the cross sections (insides) of the 3D models. Note that the display control unit 129 can generate 2D images in which 3D models M located outside the display space 117, such as at the back of the display space 117, are projected onto the surface of the display space 117, in addition to the 3D models M located between the display space 117 and the display viewpoint position T.

[0096] Furthermore, the 3D model control unit 126 updates the 2D image according to the viewpoint position of the user U supplied from the user viewpoint detection unit 127. Fig. 27 is a schematic diagram showing updating of the 2D image by the 3D model control unit 126. When the viewpoint position of the user U changes as shown in Figs. 27(a) and 27(b), the 3D model control unit 126 generates a 2D image according to the viewpoint position of the user U.

[0097] Furthermore, when rendering a 2D image, the display control unit 129 may perform blurring on the 2D image. Fig. 28 is a schematic diagram showing a 3D model M and a blurred 2D image G. By performing blurring on the 2D image G as shown in the figure, it is possible to present the 3D model M as existing in front of the display space 117.

[0098] [About supplementary information] The spatial reproduction display system 100 features a featured 3D model M R1 Even if the display viewpoint position T is separated from the target 3D model M R2 is placed in the display space 117. Therefore, the user U can see the 3D model M R1In response to this, the information processing device 120 provides the following supplementary display to make it difficult to recognize that the 3D model of interest M R1 This allows the user to recognize that the position of the display viewpoint T is separated from the display viewpoint position T. Figures 29 to 33 are schematic diagrams showing supplementary displays by the information processing device 120.

[0099] As shown in Fig. 29(a), the 3D model of interest M R1 is positioned in the display space 117, and as shown in FIG. 29(b), R1 When the 3D model M moves away from the display viewpoint position T, the 3D model M appears in the display space 117 as shown in FIG. R2 Here, the display control unit 129 arranges the 3D model of interest M R1 Featured 3D Model M R2 During the process of changing the background of the 3D model M, the background of the 3D model M can be changed to a background with flowing light, as shown in Fig. 29(b) and Fig. 30. This allows the user U to change the background of the 3D model M R It's not just a scaled-down version, but a featured 3D model M R1 It is possible to recognize that the object has moved away from the display viewpoint position T.

[0100] Also, as shown in FIG. 31(a), the 3D model of interest M R1 is positioned in the display space 117, and as shown in FIG. 31(b), R1 When the 3D model M moves away from the display viewpoint position T, the 3D model M appears in the display space 117 as shown in FIG. R2 Here, the display control unit 129 displays the 3D model of interest M R1 Featured 3D Model M R2 During the process, pay attention to the 3D model M as indicated by the arrow. R2 The user U can then move the 3D model M slightly to the back and then return it to its original position. R1 It can be recognized that has moved away from the display viewpoint position T.

[0101] Also, as shown in FIG. 32(a), the 3D model of interest M R1 is positioned in the display space 117, and as shown in FIG. 32(b), R1 When the display viewpoint position T moves away from the display viewpoint position T, the 3D model M of interest appears in the display space 117. R2 Here, the display control unit 129 can display the 3D model M so that it extends beyond the display space 117 without changing the background of the 3D model M. Specifically, the display control unit 129 can hold a background model such as clouds separately from the 3D model M, render the background model only within the display space 117, and express the background model flowing into the background. Even with such a display, the user U can easily see the 3D model M. R1 It can be recognized that has moved away from the display viewpoint position T.

[0102] Furthermore, as shown in Fig. 33(a), the 3D model of interest M R1 is positioned in the display space 117, and as shown in FIG. 33(b), R1 When the display viewpoint position T moves away from the display viewpoint position T, the 3D model M of interest appears in the display space 117. R2 Here, the display control unit 129 displays the 3D model of interest M as shown in FIGS. R The displayed viewpoint position T and the focused 3D model M R The distance to the 3D model M can be displayed as a character string or a display such as a meter. R1 It can be recognized that has moved away from the display viewpoint position T.

[0103] [About display space size] In the spatial reproduction display system 100, the display space acquisition unit 124 acquires the size of the display space 117 as described above. Here, the size of the display space 117 may be changed in the spatial reproduction display 110. Fig. 34 is a schematic diagram showing how the size of the display space 117 is changed. As shown in the figure, in the spatial reproduction display 110, the size of the display space 117 can be changed by adjusting the tilt angle of the display area 116.

[0104] When the size of the display space 117 is changed, the display space acquisition unit 124 acquires the new size of the display space 117 and supplies it to the change processing execution determination unit 125 and the 3D model control unit 126. The change processing execution determination unit 125 and the 3D model control unit 126 can perform the above-mentioned processing based on the new size of the display space 117.

[0105] [About spatial reproduction displays] This technology can be used in a spatial reproduction display 110 that enables stereoscopic display of a 3D model M as if it actually exists in a display space 117. Here, the spatial reproduction display 110 is not limited to one that exists in real space, but may also be a spatial reproduction display that is virtually placed in a space formed by AR (Augmented Reality) glasses or VR (Virtual Reality) / HMD (Head Mounted Display).

[0106] [Hardware configuration of information processing device] A description will be given of a hardware configuration that can realize the functional configuration of the information processing device 120. Fig. 35 is a schematic diagram showing this hardware configuration.

[0107] As shown in the figure, the information processing device 120 incorporates a CPU (Central Processing Unit) 1001 and a GPU (Graphics Processing Unit) 1002. An input / output interface 1006 is connected to the CPU 1001 and the GPU 1002 via a bus 1005. A ROM (Read Only Memory) 1003 and a RAM (Random Access Memory) 1004 are connected to the bus 1005.

[0108] Connected to the input / output interface 1006 are an input unit 1007 including input devices such as a keyboard and a mouse through which a user inputs operation commands, an output unit 1008 that outputs processing operation screens and images of processing results to a display device, a storage unit 1009 including a hard disk drive or the like that stores programs and various data, and a communication unit 1010 including a LAN (Local Area Network) adapter or the like that executes communication processing via a network typified by the Internet. Also connected is a drive 1011 that reads and writes data from / to a removable storage medium 1012 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory.

[0109] The CPU 1001 executes various processes in accordance with a program stored in a ROM 1003 or a program read from a removable storage medium 1012 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, installed in a storage unit 1009, and loaded from the storage unit 1009 into a RAM 1004. The RAM 1004 also stores data necessary for the CPU 1001 to execute various processes as appropriate. The GPU 1002 executes calculations necessary for image rendering under the control of the CPU 1001.

[0110] In the information processing device 120 configured as described above, the CPU 1001 performs the above-described series of processes by, for example, loading a program stored in the memory unit 1009 into the RAM 1004 via the input / output interface 1006 and the bus 1005 and executing it.

[0111] The program executed by the information processing device 120 can be provided by being recorded on a removable storage medium 1012 such as a package medium, for example. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0112] In the information processing device 120, a program can be installed in the storage unit 1009 via the input / output interface 1006 by attaching the removable storage medium 1012 to the drive 1011. The program can also be received by the communication unit 1010 via a wired or wireless transmission medium and installed in the storage unit 1009. Alternatively, the program can be installed in advance in the ROM 1003 or the storage unit 1009.

[0113] The program executed by the information processing device 120 may be a program that is processed chronologically in the order described in this disclosure, or may be a program that is processed in parallel or at the required timing, such as when called.

[0114] Furthermore, the entire hardware configuration of the information processing device 120 does not have to be installed in one device, and the information processing device 120 may be configured by multiple devices. Furthermore, part of the hardware configuration of the information processing device 120 may be installed in multiple devices connected via a network.

[0115] [About this disclosure] The effects described in this disclosure are merely examples and are not limiting, and other effects may also be present. The description of multiple effects above does not necessarily mean that these effects are exhibited simultaneously. It means that at least one of the effects described above can be obtained depending on the conditions, etc., and effects not described in this disclosure may also be exhibited. Furthermore, at least two of the characteristic features described in this disclosure can be arbitrarily combined.

[0116] The present technology can also be configured as follows. (1) a viewpoint position determination unit that determines a viewpoint position relative to a 3D model in 3D content presented by a spatial reproduction display capable of stereoscopically displaying the 3D model; an attention area specifying unit that specifies an attention area including at least a portion of the 3D model; a display space acquisition unit that acquires the size of a display space for displaying the 3D model on the spatial reproduction display; a display control unit that changes the position of the 3D model of interest relative to the viewpoint position within the display space based on the viewpoint position, the viewpoint position, and the size of the display space, where the 3D model included in the viewpoint area is a 3D model of interest, and causes the spatial reproduction display to stereoscopically display the 3D model; An information processing device comprising: (2) The information processing device according to (1) above, The display control unit changes the position of the 3D model of interest within the display space by reducing the distance between the viewpoint position and the 3D model of interest at a first ratio, and reduces the size of the 3D model of interest at a second ratio that is the same as the first ratio. Information processing device. (3) The information processing device according to (1) above, The display control unit changes the position of the 3D model of interest within the display space by reducing the distance between the viewpoint position and the 3D model of interest at a first ratio, and reduces the size of the 3D model of interest at a second ratio such that the entire 3D model of interest fits within the display space. Information processing device. (4) The information processing device according to (2) or (3), The display control unit reduces the distance between the viewpoint position and the 3D model at the first ratio and reduces the size of the 3D model at the second ratio. Information processing device. (5) The information processing device according to any one of (1) to (4) above, The viewpoint position determining unit moves the viewpoint position in response to an operation input by a user. Information processing device. (6) The information processing device according to any one of (1) to (5) above, The attention area specifying unit moves the attention area in response to an operation input by a user. Information processing device. (7) The information processing device according to any one of (1) to (6) above, The viewpoint position determining unit moves the viewpoint position as time passes. Information processing device. (8) The information processing device according to any one of (1) to (7) above, The attention area specifying unit moves the attention area as time passes. Information processing device. (9) The information processing device according to any one of (1) to (8) above, The display control unit generates a 2D image by projecting the 3D model located outside the display space onto a surface of the display space, and causes the spatial reproduction display to display the 2D image. Information processing device. (10) The information processing device according to (9) above, The display control unit projects the 3D model located between the viewpoint position and the display space onto a surface of the display space on the viewpoint position side, thereby generating the 2D image. Information processing device. (11) The information processing device according to (10) above, The display control unit performs blurring on the original 2D image. Information processing device. (12) The information processing device according to any one of (1) to (11) above, The viewpoint position determination unit determines the viewpoint position to be the viewpoint position specified in the 3D content. Information processing device. (13) The information processing device according to any one of (1) to (11) above, The viewpoint position determination unit moves the viewpoint position specified in the 3D content so that the display space is positioned on a straight line connecting the viewpoint position and the 3D model of interest, and sets the viewpoint position as the viewpoint position. Information processing device. (14) The information processing device according to any one of (1) to (13) above, The attention area specifying unit specifies an attention area designated in the 3D content as the attention area. Information processing device. (15) The information processing device according to any one of (1) to (13) above, The attention area specifying unit specifies the attention area based on a result of detecting a user's gaze point. Information processing device. (16) The information processing device according to any one of (1) to (13) above, The attention area specifying unit specifies the attention area based on the arrangement of the 3D model. Information processing device. (17) The information processing device according to any one of (1) to (16) above, The display control unit generates a model image for the right eye and a model image for the left eye, which are parallax images of the 3D model seen from the viewpoint position, and displays the model image for the right eye and the model image for the left eye on the spatial reproduction display, thereby stereoscopically displaying the 3D model. Information processing device. (18) The information processing device according to any one of (1) to (17) above, The display control unit changes the orientation of the 3D model in accordance with the result of detecting the user's viewpoint. Information processing device. (19) a viewpoint position determination unit that determines a viewpoint position relative to a 3D model in 3D content presented by a spatial reproduction display capable of stereoscopically displaying the 3D model; an attention area specifying unit that specifies an attention area including at least a portion of the 3D model; a display space acquisition unit that acquires the size of a display space for displaying the 3D model on the spatial reproduction display; a display control unit that changes the position of the 3D model of interest relative to the viewpoint position within the display space based on the viewpoint position, the viewpoint position, and the size of the display space, and causes the spatial reproduction display to stereoscopically display the 3D model, assuming that the 3D model included in the viewpoint region is a 3D model of interest. A program that operates an information processing device as a (20) In 3D content presented by a spatial reproduction display capable of stereoscopically displaying a 3D model, determining a viewpoint position relative to the 3D model; identifying a region of interest that includes at least a portion of the 3D model; obtaining a size of a display space for displaying the 3D model on the spatial reproduction display; If the 3D model included in the attention area is a attention 3D model, the position of the attention 3D model relative to the viewpoint position is changed within the display space based on the viewpoint position, the attention area, and the size of the display space, and the 3D model is stereoscopically displayed on the spatial reproduction display. Information processing methods. [Explanation of symbols]

[0117] 100...Spatial reproduction display system 110...Spatial reproduction display 116…display area 117…display space 120...Information processing device 121...3D content storage unit 122... Viewpoint position determination unit 123...Area of ​​interest identification unit 124…Display space acquisition unit 125...Change processing execution determination unit 126...3D model control unit 127...User viewpoint detection unit 128...Rendering section 129...Display control unit

Claims

1. a viewpoint position determination unit that determines a viewpoint position relative to a 3D model in 3D content presented by a spatial reproduction display capable of stereoscopically displaying the 3D model based on a viewpoint position acquired from a 3D content storage unit that stores the 3D content; an attention area specifying unit that specifies an attention area including at least a part of the 3D model by acquiring the attention area from the 3D content storage unit; a display space acquisition unit that acquires a size of a display space for displaying the 3D model on the spatial reproduction display from a registry of the spatial reproduction display; a display control unit that changes the position of the 3D model of interest relative to the viewpoint position within the display space based on the viewpoint position, the viewpoint position, and the size of the display space, when the 3D model included in the viewpoint area is a 3D model of interest, and causes the spatial reproduction display to stereoscopically display the 3D model; An information processing device comprising:

2. 2. The information processing device according to claim 1, The display control unit changes the position of the 3D model of interest within the display space by reducing the distance between the viewpoint position and the 3D model of interest at a first ratio, and reduces the size of the 3D model of interest at a second ratio that is the same as the first ratio. Information processing device.

3. 2. The information processing device according to claim 1, The display control unit changes the position of the 3D model of interest within the display space by reducing the distance between the viewpoint position and the 3D model of interest at a first ratio, and reduces the size of the 3D model of interest at a second ratio such that the entire 3D model of interest fits within the display space. Information processing device.

4. 4. The information processing device according to claim 2, The display control unit reduces the distance between the viewpoint position and the 3D model at the first ratio and reduces the size of the 3D model at the second ratio. Information processing device.

5. 2. The information processing device according to claim 1, The viewpoint position determining unit moves the viewpoint position in response to an operation input by a user. Information processing device.

6. 2. The information processing device according to claim 1, The attention area specifying unit moves the attention area in response to an operation input by a user. Information processing device.

7. 2. The information processing device according to claim 1, The viewpoint position determining unit moves the viewpoint position as time passes. Information processing device.

8. 2. The information processing device according to claim 1, The attention area specifying unit moves the attention area as time passes. Information processing device.

9. 2. The information processing device according to claim 1, The display control unit generates a 2D image by projecting a 3D model other than the 3D model of interest, which is included in the 3D content and is located outside the display space, onto a surface of the display space, and displays the 2D image on the spatial reproduction display. Information processing device.

10. 10. The information processing device according to claim 9, The display control unit projects 3D models other than the 3D model of interest, among 3D models included in the 3D content, that are located between the viewpoint position and the display space, onto a surface of the display space on the viewpoint position side, to generate the 2D image. Information processing device.

11. The information processing device according to claim 10, The display control unit performs blurring processing on the 2D image. Information processing device.

12. 2. The information processing device according to claim 1, The viewpoint position determination unit determines a viewpoint position specified in the 3D content as the viewpoint position. Information processing device.

13. 2. The information processing device according to claim 1, The attention area specifying unit specifies an attention area designated in the 3D content as the attention area. Information processing device.

14. 2. The information processing device according to claim 1, The attention area specifying unit specifies the attention area based on the arrangement of the 3D model. Information processing device.

15. 2. The information processing device according to claim 1, The display control unit generates a model image for a right eye and a model image for a left eye, which are parallax images of the 3D model seen from the viewpoint position, and displays the model image for a right eye and the model image for a left eye on the spatial reproduction display, thereby stereoscopically displaying the 3D model. Information processing device.

16. 2. The information processing device according to claim 1, The display control unit changes the orientation of the 3D model in accordance with a result of detecting a user's viewpoint. Information processing device.

17. a viewpoint position determination unit that determines a viewpoint position relative to a 3D model in 3D content presented by a spatial reproduction display capable of stereoscopically displaying the 3D model by acquiring the viewpoint position relative to the 3D model from a 3D content storage unit that stores the 3D content; an attention area specifying unit that specifies an attention area including at least a part of the 3D model by acquiring the attention area from the 3D content storage unit; a display space acquisition unit that acquires a size of a display space for displaying the 3D model on the spatial reproduction display from a registry of the spatial reproduction display; a display control unit that changes the position of the 3D model of interest relative to the viewpoint position within the display space based on the viewpoint position, the viewpoint position, and the size of the display space, and causes the spatial reproduction display to stereoscopically display the 3D model, when the 3D model included in the viewpoint region is the 3D model of interest. A program that operates an information processing device as a

18. In 3D content presented by a spatial reproduction display capable of stereoscopically displaying a 3D model, determining a viewpoint position relative to the 3D model by acquiring the viewpoint position from a 3D content storage unit that stores the 3D content; identifying a region of interest that includes at least a portion of the 3D model by obtaining it from the 3D content storage unit; obtaining a size of a display space for displaying the 3D model on the spatial rendering display from a registry of the spatial rendering display; When the 3D model included in the attention area is set as the attention 3D model, the position of the attention 3D model relative to the viewpoint position is changed within the display space based on the viewpoint position, the attention area, and the size of the display space, and the 3D model is stereoscopically displayed on the spatial reproduction display. Information processing methods.

Images