Information processing device, information processing system, and component
By incorporating shielding and extension members aligned with real-space planes, the display device addresses user discomfort in stereoscopic images, enhancing focus adjustment and spatial recognition to maintain the three-dimensional effect.
Patent Information
- Application Number
- JP2021567264
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-12-27
- Filing Date
- 2020-12-14
- Publication Date
- 2025-12-09
- Estimated Expiration
- 2040-12-14
AI Technical Summary
Stereoscopic image display devices cause user discomfort due to the discrepancy between the actual display position and the perceived virtual object position, leading to fatigue and loss of the three-dimensional effect.
The implementation of a display device with a shielding member, extension member, and side wall members aligned along horizontal and vertical planes in real space to guide the user's gaze and activate focus adjustment, reducing the sense of discomfort by obstructing the display surface and inducing spatial recognition.
The solution effectively mitigates user discomfort by activating focus adjustment and spatial recognition, maintaining the stereoscopic effect and preventing the perception of the image as two-dimensional.
Smart Images

Figure 0007782266000001 
Figure 0007782266000002 
Figure 0007782266000003
Abstract
Description
[Technical Field]
[0001] The present technology relates to an information processing device, an information processing system, and a component, and particularly to an information processing device, an information processing system, and a component that can reduce the sense of discomfort felt by a user viewing a stereoscopic image. [Background technology]
[0002] In recent years, stereoscopic image display devices capable of displaying content in three dimensions have become widespread. Stereoscopic image display devices provide binocular parallax to the user by displaying a right-eye image and a left-eye image shifted horizontally on a display, and can display virtual objects at any distance in the depth direction.
[0003] For example, Patent Document 1 describes a technique for controlling the display on a display unit so that a stereoscopic image is displayed on a virtual display surface arranged in space. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2019 / 044188 Summary of the Invention [Problem to be solved by the invention]
[0005] However, when virtual depth is expressed using a stereoscopic image display device with a flat display surface, the surface position of the stereoscopic image display device, which is the actual display position, will differ from the virtual surface position of the virtual object.
[0006] Therefore, even though the focal position of the eyes is the surface position of the stereoscopic image display device, the user will perceive that the focus is on a virtual object that is virtually placed at a position different from the surface position of the stereoscopic image display device.
[0007] This may cause discomfort or fatigue to the user viewing the stereoscopic image due to the difference between the sense of position of the virtually placed virtual object and the sense of distance based on the user's everyday experience.
[0008] The present technology has been made in view of such circumstances, and is intended to reduce the sense of discomfort felt by a user viewing a stereoscopic image. [Means for solving the problem]
[0009] An information processing device according to one aspect of the present technology is an information processing device including a first display unit that displays a stereoscopic image, and a surface including an edge of the display surface of the first display unit, the surface being along at least one of a horizontal plane and a vertical plane in real space.
[0010] An information processing system according to one aspect of the present technology is an information processing system comprising an information processing device, a shielding member, an extension member, and a side wall member, wherein the information processing device comprises a display unit that displays a stereoscopic image, the shielding member is installed along a first horizontal plane in real space that includes an upper end of the display surface, the extension member is installed along a second horizontal plane in real space that includes a lower end of the display surface, and the side wall member is installed along a vertical plane in real space that includes each of the left and right ends of the display surface of the display unit.
[0011] A component according to one aspect of the present technology is a component that is installed along at least one of a horizontal plane and a vertical plane in real space, the plane including an edge of a display surface of a display unit that displays a stereoscopic image.
[0012] In an information processing device according to one aspect of the present technology, a stereoscopic image is displayed, and a user's gaze is attracted by a member that is a surface including an edge of the display surface and that is aligned along at least one of a horizontal plane and a vertical plane in real space.
[0013] In an information processing system according to one aspect of the present technology, a three-dimensional image is displayed, a shielding member is placed along a first horizontal plane in real space that includes an upper end of a display surface, an extension member is placed along a second horizontal plane in real space that includes a lower end of the display surface, and side wall members are placed along vertical planes in real space that include the left or right end, respectively, of the display surface.
[0014] In a component according to one aspect of the present technology, the user's gaze is attracted by a component that is installed along at least one of a horizontal plane and a vertical plane in real space, the component being a plane that includes an edge of a display surface that displays a stereoscopic image. [Brief explanation of the drawings]
[0015] [Figure 1] FIG. 10 is a diagram schematically illustrating a state of stereoscopic display. [Figure 2] 10A and 10B are side views showing examples of focus adjustment by a user observing a stereoscopic image. [Figure 3] 1 is a perspective view showing a first configuration example of the appearance of a display device according to an embodiment of the present technology. [Figure 4] FIG. 10 is a perspective view showing a second configuration of the exterior of the display device. [Figure 5] FIG. 3 is an enlarged cross-sectional view of a main part showing the vicinity of a shielding member. [Figure 6] FIG. 1 illustrates an example of the configuration of an information processing system. [Figure 7] FIG. 7 is a block diagram showing an example of a functional configuration of the information processing system of FIG. 6. [Figure 8] FIG. 10 is a perspective view showing a second configuration of the exterior of the display device. [Figure 9] FIG. 2 is an enlarged cross-sectional view of a main part showing the vicinity of the upper side of the mask part. [Figure 10] FIG. 10 is a perspective view showing a fourth configuration of the exterior of the display device. [Figure 11] FIG. 10 is a diagram illustrating another example of the configuration of the information processing system. [Figure 12] 12 is a block diagram showing an example of a functional configuration of the information processing system of FIG. 11. [Figure 13]FIG. 10 is another perspective view showing the fourth configuration of the exterior of the display device. [Figure 14] FIG. 10 is a perspective view showing a fifth configuration of the exterior of the display device. [Figure 15] FIG. 10 is another perspective view showing the fourth configuration of the exterior of the display device. [Figure 16] FIG. 10 is a diagram illustrating yet another exemplary configuration of the information processing system. [Figure 17] 17 is a block diagram showing an example of a functional configuration of the information processing system of FIG. 16. [Figure 18] FIG. 10 is a perspective view showing a sixth configuration of the appearance of the display device. [Figure 19] FIG. 10 is another perspective view showing the first configuration of the exterior of the display device. [Figure 20] FIG. 10 is a perspective view showing a seventh configuration of the appearance of the display device. [Figure 21] FIG. 10 is a cross-sectional view showing a seventh configuration of the appearance of the display device. [Figure 22] 10A and 10B are diagrams illustrating examples of a shielding member. [Figure 23] 10A and 10B are diagrams illustrating examples of shapes of a shielding member. [Figure 24] 10A and 10B are diagrams illustrating examples of shapes of a shielding member. DETAILED DESCRIPTION OF THE INVENTION
[0016] Hereinafter, embodiments of the present technology will be described in the following order. 1. Overview 2. Examples of shielding materials 3.Example of extension member 4. Variations
[0017] <1. Overview> In recent years, stereoscopic display of virtual objects has been realized by displaying a stereoscopic image consisting of an image for the left eye and an image for the right eye. A user can perceive depth due to binocular parallax, which is the difference between the image for the left eye and the image for the right eye.
[0018] Various technologies have been developed to deliver different images to the user's left and right eyes (images for the left and right eyes). For example, there are methods in which a user wears special glasses to view a display, a method in which a user wears a special device (HMD: Head Mounted Display) in which a display is placed in front of each eye, and methods that deliver different images to the left and right eyes without wearing glasses or a device (for example, parallax barrier methods and lenticular methods).
[0019] FIG. 1 is a diagram showing a schematic view of a stereoscopic display.
[0020] 1, a horizontally long rectangular display unit 11 configured by an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, etc. is provided on the front of the display 1. A narrow frame 12 is provided around the planar display unit 11.
[0021] The display 1 is installed, for example, so that the display unit 11 faces diagonally upward with respect to a horizontal plane in real space.
[0022] The display 1 is a display device capable of displaying a stereoscopic image on a display unit 11. In Fig. 1, an object O1 having a substantially cubic shape is displayed so that a part of it appears to protrude from the display 1.
[0023] The display 1 expresses virtual depth by displaying a stereoscopic image, and can give the user the sensation that the object O1 exists in real space.
[0024] 2 is a side view showing an example of focus adjustment by a user observing a stereoscopic image. For convenience of explanation, in FIG. 2, the display unit 11 is arranged so as to be perpendicular to the horizontal plane in real space.
[0025] When a stereoscopic image in which an object O1 is virtually positioned so that a part of it appears to protrude from the display unit 11 is displayed on the display unit 11, the image display position on the display unit 11 where the object O1 is actually displayed and the virtual surface position of the object O1 are different positions. The image display position of the object O1 is the position on the display surface of the display unit 11 shown by the dashed dotted line in Figure 2.
[0026] Therefore, even though the focal position of the eye is the position shown by the dashed line, the user will perceive it as if the focus is on, for example, vertex P1 of object O1, which is placed at a position different from the display surface of display unit 11.
[0027] The user may feel uncomfortable due to the difference between the sense of the position of the virtually placed object O1 and the sense of distance based on the user's experience, since the focus is maintained for a long time at the distance between the user and the display unit 11. The influence of such discomfort on the user's focus adjustment may cause the user to lose the stereoscopic effect they have or feel fatigued.
[0028] In this technology, as shown by the colored portion in Fig. 2, the obstruction 21 is provided near the display unit 11 so as to be horizontal with respect to a horizontal plane in real space. When the user views the display unit 11 from a certain viewpoint, the obstruction 21 is placed so as to obstruct a part of the object O1. In addition, the obstruction 21 has an effective shape and color so as not to interfere with the user's observation of the stereoscopic image.
[0029] The obstruction 21 has a structure (eye-catching structure) that attracts the user's gaze. The difference between the distance from the user's viewpoint to a part of the obstruction 21 and the distance from the viewpoint to the display surface induces the user to adjust their focus. In addition, the partial obstruction of the display surface by the obstruction 21 provides the user with a sense of front and back. Furthermore, the obstruction 21 can also activate the user's perception of convergence. These features make it possible to reduce the sense of discomfort that the user may experience when observing a stereoscopic image.
[0030] FIG. 3 is a perspective view showing a first configuration example of the appearance of a display device 31 according to an embodiment of the present technology.
[0031] As shown in FIG. 3, the display device 31 is provided with the display 1 described with reference to FIG.
[0032] A transparent protective panel 41 is provided as a cover member on the front surface of the display 1. A notch 41A is formed in part of the upper central edge of the protective panel 41 so that the camera 45 does not come into contact with the protective panel 41.
[0033] Side wall members 42-1 and 42-2, which are triangular plate-shaped transparent members, are provided on the left and right edge portions of frame 12 provided around display unit 11. Side wall members 42-1 and 42-2 are provided so that one side surface thereof contacts display 1.
[0034] The side wall members 42-1 and 42-2 are installed so as to be perpendicular to a horizontal plane in real space that includes the left and right ends of the display unit 11. The side wall members 42-1 and 42-2 are also installed so that the upper surfaces 42A-1 and 42A-2 are parallel to the horizontal plane in real space.
[0035] A shielding member 43, which is a narrow, strip-like, opaque member, is provided in the shape of a canopy at the upper edge of the frame 12. The shielding member 43 is installed so that the lower surfaces of the shorter sides thereof contact parts of the upper surfaces 42A-1 and 42A-2 and the longer sides thereof contact the protective panel 41.
[0036] An extension member 44, which is a table-shaped opaque member, is provided in front of the protection panel 41. The extension member 44 is placed so that its upper surface is horizontal to a horizontal plane in real space that includes the lower end of the display unit 11.
[0037] A camera 45 is provided on the upper side of the display 1 in accordance with the shape of the notch 41A. The camera 45 captures an image of the space in front of the display device 31.
[0038] The side wall members 42-1 and 42-2, the shielding member 43, and the extension member 44 function as the shield 21 described with reference to Fig. 2. That is, the side wall members 42-1 and 42-2, the shielding member 43, and the extension member 44 can activate the focusing function of the user's eyes and activate spatial recognition by blocking, in response to the user's movements and natural shaking while observing the stereoscopic image displayed on the display unit 11.
[0039] This makes it possible to mitigate the discomfort that can occur when the focal length is fixed or the image is left unobstructed for a long period of time due to the difference from the state that the user recognizes as correct based on their experience, resulting in a loss of the three-dimensional effect that the user has or the perception of the three-dimensional image as a two-dimensional image.
[0040] The display device 31 may be provided with all of the side wall members 42-1, 42-2, the shielding member 43, and the extension member 44, or may be provided with only some of the side wall members 42-1, 42-2, the shielding member 43, and the extension member 44.
[0041] <2. Examples of shielding materials> FIG. 4 is a perspective view showing a second configuration of the exterior of the display device 31. As shown in FIG.
[0042] In FIG. 4, of the above-mentioned members functioning as the shield 21, only the shield member 43 is provided on the display device 31.
[0043] In FIG. 4, the display unit 11 and the protection panel 41 are shown as members having the same shape.
[0044] FIG. 5 is an enlarged cross-sectional view of the main part of the shielding member 43 and its vicinity shown in FIG.
[0045] 5, the shielding member 43 is attached horizontally so as to extend forward from the protection panel 41. An upper surface 43A and a lower surface 43B of the shielding member 43 each become horizontal surfaces in real space.
[0046] A rear portion 61 is provided as part of the frame 12 on the rear side of the display portion 11. A predetermined gap is formed between the display 1 and the protection panel 41.
[0047] As shown by the hatched area in FIG. 5, in the cross section of the shielding member 43, the contact surface 43C that comes into contact with the protection panel 41 that is provided at an angle to the horizontal plane in real space is an inclined surface according to the angle of the protection panel 41.
[0048] The depth direction length of the upper surface 43A is shorter than the length from the upper end to the lower end of the display unit 11 and the length corresponding to the angle between the horizontal plane in real space and the display unit 11. In other words, the depth direction length of the upper surface 43A is shorter than the depth direction length of the horizontal plane of a rectangular parallelepiped having the upper and lower ends of the display unit 11 as diagonal sides. The depth direction length of the shielding member 43 is regarded as the depth direction length of the upper surface 43A.
[0049] As indicated by the two-dot chain line, the lower surface 43B is at the same height as the upper end of the display unit 11. In other words, the lower surface 43B is a surface along a horizontal plane in real space that includes the upper end of the display unit 11. The front surface 43E of the shielding member 43 is formed perpendicular to the horizontal plane in real space.
[0050] The angle of the shielding member 43 may be kept horizontal depending on the angle of the protection panel 41 with respect to the horizontal plane in real space. The shielding member 43 may be completely fixed to the housing of the display device 31, or may be configured to be integrated with the housing, or may be detachable from the housing of the display device 31.
[0051] FIG. 6 is a diagram illustrating an example of the configuration of an information processing system.
[0052] 6 is configured by providing a display control device 81 as an external device to the display device 31. The display control device 81 may be provided outside the housing of the display device 31, or the display control device 81 may be provided inside the housing of the display device 31 and configured as an information processing device.
[0053] The display control device 81 is configured by, for example, a PC (Personal Computer) or a dedicated device. The display control device 81 controls the display device 31 to display a stereoscopic image.
[0054] The display control device 81 includes a CPU (Central Processing Unit) 91, a storage unit 92, and a GPU (Graphics Processing Unit) 93.
[0055] The CPU 91 executes a predetermined program and controls the entire display control device 81. For example, the CPU 91 obtains a 3D model used to generate a stereoscopic image from the storage unit 92 and supplies it to the GPU.
[0056] The storage unit 92 is configured by a hard disk drive (HDD), a solid state drive (SSD), a main memory, etc. The storage unit 92 stores 3D models of objects to be displayed in three dimensions.
[0057] The GPU 93 is connected to the display 1 of the display device 31 via the display interface 82. The GPU 93 performs image processing such as rendering based on the 3D model under the control of the CPU 91, and generates a stereoscopic image. The GPU 93 outputs the stereoscopic image to the display 1.
[0058] Fig. 7 is a block diagram showing an example of the functional configuration of the information processing system in Fig. 6. Of the configurations shown in Fig. 7, the same components as those described above are denoted by the same reference numerals. Duplicate explanations will be omitted as appropriate.
[0059] As shown in FIG. 7, in the display control device 81, a renderer 101, a sensor information acquisition unit 102, and an image selection unit 103 are realized by a CPU 91 and the like.
[0060] A 3D model is input to the renderer 101. The renderer 101 generates stereoscopic images that represent the 3D model as viewed from multiple viewpoints, and supplies the images to the image selection unit 103. For example, the renderer 101 generates stereoscopic images for all viewpoints (viewing angles) that can be displayed by the display unit 11 of the display device 31.
[0061] The sensor information acquisition unit 102 acquires sensor information representing the detection results by the sensor unit 111 of the display device 31. The sensor information acquisition unit 102 detects the position and posture of the user based on the sensor information. The position and posture of the user may be, for example, a position and posture relative to the display unit 11. Furthermore, the position and posture of the user may be the position (viewpoint) of the user's eyes, or the position of the user's left eye and the position of the user's right eye. Furthermore, the posture of the user may be the direction of the user's face, or the line of sight of the user's left eye and right eye.
[0062] For example, when the sensor unit 111 is a camera 45 facing forward of the display device 31, the sensor information acquisition unit 102 detects the position and posture of the user based on the captured image supplied from the sensor unit 111. Note that information representing the position and posture of the user detected by the sensor unit 111 may be acquired by the sensor information acquisition unit 102. The sensor information acquisition unit 102 supplies the information representing the position and posture of the user to the image selection unit 103.
[0063] The image selection unit 103 selects a stereoscopic image to be displayed on the display unit 11 based on the information supplied from the sensor information acquisition unit 102. Specifically, the image selection unit 103 selects, from among the multiple stereoscopic images (View 1 Image to View x Image) supplied from the renderer 101, a stereoscopic image in which a 3D model is orthogonally projected according to the position and posture of the user.
[0064] The image selection unit 103 supplies the selected stereoscopic image to the display unit 11 of the display device 31, causing the stereoscopic image to be displayed.
[0065] The display device 31 includes a display unit 11 and a sensor unit 111 .
[0066] The sensor unit 111 is configured with a camera, a depth camera, a human presence sensor, etc. The sensor unit 111 detects a user observing a stereoscopic image. For example, when the sensor unit 111 is a camera 45, the sensor unit 111 captures an image in front of the display device 31 and generates a captured image.
[0067] By providing the shielding member 43 in the display device 31 having the above-described configuration, the user's focus adjustment function is activated, and the sense of discomfort that occurs when observing a stereoscopic image is reduced. Although an example in which the shielding member 43 functions as a shield has been described, the protective panel 41 can be formed so that it also functions as a shield.
[0068] FIG. 8 is a perspective view showing a second configuration of the exterior of the display device 31. As shown in FIG.
[0069] 8, the protective panel 41 is provided with a transparent, horizontally elongated rectangular transmitting portion 131, leaving behind a narrow mask portion 132 made of an opaque material. The mask portion 132 is provided so as to surround the upper, lower, left, and right edge portions of the transmitting portion 131.
[0070] FIG. 9 is an enlarged cross-sectional view of the main part showing the vicinity of the upper side of the mask part 132 in FIG.
[0071] 9, the mask unit 132 is provided obliquely in the same manner as the protection panel 41, which is provided obliquely with respect to a horizontal plane in real space. As shown by the hatched area A in FIG. 9, in the cross section of the mask unit 132, the contact surface 132E that comes into contact with the transmissive unit 131 is a horizontal plane in real space. That is, the contact surface 132E is provided along a horizontal plane in real space that includes the upper end of the display unit 11 on the depth side, as shown by the two-dot chain line.
[0072] The front surface 132A and the back surface 132B of the mask portion 132 are provided as parts of the front surface and the back surface of the protection panel 41, respectively.
[0073] The masking portion 132 may be provided only on the upper edge portion of the protective panel 41, or may be provided symmetrically on all the upper, lower, left, and right edge portions of the protective panel 41. The masking portion 132 may also be provided so as to correspond to the inclination of the display 1. Specifically, the masking portion 132 may be provided on the edge portion of the protective panel 41 that is farthest from the user in front of the display device 31.
[0074] As described above, the mask unit 132 is provided so as to protrude further forward of the display device 31 than the display unit 11. Therefore, the mask unit 132 functions as a minute shield 21 that shields part of the display unit 11. As a result, the mask unit 132 can activate the focusing function of the user's eyes by the user's movements or natural shaking, and can activate spatial recognition by shielding.
[0075] As shown in B of Fig. 9, a portion of the front surface and a portion of the back surface of the protective panel 41 may be painted. Alternatively, a portion of either the front surface or the back surface of the protective panel 41 may be painted.
[0076] In B of Fig. 9, the upper ends of both the front and back surfaces of protective panel 41 are painted with opaque paint. Front surface painted portion 151A, which is the front surface of painted protective panel 41, has the same shape as front surface 132A in A of Fig. 9. Furthermore, back surface painted portion 151B, which is the back surface of painted protective panel 41, has the same shape as back surface 132B in A of Fig. 9.
[0077] That is, the front surface coated portion 151A and the back surface coated portion 151B are provided so that their lower ends contact a horizontal plane in real space that includes the upper end of the display unit 11 on the depth side, as indicated by the two-dot chain line.
[0078] As described above, the surface coating portion 151A is provided so as to protrude further forward of the display device 31 than the display unit 11. Therefore, the surface coating portion 151A functions as a shield 21 that shields a part of the display unit 11. As a result, the surface coating portion 151A can activate the focusing function of the user's eyes by the user's movements or natural shaking, and can activate spatial recognition by shielding.
[0079] <3. Examples of extension members> FIG. 10 is a perspective view showing the exterior of the display device 31 in a fourth configuration.
[0080] In FIG. 10, of the above-mentioned members functioning as the shield 21, the extension member 44 and the mask portion 132 are provided on the display device 31.
[0081] A sub-display 211 is provided on the upper surface of the extension member 44. The sub-display 211 has a sub-display unit 215 configured by an LCD, an organic EL display, or the like. A sub-display image, which is an image continuous with the stereoscopic image displayed on the display unit 11, is displayed on the sub-display unit 215.
[0082] 10, a substantially rectangular floor object O21 is displayed across the display unit 11 and the sub-display unit 215. The floor object O21 is virtually disposed along the upper surface of the extension member 44, extending from the front side of the extension member 44 toward the depth direction.
[0083] The floor object O21 is represented by displaying a stereoscopic image showing a part of the floor object O21 on the display unit 11, and displaying a sub-display image showing the remaining part of the floor object O21 on the sub-display unit 215.
[0084] By displaying a sub-display image in which a floor object O21 is present on the display surface of the sub-display unit 215, the extension member 44 can activate the focusing function of the user's eyes more strongly than the above-mentioned member that functions as an obstruction 21.
[0085] The angle of the upper surface of the extension member 44 may be kept horizontal depending on the angle of the protection panel 41 with respect to a horizontal plane in real space. The extension member 44 may be completely fixed to the housing of the display device 31, or configured to be integrated with the housing, or may be detachable from the housing of the display device 31. In other words, the extension member 44 may be provided independently and detachably attached to the display device 31. When attaching the extension member 44 to the display device 31, it may be connected not only mechanically but also electrically.
[0086] FIG. 11 is a diagram illustrating another example of the configuration of the information processing system.
[0087] In Fig. 11, the same components as those in the information processing system in Fig. 6 are denoted by the same reference numerals, and duplicated explanations will be omitted where appropriate.
[0088] The configuration of the information processing system shown in FIG. 11 differs from the configuration described with reference to FIG. 6 in that an extension member 44 is provided in the display device 31.
[0089] The extension member 44 is provided with a sub-display 211 having a sub-display unit 215. The sub-display unit 215 is configured by a 3D display capable of displaying stereoscopic images or a 2D display capable of displaying only 2D images.
[0090] The sub-display 211 is connected to the GPU 201 of the display control device 81 via the display interface 201. The sub-display 211 displays the sub-display image supplied from the GPU 201 on the sub-display unit 215.
[0091] The GPU 93 outputs the sub-display image to the sub-display 211 .
[0092] Fig. 12 is a block diagram showing an example of the functional configuration of the information processing system in Fig. 11. Of the configurations shown in Fig. 12, the same components as those described above are denoted by the same reference numerals. Duplicate explanations will be omitted as appropriate.
[0093] The configuration of the information processing system shown in FIG. 12 differs from the configuration described with reference to FIG. 7 in that a sub-display unit 215 is provided in the display device 31.
[0094] The renderer 101 generates a plurality of stereoscopic images and also generates a sub-display image based on the 3D model. The renderer 101 supplies the sub-display image to the sub-display unit 215 for display.
[0095] The renderer 101 may be supplied with a stereoscopic image selected by the image selection unit 103 from the image selection unit 103, or with information representing the user's position and posture from the sensor information acquisition unit 102.
[0096] In these cases, the renderer 101 can generate a sub-display image based on information supplied from the image selection unit 103 and the sensor information acquisition unit 102.
[0097] The sub-display unit 215 displays the sub-display image supplied from the renderer 101.
[0098] It should be noted that a lighting device may be provided on the extension member 44. Also, it is not necessary to provide the sub-display 211 on the extension member 44.
[0099] FIG. 13 is another perspective view showing the fourth configuration of the exterior of the display device 31. In FIG.
[0100] 13, an illumination device 221 is provided so as to be housed in the edge portion of the lower end of the front surface of the extension member 44. The illumination device 221 is configured by a light source such as an LED (Light Emitting Diode). The illumination device 221 can irradiate light onto the detection range of the sensor unit 111. For example, the illumination device 221 can illuminate the shooting range of the camera 45 with light.
[0101] This makes it possible to improve the accuracy of the user's face recognition and pupil recognition by the sensor unit 111, regardless of the use environment of the display device 31. Furthermore, since the lighting device 221 is provided so as to be housed in the extension member 44, it is possible to improve the recognition performance of the sensor unit 111 with space-saving, cost-saving, and simple installation.
[0102] Note that the light from the illumination device 221 may cause the screen edges of the display device 31 to appear to glow. Therefore, by providing a mask unit 132 on the protective panel 41 of the display device 31, it is possible to prevent the user from seeing the protective panel 41 and the display 1 glowing due to the light from the illumination device 221. Furthermore, by providing the mask unit 132 at a position where the light from the illumination device 221 enters the protective panel 41 and the display 1, it is possible to prevent the light from the illumination device 221 from entering the protective panel 41 and the display 1. Therefore, by providing the mask unit 132 on the protective panel 41, it is possible to prevent the screen edges or the entire screen of the display device 31 from glowing due to the light from the illumination device 221, or to prevent the user from noticing the light from the screen edges. This can mitigate the light from the illumination device 221 interfering with the user's observation of a stereoscopic image and thus reducing the loss of the stereoscopic effect that the user experiences.
[0103] <4. Modifications> Example of a long shielding element FIG. 14 is a perspective view showing the appearance of the display device 31 in a fifth configuration.
[0104] In FIG. 14, of the members that function as the shield 21, the side wall members 42-1 and 42-2 and the shield member 251 are provided on the display device 31.
[0105] The side wall members 42-1 and 42-2 are installed so that the front surfaces 42E-1 and 42E-2 are perpendicular to the horizontal plane in real space.
[0106] The shielding member 251 is an opaque member that is longer in the depth direction than the shielding member 43 described with reference to Fig. 4. The shielding member 251 is installed so as to be in contact with the upper surfaces 42A-1 and 42A-2 of the side wall members 42-1 and 42-2. In other words, the shielding member 251 is provided along a horizontal plane in real space.
[0107] The depth length of the shielding member 251 is the same as the length from the top to the bottom of the display unit 11 and the length corresponding to the angle between a horizontal plane in real space and the display unit 11. In other words, the depth length of the shielding member 251 is the same as the depth length of the horizontal plane of a rectangular parallelepiped whose diagonal sides are the top and bottom ends of the display unit 11. Note that here, the depth length of the shielding member 251 is regarded as the depth length of the bottom surface.
[0108] The shielding member 251 is placed so that the front surface 251E is perpendicular to the horizontal plane in the real space.
[0109] FIG. 15 is another perspective view showing the fourth configuration of the exterior of the display device 31. In FIG.
[0110] 15, front surfaces 42E-1 and 42E-2 of side wall members 42-1 and 42-2 and a front surface 251E of shielding member 251 are illuminated. For example, light emitters (flat lights) such as OLEDs (Organic Light Emitting Diodes) and CLEDs (Crystal LED Displays) are provided on each of front surfaces 42E-1 and 42E-2 and 251E. Light is emitted by the light emitters provided on front surfaces 42E-1 and 42E-2 and 251E.
[0111] A fluorescent agent may be mixed into the sidewall members 42-1 and 42-2. In this case, light is emitted by the fluorescent agent mixed into the sidewall members 42-1 and 42-2. Alternatively, a light source may be provided in the housing of the display device 31, and light guide plates may be used as the sidewall members 42-1 and 42-2. In this case, light from the light source provided in the display device 31 enters the inside of the sidewall members 42-1 and 42-2 from one side surface thereof and is diffused from the front surfaces 42E-1 and 42E-2.
[0112] As described above, by illuminating front surfaces 42E-1, 42E-2 and front surface 251E, it is possible to make it easier for the user to recognize the presence of side wall members 42-1, 42-2 and shielding member 251 even when the user moves away from display unit 11. This makes it possible to guide the user's line of sight to side wall members 42-1, 42-2 and shielding member 251, thereby activating the focusing function of the user's eyes.
[0113] FIG. 16 is a diagram illustrating yet another exemplary configuration of the information processing system.
[0114] In Fig. 16, the same components as those in the information processing system in Fig. 11 are denoted by the same reference numerals, and duplicated explanations will be omitted where appropriate.
[0115] The configuration of the information processing system shown in Figure 16 differs from the configuration described with reference to Figure 11 in that the display device 31 is provided with a shielding member 251 and light sources 291-1 to 291-6, and the display control device 81 is provided with an I / O (Input / Output) unit 281.
[0116] The I / O unit 281 is configured with a USB (Universal Serial Bus) interface, a UART (Universal Asynchronous Receiver / Transmitter), etc. The I / O unit 281 is connected to light sources 291-1 to 291-6 of the display device 31 via a wire 271. The I / O unit 281 supplies control signals to the light sources 291-1 to 291-6 to drive the light sources 291-1 to 291-6 and control the color of the light to be output.
[0117] The light sources 291-1 to 291-6 are provided in the housing of the display device 31. The light sources 291-1 to 291-3 are provided on the side wall member 42-1 side of the display device 31, and emit light under control of the I / O unit 281. The light output by the light sources 291-1 to 291-3 enters the inside of the side wall member 42-1 from the side surface and is diffused from the front surface 42E-1.
[0118] On the other hand, the light sources 291-4 to 291-6 are provided on the side wall member 42-2 side of the display device 31, and emit light under control of the I / O unit 281. The light output from the light sources 291-4 to 291-6 enters the inside of the side wall member 42-2 from the side surface and is diffused from the front surface 42E-2.
[0119] Fig. 17 is a block diagram showing an example of the functional configuration of the information processing system in Fig. 16. Of the configurations shown in Fig. 17, the same components as those described above are denoted by the same reference numerals. Duplicate explanations will be omitted as appropriate.
[0120] 17 differs from the configuration described with reference to Fig. 12 in that a light source 291 and a driver 321 are provided in the display device 31, and an I / O unit 281 and an edge color calculation unit 311 are provided in the display control device 81. In the display control device 81, the edge color calculation unit 311 is realized by a CPU 91 or the like.
[0121] The edge color calculation unit 311 receives a plurality of three-dimensional images from the renderer 101. Based on the three-dimensional images received from the renderer 101, the edge color calculation unit 311 determines the color, brightness, and lighting pattern of light for the light source 291. For example, the edge color calculation unit 311 determines the color of light to be output by the light source 291 to be a color contained in the three-dimensional image or a color associated with the environment of the space depicted in the three-dimensional image.
[0122] The edge color calculation unit 311 supplies the light emission information to the I / O unit 281. The light emission information includes information representing the color, brightness, and lighting state of the light.
[0123] The I / O unit 281 generates a control signal for causing the light source 291 to emit light in accordance with the light emission information supplied from the edge color calculation unit 311 , and supplies the control signal to a driver 321 of the display device 31 .
[0124] The driver 321 controls the light source 291 in accordance with the control signal supplied from the I / O unit 281 .
[0125] The light source 291 is configured by an LED, an EL element, etc. The light source 291 emits light according to the control of the driver 321.
[0126] As described above, the information processing system can illuminate the front surfaces 42E-1 and 42E-2 in colors that match the stereoscopic image.
[0127] This makes it possible to more naturally guide the user's line of sight to the side wall members 42-1 and 42-2 and the shielding member 251, thereby activating the focusing function of the user's eyes. Furthermore, the display device 31 can improve the sense of immersion in content expressed by stereoscopic images.
[0128] It is also possible to light not only the front surfaces 42E-1 and 42E-2 but also one surface or the entire side wall members 42-1 and 42-2 in a manner that matches the stereoscopic image by emitting light from the light source 291. For example, a color corresponding to the image displayed on the display unit 11 may be expressed inside the side wall members 42-1 and 42-2, or an image corresponding to the image displayed on the display unit 11 may be displayed.
[0129] -Example of an integrated flexible display FIG. 18 is a perspective view showing the appearance of the display device 31 in a sixth configuration.
[0130] 18, instead of the display 1 (the display unit 11) and the sub-display 211 (the sub-display unit 215), an integrated flexible display 351 may be provided in the display device 31. The flexible display 351 is configured by a foldable display such as an organic EL display.
[0131] The flexible display 351 is provided along the protection panel 41 , is bent near the contact point between the protection panel 41 and the extension member 44 , and is provided along the upper surface of the extension member 44 .
[0132] On the flexible display 351, a stereoscopic image is displayed in which the stereoscopic image displayed on the display unit 11 and the sub-display image displayed on the sub-display unit 215 are combined.
[0133] Example of a linear shielding element FIG. 19 is another perspective view showing the first configuration of the exterior of the display device 31. In FIG.
[0134] 19, linear shielding members 361 are provided between the vertices of the side wall members 42-1 and 42-2 of the display device 31 described with reference to FIG. 3. The shielding members 361 are provided along a horizontal plane in real space. The shape of the shielding members 361 may be a long, thin plate. The shielding members 361 may be a predetermined color, such as white.
[0135] The color of the shielding member 361 may be changed in accordance with the stereoscopic image displayed on the display unit 11. The shielding member 361 may also be formed so as to emit light.
[0136] The shielding member 361 serves as a reference to attract the user's gaze and can activate the focusing function of the user's eyes.
[0137] Example of a water tank-type component 20 and 21 are perspective views showing a seventh configuration of the exterior of the display device 31. FIG.
[0138] 20 and 21, a water tank-shaped member 371, which is a water tank-shaped shield, is provided in front of protection panel 41. Water tank-shaped member 371 is made up of side wall members 42-1 and 42-2, a shielding member 381, and a front member 382.
[0139] Shielding member 381 has the same shape as shielding member 251 described with reference to Fig. 14 and is provided at the same position. Shielding member 381 differs from shielding member 251 in that it is transparent. Front surface member 382 contacts shielding member 381 and side wall members 42-1 and 42-2, and is provided along a vertical plane in real space.
[0140] As shown in FIG. 21, the shielding member 381 and the front member 382 are provided so that their cross sections are hook-shaped.
[0141] The reflection of the outside scenery on the surface of aquarium-shaped member 371 serves as a reference that attracts the user's gaze and activates the focusing function of the user's eyes. Although the surface of aquarium-shaped member 371 is visible no matter what angle the stereoscopic image is viewed from, the user recognizes the surface of aquarium-shaped member 371 as part of an object they normally see, such as an aquarium or showcase, and therefore it is possible to reduce the sense of incongruity felt by having aquarium-shaped member 371 installed on display device 31.
[0142] As part of the water-tub-shaped member 371, a linear shielding member 361 (FIG. 19) may be formed between the vertices of the sidewall members 42-1 and 42-2.
[0143] - Shape of the shielding member 251 FIG. 22 is a diagram showing an example of the shielding member 251. As shown in FIG.
[0144] 22, the larger the area of the representation space of the display device 31 that is covered by the shielding member 251, the more strongly the shielding member 251 attracts the user's gaze and the more the user's eye focusing function is activated. However, as the shielding member 251 becomes larger, it is expected that the area in which the stereoscopic image can be observed without being blocked by the shielding member 251 will be limited.
[0145] Therefore, by forming the shielding member 251 in a shape as shown in FIGS. 23 and 24, the observation area in which the stereoscopic image is blocked by the shielding member 251 can be reduced.
[0146] 23 and 24 are diagrams showing examples of the shape of the shielding member 251. FIG.
[0147] A in Fig. 23 shows a shielding member 251 that widely covers the representation space of the display device 31 described with reference to Fig. 22. As described with reference to Fig. 14, the depth direction length of the shielding member 251 in A in Fig. 23 is the same as the depth direction length of the horizontal plane of a rectangular parallelepiped having the upper and lower ends of the display unit 11 as diagonal sides.
[0148] Fig. 23B shows a shielding member 251 whose length in the depth direction of display device 31 is shorter than that of shielding member 251 in Fig. 23A. Shielding member 251 in Fig. 23B corresponds to shielding member 43 described with reference to Fig. 5 etc. As described with reference to Fig. 5, the length in the depth direction of shielding member 251 in Fig. 23B is shorter than the length in the depth direction of the horizontal plane of a rectangular parallelepiped whose diagonal sides are the upper and lower ends of display unit 11.
[0149] Fig. 24A shows a shielding member 251 having a trapezoidal opening 251H-1 formed therein. As shown by the colored portions, the shielding member 251 in Fig. 24A has a shape in which a rectangular plate is cut out along the opening 251H-1. The opening 251H-1 is formed on the front side of the shielding member 251.
[0150] 24B shows a shielding member 251 in which a trapezoidal opening 251H-2 is formed. The area of the opening 251H-2 is smaller than the area of the opening 251H-1 (FIG. 24A). As shown by the colored portions, the shielding member 251 in FIG. 24B has a shape in which a rectangular plate is cut out along the opening 251H-2. The opening 251H-2 is formed on the front side of the shielding member 251.
[0151] As described above, by forming the shape of the shielding member 251 so that the central portion, which is an important area when observing a stereoscopic image, is cut out, it is possible to reduce the observation area of the stereoscopic image blocked by the shielding member 251, without impairing the effect of attracting the user's gaze. Note that, although Fig. 24 shows the case where the opening 251H is formed in a substantially trapezoidal shape, any other shape may be used as long as it is possible to reduce the observation area of the stereoscopic image blocked by the shielding member 251.
[0152] ·others The above-described members functioning as the shielding member 21, such as the sidewall members 42-1 and 42-2, the shielding member 43, and the extension member 44, can activate the focusing function of the user's eyes even if they are provided at any position above, below, left, or right of the display unit 11 serving as the screen of the display device 31. For example, the shielding member 43 may be provided near the bottom edge or near the left or right edge of the display unit 11. When the display device 31 is rotated for use, members formed along the four sides of the display unit 11 can also activate the focusing function of the user's eyes. Furthermore, the tilt of the display 1 may be changeable, and may be set to an arbitrary or predetermined tilt. In this case, the position, tilt, or configuration of the members functioning as the shielding member 21, such as the sidewall members 42-1 and 42-2, the shielding member 43, and the extension member 44, may be changeable or may be automatically changed according to the state of the display device 31, such as the tilt of the display 1.
[0153] The above-described display device 31 can be configured as, for example, a display device, a dedicated device, a PC (Personal Computer), a television receiver, a tablet computer, or other electronic device. Therefore, the display device 31 can also be said to be an information processing device such as a PC.
[0154] Furthermore, the above-described sidewall members 42-1 and 42-2, shielding member 43, extension member 44, and other members can be formed using materials and exterior colors that are appropriate for each. Furthermore, when completely fixing the sidewall members 42-1 and 42-2, shielding member 43, extension member 44, and other members to the display device 31, fixing methods such as adhesives or screws can be used. Furthermore, like the shielding member 43 and extension member 44, the sidewall members 42-1 and 42-2 may be completely fixed to the housing of the display device 31, or may be configured to be integrated with the housing, or may be removable from the housing of the display device 31.
[0155] In this specification, edges such as the top, bottom, left, and right edges are also referred to as edges, and the term "edge" is not limited to edges in the strict sense but may include areas near the edges. For example, the term "edge" is not limited to the top edge of the display surface but may include areas near the top edge.
[0156] The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.
[0157] The program to be installed is provided by being recorded on removable media 1011 such as an optical disc (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or semiconductor memory. Alternatively, the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in a ROM (Read Only Memory) or the storage unit 92 shown in FIG. 6.
[0158] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.
[0159] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.
[0160] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0161] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.
[0162] <Configuration combination example> The present technology can also be configured as follows.
[0163] (1) a first display unit that displays a stereoscopic image; a surface including an edge of the display surface of the first display unit, the surface being a member along at least one of a horizontal plane and a vertical plane in real space; An information processing device comprising: (2) The member is a first shielding member along a first horizontal plane in real space that includes the upper end of the display surface. The information processing device according to (1) above. (3) The first shielding member has a length that is shorter than the length from the top to the bottom of the display surface and a length that corresponds to the angle between the first horizontal plane and the display surface. The information processing device according to (2) above. (4) The first shielding member has a masked area along the first horizontal plane and is configured as a cover member provided along the display surface. The information processing device according to (2) above. (5) The first shielding member is configured as a cover member that is painted on both the front and back sides so that the portion that contacts the first horizontal surface is the lower end and is provided along the display surface. The information processing device according to (2) above. (6) The first shielding member has a length corresponding to the length from the top to the bottom of the display surface and the angle formed between the first horizontal plane and the display surface. The information processing device according to (2) above. (7) The first shielding member has a cut-out shape. The information processing device according to (2) or (6). (8) The member is an extending member along a second horizontal plane in real space that includes the lower end of the display surface. The information processing device according to any one of (1) to (7). (9) The extension member has a second display unit that displays an image continuous with the stereoscopic image displayed on the display surface. The information processing device according to (8). (10) The extension member has a light emitting body. The information processing device according to (8) or (9). (11) a sensor unit for acquiring information about a user observing the stereoscopic image, the light emitter emits light to assist the sensor unit in acquiring information, The first display unit displays a stereoscopic image determined based on the result of information acquisition by the sensor unit. The information processing device according to (10) above. (12) The information processing device further includes a first shielding member provided to prevent light emitted from the light emitter from being emitted from the information processing device. The information processing device according to (11) above. (13) The members are two side wall members along a vertical plane in real space that includes the left and right ends of the display surface. The information processing device according to any one of (1) to (12). (14) The sidewall member has a light emitter. The information processing device according to (13) above. (15) The side wall member is a light guide plate that diffuses light emitted by a light emitter provided in a housing that houses the first display unit. The information processing device according to (13) above. (16) a control unit that controls the color of the light emitted by the light emitter based on the stereoscopic image; The information processing device according to (14) or (15). (17) The members further include two side wall members along a vertical plane in real space that includes the left and right ends of the display surface, and a front surface member that contacts the first shielding member and the side wall members and that extends along the vertical plane in real space. The information processing device according to (2) above. (18) The device further includes a linear second shielding member provided along the first horizontal plane. The information processing device according to any one of (2) to (17). (19) An information processing system including an information processing device, a shielding member, an extension member, and a side wall member, the information processing device includes a display unit that displays a stereoscopic image; the shielding member is installed along a first horizontal plane in real space that includes an upper end of a display surface of the display unit, the extension member is installed along a second horizontal plane in real space that includes a lower end of the display surface of the display unit, The side wall member is installed along a vertical plane in real space that includes the left end or the right end of the display surface of the display unit. Information processing system. (20) A surface including an edge of the display surface of a display unit that displays a stereoscopic image, and is installed along at least one of a horizontal plane and a vertical plane in real space. Components. [Explanation of symbols]
[0164] 1 display, 11 display unit, 12 frame, 21 shielding object, 31 display device, 41 protective panel, 42-1, 42-2 side wall member, 43 shielding member, 44 extension member, 45 camera, 81 display control device, 101 renderer, 102 sensor information acquisition unit, 103 image selection unit, 111 sensor unit, 131 transmission unit, 132 mask unit, 151A surface coating unit, 151B back surface coating unit, 211 sub-display, 215 sub-display unit, 221 lighting device, 251 shielding member, 281 I / O unit, 291-1 to 291-6 light source, 321 driver, 351 flexible display, 361 shielding member, 371 aquarium-shaped member, 381 Shielding member, 382 Front member, 251H-1, 251H-2 Opening
Claims
1. a first display unit that is a display unit that actually displays a stereoscopic image made up of a left-eye image and a right-eye image having parallax therebetween, the first display unit facing diagonally upward with respect to a horizontal plane in real space; a first shielding member along a first horizontal plane in real space that includes an upper end of a display surface of the first display unit; Equipped with The length of the first shielding member in the depth direction is equal to or less than the length of the depth direction of a horizontal plane of a rectangular parallelepiped having diagonal sides extending from the top end to the bottom end of the display screen. Information processing device.
2. The first shielding member is an opaque member. The information processing device according to claim 1 .
3. The first shielding member has a masked area along the first horizontal plane and is configured as a cover member provided along the display surface.
3. The information processing device according to claim 1.
4. The first shielding member is configured as a cover member that is painted on both the front and back sides so that the portion that contacts the first horizontal surface is the lower end and is provided along the display surface.
3. The information processing device according to claim 1.
5. The first shielding member has a cut-out shape.
3. The information processing device according to claim 1.
6. and an extension member extending along a second horizontal plane in real space, the second horizontal plane including a lower end of the display surface.
6. The information processing device according to claim 1.
7. The extension member has a second display unit that displays an image continuous with the stereoscopic image displayed on the display surface. The information processing device according to claim 6 .
8. The extension member has a first light emitter.
8. The information processing device according to claim 6 or 7.
9. a sensor unit for acquiring information about a user observing the stereoscopic image, the first light emitter emits light to assist the sensor unit in acquiring information; The first display unit displays a stereoscopic image determined based on the result of information acquisition by the sensor unit. The information processing device according to claim 8 .
10. The first shielding member is provided to prevent light emitted from the first light-emitting body from being emitted from at least one of the first display unit and a cover member provided along the display surface. The information processing device according to claim 9 .
11. and two sidewall members along a vertical plane in real space, the sidewall members including the left and right ends of the display surface. The information processing device according to claim 1 .
12. The sidewall member has a second light emitter. The information processing device according to claim 11.
13. The side wall member is a light guide plate that diffuses light emitted by a third light emitter provided in a housing that houses the first display unit. The information processing device according to claim 11.
14. a control unit that controls the color of the light output by the third light emitter based on the stereoscopic image. The information processing device according to claim 13.
15. Further comprising a front surface member that contacts the first shielding member and the side wall member and that is aligned along a vertical plane in real space.
15. The information processing device according to claim 11.
16. The device further includes a linear second shielding member provided along the first horizontal plane.
16. The information processing device according to claim 1.
17. An information processing system including an information processing device, a shielding member, an extension member, and a side wall member, The information processing device includes: a display unit that actually displays a stereoscopic image made up of a left-eye image and a right-eye image having parallax therebetween, the display unit facing obliquely upward with respect to a horizontal plane in real space; the shielding member is installed along a first horizontal plane in real space that includes an upper end of a display surface of the display unit, the length in the depth direction of the shielding member is equal to or less than the length in the depth direction of a horizontal plane of a rectangular parallelepiped having diagonal sides extending from the upper end to the lower end of the display surface of the display unit, the extension member is installed along a second horizontal plane in real space that includes a lower end of the display surface of the display unit, The side wall member is installed along a vertical plane in real space that includes the left end or the right end of the display surface of the display unit. Information processing system.
Citation Information
Patent Citations
JP1987176882U
Stereoscopic display system utilizing parallax
JP1998333079A
Stereoscopic image display apparatus, and polarizing glasses apparatus for stereoscopic image display apparatus
JP2004104371A
Game system
JP2010213805A
Image presentation device, image presentation method and program
JP2010259003A