Display system, display control device, and computer-readable medium

Abstract

The present invention provides a display system, a display control device, and a computer-readable medium. The display system comprises N pixel groups capable of displaying different images in N directions (N is a natural number), and a processor, wherein the processor determines a direction in which a person can be visually recognized by the pixel group, and displays an image in a direction less than N, including at least the determined direction, on the pixel group corresponding to the direction.

Description

Technical Field

[0001] The present disclosure relates to a display system, a display control device, and a computer-readable medium. Background Art

[0002] Japanese Patent Application Publication No. 2018-523321 describes a technology that provides a display for the right eye and the left eye, and prepares images with a viewpoint changed according to the orientation of each display, thereby achieving stereoscopic vision. Summary of the Invention

[0003] One method for displaying different images in multiple directions is known as panoramic imaging. In this method, microlenses are arranged in an array to display images on a display unit, with each pixel facing a different direction, thereby embodying stereoscopic vision. In this technology, to provide different images to people in different directions, different image signals are generated for pixel groups assigned to different directions. Therefore, rendering processing must be performed in parallel according to the number of directions in which different images can be displayed, resulting in a huge processing load.

[0004] Therefore, an object of the present disclosure is to reduce the load of image processing compared to the case where images are provided to people in multiple directions for an unspecified number of people.

[0005] According to the first scheme of the present disclosure, a display system is provided, which has N groups of pixel groups capable of displaying different images in N directions (N is a natural number), respectively, and a processor, wherein the processor determines the direction of a person who can visually identify the pixel group, and displays an image in a direction less than N directions including at least the determined direction on the pixel group corresponding to the direction.

[0006] According to the second scheme of the present disclosure, the N groups of pixel groups are arranged in the first direction, and the processor determines the direction of the person through the first angle of the person in the first direction and the second angle in the second direction, so that the image of the three-dimensional object when observed from the direction of the second angle is displayed on the pixel group that displays the image in the direction of the first angle.

[0007] According to the third aspect of the present disclosure, the processor displays the image of the person facing the specified direction on the pixel groups whose number corresponds to the form of change in the position of the person in the real space.

[0008] According to the fourth aspect of the present disclosure, the change form of the position includes at least one or more of the moving direction of the position, the moving speed of the position, and the time during which the position is fixed.

[0009] According to the fifth aspect of the present disclosure, the processor displays an image of a three-dimensional object viewed from a viewpoint corresponding to a change in the position of the person whose direction is determined in the real space.

[0010] According to the sixth aspect of the present disclosure, the change form of the position includes at least one or more of a moving direction of the position, a moving speed of the position, and a time during which the position is fixed.

[0011] According to the seventh aspect of the present disclosure, the processor causes the image of the person facing the specified direction to be displayed on the following number of pixel groups, the number of which corresponds to the position of the person.

[0012] According to the eighth aspect of the present disclosure, the processor displays the image of each person facing the specified direction on the pixel groups whose number corresponds to the number of the persons.

[0013] According to the ninth aspect of the present disclosure, the processor displays the image of the person facing the specified direction on the pixel groups whose number corresponds to the movement of the specific part of the person.

[0014] According to the tenth aspect of the present disclosure, the processor displays an image of a three-dimensional object viewed from a viewpoint corresponding to the movement of the specific part of the person whose direction is determined.

[0015] According to the 11th scheme of the present disclosure, a display control device is provided, which has N groups of pixel groups capable of displaying different images in N directions (N is a natural number), respectively, and a processor, wherein the processor determines the direction of a person who can visually identify the pixel group, and displays an image in a direction less than N directions including at least the determined direction on the pixel group corresponding to the direction.

[0016] According to the 12th scheme of the present disclosure, a computer-readable medium is provided, which stores a program for causing a computer to execute processing, wherein the computer has N groups of pixel groups capable of displaying different images in N directions (N is a natural number) respectively, and a processor, wherein the processing includes: a step of determining the direction of a person who can visually identify the pixel group; and a step of causing an image in a direction less than N directions including at least the determined direction to be displayed on the pixel group corresponding to the direction.

[0017] Effects of the Invention

[0018] According to the first, eleventh, and twelfth aspects, the load of image processing can be reduced compared to the case where images are provided to people in multiple directions for an unspecified number of people.

[0019] According to the second aspect, stereoscopic display can be performed also in directions other than the direction in which the pixels included in the pixel group are arranged.

[0020] According to the third and fourth aspects, compared with the case where the number of pixel groups is fixed, more accurate images can be viewed, and more people can view accurate images.

[0021] According to the fifth and sixth aspects, compared with a case where the viewpoint is fixed, it is easier to view the image of a three-dimensional object from a desired angle.

[0022] According to the seventh aspect, compared with the case where the number of pixel groups is fixed, people at any position can see more accurate images, and more people can see accurate images.

[0023] According to the eighth aspect, pixel groups can be effectively utilized regardless of the number of people.

[0024] According to the ninth aspect, the person viewing the image can change the accuracy of the image by his or her own will.

[0025] According to the tenth aspect, a person viewing an image can change the angle of the image by his or her own will. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 1 is a diagram showing the overall configuration of a multi-directional display system according to an embodiment.

[0027] Figure 2 This is an enlarged view of the grating sheet.

[0028] Figure 3 A diagram showing an example of directions in which images are displayed.

[0029] Figure 4 is a diagram showing the hardware configuration of an image processing device.

[0030] Figure 5 This is a diagram showing a functional configuration implemented by the image processing device.

[0031] Figure 6 This is a diagram showing an example of an angle indicating the direction of a person.

[0032] Figure 7 This is a diagram showing an example of the operation steps in the display process. DETAILED DESCRIPTION

[0033] [1] Example

[0034] Figure 1The overall structure of a multi-directional display system 1 according to an embodiment is shown. Multi-directional display system 1 is a system that displays different images in multiple directions and is an example of a "display system" in the present disclosure. Multi-directional display system 1 includes a display device 10, an imaging device 20, and an image processing device 30.

[0035] Display device 10 is a device that displays images and has the function of displaying different images in multiple directions. Display device 10 includes a display body 11 and a lenticular sheet 12. Display body 11 displays images by emitting light from a plurality of pixels arranged in a planar pattern. Display body 11 is, for example, a liquid crystal display, but may also be an organic EL (electroluminescence) display or a plasma display.

[0036] The grating sheet 12 is mounted on the display surface 111 of the display main body 11. Figure 1 , the three-dimensional coordinate axes are represented by the X-axis, the Y-axis, and the Z-axis. The coordinate axes on the plane along the display surface 111 are the X-axis (the axis along the horizontal direction) and the Y-axis (the axis along the vertical direction), and the Z-axis is positive in the direction opposite to the normal of the display surface 111. Hereinafter, the direction indicated by the arrow of each axis is referred to as the positive direction, and the direction opposite to the positive direction is referred to as the negative direction. Furthermore, the direction along each axis is referred to as the "X-axis direction," the "Y-axis direction," and the "Z-axis direction."

[0037] The lenticular sheet 12 is a sheet on which elongated arched (partially cylindrical) convex lenses are arranged and mounted on the negative Z-axis side of the display surface 111. Figure 2 The relationship between the grating sheet 12 and the pixels of the display main body 11 will be described.

[0038] Figure 2 The grating plate 12 is shown in an enlarged manner. Figure 2 Schematically shows the grating sheet 12 and the pixel portion 112 of the display body 11 viewed along the positive direction of the Y axis.

[0039] The grating sheet 12 includes lens sections 122-1, 122-2, 122-3, 122-4, 122-5, 122-6, ... (hereinafter referred to as "lens section 122" unless otherwise specified). The pixel section 112 includes a pixel group 112-1 including pixels 112-1-1, 112-1-2, 112-1-3, 112-1-4, 112-1-5, 112-1-6, ...

[0040] As mentioned above, the plurality of lens portions 122 are each an elongated arched convex lens, and are arranged in the X-axis direction. That is, each lens portion 122 is arranged such that its length direction is along the Y-axis. Figure 2 In the example, for example, four pixels are arranged along the X-axis direction in the opposing regions 123-1, 123-2, 123-3, 123-4, 123-5, 123-6, ... (hereinafter referred to as "opposing regions 123" when not distinguishing one from the other) opposing the lens portions 122.

[0041] In addition, Figure 2 In the figure, for ease of viewing, the number of pixels arranged along the X-axis direction in each opposing region 123 is set to 4. However, the display body 11 has N (N is a natural number) pixel groups in each opposing region 123. In this embodiment, N is greater than 4, which will be described in detail later.

[0042] Each pixel in pixel group 112-1 is arranged at one end of the positive X-axis direction of opposing region 123. Light emitted by each pixel in pixel group 112-1 travels in the negative Z-axis direction and is refracted in the same direction (hereinafter referred to as the "common direction") at the positive X-axis end of each lens portion 122. Therefore, light emitted by each pixel in pixel group 112-1 reaches the eye of a person located in the common direction of refracted light, thereby displaying an image.

[0043] Since the pixel groups, excluding pixel group 112-1, are composed of pixels with a common configuration in each opposing region 123, they are refracted in the same direction within each lens portion 122. Therefore, the light reaches the eyes of a person positioned in the common direction corresponding to each pixel group, and an image is displayed. Thus, the display device 10 includes N pixel groups capable of displaying different images in N directions. The N pixel groups are arranged in the X-axis direction.

[0044] Figure 3 An example of the direction in which an image is displayed is shown. Figure 3 FIG. 1 shows the display device 10 (display body 11 and grating sheet 12) viewed along the positive Y-axis. The display device 10 displays different images in 91 directions, including display directions D0, D1, D2, ..., D45, ..., and D90. In other words, in this embodiment, the display device 10 has 91 pixel groups.

[0045] Display direction D45 is aligned with the normal direction of display surface 111, and the angles of the display directions differ by 1 degree. That is, display directions D0 and D90 both form a 45-degree angle with display direction D45. Hereinafter, angles toward display direction D0 are represented by negative values, and angles toward display direction D90 are represented by positive values ​​(i.e., display direction D0 is -45 degrees, and display direction D90 is 45 degrees).

[0046] The camera device 20 is, for example, a digital camera and is mounted vertically above the display device 10. The direction (photographing direction) facing the lens of the camera device 20 is toward the direction facing the display surface 111. Figure 3 The display direction shown is captured so that all images are within the viewing angle. The display device 10 and the camera device 20 are electrically connected to the image processing device 30 via a cable or the like. Alternatively, this connection may be made via wireless communication.

[0047] The image processing device 30 performs processing related to the image displayed by the display device 10 and the image captured by the imaging device 20 .

[0048] Figure 4 The hardware configuration of image processing device 30 is shown. Image processing device 30 is a computer including a processor 31, memory 32, storage device 33, and device I / F 34. Processor 31 includes, for example, a CPU (Central Processing Unit) or other computing device, registers, and peripheral circuits. Processor 31 is an example of a "processor" in the present disclosure.

[0049] Memory 32 is a recording medium readable by processor 31 and includes RAM (Random Access Memory) and ROM (Read Only Memory). Storage device 33 is a recording medium readable by processor 31 and includes, for example, a hard disk drive or flash memory. Processor 31 uses RAM as a work area and executes programs stored in ROM or storage device 33 to control the operation of various hardware devices.

[0050] Device I / F 34 serves as an interface (I / F) between the display device 10 and the camera device 20. In multi-directional display system 1, processor 31 executes programs to control various components, thereby implementing the functions described below. The operations performed by each function are also represented as those performed by processor 31 of the device that implements that function.

[0051] Figure 5 FIG3 shows the functional structure implemented by the image processing device 30. The image processing device 30 includes a person direction determination unit 301, an object definition unit 302, a rendering unit 303, and a raster rendering unit 304. The person direction determination unit 301 determines the direction of a person in the display device 10 that can visually recognize the pixel group included in the display device 10.

[0052] The person direction determination unit 301, for example, obtains an image captured by the camera device 20 and uses known facial recognition technology to identify the face of a person shown in the image. The person direction determination unit 301 determines that the person whose face is being recognized can recognize the display surface 111 (i.e., a group of pixels) and determines the direction of the person's face based on the position of the recognized face within the image. The person direction determination unit 301 determines the person's direction using, for example, a direction table that associates the coordinates of each pixel with a direction in real space.

[0053] The direction table is created in advance by, for example, the provider of the multi-directional display system 1 placing an object in a specific direction in the real space and adjusting the position of the object in the image to which it is mapped. In this embodiment, the direction of the character is determined by, for example, the normal direction of the display surface 111 (the direction of the normal direction of the display surface 111). Figure 3 Specifically, the direction of the character is represented by the angle formed by the X-axis direction and the normal direction and the angle formed by the Y-axis direction and the normal direction.

[0054] The angle formed with the normal direction in the X-axis direction is the angle formed by the projected vector and the normal direction when the vector representing the direction of the person is projected onto a plane containing the X-axis and the Z-axis. In addition, the angle formed with the normal direction in the Y-axis direction is the angle formed by the projected vector and the normal direction when the vector representing the direction of the person is projected onto a plane containing the Y-axis and the Z-axis. Figure 6 These angles are explained.

[0055] Figure 6 An example of the angle indicating the direction of a person is shown. Figure 6 In FIG, the direction D100 of the character is represented by the coordinates (x, y, z) of a vector in a three-dimensional coordinate system with the center of the display surface 111 as the origin. Figure 6 (a) shows projection direction D100-x (coordinates (x, 0, z)) of the person's direction D100 onto a plane containing the X-axis and the Z-axis. Angle θ1 formed between projection direction D100-x and display direction D45 (normal direction) is the angle formed between person's direction D100 and the normal direction in the X-axis direction.

[0056] And, in Figure 6(b) shows the projection direction D100-y (coordinates (0, y, z)) of the person's direction D100 onto the plane containing the Y-axis and the Z-axis. The angle θ2 formed between the projection direction D100-y and the display direction D45 (normal direction) is the angle formed between the person's direction D100 and the normal direction in the Y-axis direction. Thus, the person's direction determination unit 301 determines the direction of the person in the visually recognizable pixel group using the angle θ1 of the person in the X-axis direction and the angle θ2 of the person in the Y-axis direction.

[0057] The X-axis direction is an example of the "first direction" disclosed herein, and the Y-axis direction is an example of the "second direction" disclosed herein. Furthermore, angle θ1 is an example of the "first angle" disclosed herein, and angle θ2 is an example of the "second angle" disclosed herein. Furthermore, for example, when a person is located near the display surface 111, the person direction determination unit 301 may determine multiple display directions as the direction of a single person. Once the person direction determination unit 301 determines the person's direction, it supplies direction information indicating the determined direction to the rendering unit 303.

[0058] In this embodiment, the multi-directional display system 1 displays an object (also referred to as an "object") as a three-dimensional object. The object definition unit 302 stores definition information defining the three-dimensional object (hereinafter referred to as a "3D object") to be displayed. For example, the object definition unit 302 stores a set of coordinates of the surface of the 3D object as definition information. The rendering unit 303 references the definition information stored by the object definition unit 302.

[0059] The rendering unit 303 generates data representing an image displayed on each pixel group of the display device 10 (hereinafter referred to as "display image data"). The process of generating display image data in this manner is called image rendering. The rendering unit 303 renders an image of a 3D object as viewed from the direction of the person determined by the person direction determination unit 301, based on the definition information stored by the object definition unit 302.

[0060] In passing Figure 6 If the direction indicated by angles θ1 and θ2 is determined to be the direction of the character, the rendering unit 303 generates image data for displaying the 3D object as viewed from both angles θ1 and θ2. If multiple directions are determined, the rendering unit 303 renders an image of the 3D object for each direction.

[0061] The rendering unit 303 determines the distance to the person whose direction has been determined, for example, and generates image data for display based on the determined distance. For example, the rendering unit 303 determines the distance to the person whose face is recognized based on the size of the face within the image. Other known methods can also be used to determine the distance to the person. If the determined distance is less than the first threshold, the rendering unit 303 generates image data for a pixel group whose display direction falls within the first angle range.

[0062] Similarly, when the determined distance is greater than or equal to the first threshold and less than or equal to the second threshold, the rendering unit 303 generates image data for a pixel group displayed within a second angle range in the display direction. When the determined distance is greater than or equal to the second threshold and less than or equal to the third threshold, the rendering unit 303 generates image data for a pixel group displayed within a third angle range in the display direction. Furthermore, when the determined distance is greater than or equal to the third threshold, the rendering unit 303 generates image data for a pixel group displayed within a fourth angle range in the display direction.

[0063] For example, the first, second, and third thresholds are set to 30 cm, 100 cm, and 200 cm, and the first, second, and third angles are set to 11 degrees, 7 degrees, and 3 degrees. For example, if the direction of a person is 30 degrees and the distance to the person is greater than 30 cm and less than 100 cm, the rendering unit 303 generates image data for a pixel group displayed at a display direction between 27 and 33 degrees. In this case, the rendering unit 303 generates image data for an image of an object, and the further the display direction moves from 30 degrees, the more the viewpoint of the image of the object is offset from the image of the object at a display direction of 30 degrees.

[0064] Furthermore, for example, if the configuration further includes separately detecting the right and left eyes of a specific person, the rendering unit 303 may also generate display image data slightly offset from the two eyes, thereby achieving stereoscopic vision based on binocular parallax. For example, if the position of a person's right eye is detected to be 32 degrees and the position of the left eye is 30 degrees, the rendering unit 303 generates image data for a pixel group that displays the slightly offset images of the objects at 32 and 30 degrees, respectively.

[0065] Alternatively, the rendering unit 303 may determine whether a person is an adult or a child based on the size and height of the person's face, and use different thresholds and angles depending on the determination result. Furthermore, if the person direction determination unit 301 determines the directions of the person's left and right eyes using a known technique for detecting eye positions from an image, the rendering unit 303 may generate image data for a pixel group displayed within a display direction bounded by the determined left and right eye directions.

[0066] The rendering unit 303 supplies image data for display of the rendered image to the raster rendering unit 304. When the rendering unit 303 generates a plurality of image data for display, it supplies the plurality of image data to the raster rendering unit 304.

[0067] The lenticular rendering unit 304 renders the image represented by the supplied display image data using a raster method. Rendering using a raster method generates image data for displaying the image in pixel groups corresponding to the direction in which the image is to be displayed, and the image data represents the pixel values ​​of all pixels. For example, if five directions are identified as the directions of a person, the raster rendering unit 304 generates image data for displaying the image of the 3D object as viewed from each direction in the pixel groups corresponding to those directions.

[0068] Furthermore, when multiple display directions are determined as the directions of a person, the raster rendering unit 304 generates image data for displaying a common image of the 3D object in multiple pixel groups corresponding to the multiple display directions. Thus, the raster rendering unit 304 generates display image data for displaying an image facing the direction of the person determined by the person direction determination unit 301 in the pixel groups corresponding to that direction.

[0069] As described above, the display device 10 includes N (91 in this embodiment) pixel groups, including pixel groups corresponding to display directions that are not determined to be directions of people. The raster rendering unit 304 generates image data by not rendering an image for the pixel groups in the display directions that do not include people, and by setting all pixel values ​​to minimum, for example.

[0070] The reason for setting the pixel value to the minimum is that when a pixel emits light, it affects the light of adjacent pixels to a certain extent, so this influence is minimized. Thus, the raster rendering unit 304 generates image data by, for example, minimizing the pixel values ​​of a group of pixels corresponding to a direction not determined as a person's direction by the person direction determination unit 301, and not displaying an image.

[0071] It is not impossible for all N display directions to be determined as the direction of a person at the same time, but this is likely to happen only in exceptional circumstances, such as when a large number of people are intentionally positioned in front of the display surface 111. Therefore, the raster rendering unit 304 generates image data for displaying images facing fewer than N directions in pixel groups corresponding to those directions.

[0072] The raster rendering unit 304 sends the generated image data for display to the display device 10. The display device 10 displays each image represented by the sent image data for display using the corresponding pixel group. As described above, the rendering unit 303 and the raster rendering unit 304 display the image representing the three-dimensional object when viewed from the direction of the angle θ2 on the display device 10. Figure 6 The direction of the angle θ1 shown displays the pixel group of the image.

[0073] Furthermore, the rendering unit 303 and the raster rendering unit 304 display images oriented in fewer than N directions, including at least the direction of the person identified by the person direction identification unit 301 , on pixel groups corresponding to the directions.

[0074] With the above-described configuration, each device included in the multi-directional display system 1 performs a display process for displaying different images to people in multiple directions.

[0075] Figure 7 An example of the steps involved in display processing is shown. First, the imaging device 20 captures an image (step S11) and transmits the captured image to the image processing device 30 (step S12). The image processing device 30 (person direction determination unit 301) determines the direction of the person shown in the transmitted image (step S13).

[0076] Next, the image processing device 30 (rendering unit 303) renders the image to be displayed in each of the determined directions (step S14). Next, the image processing device 30 (raster rendering unit 304) renders using a raster method using the image data for display generated by rendering in each direction (step S15).

[0077] The image processing device 30 (raster rendering unit 304) then transmits the rendered image data for display to the display device 10 (step S16). The display device 10 uses the transmitted image data to display the image in each of the determined directions (step S17). The operations of steps S11 to S17 are repeated while the display device 10 displays the image in each of the character's directions.

[0078] In this embodiment, images are rendered according to the direction of each person determined as described above. Since images are not displayed in directions where no people are present, rendering is not required for those directions. Thus, according to this embodiment, the image processing load (primarily rendering by the rendering unit 303) is reduced compared to providing images to a large number of people in multiple directions.

[0079] Furthermore, in this embodiment, pixels included in the pixel group are arranged in the X-axis direction. Figure 6The angle θ1 in the X-axis direction shown in FIG. 1 shows an image of a 3D object viewed from a different direction for each character. In addition, although the pixels included in the pixel group are not arranged in the Y-axis direction, the image generated from the Figure 6 The image of the 3D object is observed in the direction of the angle θ2 in the Y-axis direction shown, so stereoscopic display is also performed in directions (the Y-axis direction in this embodiment) other than the direction in which the pixels included in the pixel group are arranged (the X-axis direction in this embodiment).

[0080] [2] Modification

[0081] The above embodiment is only an example of implementation of the present disclosure, and the following modifications are also possible. In addition, the embodiment and each modification can be combined and implemented as needed.

[0082] [2-1] Method for determining the character's direction

[0083] In the embodiment, the person direction determination unit 301 determines the person's direction by recognizing the person's face, but the method for determining the person's direction is not limited to this. The person direction determination unit 301 can determine the person's direction by, for example, detecting the person's eyes from an image, or by detecting the person's entire body.

[0084] Furthermore, if the person is carrying a communication terminal such as a smartphone that has a positioning unit (a unit that measures the terminal's position), the person's direction determination unit 301 may also obtain position information indicating the position measured by the communication terminal and determine the person's direction based on the relationship between the position information and the pre-stored position information of the display device 10. In this case, the person's direction can be determined even without the imaging device 20.

[0085] [2-2] Allocation of pixel groups

[0086] In this embodiment, when multiple display directions are determined as the directions of a person, the raster rendering unit 304 allocates multiple pixel groups corresponding to these multiple display directions as pixel groups for displaying an image for the person. This is not limiting, and the raster rendering unit 304 may also allocate multiple pixel groups as pixel groups for displaying an image for a specific person using other methods.

[0087] The raster rendering unit 304 generates, for example, display image data for displaying an image of a person whose direction has been determined by the person direction determination unit 301, using a number of pixel groups corresponding to the form of change in the person's position in real space. The form of change in the person's position in real space refers to, for example, the direction of movement of the person's position. The direction of movement of the person's position can be determined by, for example, determining the distance to the person in addition to the direction of the person determined by the person direction determination unit 301.

[0088] The person direction determination unit 301 determines the distance to the person with the face, for example, based on the size of the recognized face within the image. Alternatively, other known methods may be used to determine the distance to the person. If the determined distance becomes shorter, that is, if the person's position is moving toward the display device 10, the raster rendering unit 304 increases the number of pixel groups allocated to the person, for example.

[0089] On the contrary, if the moving direction of the character is away from the display device 10, the raster rendering unit 304 reduces the number of pixel groups assigned to the character. Figure 3 As shown, light emitted from each pixel arranged along the X-axis direction in each opposing area 123 is refracted by the grating sheet 12 and travels radially. Therefore, the closer to the display device 10, the more pixels whose light reaches the person's eyes.

[0090] Therefore, if only one pixel group displays an image for a person near the display device 10, the pixel group that does not display the image will also be visible. Therefore, if the pixel values ​​of these pixel groups are minimized and one side appears black, the image reaching the person's eyes will also appear black. Furthermore, if the pixel group displaying the other image is seen by both eyes, the two images will appear mixed.

[0091] In contrast, if the pixel groups seen by a person's left and right eyes display the same image, the image can be accurately seen. Furthermore, while there are technologies that allow for stereoscopic viewing by viewing slightly offset images for the left and right eyes, even in this case, if images different from those intended for the left and right eyes appear in the left and right eyes, the stereoscopic image cannot be accurately seen. To achieve this accurate viewing, the number of pixel groups allocated to a person can simply be increased. However, increasing the number of pixel groups allocated to one person reduces the number of pixel groups available for allocation to other characters.

[0092] Therefore, by changing the number of pixel groups assigned to a person according to the direction of movement as described above, a more accurate image can be seen even when the person is close to the display device 10, compared to the case where the assignment of pixel groups is fixed, and more pixel groups can be left to be assigned to the person, allowing more people to see the accurate image.

[0093] Alternatively, the change in a person's position in real space may be the person's movement speed. In this case, for example, the faster the person's movement speed, the more the raster rendering unit 304 increases the number of pixel groups allocated to the person. This allows for more accurate images to be viewed regardless of the person's movement speed, compared to a case where the pixel group allocation is fixed. This allows for more accurate images to be viewed by more people.

[0094] Furthermore, the change in a person's position in real space can also occur over time while the person's position remains fixed. In this case, for example, the longer the person's position remains fixed, the more the raster rendering unit 304 increases the number of pixel groups allocated to the person. This allows a person who continues viewing an image for a longer period of time to see a more accurate image, and more people to see an accurate image, compared to a case where the pixel group allocation remains fixed.

[0095] Furthermore, the raster rendering unit 304 may also generate image data for displaying an image of a person whose direction is determined by the person direction determination unit 301 in the following number of pixel groups, where the number of groups does not correspond to the change form of the above-mentioned position, but more simply corresponds to the position of the person in the actual space.

[0096] In this case, for example, the closer a person's position is to the display device 10, the more the raster rendering unit 304 increases the number of pixel groups allocated to the person. This allows a person to see a more accurate image regardless of their position, compared to a case where the pixel group allocation is fixed, and more people can see accurate images.

[0097] Furthermore, the raster rendering unit 304 may generate display image data for displaying an image of a person whose direction has been determined by the person direction determination unit 301 using a number of pixel groups corresponding to the number of persons. In this case, for example, the fewer the number of persons whose directions have been determined, the greater the number of pixel groups allocated to those persons.

[0098] In other words, conversely, the more people whose directions are determined, the smaller the number of pixel groups allocated to these people is, thereby effectively utilizing pixel groups regardless of the number of people, compared to a case where pixel group allocation is fixed.

[0099] Furthermore, the raster rendering unit 304 may generate image data for displaying an image of a person whose direction has been determined by the person direction determination unit 301, using a number of pixel groups corresponding to the movement of a specific part of the person. A specific part may be, for example, a body part such as a hand, foot, eye, mouth, or face. In this case, the person direction determination unit 301 identifies the position or shape of the specific part of the person within the image and notifies the raster rendering unit 304 of the identified position or shape.

[0100] The raster rendering unit 304 determines the movement of a specific part based on the reported temporal changes in position or shape. For example, if a person's hand moves upward, the raster rendering unit 304 increases the pixel group allocated to that person; if the hand moves downward, the pixel group allocated to that person decreases. This allows the person viewing the image to change the accuracy of the image through their own volition.

[0101] [2-3] Viewpoint of three-dimensional objects

[0102] In the embodiment, the rendering unit 303 generates a Figure 6 3D object display image data is generated when the 3D object is viewed from the angle θ1 and the angle θ2 shown in FIG. 3D object rendering method is not limited thereto. The rendering unit 303 may also generate image data representing the 3D object as viewed from a viewpoint corresponding to the changing position of the person whose direction has been determined by the person direction determination unit 301 in real space.

[0103] The form of change in the character's position in real space is, for example, the direction in which the character moves. Specifically, if the 3D object is a can and the character's movement direction is toward the display device 10, the rendering unit 303 switches from viewing the can from the outside to viewing the can from the inside after approaching to a certain distance.

[0104] Furthermore, if the person's position moves away from the display device 10, the rendering unit 303 switches the viewpoint from viewing the can from the inside to viewing the can from the outside after moving away to a certain distance. This allows the person viewing the display device 10 to switch their viewpoint to the side they wish to view, both externally and internally, of the 3D object.

[0105] Furthermore, the form of change in a character's position in real space may also be the character's movement speed. For example, the rendering unit 303 generates image data for displaying a 3D object viewed from a viewpoint where the faster the character's movement speed, the greater the movement. This allows the person viewing the display device 10 to more quickly switch to their desired angle compared to a case where the viewpoint is changed regardless of the speed of movement when viewing the 3D object.

[0106] The changing form of a person's position in real space can also occur during the time the person's position remains fixed. For example, the rendering unit 303 generates image data representing a 3D object, where the longer the person's position remains fixed, the closer the 3D object is to the viewpoint. This allows the person viewing the display device 10 to focus more closely on a desired area, resulting in more detailed display of that area. Furthermore, regardless of which of the aforementioned changing forms is used, it is easier to view the image of the 3D object from a desired angle than when the viewpoint is fixed.

[0107] Furthermore, the raster rendering unit 304 may generate image data for displaying a 3D object as viewed from a viewpoint corresponding to the movement of a specific part of the person whose direction has been determined by the person's direction determination unit 301. As in the above example, the specific part may be, for example, a part of the body. For example, if the person moves their hand up or down, the raster rendering unit 304 moves the viewpoint up or down; if the person moves their hand left or right, the viewpoint moves left or right. This allows the person viewing the image to change the angle of the image at their own will.

[0108] In this case, the amount of viewpoint movement relative to the 3D object can also be changed based on the amount of movement of the person's hand, either up or down or left or right. For example, if the person moves their hand at an angle corresponding to 3 degrees relative to the display device 10, the viewpoint can be moved by a larger amount, 30 degrees, relative to the 3D object. This allows the angle of the displayed object image to be exaggerated relative to the amount of hand movement.

[0109] [2-4] Grating

[0110] In the embodiment, the grating sheet has a plurality of lens portions 122 arranged in the X-axis direction, each of which is a thin, arched convex lens. However, the present invention is not limited thereto. For example, the grating sheet may have lens portions arranged in a grid pattern in a planar shape in the X-axis and Y-axis directions.

[0111] The display body of this variant has N (N is a natural number) pixel groups arranged along the X-axis direction and M (M is a natural number) pixel groups arranged along the Y-axis direction in the relative areas of each lens portion. Thus, in addition to the pixel groups arranged along the X-axis direction, the display body also has pixel groups arranged along the Y-axis direction. By rendering these pixel groups arranged in the Y-axis direction in a raster manner by the raster rendering unit 304, the display device of this variant displays an image in each direction determined in the X-axis direction and in each direction also determined in the Y-axis direction. Thus, for example, different images are displayed depending on an adult with a high viewing angle and a child with a low viewing angle.

[0112] [2-5] Functional structure

[0113] Implementation in multi-directional display system 1 Figure 5 The method of the functions shown is not limited to the method described in the embodiment. For example, as long as the display device 10 has a Figure 4 The hardware structure of the structure described above can also realize the display device 10. Figure 5 Furthermore, the display device 10 may also include a built-in camera 20 .

[0114] In this case, the display device 10 is a single unit, serving as an example of a "display system" in the present disclosure. Thus, the "display system" in the present disclosure can include all components within a single housing, or it can include components in two or more housings. Furthermore, the imaging device 20 can be part of the display system or an external component.

[0115] Furthermore, for example, in the above-mentioned modified example, the person direction determination unit 301 determines the distance to the person or recognizes the position or shape of a specific part of the person in the image, but the function of determining the distance and the function of recognizing the position or shape may be provided separately. Furthermore, for example, the operations performed by the rendering unit 303 and the raster rendering unit 304 may be performed by a single function. In short, as long as the multi-directional display system 1 is implemented as a whole, Figure 5 The functions shown in the above examples can also be freely specified, such as the structure of the device that realizes each function and the scope of the action performed by each function.

[0116] [2-6] Processor

[0117] In the above embodiments, the processor refers to a processor in a broad sense, including a general-purpose processor (such as a CPU: Central Processing Unit, etc.) or a dedicated processor (such as a GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0118] Furthermore, the operations of the processors in the above embodiments may be performed not only by a single processor but also by the cooperation of multiple processors located in physically separate locations. Furthermore, the order of the operations of the processors is not limited to that described in the above embodiments and may be modified as appropriate.

[0119] [2-7] Public Type

[0120] The present disclosure can be understood as a display device such as a display device, a camera device, and an image processing device, and can also be understood as a display system including each device. Furthermore, the present disclosure can be understood as an information processing method for realizing the processing performed by each device, or as a program for causing a computer that controls each device to function. The program can be provided in the form of a recording medium such as a CD storing the program, or can be provided in a form that can be downloaded to a computer via a communication line such as the Internet and installed for use.

Claims

1. A display system comprising N groups of pixels capable of displaying different images in N directions and a processor, wherein: N is a natural number, The N groups of pixels are arranged in a first direction, The processor determines directions of the plurality of persons by visually recognizing the plurality of persons in the pixel group at a first angle in the first direction and a second angle in the second direction, The processor displays an image directed to a number less than N directions including at least the determined direction on the pixel group corresponding to the direction. The processor displays an image representing a three-dimensional object when viewed from the second angle on the pixel group that displays the image in the direction of the first angle. The processor displays the image of each person facing the specified direction on the pixel groups whose number corresponds to the number of the persons.

2. The display system according to claim 1, wherein: The processor displays an image of a person facing the specified direction using a number of pixel groups corresponding to a change in the position of the person in the real space.

3. The display system according to claim 2, wherein: The change form of the position includes at least one or more of the moving direction of the position, the moving speed of the position, and the time during which the position is fixed.

4. The display system according to any one of claims 1 to 3, wherein: The processor displays an image of a three-dimensional object viewed from a viewpoint corresponding to a change in the position of the person whose direction is determined in the real space.

5. The display system according to claim 4, wherein: The change form of the position includes at least one or more of the moving direction of the position, the moving speed of the position, and the time during which the position is fixed.

6. The display system according to any one of claims 1 to 3, wherein: The processor displays an image of a person facing the specified direction on a number of pixel groups corresponding to the position of the person.

7. The display system according to any one of claims 1 to 3, wherein: The processor displays an image of a person facing the specified direction on a number of pixel groups corresponding to a movement of a specific part of the person.

8. The display system according to any one of claims 1 to 3, wherein: The processor displays an image of a three-dimensional object viewed from a viewpoint corresponding to the movement of the specific part of the person whose direction is determined.

9. A display control device comprising N groups of pixels capable of displaying different images in N directions and a processor, wherein: N is a natural number, The N groups of pixels are arranged in a first direction, The processor determines directions of the plurality of persons by visually recognizing the plurality of persons in the pixel group at a first angle in the first direction and a second angle in the second direction, The processor displays an image directed to a number less than N directions including at least the determined direction on the pixel group corresponding to the direction. The processor displays an image representing a three-dimensional object when viewed from the second angle on the pixel group that displays the image in the direction of the first angle. The processor displays the image of each person facing the specified direction on the pixel groups whose number corresponds to the number of the persons.

10. A computer-readable medium storing a program for causing a computer to execute a process, the computer comprising N pixel groups capable of displaying different images in N directions and a processor, the N pixel groups being arranged in a first direction, wherein: N is a natural number, The process has the following steps: determining directions of the plurality of persons by visually recognizing the plurality of persons in the pixel group at a first angle in the first direction and a second angle in the second direction; causing an image oriented in a number less than N directions including at least the determined direction to be displayed on the pixel group corresponding to the direction; causing an image representing a three-dimensional object when viewed from the second angle to be displayed on the pixel group that displays the image in the direction facing the first angle; as well as The images of the persons facing the specified direction are displayed on the pixel groups whose number corresponds to the number of persons.

Images