Virtual space image display device, virtual space image display method, and virtual space image display program

Abstract

To provide a virtual space image display device capable of realizing a more accurate view from spectator seats. [Solution] The virtual space image display device 1 includes a spatial coordinate setting unit 410 that sets spatial coordinates corresponding to the viewing facility, and an operation information input unit that receives operation information related to user operations. The virtual space image display device 1 also includes a monocular field of view image generation unit 420 that generates a monocular field of view image based on design information, and a field of view determination unit 440 that determines whether to display a monocular field of view image or a binocular field of view image based on the operation information. The virtual space image display device 1 also includes a binocular field of view image generation unit 430 that, when it is determined that a binocular field of view image should be displayed, generates a binocular field of view image in which the image of the spectator's head included in the monocular field of view image is horizontally reduced by a predetermined length. The virtual space image display device 1 also includes a display unit 300 that displays the monocular field of view image or the binocular field of view image based on the determination result of the field of view determination unit.

Description

[Technical Field]

[0001] The present invention relates to a virtual space image display device, a virtual space image display method, and a virtual space image display program. [Background technology]

[0002] Conventionally, when designing viewing facilities such as theaters, arenas, stadiums, etc., a method has been proposed in which a quantitative value is calculated regarding the visibility of a stage, field, etc. (hereinafter referred to as "stage") from the spectator seats, and the visibility is evaluated based on that value. Patent Document 1 discloses a viewing facility evaluation device that uses virtual space images. The viewing facility evaluation device disclosed in Patent Document 1 generates and displays the view from the spectator seats using virtual space images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6887085 Summary of the Invention [Problem to be solved by the invention]

[0004] Recent advances in cerebral physiology have shown that information from each of the human eyes does not intersect along the neural pathways, but rather forms a binocular image in the cerebral visual cortex. In other words, in the case of binocular vision, it is believed that image fragments containing obstacles are unconsciously erased in a mosaic-like pattern, or their density is diluted, resulting in their disappearance from consciousness. Meanwhile, the field of view in the virtual space image disclosed in Patent Document 1 is a monocular image, which differs from an actual binocular image.

[0005] The present invention has been made in consideration of the problems inherent in the prior art, and an object of the present invention is to provide a virtual space image display device that can more accurately reproduce the view from the spectator seats. [Means for solving the problem]

[0006] In order to solve the above problems, a virtual space image display device according to an aspect of the present invention comprises a spatial coordinate setting unit that sets spatial coordinates corresponding to an observation facility based on design information relating to the facility, which has a stage and audience seats; an operation information input unit that receives operation information relating to operations from a user; a monocular field of view image generation unit that generates a monocular field of view image based on the design information in which the spatial coordinates have been set; a field of view determination unit that determines whether to display a monocular field of view image or a binocular field of view image based on the operation information; a binocular field of view image generation unit that generates a binocular field of view image in which the image of the spectator's head included in the monocular field of view image has been horizontally reduced by a predetermined length when the field of view determination unit determines that the binocular field of view image should be displayed; and a display unit that displays the monocular field of view image or the binocular field of view image based on the determination result determined by the field of view determination unit.

[0007] Another aspect of the present invention is a virtual space image display method executed by a computer, which sets spatial coordinates corresponding to an observation facility based on design information about the facility, which includes a stage and seating, inputs operation information related to operations from a user, generates a monocular field of view image based on the design information in which the spatial coordinates have been set, determines whether to display a monocular field of view image or a binocular field of view image based on the operation information, and if it is determined that a binocular field of view image should be displayed, generates a binocular field of view image in which the image of the spectator's head included in the monocular field of view image is reduced horizontally by a predetermined length, and displays the monocular field of view image or the binocular field of view image based on the determination result.

[0008] A virtual space image display program according to another aspect of the present invention causes a computer to execute the following process: based on design information about an observation facility having a stage and seating, set spatial coordinates corresponding to the observation facility; input operation information about operations from a user; based on the design information in which the spatial coordinates have been set, generate a monocular field of view image based on the operation information; determine whether to display a monocular field of view image or a binocular field of view image; if it is determined that a binocular field of view image should be displayed, generate a binocular field of view image in which the image of the spectator's head included in the monocular field of view image is reduced horizontally by a predetermined length; and display the monocular field of view image or the binocular field of view image based on the determination result. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to provide a virtual space image display device that can more accurately realize the view from the spectator seats. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating an example of a virtual space image display device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating an example of an input unit according to the present embodiment. [Figure 3] FIG. 2 is a block diagram showing an example of information stored in a storage unit according to the embodiment. [Figure 4A] 1 is a plan view showing an example of a viewing facility to which a virtual space image display device according to an embodiment of the present invention is applied. [Figure 4B] 1 is a plan view showing an example of a viewing facility to which a virtual space image display device according to an embodiment of the present invention is applied. [Figure 4C] 1 is a plan view showing an example of a viewing facility to which a virtual space image display device according to an embodiment of the present invention is applied. [Figure 5] 1 is a perspective view showing an example of a viewing facility to which a virtual space image display device according to an embodiment of the present invention is applied. [Figure 6] FIG. 10 is a diagram for explaining an example of a field of view including a line-of-sight obstruction. [Figure 7A]FIG. 10 is a diagram for explaining the line of sight from the spectator seats. [Figure 7B] FIG. 10 is a diagram for explaining the line of sight from the spectator seats. [Figure 8] FIG. 1 is a diagram for explaining the dimensions of an adult's head. [Figure 9] 10A and 10B are diagrams for explaining a model shape of a head used in the virtual space image display device according to the present embodiment. [Figure 10A] 10A and 10B are diagrams for explaining a model shape of a head used in the virtual space image display device according to the present embodiment. [Figure 10B] 10A and 10B are diagrams for explaining a model shape of a head used in the virtual space image display device according to the present embodiment. [Figure 11A] 10A and 10B are diagrams for explaining a model shape of a head used in the virtual space image display device according to the present embodiment. [Figure 11B] 10A and 10B are diagrams for explaining a model shape of a head used in the virtual space image display device according to the present embodiment. [Figure 12] 10A and 10B are diagrams for explaining a parallax angle applied in the virtual space image display device according to the present embodiment. [Figure 13] 10A and 10B are diagrams for explaining the relationship between the parallax angle applied in the virtual space image display device according to the embodiment and the distance at the focal point. [Figure 14A] 1 is a diagram showing an example of a monocular field of view image in the virtual space image display device according to the present embodiment. FIG. [Figure 14B] 1 is a diagram showing an example of a binocular field of view image in the virtual space image display device according to the present embodiment. FIG. [Figure 15A] 1 is a diagram showing an example of a monocular field of view image in the virtual space image display device according to the present embodiment. FIG. [Figure 15B] 1 is a diagram showing an example of a binocular field of view image in the virtual space image display device according to the present embodiment. FIG. [Figure 16A] 1 is a diagram showing an example of a monocular field of view image in the virtual space image display device according to the present embodiment. FIG. [Figure 16B]1 is a diagram showing an example of a binocular field of view image in the virtual space image display device according to the present embodiment. FIG. [Figure 17] 10 is a flowchart illustrating an example of processing of the virtual space image display device according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] The virtual space image display device 1 according to this embodiment will be described in detail below with reference to the drawings. Note that the dimensional proportions in the drawings are exaggerated for the sake of explanation and may differ from the actual proportions. Furthermore, this embodiment will be described in more detail below with examples and comparative examples, but this embodiment is not limited to these examples.

[0012] (Overview of the virtual space image display device 1) The virtual space image display device 1 according to this embodiment is a device that displays a virtual space image of the view of the stage from the spectator seats in an observation facility to be evaluated. Below, the virtual space image display device 1 will be described with reference to several specific embodiments.

[0013] 1 is a block diagram showing an example of a virtual space image display device 1 according to this embodiment. The virtual space image display device 1 includes an input unit 100, a storage unit 200, a display unit 300, and a control unit 400.

[0014] The functions of input unit 100, display unit 300, and control unit 400 constituting virtual space image display device 1 are realized by a processor provided in a personal computer or the like executing a program in memory. Virtual space image display device 1 may be constituted by one or more personal computers. It is also possible to realize the functions of virtual space image display device 1 by linking multiple personal computers installed in physically separate locations. Furthermore, the functions of virtual space image display device 1 are not limited to being realized by a personal computer, but may also be realized by devices such as a server or tablet equipped with a processor.

[0015] The input unit 100 has an interface function for allowing the user to input various pieces of information, and information is input from outside the virtual space image display device 1. The user inputs information to the input unit 100 via, for example, a keyboard, a mouse, a touch panel, a trackball, or a voice recognition device connected to the virtual space image display device 1. In this embodiment, the information input to the input unit 100 is facility information and operation information. The facility information includes design information regarding the size (dimensions) and structure of the viewing facility to be evaluated, and information regarding a human body model that defines the size of a human. The operation information includes information regarding instructions and settings related to operations performed by the user on the virtual space image display device 1.

[0016] Fig. 2 shows a schematic block diagram of the input unit 100. As shown in Fig. 2, the input unit 100 is configured to include a facility information input unit 110 and an operation information input unit 120. Facility information is input to the facility information input unit 110 and stored in the memory unit 200. Furthermore, operation information is input to the operation information input unit 120 and, depending on the operation content, is input to the display unit 300 or the control unit 400, or is stored in the memory unit 200.

[0017] The operation information input unit 120 receives operation information related to an operation from a user. The operation information input unit 120 stores the input operation information in an operation information DB 220 shown in FIG. 3. In this embodiment, the operation information may be, for example, position information of an audience seat where a virtual space image is desired to be generated. The operation information may also be information about the line of sight from the specified audience position. The operation information also includes information for selecting whether the image to be displayed as the virtual space image is a monocular image or a binocular image.

[0018] FIG. 3 shows a schematic block diagram of the storage unit 200. The storage unit 200 stores facility information, operation information, monocular field of view image information, and binocular field of view image information. As described above, the facility information includes design information related to the size (dimensions) and structure of the viewing facility to be evaluated. Here, the design information of the viewing facility to be evaluated is, for example, 3D computer-aided design (CAD) data, building information modeling (BIM) data, design drawings, etc. of the viewing facility. This design information is stored in advance in the storage unit 200 of the virtual space image display device 1 via the input unit 100. Note that the storage unit 200 is not limited to a configuration included inside the virtual space image display device 1, and may be, for example, an external storage device connected to the outside of the virtual space image display device 1.

[0019] The monocular field of view image information is information relating to a virtual space image generated by the monocular field of view image generation unit 420, which will be described later. The binocular field of view image information is information relating to a monocular binocular field of view image generated by the binocular field of view image generation unit 430, which will be described later. In this embodiment, the monocular field of view image is an image of the field of view from the spectator seats, in which the stage and a human body model in front are expressed using CG (Computer Graphics). In this embodiment, the binocular field of view image is an image of the field of view from the spectator seats, in which the stage and a human body model in front are expressed using CG, similar to the monocular field of view image, in which the stage and a human body model in front are approximated to the field of view seen by both eyes of a human being. Details of the monocular field of view image information and the binocular field of view image information will be described later.

[0020] The display unit 300 sends monocular visual field image information, binocular visual field image information, etc. to a display device (not shown) connected to the virtual space image display device 1, and causes the display device to display them. Specifically, the display unit 300 causes the display device to display the monocular visual field image or the binocular visual field image based on the determination result determined by the visual field determination unit 440 described below. Examples of the display device include a display device for a personal computer or a tablet, an HMD (Head Mounted Display), etc.

[0021] The control unit 400 includes a spatial coordinate setting unit 410, a monocular visual field image generating unit 420, a binocular visual field image generating unit 430, and a visual field determining unit 440.

[0022] The spatial coordinate setting unit 410 reads facility information (design information) from the storage unit 200 and assigns the design information as spatial coordinates on three-dimensional axes. That is, the spatial coordinate setting unit 410 sets spatial coordinates corresponding to the viewing facility based on the design information for the viewing facility, which includes a stage and audience seats. Specifically, as shown in FIG. 4A, the spatial coordinate setting unit 410 first sets a plan view of the viewing facility seen from above as an XY plane. In the XY plane, the spatial coordinate setting unit 410 determines a central axis 11 that is symmetrical from the stage 20 toward the audience seats 30, and determines the point where the central axis 11 intersects with the boundary between the stage 20 and the audience seats 30 as the coordinate origin 10. That is, in the XY plane, the positive side of the X axis is the side toward the stage 20, and the negative side of the X axis is the side toward the audience seats 30. Note that in this specification, the audience seats and audience seats in the viewing facility are collectively referred to as audience seats 30, and individual seats in the audience seats 30 are referred to as seats.

[0023] Acting area 20a shown in Figure 4A is the activity area on stage 20, where plays, musical performances, etc. take place. Figure 4A is also a conceptual diagram showing first floor seats 30a on the positive side of the Y axis, and second floor seats 30b and side balcony seats 30c on the negative side of the Y axis. In an actual viewing facility, first floor seats 30a, second floor seats 30b, and side balcony seats 30c are located on both the positive and negative sides of the Y axis.

[0024] Furthermore, as shown in FIG. 4B, the spatial coordinate setting unit 410 defines a vertical plane passing through the central axis 11 as the XZ plane. Furthermore, the spatial coordinate setting unit 410 defines a plane perpendicular to the XY and XZ planes as the YZ plane. FIG. 4C is a cross-sectional view of the viewing facility taken along the dashed-dotted line AA in FIG. 4A, showing an example of the YZ plane. Note that FIG. 4C also shows a proscenium 20b. Here, the proscenium is a frame-shaped wall that forms an opening to the stage and separates the stage from the audience seats in the front row. FIG. 5 is a perspective view, in isometric projection, of the viewing facility whose spatial coordinates have been set by the spatial coordinate setting unit 410.

[0025] In this embodiment, as shown in Figures 4A to 4C and 5, the stage side is the positive direction of the X axis and the audience side is the negative direction of the X axis, but the setting of spatial coordinates on the three-dimensional coordinate axes is not limited to this. For example, it is also possible to use a configuration in which the stage side is the negative direction of the X axis and the audience side is the positive direction of the X axis. Similarly, the positive and negative directions of the Y axis and Z axis are not limited to those in the above embodiment, and the positive and negative directions of the Y axis and Z axis may be set in the opposite direction to the example shown in Figures 4A to 4C and 5.

[0026] Although the example has been shown in which the design information of the viewing facility is acquired by the spatial coordinate setting unit 410 reading it from design information previously stored in the storage unit 200 of the virtual space image display device 1, the method of acquiring the design information is not limited to this. For example, a method may be used in which the user inputs design information about the viewing facility from outside the virtual space image display device 1, and the spatial coordinate setting unit 410 acquires the design information.

[0027] The monocular field of view image generation unit 420 generates a virtual space image based on the spatial coordinates of the viewing facility set by the spatial coordinate setting unit 410, and stores information about the virtual space image in the storage unit 200. The virtual space image can be expressed using three-dimensional color computer graphics. In the virtual space expressed by the virtual space image, it is possible to express the components of the virtual space, such as the stage, audience seats, and spectators, from any position and angle.

[0028] The monocular field of view image information stored in the storage unit 200 is converted into image data in the display unit 300 and displayed on the screen of the above-mentioned display device (not shown). Here, the binocular field of view applied to the virtual space image display device 1 according to this embodiment will be described.

[0029] (About binocular vision) Healthy humans have both left and right eyes, and the information from each eye does not cross paths along the neural pathways. Recent advances in cerebral physiology have shown that the brain first combines partial regions of the visual cortex in a mosaic-like fashion to form a binocular image in real time, matching the information desired from the eyes.

[0030] It is known that this information alternates rapidly between the left and right visual fields several times per second. The selection of information dominance is known as binocular rivalry. However, in partial binocular rivalry, when certain conditions are met, such as when the brain perceives information from one eye as an obstacle to the line of sight, the cerebrum selectively adopts and eliminates it at any time, even without concentrating on it. As a result, the fragments of the image that are obstacles are diluted, and only the fragments of the image that the eye wants to see, coming from the other eye, become dominant and are adopted.

[0031] Figure 6 is a diagram explaining the field of view including line-of-sight obstructions. For example, as shown in Figure 6, both the left and right eyes can see one's own nose and the frame of one's glasses, but this is not usually noticed. Even if a road sign is visible to the left eye in Figure 6, when one looks at a person ahead, the part that is not visible in the image of the right eye is erased. Also, some small images in the surrounding area are not noticed.

[0032] In other words, the fragments of the image containing the obstacles are unconsciously erased or diluted in density like a mosaic, and as a result, they become invisible to consciousness. This phenomenon is commonly observed in parts of the face such as the nose, eyelids, eyebrows, and hair that are located in front of the eyeballs, and in eyeglasses wearers, in eyeglass frames.

[0033] Measurements of body dimensions have shown that the centers of the eyeballs of the left and right eyes are approximately 65 mm apart for Japanese adult men and 60 mm for adult women, and are normally parallel to the ground. This creates a parallax between the left and right fields of view, resulting in a three-dimensional perception.

[0034] At the same time, because the left and right eyeballs are positioned far apart, we assume that the gaze is directed at an object (hereafter referred to as a line of sight obstruction) located far in front of the eyes (approximately 50 cm to 2 meters), and the focus is adjusted to align the center of the left and right visual fields (fixation point). In this case, the image is recognized as an object obstructing the line of sight, and the image is processed in the visual cortex via neurons, but the image becomes out of focus on both sides and shifts to the left and right, resulting in a double image. This results in an unstable image that does not match the left and right images, and local binocular rivalry occurs. In this case, the fixation point, which is usually in front, becomes dominant, and the part of the image that only one eye sees that obstructs the view is erased, making that part transparent.

[0035] In a theater, when viewing with both eyes, image fragments including obstacles visible only to one eye, such as the outlines of the backs of heads of front-row audience members or handrails, are erased from consciousness, rendering those parts transparent. In particular, when considering the lighting conditions of a performance, where the stage is bright and the auditorium is dark, silhouettes of the backs of the heads of audience members in the front appear darker than the stage. This reduces the light stimulus to the photoreceptor cells on the retina and the stimulation to the visual nerve. Therefore, shadow images are more easily erased and rendered transparent in the brain than in a brightly lit room or a daytime outdoor event. An extreme example of this phenomenon can be experienced during a vision test, when a shutter is lowered in front of one of the eyes, leaving the viewer unable to tell which eye they are looking with.

[0036] Based on this phenomenon, when an observer observing with both eyes has a line of sight obstruction such as the head of a spectator in the front row, the virtual space image display device 1 can add an effective portion to the simulation, taking into account the loss of visual field that occurs when depicting from a monocular viewpoint. This embodiment will be described for the case where a head in front of the observer, which acts as a line of sight obstruction, is simulated, particularly in the direction of the center of the stage in a theater, arena, etc.

[0037] For example, when watching a play or sporting event, players often move around the stage or playing surface. In other words, the center of play moves fluidly. Most of the spectators face the direction of the center of play. Therefore, both observers and the surrounding spectators face the center of play on the stage, so most of the time observers look at the area around the back of the heads of the spectators in the front row. Figures 7A and 7B are diagrams used to explain the line of sight of spectators in a certain zone during play or sporting events. Figure 7A shows the line of sight of spectators when players are playing directly in front, and Figure 7B shows the line of sight of spectators when players are playing diagonally to the right.

[0038] Normally, the width of a human head is smaller than the depth from front to back, but when always viewed from the back of the head, it can be roughly approximated by a rotating body obtained by rotating the smaller left and right contours. The virtual space image display device 1 according to this embodiment can simulate the actual view by reducing the dimensions of this contour horizontally by half the left and right parallax.

[0039] Figure 8 is a diagram explaining the dimensions of an adult's head. The average head length for adult men aged 20 to 69 is thought to be 191 mm, and for adult women, it is thought to be 180 mm. The average head width for adult men is thought to be 160 mm, and for women, it is thought to be 155 mm. In other words, the head length is greater than the head width for both men and women.

[0040] 7A and 7B, if we assume that the viewer is always looking at the back of the head, and use the larger man's head width, it will be 160 mm. Even if we add a hair margin of 10 + 10 mm, the diameter is still considered to be 180 mm. FIG. 9 is a diagram showing the model shape of the head used in the virtual space image display device 1 according to this embodiment.

[0041] For example, let's consider a simulation where the interpupillary distance is 64mm, and the distance to the head of the person in front and the distance on the stage where the person is gazing is being considered. If the front row of spectators, who act as the primary line of sight obstruction, is about 1m away, and the play area (fixation point) is more than 10m away, the disparity between the two eyes will be equivalent to approximately 60mm. Therefore, it is considered appropriate to simulate this using a rotating body with the head width reduced by 30mm each.

[0042] Figures 10A and 10B are diagrams for explaining the model shape of the head used in virtual space image display device 1 according to this embodiment. Figures 11A and 11B show the model shape of the head used in virtual space image display device 1 according to this embodiment, obtained by removing 30 mm on both sides from the head shape model in Figures 10A and 10B.

[0043] Regarding the distance between the heads of spectators in the front row and the observer, the most primary line of sight obstruction is the row immediately preceding it, at a distance of 0.75 to 1.0 m. The secondary line of sight obstruction is the row two rows behind, at a distance of 1.5 to 2.0 m. The impact gradually decreases beyond that. Therefore, if a qualitative understanding of the situation can be achieved within a range of less than 1 m to more than 2 m, the device is considered to be sufficiently practical.

[0044] FIG. 12 is a diagram for explaining the parallax angle applied in the virtual space image display device 1 according to this embodiment. The parallax angle θ (rad) between the focal point F and the obstacle ob according to the distance D to the focal point F is determined as follows: The parallax angle of the left eye between the focal point F and the obstacle ob is θ L , the disparity angle of the right eye is θ R Also, let the interpupillary distance be i. tan(a R )=tan(a L )=i / (2d), tan(b R )=tan(b L )=i / (2D), the following equation (1) is determined. [Number 1] θ R =θ L =a R -b R ···(1)

[0045] Also, if the distance D is expanded to infinity, b R =b L = 0, so a R and θ R If the parallax of the obstacle is a (rad) and the parallax between infinity and the focus is b (rad), the parallax angle θ between the focus F and the obstacle ob is determined as follows: [Number 2] θ=ab (2) [Number 3] tan(a)=i / (2d) (3) [Number 4] tan(b)=i / (2D) (4) [Number 5] θ=ab=arctan(i / (2d))-arctan(i / (2D))...(5)

[0046] Fig. 13 is a diagram for explaining the relationship between the parallax angle applied to the virtual space image display device 1 according to this embodiment and the distance at the focal point. Specifically, Fig. 13 shows calculated parallax dimensions when the parallax is assumed to be 60 mm, the distance to the line of sight obstacle is set to 1 m, 1.5 m, and 2 m, and the fixation point to be gazed at is changed.

[0047] Figure 13 shows the parallax angle θ when n = D / d, the distance to the obstacle ob = 1 m, and the distance D to the focal point F is changed from 2 to 50. When the distance D is 11 m or more, the parallax angle θ converges to 0.06.

[0048] Furthermore, when the distance d, which is an obstruction to the line of sight, is 1m, and the fixation point (distance D) is 17m or more, it matches the average interpupillary distance for women. When the distance d, which is an obstruction to the line of sight, is 1m, and the fixation point (distance D) is 37m or more, it matches the average interpupillary distance for women. Furthermore, when the distance d, which is an obstruction to the line of sight, is 2m, and the fixation point (distance D) is 50m or more, it matches the average interpupillary distance for women.

[0049] However, in this case, there is a difference of 20 mm compared to when the margin for hair is not taken into account, and in this case, 40 mm or more can be considered to be the safe tolerance range. If 40 mm or more is the tolerance range, even if the line of sight obstruction is 2 m, it will be fine as long as the fixation point is 11 m or more away, which is considered to be quite practical.

[0050] Figures 14A, 15A, and 16A show views from different spectator seats displayed as virtual space images in a monocular field of view, while Figures 14B, 15B, and 16B show virtual space images corresponding to Figures 14A, 15A, and 16A, respectively, displayed as virtual space images in a binocular field of view.

[0051] As shown in Figures 14B, 15B, and 16B, the virtual space image display device 1 of this embodiment can more accurately realize how the image will appear from the spectator seats by displaying a virtual space image in the binocular field of view.

[0052] Returning to the block diagram of FIG. 1 showing an example of the virtual space image display device 1, the description will be continued.

[0053] The monocular field of view image generation unit 420 generates a monocular field of view image based on design information in which spatial coordinates are set. Specifically, the monocular field of view image generation unit 420 generates a monocular field of view image based on design information 211 and human body model information 212 stored in the facility information DB 210 shown in Fig. 3. In addition, the monocular field of view image generation unit 420 stores the generated monocular field of view image in the monocular field of view image information DB 230 shown in Fig. 3.

[0054] The binocular field of view image generation unit 430 generates a binocular field of view image based on the monocular field of view image generated by the monocular field of view image generation unit 420. Specifically, the binocular field of view image generation unit 430 generates a binocular field of view image in which the shape models of the heads of other spectators present in the field of view in the virtual space image are reduced by 30 mm on the left and right, as shown in Figures 11A and 11B. The binocular field of view image generation unit 430 also stores the generated binocular field of view image in the binocular field of view image information DB 240 shown in Figure 3. That is, when the field of view determination unit 440 (described later) determines that a binocular field of view image should be displayed, the binocular field of view image generation unit 430 generates a binocular field of view image in which the image of the spectator's head included in the monocular field of view image is reduced by a predetermined length in the horizontal direction.

[0055] The visual field determination unit 440 determines whether to display a monocular visual field image or a binocular visual field image based on the operation information.

[0056] (Outline of processing flow of virtual space image display device 1) Next, a flowchart of an example of the operation of virtual space image display device 1 will be described with reference to Fig. 17. The processing procedure shown in Fig. 17 is executed by a CPU (Central Processing Unit), which is a processor included in a personal computer on which virtual space image display device 1 is executed. Examples of operating units that execute some of the functions of the CPU include input unit 100, display unit 300, and control unit 400. In this case, the CPU executes operations in accordance with a program stored in ROM (Read Only Memory) (not shown).

[0057] Note that some or all of the following processing procedures can be executed by hardware such as a DSP (Digital Signal Processing) or an ASIC (Application Specific Integrated Circuit). However, in this embodiment, a case will be described in which the procedures are executed by a CPU according to a program stored in a ROM.

[0058] In step S1701, the spatial coordinate setting unit 410 reads facility information (design information) from the storage unit 200 and assigns the design information as spatial coordinates on three-dimensional axes. That is, the spatial coordinate setting unit 410 sets spatial coordinates corresponding to the viewing facility based on the design information about the viewing facility that includes a stage and audience seats. Thereafter, the process proceeds to step S1702.

[0059] In step S1702, the operation information input unit 120 acquires operation information related to an operation from the user. The operation information input unit 120 stores the input operation information in the operation information DB 220 shown in FIG. 3. In this embodiment, the operation information may be, for example, position information of an audience seat where a virtual space image is desired to be generated. The operation information may also be information about the line of sight from the specified audience position. The operation information also includes information for selecting whether the image to be displayed as the virtual space image is a monocular image or a binocular image. Then, the process proceeds to step S1703.

[0060] In step S1703, the monocular field of view image generation unit 420 generates a monocular field of view image based on the design information in which spatial coordinates are set. Specifically, the monocular field of view image generation unit 420 generates a monocular field of view image based on the design information 211 and the human body model information 212 stored in the facility information DB 210 shown in Fig. 3. The monocular field of view image generation unit 420 also stores the generated monocular field of view image in the monocular field of view image information DB 230 shown in Fig. 3. Thereafter, the process proceeds to step S1704.

[0061] In step S1704, the visual field determination unit 440 determines whether to display a monocular visual field image or a binocular visual field image based on the operation information. In step S1704, if the visual field determination unit 440 determines to display a monocular visual field image based on the operation information (step S1704: YES), the process proceeds to step S1705. On the other hand, in step S1704, if the visual field determination unit 440 determines to display a binocular visual field image based on the operation information (step S1704: NO), the process proceeds to step S1706.

[0062] In step S1705, the display unit 300 displays the monocular field of view image on the display device, and then the process proceeds to step S1708.

[0063] In step S1706, the binocular field of view image generation unit 430 generates a binocular field of view image based on the monocular field of view image generated by the monocular field of view image generation unit 420. Specifically, the binocular field of view image generation unit 430 generates a binocular field of view image in which the shape models of the heads of other spectators present in the field of view in the virtual space image are reduced by 30 mm on the left and right, as shown in FIGS. 11A and 11B. The binocular field of view image generation unit 430 also stores the generated binocular field of view image in the binocular field of view image information DB 240 shown in FIG. 3. That is, in step S1706, when the field of view determination unit 440 (described later) determines that a binocular field of view image should be displayed, the binocular field of view image generation unit 430 generates a binocular field of view image in which the images of the spectators' heads included in the monocular field of view image are reduced by a predetermined length in the horizontal direction. Then, the process proceeds to step S1707.

[0064] In step S1707, the display unit 300 displays the binocular visual field image on the display device, and then the process proceeds to step S1708.

[0065] In step S1708, control unit 400 determines the operation information input by the user, and if the user specifies end (step S1708: YES), the processing flow ends. On the other hand, if the user inputs an operation other than end, such as readjusting a value (step S1708: NO), the process returns to step S1702, and the processing from step S1702 is repeated. That is, the processing from step S1702 to S1708 is repeated until the user specifies end as operation information.

[0066] As described above, the virtual space image display device 1 includes a spatial coordinate setting unit 410 that sets spatial coordinates corresponding to the viewing facility based on design information about the viewing facility, which includes a stage and seating. The virtual space image display device 1 also includes an operation information input unit 120 that receives operation information related to user operations. The virtual space image display device 1 also includes a monocular field of view image generation unit 420 that generates a monocular field of view image based on the design information in which the spatial coordinates are set. The virtual space image display device 1 also includes a field of view determination unit 440 that determines whether to display a monocular field of view image or a binocular field of view image based on the operation information. The virtual space image display device 1 also includes a binocular field of view image generation unit 430 that, when the field of view determination unit 440 determines that a binocular field of view image should be displayed, generates a binocular field of view image in which the image of the audience's head included in the monocular field of view image is horizontally reduced by a predetermined length. The virtual space image display device 1 also includes a display unit 300 that displays a monocular field of view image or a binocular field of view image based on the determination result of the field of view determination unit 440.

[0067] As a result, virtual space image display device 1 generates and displays a binocular field of view image that approximates the field of view of a human being with both eyes by horizontally reducing the image of the spectator's head included in the monocular field of view image, which corresponds to a general virtual space image, by a predetermined length. Therefore, virtual space image display device 1 can accurately realize the view from the spectator seats by approximating the view from the human being with both eyes.

[0068] Furthermore, the binocular field of view image generating section 430 of the virtual space image display device 1 may generate a binocular field of view image in which the shape model of the spectator's head contained in the monocular field of view image is reduced by 30 mm on each side. This allows the virtual space image display device 1 to more accurately reproduce the field of view of a human being with both eyes, thereby more accurately realizing the view from the spectator seats.

[0069] (Other embodiments) Although the embodiments have been described in detail with reference to the drawings, the present embodiments are not limited to the contents described in the above embodiments. Furthermore, the components described above include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the configurations described above can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the configurations can be made without departing from the spirit of the embodiments.

[0070] For example, as shown in afterimage A in Fig. 14B, when displaying a binocular field image, the virtual space image display device 1 may superimpose (display) a region removed from the monocular field image with a semi-transparent image. The semi-transparent image may have, for example, an opacity of 10% to 30% or a transmittance of 70% to 90%. This allows the virtual space image display device 1 to retain, as an expression in CG or the like, visual information that remains partially in the consciousness due to the binocular rivalry described above.

[0071] This method replaces the temporal occurrence probability of an obstacle afterimage that appears periodically due to binocular rivalry with an opacity factor. For example, if an image appears 20% of the time, it can be considered a simple method of pseudo-expression by replacing it with an opacity factor of 20%.

[0072] In the above-described embodiment, the virtual space image display device 1 displays a monocular field image or a binocular field image as a still image, but the displayed image may be a moving image. When the image to be displayed is a moving image and a binocular field image is displayed, the display unit 300 may display the monocular field image as a moving image by inserting the monocular field image at a fixed rate into a predetermined frame rate.

[0073] For example, if the display is a moving image with a frame rate of 60 fps, one image may be inserted every six frames (10 frames per second) into an image excluding obstacles, assuming a binocular field of view. In this case, the virtual space image display device 1 can easily and simulatively display obstacles that appear periodically due to binocular rivalry with a probability of 1 / 6, or 16.6%.

[0074] Furthermore, the scope of this embodiment includes a computer program (virtual space image display program) that causes a computer to execute the processing (virtual space image display method) in virtual space image display device 1, and a computer-readable recording medium on which the program is recorded. Any type of computer-readable recording medium may be used. Furthermore, the computer program is not limited to being recorded on the recording medium described above, and may be transmitted via a telecommunications line, a wireless or wired communication line, a network such as the Internet, or the like.

[0075] (Addendum) The above description of the embodiments discloses the following techniques.

[0076] (Technology 1) A spatial coordinate setting unit that sets spatial coordinates corresponding to an observation facility having a stage and audience seats based on design information about the observation facility; an operation information input unit to which operation information relating to an operation from a user is input; a monocular field of view image generating unit that generates a monocular field of view image based on the design information in which the spatial coordinates are set; a visual field determination unit that determines whether the monocular visual field image or the binocular visual field image is to be displayed based on the operation information; a binocular field of view image generation unit that generates a binocular field of view image by horizontally reducing an image of the spectator's head included in the monocular field of view image by a predetermined length when the field of view determination unit determines that the binocular field of view image should be displayed; A virtual space image display device comprising: a display unit that displays the monocular field of view image or the binocular field of view image based on the determination result determined by the field of view determination unit.

[0077] With this configuration, virtual space image display device 1 generates and displays a binocular field of view image that approximates the field of view of a human eye by horizontally reducing the image of the spectator's head included in a monocular field of view image that corresponds to a general virtual space image by a predetermined length. Therefore, by approximating the view from the spectator seats to the field of view of a human eye, virtual space image display device 1 can accurately realize the view from the spectator seats.

[0078] (Technology 2) A virtual space image display device according to Technology 1, wherein the binocular field of view image generation unit generates the binocular field of view image by reducing the shape model of the spectator's head included in the monocular field of view image by 30 mm on each side.

[0079] With this configuration, the virtual space image display device 1 can more accurately reproduce the field of view of a human being with both eyes, thereby enabling the view from the spectator seats to be more accurately realized.

[0080] (Technology 3) The virtual space image display device according to Technology 1 or 2, wherein the binocular field of view image generation unit generates the binocular field of view image by superimposing a region removed from the monocular field of view image with a translucent image.

[0081] With this configuration, the virtual space image display device 1 can retain visual information, part of which remains in consciousness due to binocular rivalry, as an expression in CG or the like.

[0082] (Technology 4) A virtual space image display device described in any one of Technologies 1 to 3, wherein when the display unit displays the binocular field of view image, the display unit inserts the monocular field of view image at a certain rate into a predetermined frame rate to display it as a video.

[0083] This configuration enables the virtual space image display device 1 to simply and virtually represent obstacles that appear periodically due to binocular rivalry.

[0084] (Technology 5) A virtual space image display method executed by a computer, Based on design information relating to an observation facility having a stage and seating, spatial coordinates corresponding to the observation facility are set; Operation information regarding the operation from the user is input, generating a monocular field of view image based on the design information in which the spatial coordinates are set; determining whether the monocular field of view image or the binocular field of view image is to be displayed based on the operation information; When it is determined that the binocular field of view image is to be displayed, the binocular field of view image is generated by horizontally reducing the image of the spectator's head included in the monocular field of view image by a predetermined length, A virtual space image display method, which displays the monocular field of view image or the binocular field of view image based on a determination result.

[0085] With this configuration, the virtual space image display method generates and displays a binocular field of view image that approximates the field of view of a human eye by horizontally reducing the image of the spectator's head included in the monocular field of view image, which corresponds to a general virtual space image, by a predetermined length. Therefore, the virtual space image display method can accurately realize the view from the spectator seats by approximating the view of a human eye.

[0086] (Technology 6) Based on design information about an observation facility equipped with a stage and seating, spatial coordinates corresponding to the observation facility are set, Operation information regarding the operation from the user is input, generating a monocular field of view image based on the design information in which the spatial coordinates are set; determining whether the monocular field of view image or the binocular field of view image is to be displayed based on the operation information; When it is determined that the binocular field of view image is to be displayed, the binocular field of view image is generated by horizontally reducing the image of the spectator's head included in the monocular field of view image by a predetermined length, A virtual space image display program for causing a computer to execute a process of displaying the monocular field image or the binocular field image based on the determination result.

[0087] With this configuration, the virtual space image display program generates and displays a binocular field of view image that approximates the field of view of a human eye by horizontally reducing the image of the spectator's head included in the monocular field of view image, which corresponds to a general virtual space image, by a predetermined length. Therefore, the virtual space image display program can accurately realize the view from the spectator seats by approximating the view of a human eye.

[0088] Although the present embodiment has been described above, the present embodiment is not limited to this, and various modifications are possible within the scope of the gist of the present embodiment. [Explanation of symbols]

[0089] 1 Virtual space image display device 100 Input section 110 Facility information input section 120 Operation information input section 200 Storage section 210 Facility Information DB 211 Design information 212 Human Body Model Information 220 Operation information DB 230 Monocular Image Information DB 240 Binocular Visual Field Image Information DB 300 Display 400 control section 410 Spatial coordinate setting section 420 Monocular field of view image generation unit 430 Binocular field of view image generation unit 440 Visual field determination section

Claims

1. a spatial coordinate setting unit that sets spatial coordinates corresponding to an observation facility having a stage and audience seats based on design information relating to the observation facility; an operation information input unit to which operation information relating to an operation from a user is input; a monocular field of view image generating unit that generates a monocular field of view image based on the design information in which the spatial coordinates are set; a visual field determination unit that determines whether the monocular visual field image or the binocular visual field image is to be displayed based on the operation information; a binocular field of view image generation unit that generates a binocular field of view image by horizontally reducing an image of the spectator's head included in the monocular field of view image by a predetermined length when the field of view determination unit determines that the binocular field of view image should be displayed; A virtual space image display device comprising: a display unit that displays the monocular field of view image or the binocular field of view image based on the determination result determined by the field of view determination unit.

2. 2. The virtual space image display device according to claim 1, wherein the binocular field of view image generation unit generates the binocular field of view image by reducing the shape model of the spectator's head included in the monocular field of view image by 30 mm on each side.

3. The virtual space image display device according to claim 1 , wherein the binocular field of view image generating unit generates the binocular field of view image by superimposing a semi-transparent image on the region removed from the monocular field of view image.

4. The virtual space image display device according to claim 1 , wherein, when displaying the binocular field of view image, the display unit displays the monocular field of view image as a moving image by inserting the monocular field of view image into a predetermined frame rate at a constant rate.

5. A computer-implemented virtual space image display method, comprising: Based on design information relating to an observation facility having a stage and seating, spatial coordinates corresponding to the observation facility are set; Operation information regarding the operation from the user is input, generating a monocular field of view image based on the design information in which the spatial coordinates are set; determining whether the monocular field of view image or the binocular field of view image is to be displayed based on the operation information; When it is determined that the binocular field of view image is to be displayed, the binocular field of view image is generated by horizontally reducing the image of the spectator's head included in the monocular field of view image by a predetermined length, A virtual space image display method, which displays the monocular field of view image or the binocular field of view image based on a determination result.

6. Based on design information relating to an observation facility having a stage and seating, spatial coordinates corresponding to the observation facility are set; Operation information regarding the operation from the user is input, generating a monocular field of view image based on the design information in which the spatial coordinates are set; determining whether the monocular field of view image or the binocular field of view image is to be displayed based on the operation information; When it is determined that the binocular field of view image is to be displayed, the binocular field of view image is generated by horizontally reducing the image of the spectator's head included in the monocular field of view image by a predetermined length, A virtual space image display program for causing a computer to execute a process of displaying the monocular field image or the binocular field image based on the determination result.

Images