Display apparatus, method of controlling display apparatus, and program

Abstract

To provide a virtual space to a user properly.SOLUTION: A display apparatus that is worn on a user and provides a virtual space SV to the user includes: a virtual space information acquisition unit that acquires information on a movement region AV2 in which the user is movable in the virtual space SV; a real space information acquisition unit that acquires information on a movement region AR2 in which the user is movable in a real space SR in which the user exists; a correspondence relation acquisition unit that acquires a correspondence relation between the virtual space SV and the real space SR, the correspondence relation being set on the basis of a superimposed area, which is an area in which the movement region AV2 and the movement region AR2 are superimposed on each other when the virtual space SV and the real space SR are superimposed on each other; and a display control unit which causes a display unit to display an image for the virtual space SV on the basis of the correspondence relation and the position of the display apparatus in the real space SR.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a display device, a control method for the display device, and a program.

Background Art

[0002] Recently, information devices have evolved significantly. Not only smartphones, which are typical examples, but also so-called wearable devices have become widespread. As wearable devices, glasses-type HMDs (head-mounted displays) that directly stimulate vision are known. When using such an HMD, it is possible to provide a virtual space for user U by displaying an image according to the user's line-of-sight direction. For example, Patent Document 1 describes that coordinate data from a three-dimensional sensor is held as a reference coordinate in a three-dimensional space and made to coincide with a reference position in a virtual three-dimensional space, thereby correcting the viewpoint position of the user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In such a display device, it is required to appropriately provide a virtual space for the user.

[0005] In view of the above problems, an object of the present invention is to provide a display device, a control method for the display device, and a program that can appropriately associate the coordinates of the real space with the coordinates of the virtual space.

Means for Solving the Problems

[0006] A display device according to an aspect of the present invention is a display device that is worn by a user and provides a virtual space to the user. The display device includes a virtual space information acquisition unit that acquires information on a virtual movement area in which the user can move in the virtual space, a real space information acquisition unit that acquires information on a real movement area in which the user can move in the real space where the user exists, and a correspondence relationship acquisition unit that acquires a correspondence relationship between the virtual space and the real space, which is set based on an overlapping area where the virtual movement area and the real movement area overlap when the virtual space and the real space are overlapped. The display device further includes a display control unit that causes an image for the virtual space to be displayed on a display unit based on the correspondence relationship and the position of the display device in the real space.

[0007] A control method for a display device according to an aspect of the present invention is a control method for a display device that is worn by a user and provides a virtual space to the user. The control method includes a step of acquiring information on a virtual movement area in which the user can move in the virtual space, a step of acquiring information on a real movement area in which the user can move in the real space where the user exists, a step of acquiring a correspondence relationship between the virtual space and the real space, which is set based on an overlapping area where the virtual movement area and the real movement area overlap when the virtual space and the real space are overlapped, and a step of causing an image for the virtual space to be displayed on a display unit based on the correspondence relationship and the position of the display device in the real space.

[0008] A program according to an aspect of the present invention is a program that causes a computer to execute a control method for a display device that is worn by a user and provides a virtual space to the user. The program includes a step of causing the computer to acquire information on a virtual movement area in which the user can move in the virtual space. ​​​​​​​​​​​​​ acquiring information on a virtual movement area in which the user can move; and the user acquiring information on an actual movement area in which the user can move in the actual real space and, when the virtual space and the real space are superimposed, obtaining a correspondence relationship between the virtual space and the real space, which is set based on a superimposed area where the virtual movement area and the actual movement area are superimposed ; obtaining a correspondence relationship between the virtual space and the real space, which is set based on a superimposed area where the virtual movement area and the actual movement area are superimposed when the virtual space and the real space are superimposed ; and causing a computer to perform a step of causing a display unit to display an image for the virtual space based on the correspondence relationship and the position of the display device in the real space . [[Advantages of the Invention]]

[0009] According to the present invention, a virtual space can be appropriately provided to the user. [[Brief Description of the Drawings]]

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited by the embodiments described below. The present invention is not limited by the embodiments described below.

[0012] (Real Space and Virtual Space) FIG. 1 is a schematic diagram for explaining an example of a real space and a virtual space. The display device 10 according to the present embodiment is a display device that displays an image. As shown in FIG. 1, the display device 10 is a so-called HMD (Head Mount Display) mounted on the head of the user U. The display device 10 provides a virtual space for the user U by displaying an image. As shown in FIG. 1, the real space where the user U actually exists is defined as the real space SR, and the virtual space provided by the display device 10 for the user U is defined as the virtual space SV. In this case, the display device 10 displays an image for the virtual space SV according to the operation (gaze) of the user U in the real space SR. That is, the display device 10 simulates the user U operating as an avatar UV in the virtual space SV and displays an image for the virtual space SV. Therefore, the user U can recognize that he / she exists in the virtual space SV. Note that the virtual space SV here is MR (Mixed Reality ), which is a space that reproduces an actual place away from the location where the user U exists, but is not limited to this, and can also be a virtual space that does not actually exist, that is, VR (Vertial Reali ), or other virtual spaces. not limited thereto, and can also be a virtual space that does not actually exist, that is, VR (Virtual Reality). It may be (ty). Hereinafter, in the coordinate system of the real space SR, one direction along the horizontal direction is defined as the direction XR, the direction perpendicular to the direction XR along the horizontal direction is defined as the direction YR, and the vertical direction is defined as the direction ZR. Also, in the coordinate system of the virtual space SV, one direction along the horizontal direction is the direction X V, the direction perpendicular to the direction XV along the horizontal direction is the direction YV, and the vertical direction is the direction ZV .

[0013] (Display device) FIG. 2 is a schematic block diagram of the display device according to the present embodiment. The display device 10 can be said to be a computer. As shown in FIG. 2, it includes an input unit 20, a display unit 22, a storage unit 2 4, a communication unit 26, a real space detection unit 28, and a control unit 30. The input unit 20 is a mechanism that receives operations by the user U, and can be, for example, a controller or a microphone provided in the HMD or the like. The display unit 22 is a display that displays an image. By outputting an image, the display unit 22 provides the virtual space SV to the user U. The display device 10 may include, in addition to the display unit 22, a device that outputs information, such as a speaker that outputs sound .

[0014] The storage unit 24 is a memory that stores various information such as the calculation content and programs of the control unit 30. For example, it includes at least one of a main storage device such as a RAM (Random Access Memory) and a ROM (Re ad Only Memory), and an external storage device such as an HDD (Hard Disk Drive). The program for the control unit 30 stored in the storage unit 24 may be stored in a recording medium readable by the display device 10 .

[0015] The communication unit 26 is a communication module that communicates with an external device, such as an antenna, etc. The display device 10 communicates with an external device by wireless communication, but may also use wired communication, and the communication method may be arbitrary.

[0016] The real space detection unit 28 is a sensor that detects the surroundings of the display device 10 (user U) in the real space SR. The real space detection unit 28 detects objects existing around the display device 10 (user U) in the real space SR, and in this embodiment, it is a camera. However, as long as the real space detection unit 28 can detect objects existing in the real space SR around the display device 10 (user U), it is not limited to being a camera, and for example, it may be LIDAR (Light Detect ion And Ranging), etc. ion And Ranging), etc. ion And Ranging), etc.

[0017] The control unit 30 is an arithmetic device and includes an arithmetic circuit such as a CPU (Central Processin g Unit), etc. The control unit 30 includes a virtual space information acquisition unit 40, a real space information acquisition unit 42, a correspondence relationship acquisition unit 44, a display control unit 46, and an avatar information transmission unit 4 8. The control unit 30 reads a program (software) from the storage unit 24 and executes it, thereby realizing the virtual space information acquisition unit 40, the real space information acquisition unit 42, the correspondence relationship acquisition unit 44, the display control unit 46, and the avatar information transmission unit 48, and executing their processes. Note that the control unit 30 may execute these processes by one CPU, or may be provided with a plurality of CPUs and execute the processes with these plurality of CPUs. Also, at least a part of the processes of the virtual space information acquisition unit 40, the real space information acquisition unit 42, the correspondence relationship acquisition unit 44, the display control unit 46, and the avatar information transmission unit 48 may be realized by a hardware circuit. unit 48 may be realized by a hardware circuit.

[0018] (Virtual Space Information Acquisition Unit) The virtual space information acquisition unit 40 acquires information on the virtual space SV. The virtual space information acquisition unit 40 acquires, for example, information on the virtual space SV from an external device (server) via the communication unit 26. The information on the virtual space SV includes image data of the virtual space SV in the coordinate system of the virtual space SV. The image data of the virtual space SV indicates the coordinates, shape, etc. of the object to be displayed as an image for the virtual space SV. Note that in this embodiment, the virtual space SV is not constructed according to the environment around the user U in the real space SR, but is preset without relation to the environment around the user U in the real space SR.

[0019] FIG. 3 is a schematic diagram showing an example of the virtual space. FIG. 3 is an example of a plan view when the virtual space SV is viewed from the ZV direction. The virtual space information acquisition unit 40 also acquires information on the movable area AV2 (virtual movement area) in the virtual space SV as information on the virtual space SV. That is, the virtual space information acquisition unit 40 also acquires information indicating the position occupied by the movable area AV2 in the coordinate system of the virtual space SV. The movable area AV2 is an area (or space) in the virtual space SV where the avatar UV of the user U can move, and may be an area excluding the immovable area AV1, which is an area (or space) in the virtual space SV where the avatar UV of the user U cannot move. The movable area AV2 may be, for example, the floor of a room where avatars gather in the virtual space SV, and the immovable area AV1 may be, for example, an obstacle in the virtual space SV through which the avatar UV cannot pass. ​​​​​Existing areas and areas of interest in a meeting in the virtual space SV (such as desks, screens, etc.) can be any. In this embodiment, the movable area AV2 can be preset when setting the virtual space SV, for example, or can be set by the virtual space information acquisition unit 40 based on, for example, the size of the avatar UV and the size of the immovable area AV1.

[0020] Note that in FIG. 3, the virtual space SV and the immovable area AV1 when viewed from the ZV direction are rectangular, but this is merely an example. The shapes and sizes of the virtual space SV, the immovable area AV1, and the movable area AV2 are not limited to the example in FIG. 3 and can be arbitrary.

[0021] (Real space information acquisition unit) The real space information acquisition unit 42 acquires information on the real space SR. The information on the real space SR refers to the position information indicating the coordinates and shapes of the objects existing around the display device 10 (user U) in the coordinate system of the real space SR. In this embodiment, the real space information acquisition unit 42 controls the real space detection unit 28 to cause the real space detection unit 28 to detect the objects around the display device 10 (user U), and acquires the detection result as the information on the real space SR. However, the method of acquiring the information on the real space SR is not limited to being detected by the real space detection unit 28. For example, the layout information of the room of the user U, etc., is preset as the information on the real space SR, and the real space information acquisition unit 42 may acquire the preset information on the real space SR. For example, the information on the real space SR such as the layout information of the room of the user U is preset, and the real space information acquisition unit 42 may acquire the preset information on the real space SR.

[0022] FIG. 4 is a schematic diagram showing an example of the real space. FIG. 4 is an example of a plan view when the real space SR is viewed from the ZR direction. The real space information acquisition unit 42 acquires information on the movable area AR2 (actual movement area) in the real space SR. That is, the real space information acquisition unit 42 acquires the real space SR ​ The position information indicating the position of the movable area AR2 in the coordinate system of the movable area AR2 is obtained. The area AR2 is the area in which the user U can move in the real space SR (or the area in which the user U can move). A region where user U cannot move (or a space where user U cannot move) The movable area AR2 may be an area excluding a certain unmovable area AR1. The unmovable area AR1 may be, for example, the floor of the room where the user U is. In the area, there are obstacles (such as a desk or a bed) that the user U cannot pass through. In this embodiment, the real space information acquisition unit 42 determines whether the moving object is movable based on the information of the real space SR. The real space information acquisition unit 42 sets the area AR2 and the non-movement area AR1. Based on the information, the location of the object that the user U cannot move is identified, and the object that the user U cannot move is identified. The area (or space) occupied by the body is defined as an unmovable area AR1, and the objects that the user U cannot move are An area (or space) that does not exist may be set as the movable area AR2. The movable area AR2 and the unmovable area AR1 are not limited to being set based on information from the real space SR. For example, the layout information of the user U's room, etc., can be used to distinguish between the movable area AR2 and the non-movable area AR3. The information of the area AR1 is set in advance, and the real space information acquisition unit 42 uses the set movable area Information on the area AR2 and the unmovable area AR1 may be acquired.

[0023] Note that FIG. 4 is merely an example. The shape and size of AR2 are not limited to the example in FIG. 4 and may be any shape and size.

[0024] (Correspondence acquisition section) The correspondence relationship acquisition unit 44 acquires the information of the movable area AV2 acquired by the virtual space information acquisition unit 40. and based on the information of the movable area AR2 acquired by the real space information acquisition unit 42, the virtual space S V sets the correspondence relationship between the coordinate system of the virtual space SV and the coordinate system of the real space SR. The correspondence relationship between the coordinate system of the virtual space SV and the coordinate system of the real space SR refers to the information indicating the position and orientation of the real space SR in the coordinate system of the virtual space SV, and can also be said to be the value for converting the coordinate system of the real space SR into the coordinate system of the virtual space SV. For example, when the user U is at the reference position in the real space SV, the display device 10 displays an image of the virtual space SV when the viewpoint (avatar UV) of the user U exists at the position in the virtual space SV corresponding to the reference position of the real space SV. Hereinafter, the process of the correspondence relationship acquisition unit 44 will be specifically described.

[0025] FIG. 5 is a schematic diagram showing an example of the superposition of the virtual space and the real space. The correspondence relationship acquisition unit 44 superimposes the virtual space SV acquired by the virtual space information acquisition unit 40 and the real space SR acquired by the real space information acquisition unit 42 in a common coordinate system. In other words, the correspondence relationship acquisition unit 44 converts the coordinates of the immovable area AV1 and the movable area AV2 in the virtual space SV and the coordinates of the immovable area AR1 and the movable area AR2 in the real space SR into a common coordinate system by coordinate transformation, so as to superimpose the immovable area AV1 and the movable area AV2 and the immovable area AR1 and the movable area AR2 in a common coordinate system. The common coordinate system may be an arbitrary coordinate system. In the example of FIG. 5, in the common coordinate system, one direction along the horizontal direction is defined as the direction X and the direction orthogonal to the direction X along the horizontal direction is defined as the direction Y, and the vertical direction is defined as the direction Z.

[0026] The correspondence relationship acquisition unit 44, when superimposing the virtual space SV and the real space SR in a common coordinate system,​​​​​​ Calculate the area of the region where the movable region AV2 and the movable region AR2 overlap (or the volume of the overlapping space) as the overlapping area. The correspondence acquisition unit 44 calculates the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR based on the calculated overlapping area.

[0027] In the present embodiment, as shown in the example of FIG. 5, the correspondence acquisition unit 44 moves at least one of the relative position and the relative orientation between the virtual space SV and the real space SR in a common coordinate system to calculate the overlapping area. In other words, the correspondence acquisition unit 44 calculates the overlapping area of the movable region AV2 and the movable region AR2 for each virtual space SV and real space SR where at least one of the relative position and the relative orientation is different in a common coordinate system. Note that, in the example of FIG. 5, an example is shown in which the position and orientation of the real space SV are fixed in a common coordinate system while the position and orientation of the virtual space SR are moved, but the present invention is not limited thereto, and the overlapping area may be calculated by fixing the position and orientation of the virtual space SR and moving the position and orientation of the real space SV. SR and moving the position and orientation of the real space SV. For each combination of virtual space SV and real space SR where at least one of the relative position and the relative orientation is different, the correspondence acquisition unit 44 calculates the overlapping area where the movable region AV2 and the movable region AR2 overlap. In addition, in the example of FIG. 5, an example is shown in which the position and orientation of the real space SV are fixed in a common coordinate system while the position and orientation of the virtual space SR are moved, but the present invention is not limited thereto, and the overlapping area may be calculated by fixing the position and orientation of the virtual space SR and moving the position and orientation of the real space SV. SR and moving the position and orientation of the real space SV. SR and moving the position and orientation of the real space SV. is calculated.

[0028] Based on the overlapping area for each combination of virtual space SV and real space SR where at least one of the relative position and the relative orientation is different in a common coordinate system, the correspondence acquisition unit 44 sets the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. More specifically, the correspondence acquisition unit 44 extracts the combination of virtual space SV and real space SR with the largest overlapping area among the combinations of virtual space SV and real space SR where at least one of the relative position and the relative orientation is different. Then, the correspondence acquisition unit 44 sets the coordinate system of the extracted virtual space SV and the real space S R's coordinate system correspondence. More specifically, the correspondence acquisition unit 44 extracts the combination of virtual space SV and real space SR with the largest overlapping area among the combinations of virtual space SV and real space SR where at least one of the relative position and the relative orientation is different. Then, the correspondence acquisition unit 44 sets the coordinate system of the extracted virtual space SV and the real space S R's coordinate system correspondence. More specifically, the correspondence acquisition unit 44 extracts the combination of virtual space SV and real space SR with the largest overlapping area among the combinations of virtual space SV and real space SR where at least one of the relative position and the relative orientation is different. Then, the correspondence acquisition unit 44 sets the coordinate system of the extracted virtual space SV and the real space S The correspondence relationship with the coordinate system of R (the value for converting the coordinate system of the extracted virtual space SV of the extracted real space SR) is calculated, and the correspondence relationship between the coordinate system of the virtual space SV and the coordinate system of the real space SR is set. In other words, the correspondence relationship acquisition unit 44 extracts the virtual space SV at the position and orientation where the overlapping area is maximized, and associates the coordinate system of the extracted virtual space SV with the coordinate system of the real space SR. Figure 6 is a schematic diagram showing another example of the overlap between the virtual space and the real space. In the description of Figure 5, the correspondence relationship acquisition unit 44 overlapped with the real space SR while keeping the size of the virtual space SV fixed and changing the position and orientation of the virtual space SV. However, as shown in Figure 6, it is possible to overlap with the real space SR while changing the size of the virtual space SV. In this case, the correspondence relationship acquisition unit 44 calculates the overlapping area while changing the relative sizes of the virtual space SV and the real space SR in a common coordinate system. In other words, the correspondence relationship acquisition unit 44 calculates the overlapping area where the movable area AV2 and the movable area AR2 overlap for each combination of the virtual space SV and the real space SR with different relative sizes in a common coordinate system. Even when changing the relative size, it is preferable to keep the area ratios of the immovable area AV1 and the movable area AV2 with respect to the virtual space SV and the immovable area AR1 and the movable area AR2 with respect to the real space SR fixed. In other words, it is preferable to uniformly enlarge and reduce the entire virtual space SV and the entire real space SR without enlarging and reducing only a part of the virtual space SV or the real space SR.

[0029] Figure 6 is a schematic diagram showing another example of the overlap between the virtual space and the real space. In the description of Figure 5, the correspondence relationship acquisition unit 44 overlapped with the real space SR while keeping the size of the virtual space SV fixed and changing the position and orientation of the virtual space SV. However, as shown in Figure 6, it is possible to overlap with the real space SR while changing the size of the virtual space SV. In this case, the correspondence relationship acquisition unit 44 calculates the overlapping area while changing the relative sizes of the virtual space SV and the real space SR in a common coordinate system. In other words, the correspondence relationship acquisition unit 44 calculates the overlapping area where the movable area AV2 and the movable area AR2 overlap for each combination of the virtual space SV and the real space SR with different relative sizes in a common coordinate system. Even when changing the relative size, it is preferable to keep the area ratios of the immovable area AV1 and the movable area AV2 with respect to the virtual space SV and the immovable area AR1 and the movable area AR2 with respect to the real space SR fixed. In other words, it is preferable to uniformly enlarge and reduce the entire virtual space SV and the entire real space SR without enlarging and reducing only a part of the virtual space SV or the real space SR. Figure 6 shows an example in which the size of the virtual space SR is changed while keeping the size of the real space SV fixed in a common coordinate system, but it is not limited to this. It is also possible to change the size of the virtual space SV while keeping the size of the real space SR fixed. In the example of Figure 6, an example is shown in which the size of the virtual space SR is changed while keeping the size of the real space SV fixed in a common coordinate system, but it is not limited to this. It is also possible to change the size of the virtual space SV while keeping the size of the real space SR fixed. The area ratios of the immovable area AV1 and the movable area AV2 with respect to the virtual space SV and the immovable area AR1 and the movable area AR2 with respect to the real space SR are preferably kept fixed. That is, it is preferable to uniformly enlarge and reduce the entire virtual space SV and the entire real space SR without enlarging and reducing only a part of the virtual space SV or the real space SR. Figure 6 shows an example in which the size of the virtual space SR is changed while keeping the size of the real space SV fixed in a common coordinate system, but it is not limited to this. It is also possible to change the size of the virtual space SV while keeping the size of the real space SR fixed. Figure 6 shows an example in which the size of the virtual space SR is changed while keeping the size of the real space SV fixed in a common coordinate system, but it is not limited to this. While fixing the size of the intermediate SR, change the size of the real space SV and calculate the overlapping area. This is also acceptable.

[0030] In the example of FIG. 6, the correspondence acquisition unit 44 is based on the overlapping area for each combination of the virtual space SV and the real space SR with different relative sizes in a common coordinate system, and sets the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. More specifically, the correspondence acquisition unit 44 selects, from among the combinations of the virtual space SV and the real space SR with different relative sizes, the combination of the virtual space SV and the real space SR that gives the maximum overlapping area. Then, the correspondence acquisition unit 44 sets the correspondence between the coordinate system of the extracted virtual space SV and the coordinate system of the real space SR as the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. In other words, the correspondence acquisition unit 44 extracts the virtual space SV with the scale factor that gives the maximum overlapping area, and associates the coordinate system of the virtual space SV with the size of the extracted scale factor with the coordinate system of the real space SR. It should be noted that the examples of FIGS. 5 and 6 may be combined. That is, the correspondence acquisition unit 44 calculates the overlapping area while changing the relative position, relative orientation, and relative size of the virtual space SV and the real space SR in a common coordinate system. Then, the correspondence acquisition unit 44 selects, from among the combinations of the virtual space SV and the real space SR where at least one of the relative position, relative orientation, and relative size is different in a common coordinate system, the combination of the virtual space SV and the real space SR that gives the maximum overlapping area.

[0031] Then, the correspondence acquisition unit 44 sets the correspondence between the coordinate system of the extracted virtual space SV and the coordinate system of the real space SR as the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. In the common coordinate system, while changing the relative position, relative orientation, and relative size of the virtual space SV and the real space SR, the overlapping area is calculated. Then, the correspondence acquisition unit 44 selects, from among the combinations of the virtual space SV and the real space SR where at least one of the relative position, relative orientation, and relative size is different in the common coordinate system, the combination of the virtual space SV and the real space SR that gives the maximum overlapping area. Then, the correspondence acquisition unit 44 sets the correspondence between the coordinate system of the extracted virtual space SV and the coordinate system of the real space SR as the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. Among the combinations of the virtual space SV and the real space SR where at least one of the relative position, relative orientation, and relative size is different in the common coordinate system, the combination of the virtual space SV and the real space SR that gives the maximum overlapping area is extracted. Then, the correspondence acquisition unit 44 sets the correspondence between the coordinate system of the extracted virtual space SV and the coordinate system of the real space SR as the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. The correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR is set as the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. is set.

[0032] In the above description, the correspondence acquisition unit 44 is the movable area in two dimensions in the virtual space SV The movable area AV2 indicating the area, and the movable area indicating the movable area in two dimensions in the real space SR The virtual space SV and the real space SR are associated with each other so that the overlapping area with the area AR2 becomes the maximum However, it is not limited to maximizing the overlapping area in two dimensions. For example, the correspondence acquisition unit 4 4 may associate the virtual space SV and the real space SR so that the overlapping volume with the movable area AV2 (virtual movement space) indicating the three-dimensional movable space in the virtual space SV and the movable area AR2 (real movement space) indicating the three-dimensional movable space in the real space SR becomes the maximum .

[0033] Also, in the above description, the correspondence acquisition unit 44 overlaps the virtual space SV and the real Space SR to calculate the overlapping area, and based on the overlapping area, the coordinate system of the virtual space SV and The coordinate system of the real space SR sets the correspondence. However, the calculation of the overlapping area and the setting of the correspondence Is not limited to being performed by the correspondence acquisition unit 44. For example, an external device calculates the overlapping surface The correspondence acquisition unit 44 may acquire the information of the overlapping area from the external device And set the correspondence based on it. Also, for example, an external device calculates the overlapping area And sets the correspondence based on the overlapping area, and the correspondence acquisition unit 44 may acquire the correspondence from the external device Relationship information.

[0034] (Display control unit) The display control unit 46 is based on the correspondence between the coordinate system of the virtual space SV set by the correspondence acquisition unit 44 and the coordinate system of the real space SR And the position of the user U (display device 10) in the real space SR vi. Cause the image for the virtual space SR to be displayed on the display unit 22. Specifically, the display control unit 46 obtains information on the position and orientation of the user U in the real space SR, and based on the correspondence relationship, converts the position and orientation of the user U in the real space SR into the position and orientation of the viewpoint (avatar UV) of the user U in the coordinate system of the virtual space SV. The display control unit 46 displays, as an image for the virtual space SV, the image of the virtual space SV when viewed from the calculated position and orientation of the viewpoint of the user U on the display unit 22. Note that the information on the position and posture of the user U (display device 10) in the real space SR may be obtained by any method. For example, it may be calculated using the detection result of the real space detection unit 28 (i.e., the captured image of the real

[0035] space SR here). In this way, the position and posture of the user U in the real space SR are reflected in the position and posture of the viewpoint of the user U in the virtual space SV. Therefore, when the user U moves in the real space SR, the position and posture of the viewpoint of the user U in the virtual space SV (i.e., the position and posture of the avatar UV) also move. In this case, it is preferable that the amount of movement of the user U in the real space SR and the amount of movement of the viewpoint of the user U in the virtual space SV are associated with each other. More specifically, when changing the size of the virtual space SV in a common coordinate system when setting the correspondence relationship, it is preferable to reflect the degree of change in the size of the virtual space SV in the amount of movement. Specifically, if the ratio (scale factor) of the change in the size of the virtual space SV in the common coordinate system is taken as the Causes the display unit 22 to display an image for use. That is, the display control unit 46 causes the virtual space SV image from a viewpoint that has moved by an amount that is the reciprocal multiple of the change ratio with respect to the amount of movement of the user U in the real space S R to be displayed on the display unit 22. For example, when the size of the virtual space SV is doubled when setting the correspondence relationship, the display control unit 46 causes the virtual space SV image from a viewpoint that has moved by an amount that is 1 / 2 times the amount of movement of the user U in the real space SR to be displayed on the display unit 22.

[0036] Further, the display control unit 46 may superimpose and display an object in the real space SR on the image of the virtual space SV. In this case, the display unit 22 may provide AR (Augumented Reality) that displays the image of the virtual space SV while transmitting the real space SR or may superimpose and display the image of the virtual space SV and the image showing the object in the real space SR. Also, among the movable area AV2 on the virtual space SV, the space part that does not overlap with the movable area AR2 in the real space SR may be deleted from the image of the virtual space SV or information may be presented as an immovable area. In this case, even if it is an area that remains as a movable area , an area where the space width through which the user U (the avatar UV that reproduces his / her body shape) can pass is not ensured may be deleted from the image of the virtual space SV.

[0037] The display device 10 according to the present embodiment appropriately provides the virtual space SV to the user U by displaying an image for the virtual space SV based on the correspondence relationship between the coordinate system of the virtual space SV and the coordinate system of the real space SR set in this way. For example, the user U can use the virtual space SV While visually recognizing, the user will move in the real space SR. That is, the user U tries to move within the movable area AV2 in the virtual space SV However, the actually movable area for the user U is the movable area AR2 in the real space SR. Thus, the movable area recognized by the user U and the actually movable area will be different. On the other hand, in this embodiment the virtual space SV and the real space SR are associated with each other such that the overlapping area between the movable area AV2 in the virtual space SV and the movable area AR2 in the real space SR becomes large. Therefore, the deviation between the movable area recognized by the user U and the actually movable area is reduced and the user U can secure the movable area as wide as possible. Therefore, even when the user U moves, the virtual space SV can be appropriately provided by the display device 10

[0038] (Avatar information transmission unit) The avatar information transmission unit 48 transmits the information of the avatar UV of the user U in the virtual space SV to external information via the communication unit 26. The avatar information transmission unit 48 acquires the information of the position and orientation of the user U in the real space SR, and based on the correspondence relationship between the coordinate system of the real space SR and the coordinate system of the virtual space SV, converts the position and orientation of the user U in the real space SR into the position and orientation of the avatar UV in the coordinate system of the virtual space SV. The avatar information transmission unit 48 transmits the information of the position and orientation of the avatar UV in the coordinate system of the virtual space SV and the image data (data indicating the shape, etc.) of the avatar UV to an external device. The external device transmits the information of the position and orientation of the avatar UV in the coordinate system of the virtual space SV and the image data of the avatar UV to the display device used by other users as the image data of the virtual space SV ​​​​​​​​​. The display device displays image data of the virtual space SVG including the image of the avatar UV toward the user wearing the display device. By transmitting the image data of the avatar in this way to an external device, the virtual space SV can be shared among multiple users.

[0039] (Processing Flow) The display flow of the image of the virtual space SV described above will be described. FIG. 7 is a flowchart for explaining the display flow of the image of the virtual space. As shown in FIG. 7, the display device 10 acquires information on the virtual space SV by the virtual space information acquisition unit 40 (step S10), and acquires information on the real space SR by the real space information acquisition unit 42 (step S12). Then, the display device 10 overlaps the virtual space SV and the real space SR in a common coordinate system while changing at least one of the relative position, relative orientation, and relative size between the virtual space SV and the real space SR, and calculates the overlapping area (step S14). The correspondence acquisition unit 44 extracts the combination of the virtual space SV and the real space SR that gives the maximum overlapping area among the combinations of the virtual space SV and the real space SR (step S16), and sets the correspondence between the coordinate system of the extracted virtual space SV and the coordinate system of the real space SR (step S18). The display device 10 causes the display control unit 46 to display the image of the virtual space SV on the display unit 22 based on the set correspondence and the position of the display device 10 (user U) in the real space SR (step S20).

[0040] (Effect) As described above, the display device 10 according to the present embodiment is worn by the user U and provides the virtual space SV to the user U, and includes a virtual space information acquisition unit 40 and a real space information acquisition unit. ​​​​​​​​​​​​​​It includes a virtual space information acquisition unit 40, a corresponding relationship acquisition unit 44, and a display control unit 46. The virtual space information acquisition unit 40 acquires information on a movable area AV2 (virtual movement area) in the virtual space SV where the user U (avatar UV) can move. The real space information acquisition unit 42 acquires information on a movable area AR2 (real movement area) in the real space SR where the user U exists in the real space SR where the user U can move. The corresponding relationship acquisition unit 44 acquires a corresponding relationship between the coordinate system of the virtual space SV and the coordinate system of the real space SR set based on the overlapping area. The overlapping area is the area where the movable area AV2 (virtual movement area) and the movable area AR 2 (real movement area) overlap when the virtual space SV and the real space SR are overlapped in a common coordinate system. The display control unit 46 causes the display unit 22 to display an image for the virtual space SV based on the corresponding relationship and the position of the display device 10 in the real space SR .

[0041] When the virtual space SV is provided to the user U from the display device 10, the movable area in the virtual space SV recognized by the user U and the actually movable area in the real space SR are different . In contrast, the display device 10 according to the present embodiment associates the virtual space SV and the real space SR based on the overlapping area between the movable area AV2 in the virtual space SV and the movable area AR2 in the real space SR. Therefore, the deviation between the movable area recognized by the user U and the actually movable area is reduced, and the user U can secure the movable area as wide as possible . Therefore, according to the display device 10, even when the user U moves, the virtual space S V can be appropriately provided.

[0042] In addition, the corresponding relationship is the relative position and ​A set of each virtual space SV and the real space SR in which at least one of the opposite directions is moved Among the combinations, the coordinate system of the virtual space SV with the largest overlapping area and the coordinate system of the real space SR are associated with each other. By moving the virtual space SV relative to the real space SR in this way and associating the virtual space SV and the real space SR so that the overlapping area is maximized, the user U can secure the widest possible movable area.

[0043] Also, the correspondence relationship is such that, among the combinations of each virtual space SV and the real space SR in which the relative size of the virtual space SV and the real space SR is changed in a common coordinate system, the coordinate system of the virtual space SV with the largest overlapping area and the coordinate system of the real space SR are associated with each other. By changing the size of the virtual space SV relative to the real space SR in this way and associating the virtual space SV and the real space SR so that the overlapping area is maximized, the user U can secure the widest possible movable area.

[0044] Further, the display control unit 46 moves the virtual space SV by a reciprocal multiple of the change ratio obtained by changing the size of the virtual space SV in a common coordinate system with respect to the amount of movement of the display device 10 (user U) in the real space SR. Assuming that the user U has moved in the virtual space SV, an image for the virtual space SV is displayed on the display unit 22. The display device 10 according to the present embodiment can appropriately provide the virtual space SV in accordance with the movement of the user U because it sets the amount of movement in the virtual space SV in consideration of the scaling factor when overlapping with the actual amount of movement of the user U.

[0045] (Another example of the method for setting the correspondence relationship) Another example of the method for setting the correspondence relationship between the coordinate system of the virtual space SV and the coordinate system of the real space SR described in the present embodiment will be described. ​​​​​​​​​​​​

[0046] For example, as described with reference to FIGS. 5 and 6, while changing the position, orientation, and size of the virtual space SV, when the virtual space SV and the real space SR are superimposed so that the superimposed area is maximized, around the immovable area AV1 (for example, the area of interest) of the virtual space SV, there is an immovable area AR1 (for example, an actual obstacle) in the real space SR, which may interfere when approaching the area of interest in the virtual space SV. In preparation for such a case, the correspondence acquisition unit 44 sets a priority area in the movable area AV2 of the virtual space SV, and may superimpose the virtual space SV and the real space SR so that the priority area does not overlap with the immovable area AR1 in the real space SR. This will be described in more detail below. More specifically,

[0047] FIG. 8 is a schematic diagram for explaining an example of the priority area, and FIG. 9 is a schematic diagram showing another example of the superimposition of the virtual space and the real space. The correspondence acquisition unit 44 sets a priority area within the movable area AV2 of the virtual space SV. The priority area is an area where, when the virtual space SV and the real space SR are superimposed, it is prioritized to overlap with the movable area AR2 without overlapping with the immovable area AR1. The correspondence acquisition unit 44 may set the priority area by any method. For example, a region of a predetermined size around the immovable area AV1, which is the area of interest, within the entire movable area AV2 may be set as the priority area. Also, the correspondence acquisition unit 44 may set a plurality of priority areas with different priorities. In the example of FIG. 8, the correspondence acquisition unit 44 sets a priority area AV2a around the immovable area AV1, and sets a priority area AV2b around the priority area AV2a. In this case, the priority area AV2a closer to the immovable area AV1 has a higher priority. is set to have a higher priority than the priority area AV2b. Hereinafter, among the movable areas AV2, the areas other than the priority area are described as non-priority areas as appropriate. That is, in the example of FIG. 9, the area outside the priority area AV2b becomes the non-priority area AV2c. The correspondence acquisition unit 44 superimposes the virtual space SV in which the priority area is set and the real space SR in the common coordinate system. In this case, as described with reference to FIGS. 5 and 6, the correspondence acquisition unit 44

[0048] calculates the overlapping area while changing at least one of the relative position, relative orientation, and relative size of the virtual space SV and the real space SR in the common coordinate system, and determines the virtual space S V with the maximum overlapping area and the combination of the real space SR to set the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. However, in this example, the size of the priority overlapping area, which is the area where the priority area and the movable area AR2 overlap, has a greater influence on the calculated overlapping area than the size of the non-priority overlapping area, which is the area where the non-priority area and the movable area AR2 overlap. That is, the overlapping area is calculated so as to increase as the priority overlapping area or the non-priority overlapping area increases, but the degree to which the overlapping area increases when the priority overlapping area increases by a unit amount is greater than the degree to which the overlapping area increases when the non-priority overlapping area increases by a unit amount. of the virtual space SV and the real space SR in the common coordinate system, and determines the virtual space S V with the maximum overlapping area and the combination of the real space SR to set the correspondence between the coordinate system of the virtual space SV and the coordinate system of the real space SR. However, in this example, the size of the priority overlapping area, which is the area where the priority area and the movable area AR2 overlap, has a greater influence on the calculated overlapping area than the size of the non-priority overlapping area, which is the area where the non-priority area and the movable area AR2 overlap. That is, the overlapping area is calculated so as to increase as the priority overlapping area or the non-priority overlapping area increases, but the degree to which the overlapping area increases when the priority overlapping area increases by a unit amount is greater than the degree to which the overlapping area increases when the non-priority overlapping area increases by a unit amount. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area.

[0049] For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. For example, the correspondence acquisition unit 44 in this example assigns a weight to the priority overlapping area and calculates the sum of the value obtained by multiplying the weight by the priority overlapping area and the non-priority overlapping area as the overlapping area. By assigning a weight to the priority overlapping area in this way, the priority overlapping area (priority area) contributes more to the overlapping area. The degree of influence to be obtained becomes larger than the degree of influence that the non-priority overlapping area (non-priority area) exerts on the overlapping area. Therefore, for example, as shown in FIG. 9, it is important that the priority area around the area of interest (immovable area AV1) does not overlap with the immovable area AR1, and the combination of the virtual space SV and the real space SR where the overlapping area is maximized makes it difficult for the priority overlapping area to overlap with the immovable area AR1. Therefore, for example, when approaching the area of interest in the virtual space SV, the possibility that the immovable area AR1 becomes an obstacle can be suppressed. , becomes larger. Therefore, for example, as shown in FIG. 9, it is important that the priority area around the area of interest (immovable area AV1) does not overlap with the immovable area AR1, and the combination of the virtual space SV and the real space SR where the overlapping area is maximized makes it difficult for the priority overlapping area to overlap with the immovable area AR1. Therefore, for example, when approaching the area of interest in the virtual space SV, the possibility that the immovable area AR1 becomes an obstacle can be suppressed. around does not overlap with the immovable area AR1, and the combination of the virtual space SV and the real space SR where the overlapping area is maximized makes it difficult for the priority overlapping area to overlap with the immovable area AR1. Therefore, for example, when approaching the area of interest in the virtual space SV, the possibility that the immovable area AR1 becomes an obstacle can be suppressed. In this way, in this example, the larger the priority overlapping area where the priority area set within the movable area AV2 overlaps with the movable area AV2, the more the overlapping area is calculated to be larger. In this way, in this example, the larger the priority overlapping area where the priority area set within the movable area AV2 overlaps with the movable area AV2, the more the overlapping area is calculated to be larger. region AR1 becomes an obstacle can be suppressed.

[0050] As described above, in this example, the larger the priority overlapping area where the priority area set within the movable area AV2 overlaps with the movable area AV2, the more the overlapping area is calculated to be larger. The priority area is set to have a greater degree of influence on the size of the overlapping area than the non-priority area (the area within the movable area AV2 other than the priority area). Thereby, when approaching the area of interest in the virtual space SV, the possibility that the immovable area AR1 becomes an obstacle can be suppressed. When setting a plurality of priority areas, the weight values may be made different for each priority area. In this case, in the example of FIG. 8, the weight of the priority area AV2a closer to the immovable area AV1 is set to be larger than the weight of the priority area AV2b. The priority area is set to have a greater degree of influence on the size of the overlapping area than the non-priority area (the area within the movable area AV2 other than the priority area). Thereby, when approaching the area of interest in the virtual space SV, the possibility that the immovable area AR1 becomes an obstacle can be suppressed. When setting a plurality of priority areas, the weight values may be made different for each priority area. In this case, in the example of FIG. 8, the weight of the priority area AV2a closer to the immovable area AV1 is set to be larger than the weight of the priority area AV2b. The priority area is set to have a greater degree of influence on the size of the overlapping area than the non-priority area (the area within the movable area AV2 other than the priority area). Thereby, when approaching the area of interest in the virtual space SV, the possibility that the immovable area AR1 becomes an obstacle can be suppressed. When setting a plurality of priority areas, the weight values may be made different for each priority area. In this case, in the example of FIG. 8, the weight of the priority area AV2a closer to the immovable area AV1 is set to be larger than the weight of the priority area AV2b. region AR1 becomes an obstacle can be suppressed. When setting a plurality of priority areas, the weight values may be made different for each priority area. In this case, in the example of FIG. 8, the weight of the priority area AV2a closer to the immovable area AV1 is set to be larger than the weight of the priority area AV2b. areas, the weight values may be made different for each priority area. In this case, in the example of FIG. 8, the weight of the priority area AV2a closer to the immovable area AV1 is set to be larger than the weight of the priority area AV2b. areas, the weight values may be made different for each priority area. In this case, in the example of FIG. 8, the weight of the priority area AV2a closer to the immovable area AV1 is set to be larger than the weight of the priority area AV2b. is set to be larger.

[0051] Next, as another example of the method for setting the correspondence relationship, a method for setting the correspondence relationship between the position in the height direction of the real space SR and the position in the height direction of the virtual space SV will be described. FIG. 10 is a schematic diagram showing an example when the user is viewing the virtual space. As shown in FIG. 10, the immovable area AV1a, which is the area of interest in the virtual space SV, overlaps with the immovable area AR1, which is an obstacle in the real space SV, in the position in the height direction (ZR direction in the real space coordinates). Next, as another example of the method for setting the correspondence relationship, a method for setting the correspondence relationship between the position in the height direction of the real space SR and the position in the height direction of the virtual space SV will be described. FIG. 10 is a schematic diagram showing an example when the user is viewing the virtual space. As shown in FIG. 10, the immovable area AV1a, which is the area of interest in the virtual space SV, overlaps with the immovable area AR1, which is an obstacle in the real space SV, in the position in the height direction (ZR direction in the real space coordinates). Next, as another example of the method for setting the correspondence relationship, a method for setting the correspondence relationship between the position in the height direction of the real space SR and the position in the height direction of the virtual space SV will be described. FIG. 10 is a schematic diagram showing an example when the user is viewing the virtual space. As shown in FIG. 10, the immovable area AV1a, which is the area of interest in the virtual space SV, overlaps with the immovable area AR1, which is an obstacle in the real space SV, in the position in the height direction (ZR direction in the real space coordinates). Next, as another example of the method for setting the correspondence relationship, a method for setting the correspondence relationship between the position in the height direction of the real space SR and the position in the height direction of the virtual space SV will be described. FIG. 10 is a schematic diagram showing an example when the user is viewing the virtual space. As shown in FIG. 10, the immovable area AV1a, which is the area of interest in the virtual space SV, overlaps with the immovable area AR1, which is an obstacle in the real space SV, in the position in the height direction (ZR direction in the real space coordinates). region AR1 and the position in the height direction (ZR direction in the real space coordinates) overlap, and in the virtual space SV There may be a case where the attention area is hidden. To avoid such a situation, the correspondence acquisition unit 44 sets the correspondence between the height direction positions of the immovable area AV1 and the immovable area AR1 so that they do not overlap with each other, and the correspondence between the height direction position of the real space SR and the height direction position of the virtual space SV may be set. Thereby, for example, as shown in the immovable area AV1b in FIG. 10, the position of the immovable area can be set at a position that does not overlap with the immovable area AR1. Note that the setting of the correspondence between the height direction position of the real space SR and the height direction position of the virtual space SV may be automatically performed by the correspondence acquisition unit 44, or may be performed based on an input by the user U.

[0052] Next, as another example of the correspondence setting method, an example of superimposing the virtual space SV and the real space SR so that the degree of similarity between the virtual space SV and the real space SR increases will be described. FIG. 1 1 is a schematic diagram showing another example of the superimposition of the virtual space and the real space. In this example, the correspondence acquisition unit 44 compares the shapes of the real space SR and the virtual space SV, and extracts, as a similar area SRS with a high degree of similarity, an area in the real space SR that has a shape similar to that of the virtual space SV. Then, as shown in the example of FIG. 11, the correspondence acquisition unit 44 superimposes the virtual space SV on the real space SR while changing at least one of the relative position, relative orientation, and relative size of the virtual space SV and the real space SR, thereby superimposing the virtual space SV and the similar area. The correspondence acquisition unit 44 calculates the correspondence between the coordinate system of the virtual space SV superimposed on the similar area SRS and the coordinate system of the real space SR. By superimposing the virtual space SV on the area with a high degree of similarity in this way too, the deviation between the area that the user U recognizes as movable and the actually movable area is reduced ​​​​​​​​​, the area where the user U can move can be secured as wide as possible. In this example, when overlapping, it is not necessary to consider the overlapping area, but it is not limited to this, and the overlapping area may also be considered. That is, for example the correspondence acquisition unit 44 may overlap the virtual space SV and the real space SR so that the similarity degree increases and the overlapping area increases.

[0053] Although the embodiments of the present invention have been described above, the embodiments are not limited by the contents of these embodiments. Further, the above-described components include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined, and the configurations of the respective embodiments can also be combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the gist of the above-described embodiments.

Explanation of Reference Numerals

[0054] 10 Display device 22 Display unit 40 Virtual space information acquisition unit 42 Real space information acquisition unit 44 Correspondence acquisition unit 46 Display control unit AR2 Movable area (actual movement area) AV2 Movable area (virtual movement area) SR Real space SV Virtual space U User​​​​​

Claims

1. A display device that provides a virtual space to a user, a virtual space information acquisition unit that acquires information about a virtual movement area in which the user can move in the virtual space; a real space information acquisition unit that acquires information about a real movement area in which the user can move in a real space in which the user actually exists; a correspondence relationship acquisition unit that calculates an overlap area, which is an area where the virtual movement area and the real movement area overlap when the virtual space and the real space are overlapped, and acquires a correspondence relationship between the virtual space and the real space that is set based on the overlap area; a display control unit that causes a display unit to display an image for the virtual space based on the correspondence relationship and a position of the display device in the real space; Including, the correspondence relationship acquisition unit calculates the overlapping area when each of the virtual spaces and the real space is combined with a relative size of the virtual space and the real space being changed, and acquires a correspondence relationship in which the overlapping area is maximized among the overlapping areas. Display device.

2. 2. The display device of claim 1, wherein the overlap area is calculated to be larger the larger the area of ​​overlap between a priority area set within the virtual movement area and the actual movement area, and the priority area is set to have a greater influence on the size of the overlap area than areas within the virtual movement area other than the priority area.

3. A method for controlling a display device that provides a virtual space to a user, comprising: acquiring information about a virtual movement area in which the user can move in the virtual space; acquiring information about a real movement area in which the user can move in a real space in which the user actually exists; calculating an overlapping area, which is an area where the virtual movement area and the real movement area overlap when the virtual space and the real space are overlapped, and acquiring a correspondence relationship between the virtual space and the real space, which is set based on the overlapping area; displaying an image for the virtual space on a display unit based on the correspondence relationship and a position of the display device in the real space; Including, In the step of acquiring the correspondence relationship, the overlapping area is calculated when the virtual space and the real space are combined with each other while changing the relative size of the virtual space and the real space, and the correspondence relationship in which the overlapping area is maximum is acquired. A method for controlling a display device.

4. A program for causing a computer to execute a control method for a display device that provides a virtual space to a user, acquiring information about a virtual movement area in which the user can move in the virtual space; acquiring information about a real movement area in which the user can move in a real space in which the user actually exists; calculating an overlapping area, which is an area where the virtual movement area and the real movement area overlap when the virtual space and the real space are overlapped, and acquiring a correspondence relationship between the virtual space and the real space, which is set based on the overlapping area; displaying an image for the virtual space on a display unit based on the correspondence relationship and a position of the display device in the real space; Run the following on your computer: In the step of acquiring the correspondence relationship, the overlapping area is calculated when the virtual space and the real space are combined with each other while changing the relative size of the virtual space and the real space, and the correspondence relationship in which the overlapping area is maximum is acquired. program.

Images