Visible-range identification device, visible-range display system, visible-range identification method, visible-range display method, and program

Abstract

To reduce the load of verifying a visible range.SOLUTION: A visible-range identification device comprises: person data acquisition means for acquiring person data including at least position data, height data, and posture data of a person in a real space; avatar data generation means for generating, on the basis of the person data, for a person avatar representing the person in model data representing a three-dimensional model in which the real space is represented, person avatar data including at least position data, height data, and posture data of the person avatar; visible-range identification means for identifying a visible range of the person avatar in the model data on the basis of the model data and the person avatar data; and data output means for outputting data for displaying the visible range of the person avatar, in at least a portion of the display range on a display device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a technology for identifying a visible range of a person. [Background technology]

[0002] Patent Document 1 discloses a technique for managing structures using three-dimensional shape data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-095367 A Summary of the Invention [Problem to be solved by the invention]

[0004] During combat training, it is necessary to check the range of visibility from the surroundings. Currently, this is done by installing mirrors in training facilities.

[0005] An object of the present disclosure is to provide a visible range specifying device and the like that reduces the burden of checking the visible range. [Means for solving the problem]

[0006] A visible range specifying device in one embodiment of the present disclosure includes: person data acquiring means for acquiring person data including at least position data, height data, and posture data of a person in real space; avatar data generating means for generating person avatar data including at least position data, height data, and posture data of a person avatar representing a person in model data showing a three-dimensional model in which real space is represented, based on the person data; visible range specifying means for specifying a visible range of the person avatar in the model data, based on the model data and the person avatar data; and data output means for outputting data for displaying the visible range of the person avatar in at least a part of the display range of a display device.

[0007] A visible range display system according to one embodiment of the present disclosure includes the above-described visible range specifying device, a person data output device that outputs person position data and posture data to the visible range specifying device, a storage device that stores person height data used by the visible range specifying device, and a display device that displays the visible range using the data output by the visible range specifying device.

[0008] A visible range determination method in one embodiment of the present disclosure acquires person data including at least position data, height data, and posture data of a person in real space, generates, based on the person data, person avatar data for a person avatar representing a person in model data showing a three-dimensional model representing real space, the person avatar data including at least position data, height data, and posture data of the person avatar, determines a visible range of the person avatar in the model data based on the model data and the person avatar data, and outputs data for displaying the visible range of the person avatar in at least a portion of a display range on a display device.

[0009] In one embodiment of the present disclosure, the visible range display method includes a visible range specifying device that executes the above-described visible range specifying method, a person data output device that outputs position data and posture data of a person to the visible range specifying device, a storage device that stores height data of the person used by the visible range specifying device, and a display device that displays the visible range using the data output by the visible range specifying device.

[0010] A program in one embodiment of the present disclosure causes a computer to execute the following processes: acquiring person data including at least position data, height data, and posture data of a person in real space; generating, based on the person data, person avatar data including at least position data, height data, and posture data of a person avatar for a person avatar representing a person in model data that shows a three-dimensional model representing real space; determining, based on the model data and the person avatar data, a visible range of the person avatar in the model data; and outputting data for displaying the visible range of the person avatar in at least a portion of the display range of a display device. Effect of the Invention

[0011] According to the present disclosure, it is possible to achieve the effect of reducing the burden of checking the visible range. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a visible range specifying device. [Diagram 2] FIG. 1 is a diagram showing an example of an urban area represented using a digital twin. [Diagram 3] FIG. 13 is a diagram showing an example of a human avatar identified in model data of an urban area. [Figure 4] FIG. 2 is a diagram illustrating an example of a visible range. [Diagram 5] FIG. 13 is a diagram showing another example of a visible range. [Figure 6] FIG. 13 is a diagram showing an example in which the visible range of a human avatar is displayed in part of the visual field range of a see-through HMD worn by a person. [Figure 7] FIG. 4 is a flow chart showing an example of the operation of the visible range specifying device. [Figure 8] FIG. 13 is a diagram showing a change in the visible range depending on a person's height. [Figure 9] FIG. 13 is a diagram showing an example of a display of a visible range for VIP protection. [Figure 10] FIG. 2 is a block diagram showing an example of a hardware configuration of the visible range specifying device. [Figure 11] FIG. 1 is a diagram illustrating an example of a configuration of a visible range display system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] The embodiments of the present disclosure will be described with reference to the drawings. However, the embodiments are not limited to those described in the drawings.

[0014] First Embodiment In combat training in urban areas, etc., in order to avoid attacks from opponents, especially snipers, it is necessary for the training subject to confirm from which range of the surroundings the subject can be seen, that is, the visible range from the surroundings. In such training, the visible range specifying device 10 outputs data for displaying the visible range calculated based on the position of the training subject on a display device such as a head mounted display (HMD). The display device is not limited to an HMD, and may be other display devices that realize the display of augmented reality (AR), virtual reality (VR), or mixed reality (MR). Alternatively, the display device is not limited to a device worn by a person, and may be a general display device such as a liquid crystal display. The visible range specifying device 10 is not limited to the military, and may output data in training for criminals in the police, security companies, etc.

[0015] 1 is a block diagram showing an example of the configuration of a visible range specifying device 10. The visible range specifying device 10 includes a person data acquiring unit 110, an avatar data generating unit 120, a visible range specifying unit 130, and a data output unit 140.

[0016] The person data acquisition unit 110 acquires person data in real space. The person data is data including at least position data, height data, and posture data of a person in real space. The person data may include other data such as a person's body shape. The person is a person who is a target of identification of the visible range. The person is, for example, a training subject who wears an HMD and performs combat training, but is not limited to this.

[0017] The real space is a space in which activities such as combat take place, and is not particularly limited as long as it is a space that specifies a visible range. The real space is, for example, an urban area, a forest, a hilly area, a mountainous area, or a space that includes at least a part of these. The real space is not limited to the ground as long as it is a space in which activities such as combat take place, but may be underground, on the sea, under the sea, in the air, or in space. Objects included in the real space may be man-made objects such as buildings and bridges in urban areas, natural objects such as trees, bushes, and rocks, or a combination of these.

[0018] The position data is data indicating the position of a person in real space. The person data acquisition unit 110 acquires the position data from a position output device that outputs the position data of a person using information detected by a sensor or the like. For example, the person data acquisition unit 110 may acquire the position data from a device equipped with a GPS (Global Positioning System) function carried by a person to be the target of the visible range specification. Alternatively, the person data acquisition unit 110 may acquire the position data calculated using a LiDAR (Light Detection And Ranging) carried by the person. The person data acquisition unit 110 may acquire the position data calculated using both the GPS and the LiDAR. For example, the position output device stores data such as the position of a structure in the real space to be specified and the distance of the structure in advance. Then, the position output device may calculate the position of the person using the distance data acquired from the LiDAR and the position data acquired from the GPS, and output the calculated position data to the person data acquisition unit 110.

[0019] The person data acquisition unit 110 may acquire position data using a device other than GPS and LiDAR. For example, the person data acquisition unit 110 may acquire position data obtained as follows. First, the position output device stores in advance an image of the real space to be identified and the position data of the image. Then, the position output device acquires an image of the surroundings captured by a camera carried by the person. The number of cameras is not limited to one, and may be multiple. For example, the camera may be a camera that captures a wide range, such as a 360-degree camera, or multiple cameras carried at multiple positions, such as in front, behind, left, and right of the person. The position output device identifies an image that matches the image captured by the camera in the image of the real space stored in advance. Then, the position output device outputs the position data of the identified image to the person data acquisition unit 110 as the position data of the person.

[0020] The height data is data indicating the height of a person. The person data acquisition unit 110 acquires the height data from a person data storage device that stores the height data in advance. Alternatively, the person data acquisition unit 110 may acquire height data calculated by an image recognition device that recognizes a person using an image of the person captured by a camera or the like around the person.

[0021] The posture data is data indicating the posture of a person. The posture is, for example, a standing posture, a sitting posture, a crawling posture, or a lying posture, but is not limited to these. The person data acquisition unit 110 acquires the posture data from a posture output device that outputs posture data of a person using information detected by a sensor or the like. For example, the person data acquisition unit 110 acquires the posture data from a gyroscope of an HMD worn by the person or a gyroscope of a terminal device carried by the person.

[0022] Hereinafter, a position output device that outputs a person's position data such as a GPS, and a posture output device that outputs a person's posture data such as a gyroscope may be collectively referred to as a person data output device. The person data output device may be a single device having the functions of a position output device and a posture output device, or may be a device that combines a position output device and a posture output device. The person data output device may include a person data storage device that stores height data. In this case, the person data acquisition unit 110 may acquire the position data, height data, and posture data from the person data output device. The person data storage device may store the position data and posture data output by the person data output device. In this case, the person data acquisition unit 110 may acquire the position data, height data, and posture data from the person data storage device.

[0023] Combat training may be performed at a location different from the actual battle location. For example, combat training may be performed before moving to the actual battle location. Therefore, the person data acquisition unit 110 may acquire, as the position data, position data obtained by converting the position where the person is at the time of training into the position where the visible range is to be confirmed. Alternatively, the person data acquisition unit 110 may acquire, as the posture data, posture data obtained by converting the posture of the person at the time of training into the posture of the position where the visible range is to be confirmed. For example, the person data output device converts the position data and posture data calculated using the output of the sensor into data and posture data of the position where the visible range is to be confirmed, based on conversion information between the place where the person is and the place where the visible range is to be confirmed. The conversion information is, for example, a conversion rule or a conversion formula, but is not limited to these. Then, the person data output device may convert and output the position data and posture data to the person data acquisition unit 110. However, the avatar data generation unit 120 described next may convert the position data and posture data based on a conversion rule or a conversion formula set in advance.

[0024] The avatar data generation unit 120 generates human avatar data including at least position data, height data, and posture data of a human avatar representing a human in model data representing a three-dimensional model representing real space. The human avatar represents a human in model data representing a three-dimensional model representing real space. The human avatar data may include other data such as a body shape in addition to the position data, height data, and posture data of the human avatar.

[0025] The model data is model data that represents a three-dimensional model that expresses a real space that is the target of the identification of the visible range, and is data that is stored in advance in a storage device, etc. For example, the model data is data of a three-dimensional model for expressing a digital twin, which is a virtual space generated based on information collected in the real space that is the target of the identification of the visible range, but is not limited to this. Figure 2 is a diagram showing an example of an urban area expressed using a digital twin.

[0026] A human avatar is a character image that represents a human in the model data. The avatar data generating unit 120 may use a method used for general digital twins as a method for generating human avatar data.

[0027] FIG. 3 is a diagram showing an example of a human avatar identified in model data of a city area. In FIG. 3, the human avatar is shown in front of a central building using a pin shape. The shape of the human avatar is not limited to the shape shown in FIG. 3, but may be a combination of polygons or another shape such as a human shape. The buildings around the human avatar are, for example, part of the model data of the city area generated as a digital twin.

[0028] When checking the visible range of a location different from the location where the person actually is, the avatar data generating unit 120 may generate person avatar data after converting the position data and posture data of the person based on conversion information between the location where the person is and the location where the visible range is to be checked. The conversion information is, for example, but is not limited to, a conversion rule or a conversion formula.

[0029] The visible range specification unit 130 specifies the visible range of the person avatar in the model data based on the model data and the person avatar data. In the model data, the range that can be seen from the person avatar is approximately the same as the range that can be seen from the surroundings of the person avatar. In other words, the visible range specified by the visible range specification unit 130 is approximately the same as the range that can be seen from the person avatar in a digital twin or the like. Therefore, as a method for specifying the visible range, the visible range specification unit 130 may use a method for specifying the visible range of the person avatar from the model data and the person avatar data used in a general digital twin. In specifying the visible range, the visible range specification unit 130 may use a parameter that specifies the visible range. For example, the visible range specification unit 130 may use the range of a rifle used for sniping as a parameter. In this case, the visible range specification unit 130 may specify a visible range in which the distance from the person avatar is within the range specified as the parameter. Alternatively, the visible range specification unit 130 may first specify the invisible range of the person avatar, and specify a range other than the specified invisible range as the visible range.

[0030] FIG. 4 is a diagram showing an example of a visible range. In FIG. 4, the range of the building and the ground with diagonal lines is the visible range of the human avatar. FIG. 5 is a diagram showing another example of a visible range. FIG. 5 shows a display of the visible range when a building is viewed from the side. However, FIG. 5 shows the visible range of a building arranged differently from that in FIG. 4. The visible range specification unit 130 specifies the visible range in the entire space around the person. For example, when there are natural objects such as bushes, trees, and hills in addition to artificial objects such as buildings shown in FIG. 4 and FIG. 5 around the person, the visible range specification unit 130 specifies the visible range in all artificial objects and natural objects. However, the visible range specification unit 130 may specify the visible range of the range specified using parameters as described above.

[0031] The data output unit 140 outputs data for displaying the visible range of a human avatar in at least a part of the display range of the display device. For example, the data output unit 140 may output data for displaying the visible range of a human avatar in a part of the visual field range of a see-through HMD for AR. In this case, the HMD may display the data output by the data output unit 140 in a part of the visual field of the HMD. The data output unit 140 may output data in a format that matches the display device to which the data is output. For example, the data output unit 140 may output image file data such as a JPEG (Joint Photographic Experts Group) file or a BMP (Bit Map) file.

[0032] FIG. 6 is a diagram showing an example of a case where the visible range of a person's avatar is displayed in a part of the visual field range of a see-through HMD worn by a person. The visual field range of the person in FIG. 6 shows the range of the person's front visual field that the person wearing the see-through HMD can see through the half mirror of the HMD. The superimposed visible range is the visible range acquired by the HMD from the visible range identification device 10, and shows the visible range superimposed on the visual field range of the person in the half mirror of the HMD. In FIG. 6, the visible range is displayed at the left end to ensure a central visual field in front. However, the display position of the visible range is not limited to the left end, and may be other positions. In FIG. 6, the visible range output by the data output unit 140 is a range wider than the visual field range. In this way, the data output unit 140 may output data for displaying a visible range that is not limited to the visual field range of the display device, but is wider than the visual field range, or at least a part of which is different from the visual field range. Alternatively, the data output unit 140 may output a visible range in a direction different from the visual field direction, but is not limited to the visual field direction of the person for which the visible range is identified. For example, the data output unit 140 may output data for displaying the visible range not only in the moving direction of the person who is the target of the visible range, but also in the horizontal direction, rear direction, or up and down direction with respect to the moving direction. The data output unit 140 may output data for displaying the visible range in a plurality of directions, such as four directions of front, back, left, right, etc. The data output unit 140 may output data for displaying the entire surroundings, that is, the visible range of 360 degrees.

[0033] Alternatively, the data output unit 140 may output data for displaying the visible range of a person avatar by superimposing it on the visual field image of the person avatar. For example, when a non-transmissive HMD for VR uses model data, the non-transmissive HMD displays a VR image calculated from the model data as the visual field image of the person avatar. Therefore, the data output unit 140 may output data for displaying the visible range by superimposing it on the VR screen displayed by the non-transmissive HMD as the visual field image of the person avatar. For example, when the visible range shown by the diagonal lines in FIG. 4 is superimposed on the VR image, the data output unit 140 may output data indicating the visible range in the VR image. However, the front image in VR does not include an image of the user. Therefore, when displaying the visible range in the front image of VR, the data output unit 140 may output data not including the person avatar as data for displaying the visible range. The data output unit 140 is not limited to the above, and may output data of a different format or configuration as data for displaying the visible range. Similar to a see-through HMD, the data output unit 140 may output data for displaying a visible range in a range or direction different from the range of the visual field image of a human avatar in a non-see-through HMD.

[0034] FIG. 7 is a flow diagram showing an example of the operation of the visible range identifying device 10. The person data acquiring unit 110 acquires person data including at least position data, height data, and posture data of a person in real space (step S201). The avatar data generating unit 120 generates person avatar data for a person avatar representing a person in model data representing a three-dimensional model expressing real space, based on the person data (step S202). The person avatar data is data including at least position data, height data, and posture data of the person avatar. The visible range identifying unit 130 identifies the visible range of the person avatar in the model data, based on the model data and the person avatar data (step S203). The data output unit 140 outputs data for displaying the visible range of the person avatar in at least a part of the display range of the display device (step S204).

[0035] Thus, the visible range specifying device 10 includes a person data acquiring unit 110, an avatar data generating unit 120, a visible range specifying unit 130, and a data output unit 140. The person data acquiring unit 110 acquires person data including at least position data, height data, and posture data of a person in real space. The avatar data generating unit 120 generates person avatar data including at least position data, height data, and posture data of a person avatar representing a person in model data representing a three-dimensional model expressing real space, based on the person data. The visible range specifying unit 130 specifies the visible range of the person avatar in the model data, based on the model data and the person avatar data. The data output unit 140 outputs data for displaying the visible range of the person avatar in at least a part of the display range of the display device.

[0036] In this manner, the data output unit 140 of the visible range identification device 10 outputs data for displaying the visible range of the person avatar identified using the person data acquired by the person data acquisition unit 110 and the model data stored in advance.

[0037] For example, when a person checking the visible range wears an HMD, the HMD outputs the acquired position data and posture data at each position in the real space to the person data acquisition unit 110, and displays the visible range acquired from the data output unit 140. As a result, for example, as shown in FIG. 6, a person wearing an HMD can simultaneously check the forward field of view and the visible range displayed by the HMD. For example, by using the visible range specifying device 10, a person to be trained can check the visible range without having to install a facility that reproduces the space to be trained. In this way, the visible range specifying device 10 reduces the burden of checking the visible range. Furthermore, by using the visible range specifying device 10, a person to be trained can check the visible range without having to install a mirror or the like in the training location. In this respect, the visible range specifying device 10 also reduces the burden of checking the visible range.

[0038] Alternatively, as another method of implementing training, for example, a case where the visible range is confirmed using video captured by a camera installed in a training facility during combat training is assumed. In this case, the visible range is confirmed after the training because it is necessary to play back and confirm the video captured by the camera. Therefore, if the visible range is not appropriate, the training subject needs to perform the training again. On the other hand, when the visible range specifying device 10 is used, the training subject can confirm the visible range in real time during training. In this way, the visible range specifying device 10 realizes confirmation of the visible range in real time and can realize saving of training time.

[0039] Furthermore, the data output unit 140 can output data for displaying a range and a direction different from the visual field of the person who specifies the visual field range, for example, the visual field range of the person in the transmissive HMD. Alternatively, the data output unit 140 can output data for displaying a visible range in a range or direction different from the range of the visual field image of the person avatar in the non-transmissive HMD. Therefore, the subject of training can use the visible range specifying device 10 to check the visible range other than the forward visual field without turning around, for example. For example, by using the visible range specifying device 10, the subject of training can check the visible range of 360 degrees around. In this way, the visible range specifying device 10 can easily realize the checking of multiple visible ranges.

[0040] Alternatively, by converting the location where the training subject is actually located and the location where the training subject wants to confirm the visible range, the training subject can use the visible range specifying device 10 to confirm the visible range even at a location other than the location where the training subject wants to confirm. For example, if the training subject converts the position data of the training location as position data into the position data of the location where the visible range is to be specified and outputs it to the person data acquiring unit 110, the training subject can acquire the visible range at the location where the training subject wants to confirm from the data output unit 140 even at a location other than the training location. For example, when a model using a digital twin is used as the model data, the conversion of the position and the change of the direction of the field of view are easy techniques. Therefore, by using the visible range specifying device 10, the training subject can easily confirm the visible range at a location other than the location where the training subject is actually located.

[0041] When there are multiple training subjects, the heights of the training subjects often differ from one another. When the heights of the people differ, the visible range changes. Furthermore, the visible range of a person changes with a change in the person's posture. The visible range specification unit 130 uses the height data and posture data of the person in specifying the visible range. Therefore, the data output unit 140 outputs data for appropriately displaying the visible range in accordance with the height and posture of the person. Therefore, the training subjects can confirm the visible range corresponding to their respective heights and postures.

[0042] The person in charge of training may not only act on the ground, but may also act at a place at a certain height from the ground, such as a rooftop or tower of a building. Alternatively, the person in charge of training may act in the air, such as in a helicopter. In this way, the person may not only act on the ground, but may act at a place at a certain height from the ground. FIG. 8 is a diagram showing a change in the visible range depending on the height of a person from the ground. The left diagram of FIG. 8 shows the visible range when the person is at a low position. The right diagram of FIG. 8 shows the visible range when the person is at a high position. In this way, the visible range changes when the height of the person differs. Therefore, the visible range specifying device 10 may operate taking into account the height of the person as follows. The person data acquiring unit 110 acquires the height of the person from the ground as person data. For example, the person data acquiring unit 110 acquires height information using GPS, height information in design information of a structure in the real space, or height information provided by a vertical positioning service company. The avatar data generating unit 120 generates person avatar data taking into account the height. The visible range specifying unit 130 specifies the visible range taking into account the height. Then, the data output unit 140 outputs the visible range taking the height into consideration. In this case, the subject of the training can confirm the visible range corresponding to the height relative to the ground.

[0043] The visible range specifying device 10 may specify the visible range not only in combat training but also in the guarding of important people performed by the military, police, security companies, etc. In this case, the visible range specifying unit 130 of the visible range specifying device 10 may specify the visible range not only in each position but also in a plurality of consecutive positions that change over time, such as the route along which an important person moves. Furthermore, the data output unit 140 is not limited to a display device worn by a person, such as an HMD, but may output data to be displayed on a display device that can be simultaneously viewed by a plurality of guards, such as a computer display. An example of the operation of the visible range specifying device 10 in the case of guarding will be described.

[0044] The person data acquisition unit 110 acquires person data on a real route along which a person to be guarded plans to move in real space. For example, the person data acquisition unit 110 acquires position data of the real route from a car navigation application or a map application as position data. Furthermore, the person data acquisition unit 110 acquires posture data of the person assumed based on an event on the route as posture data. When there are multiple people to be guarded, the person data acquisition unit 110 may acquire multiple person data.

[0045] The avatar data generation unit 120 generates person avatar data on a virtual route along which the person avatar of the person to be guarded moves model data, based on the person data of the person to be guarded on the real route. When the person data acquisition unit 110 acquires multiple person data, the avatar data generation unit 120 may generate multiple person avatar data.

[0046] The visible range specifying unit 130 specifies the visible range of the person avatar of the person to be guarded on the virtual route based on the model data and the person avatar data on the virtual route. The visible range specifying unit 130 is not limited to the entire visible range on the virtual route, and may specify the visible range of a part of the route. For example, the visible range specifying unit 130 may specify the visible range of a place where people move slowly, such as a place where people get into a means of transportation such as a car and a place where an event is held. The visible range specifying unit 130 may specify the visible range using a parameter. For example, the visible range specifying unit 130 may specify the visible range using the range of a weapon such as a rifle. When the avatar data generating unit 120 generates multiple person avatar data, the visible range specifying unit 130 may specify the visible range of the person avatar as a whole. Alternatively, the visible range specifying unit 130 may specify the visible range of a group of some person avatars. Alternatively, the visible range specifying unit 130 may specify the visible range of each of at least some person avatars.

[0047] The data output unit 140 outputs data for displaying at least a part of the visible range of the human avatar on the virtual route. For example, the data output unit 140 may output the visible range in a range specified on the real route or the virtual route. FIG. 9 is a diagram showing an example of the display of the visible range of VIP guards. FIG. 9 shows the visible ranges at two locations on the route along which the VIP, who is the person to be guarded, moves. The guards can plan the placement and movement of the guards in this way, referring to the visible ranges at multiple locations of the VIP, so as to minimize the visible range on the entire route. The display of FIG. 9 is not limited to this, and the data output unit 140 may output data in other formats, for example, the visible range from the specified start point to the specified end point on the route, as a video. When the visible range specification unit 130 specifies the visible range of the whole human avatar, the data output unit 140 outputs data for displaying the visible range of the whole human avatar. When the visible range specification unit 130 specifies the visible range of a part of the human avatar group, the data output unit 140 outputs data for displaying the visible range of the human avatar group. When the visible range specifying unit 130 specifies the visible range of each of the human avatars, the data output unit 140 outputs data for displaying the visible range of each of the human avatars.

[0048] The visible range specifying device 10 may specify a visible range that takes into consideration not only the person to be guarded, but also other people such as a security guard. In order to prevent attacks on the person to be guarded from the surroundings, the security guard is positioned around the person to block the visible range from the surroundings of the person to be guarded. Therefore, the range in which the security guard can be seen from the surroundings, that is, the visible range from the surroundings of the security guard, is the range that blocks the visibility of the person to be guarded. Therefore, the visible range specifying device 10 specifies the blocked range in the visible range of the person by using the visible range of other people such as the security guard. An example of the operation for specifying the blocked range will be described.

[0049] The person data acquisition unit 110 acquires, in addition to the person data of the guard target, other person data, which is data of one or more guards located around the guard target. The other person data is data including at least the position data, height data, and posture data of each of the other people.

[0050] In addition to generating the person avatar data, the avatar data generating unit 120 generates other person avatar data representing other person avatars of the security guards in the model data based on each other person data. The other person avatar data is data including at least the position data, height data, and posture data of each other person avatar in the model data.

[0051] The visible range specifying unit 130 specifies the visible range of the person avatar, and also specifies the visible range of the other person avatar of the other person who is the security officer, based on the model data and the other person avatar data. Then, the visible range specifying unit 130 specifies the range of the person avatar that is included in the visible range of the other person avatar as the blocked range. When there are multiple person avatars, the visible range specifying unit 130 may specify the visible range and blocked range of the person avatars as a whole. Alternatively, the visible range specifying unit 130 may specify the visible range and blocked range of a part of a group of person avatars. Alternatively, the visible range specifying unit 130 may specify the visible range and blocked range of each of at least a part of the person avatars. When there are multiple other person avatars, the visible range specifying unit 130 may specify the visible range and blocked range of the other person avatars as a whole. Alternatively, the visible range specifying unit 130 may specify the visible range and blocked range of a part of a group of other person avatars. Alternatively, the visible range specifying unit 130 may specify the visible range and blocked range of each of at least a part of the other person avatars.

[0052] The data output unit 140 outputs data for displaying at least one of the blocked range and the visible range of a person avatar that is not included in the blocked range. For example, the data output unit 140 may output data for displaying the blocked range and the visible range that is not included in the blocked range using different colors or patterns in the visible range superimposed on the model data. Alternatively, the data output unit 140 may output data for displaying the remaining visible range obtained by excluding the blocked range from the visible range of the person, that is, the visible range that cannot be blocked. Alternatively, the data output unit 140 may output data for displaying the blocked range blocked by one or more other avatars. When there are multiple guards, each of the guards may want to check his or her own visible range and blocked range. Therefore, the data output unit 140 may output data for displaying at least one of the blocked range and the visible range of at least some of the other avatars. A blocked range where the blocked ranges of multiple other avatars overlap is an ineffective blocked range. Therefore, the guard may check the range where multiple blocked ranges overlap. Therefore, the data output unit 140 may output data for displaying the overlapping range of the blocked ranges of multiple other person avatars. When there are multiple human avatars, the data output unit 140 may output data for displaying the visible range and blocked range of the human avatars as a whole. Alternatively, the data output unit 140 may output data for displaying the visible range and blocked range of a group of some human avatars. Alternatively, the data output unit 140 may output the visible range and blocked range of each of at least some of the human avatars.

[0053] By using the visible range identifying device 10 that operates in this way, the security personnel can use the model data to evaluate the route of the person to be guarded in advance, thereby reducing the burden of reconnaissance and the like, and the burden of creating a security plan. Furthermore, the visible range identifying device 10 outputs data for displaying at least one of the blocked range and the visible range of the person avatar that is not included in the blocked range. In other words, the visible range identifying device 10 makes the visible range and the blocked range visible. Therefore, the security personnel can easily confirm the visible range and the blocked range compared to confirmation of the visible range using a map or the like. The visible range identifying device 10 uses model data that indicates a three-dimensional model, and therefore identifies the visible range including the height direction. Therefore, the security personnel can confirm the visible range more appropriately compared to the case of using a map that is two-dimensional data.

[0054] Furthermore, the guard can consider the number and placement of guards necessary to narrow the visible range of the person to be guarded by referring to the blocked range output by the visible range specifying device 10. Furthermore, since the visible range specifying device 10 uses the height data of the person and other people, it can specify an appropriate visible range and blocked range taking into consideration the height difference between the person to be guarded and the guards to be placed around him / her. Furthermore, the visible range specifying device 10 can specify the required visible range by using parameters such as the range of fire. In this way, the guard can confirm the number and placement of guards that are actually required, such as the minimum number of guards to be placed around the person to be guarded, and as a result, can more appropriately determine the number and placement of guards that are required. Furthermore, the visible range specifying device 10 can specify the visible range more appropriately by using the height of the person from the ground. Therefore, the guard can more appropriately determine the number and placement of guards that are required by taking into consideration the height of the person to be guarded and the guards.

[0055] <Hardware configuration> Next, the hardware configuration of the visible range specifying device 10 will be described. Each component of the visible range specifying device 10 may be configured with a hardware circuit. Alternatively, each component of the visible range specifying device 10 may be configured using a plurality of devices connected via a network. For example, the visible range specifying device 10 may be configured using cloud computing. Alternatively, the plurality of components of the visible range specifying device 10 may be configured with a single piece of hardware. Alternatively, the visible range specifying device 10 may be realized as a computer including a memory, a processor connected to the memory, and a network interface. The processor is, for example, a central processing unit (CPU). However, the processor is not limited to a CPU, and may be, for example, another processing device such as a graphics processing unit (GPU). The memory is, for example, a read only memory (ROM) and a random access memory (RAM), but is not limited to these.

[0056] 10 is a block diagram showing the configuration of a computer 600, which is an example of the hardware configuration of the visible range specifying device 10. The computer 600 includes a CPU 610, a ROM 620, a RAM 630, a storage device 640, and a network interface 650.

[0057] CPU 610 reads a program from at least one of ROM 620 and storage device 640. Then, CPU 610 controls RAM 630, storage device 640, and network interface 650 based on the read program. Computer 600 including CPU 610 controls these components to realize the functions of person data acquisition unit 110, avatar data generation unit 120, visible range identification unit 130, and data output unit 140 shown in Fig. 1. In this way, computer 600 may realize the functions as a combination of hardware and software.

[0058] The CPU 610 may read the program stored in a computer-readable recording medium 690 using a recording medium reading device (not shown). Alternatively, the CPU 610 may receive the program from an external device (not shown) via the network interface 650, store the program in the RAM 630 or the storage device 640, and operate based on the stored program.

[0059] The ROM 620 stores programs and fixed data executed by the CPU 610. The ROM 620 is, for example, a programmable ROM (P-ROM) or a flash ROM. The RAM 630 temporarily stores programs and data executed by the CPU 610. The RAM 630 is, for example, a dynamic RAM (D-RAM). The storage device 640 stores data and programs that the computer 600 stores long-term. The storage device 640 may also operate as a temporary storage device for the CPU 610. The storage device 640 is, for example, a hard disk device, a solid state drive (SSD), or a disk array device.

[0060] ROM 620 and storage device 640 are non-volatile (non-transitory) recording media. On the other hand, RAM 630 is a volatile (transitory) recording media. CPU 610 can operate based on programs stored in ROM 620, storage device 640, and RAM 630. In other words, CPU 610 can operate using either a non-volatile recording medium or a volatile recording medium. When realizing each function, CPU 610 may use at least one of RAM 630 and storage device 640 as a temporary storage medium for programs and data.

[0061] The network interface 650 relays data exchange with an external device (not shown) via a network. For example, the network interface 650 relays data exchange with an HMD. The network interface 650 is, for example, a local area network (LAN) card. Furthermore, the network interface 650 is not limited to being wired, and may be wireless.

[0062] The computer 600 configured in this manner executes the operations of the components in the visible range specifying device 10 to realize the functions of the visible range specifying device 10.

[0063] <System> An example of a visible range display system 300 using the visible range specifying device 10 will be described. Fig. 11 is a diagram showing an example of the configuration of the visible range display system 300. The visible range display system 300 includes the visible range specifying device 10, an HMD 310, a person data storage device 320, and a model data storage device 340. The HMD 310 is an example of a person data output device and a display device. The visible range display system 300 may include a display 330 such as a computer as the display device.

[0064] The HMD 310 includes a GPS and a gyroscope, and outputs position data and posture data of a person to the visible range specifying device 10. The person data storage device 320 stores height data of a person. The model data storage device 340 stores model data.

[0065] The person data acquisition unit 110 acquires position data and posture data from the HMD 310, and acquires height data from the person data storage device 320, as person data. The avatar data generation unit 120 generates person avatar data including position data, height data, and posture data of a person avatar showing a person in the model data stored in the model data storage device 340, based on the person data. The visible range specification unit 130 specifies the visible range of the person avatar in the model data, based on the person avatar data. The data output unit 140 outputs data for displaying the visible range of the person avatar as data used for display by the HMD 310 or the display 330.

[0066] The HMD 310 or the display 330 displays the visible range using the data output by the visible range identifying device 10. For example, the HMD 310 displays the visible range as shown in Fig. 6. Alternatively, the display 330 displays the visible range as shown in Fig. 4.

[0067] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0068] (Appendix 1) A person data acquisition means for acquiring person data including at least position data, height data, and posture data of a person in a real space; an avatar data generating means for generating at least human avatar data including position data, height data and posture data of a human avatar representing a human in model data representing a three-dimensional model in which a real space is expressed, based on the human data; a visible range specifying means for specifying a visible range of a human avatar in the model data based on the model data and the human avatar data; a data output means for outputting data for displaying a visible range of a human avatar in at least a part of a display range of the display device; A visible range specifying device comprising:

[0069] (Appendix 2) The data output means is outputting, as data for displaying the visible range of the human avatar, data for displaying the visible range of the human avatar in a part of the visual field of the person on the display device, or data for superimposing and displaying the visible range of the human avatar on the visual field image of the human avatar displayed on the display device; 2. A visible range identifying device as described in appendix 1.

[0070] (Appendix 3) The data output means outputs data for displaying a visible range in a range or direction different from the visual field range of the person on the display device, or a visible range in a range or direction different from the visual field image range of the person avatar. 3. The visible range specifying device according to claim 1 or 2.

[0071] (Appendix 4) The person data acquisition means acquires person data on a real route along which a person moves in a real space; The avatar data generation means generates human avatar data on a virtual route along which the human avatar moves based on the human data on the real route; The visible range specifying means specifies a visible range of the human avatar on the virtual route based on the model data and the human avatar data on the virtual route; the data output means outputs data for displaying at least a part of a visible range of the human avatar on the virtual route; 4. The visible range specifying device according to claim 1 .

[0072] (Appendix 5) The person data acquisition means acquires other person data including at least position data, height data, and posture data of one or more other people located around the person; the avatar data generation means generates, based on the other person data, other person avatar data for an other person avatar representing a other person in the model data, the other person avatar data including at least position data, height data and posture data of the other person avatar; The visible range specifying means specifies a visible range of the other person's avatar based on the model data and the other person's avatar data, and specifies a range of the visible range of the human avatar that is included in the visible range of the other person's avatar as a blocked range; the data output means outputs data for displaying at least one of the blocked range and a visible range of the human avatar not included in the blocked range; 5. The visible range specifying device according to claim 1 .

[0073] (Appendix 6) the data output means outputs data for displaying at least one of a blocking range of each of the other person's avatars and a visible range of the other person's avatar; 6. The visible range identifying device according to claim 5.

[0074] (Appendix 7) the data output means outputs data for displaying an overlapping range of the blocking ranges of the plurality of other person's avatars; 7. The visible range specifying device according to claim 5 or 6.

[0075] (Appendix 8) A visible range specifying device according to any one of appendix 1 to 7, a person data output device that outputs person position data and posture data to the visible range specifying device; a storage device for storing height data of a person used by the visible range identifying device; a display device that displays the visible range using the data output by the visible range specifying device; A visible range display system comprising:

[0076] (Appendix 9) Acquire person data including at least position data, height data, and posture data of a person in real space; generating, based on the person data, person avatar data including at least position data, height data, and posture data of the person avatar for a person avatar representing a person in the model data representing a three-dimensional model in which a real space is expressed; Identifying a visible range of a human avatar in the model data based on the model data and the human avatar data; outputting data for displaying a visible range of the human avatar in at least a part of a display range of the display device; Visibility range determination method.

[0077] (Appendix 10) outputting, as data for displaying the visible range of the human avatar, data for displaying the visible range of the human avatar in a part of the visual field of the person on the display device, or data for superimposing and displaying the visible range of the human avatar on the visual field image of the human avatar displayed on the display device; 10. A method for determining a visible range as described in Supplementary Note 9.

[0078] (Appendix 11) Outputting data for displaying a visible range in a range or direction different from the visual field range of the person on the display device, or a visible range in a range or direction different from the visual field image range of the person avatar; 11. The visible range determination method according to claim 9 or 10.

[0079] (Appendix 12) Acquire person data on the actual route along which a person moves in real space; generating person avatar data on a virtual route along which the person avatar moves according to the person data on the real route; determining a visible range of the human avatar on the virtual route based on the model data and the human avatar data on the virtual route; outputting data for displaying at least a portion of a visibility range of the human avatar on the virtual route; 12. A method for determining a visible range according to any one of claims 9 to 11.

[0080] (Appendix 13) acquiring other person data including at least position data, height data, and posture data of one or more other people located around the person; generating other person avatar data including at least position data, height data, and posture data of the other person avatar for the other person avatar representing the other person in the model data based on the other person data; A visible range of the other person's avatar is specified based on the model data and the other person's avatar data, and a range of the visible range of the person's avatar that is included in the visible range of the other person's avatar is specified as a blocked range; outputting data for displaying at least one of the blocked range and a visible range of the human avatar that is not included in the blocked range; 13. A method for determining a visible range according to any one of appendix 9 to 12.

[0081] (Appendix 14) outputting data for displaying at least one of the blocked range of each of the other person's avatars and the visible range of the human avatar; 14. A method for determining a visible range as described in appendix 13.

[0082] (Appendix 15) outputting data for displaying an overlapping range of blocking ranges of a plurality of other avatars; 15. A method for determining a visible range according to claim 13 or 14.

[0083] (Appendix 16) A visible range specifying device executes the visible range specifying method according to any one of appendixes 9 to 15, a person data output device outputs position data and posture data of a person to the visible range specifying device; A storage device stores height data of a person to be used by the visible range identifying device, A display device displays the visible range using the data output by the visible range specifying device. Visibility range display method.

[0084] (Appendix 17) A process of acquiring person data including at least position data, height data, and posture data of a person in a real space; generating, based on the person data, person avatar data including at least position data, height data, and posture data of the person avatar for a person avatar representing a person in model data representing a three-dimensional model in which a real space is expressed; A process of determining a visible range of a human avatar in the model data based on the model data and the human avatar data; outputting data for displaying a visible range of a human avatar in at least a part of a display range of the display device; A program that causes a computer to execute the following.

[0085] (Appendix 18) A process of outputting, as data for displaying the visible range of the human avatar, data for displaying the visible range of the human avatar in a part of the visual field of the person on the display device, or data for superimposing and displaying the visible range of the human avatar on the visual field image of the human avatar displayed by the display device; 18. The program according to claim 17, which causes a computer to execute the above steps.

[0086] (Appendix 19) A process of outputting data for displaying a visible range in a range or direction different from the visual field range of a person on a display device, or a visible range in a range or direction different from the visual field image range of a person avatar; 19. The program according to claim 17 or 18, which causes a computer to execute the above steps.

[0087] (Appendix 20) A process of acquiring person data on a real route along which a person moves in a real space; A process of generating human avatar data on a virtual route along which the human avatar moves in the model data based on the human data on the real route; A process of determining a visible range of a human avatar on the virtual route based on the model data and the human avatar data on the virtual route; outputting data for displaying at least a portion of a visibility range of a human avatar on the virtual route; 20. The program according to any one of claims 17 to 19, which causes a computer to execute the program.

[0088] (Appendix 21) A process of acquiring other person data including at least position data, height data, and posture data of one or more other people located around the person; A process of generating other person's avatar data including at least position data, height data, and posture data of the other person's avatar for the other person's avatar representing the other person in the model data based on the other person's data; A process of specifying a visible range of the other person's avatar based on the model data and the other person's avatar data, and specifying a range of the visible range of the person's avatar that is included in the visible range of the other person's avatar as a blocked range; outputting data for displaying at least one of the blocked area and a visible area of ​​a human avatar not included in the blocked area; 21. The program according to any one of claims 17 to 20, which causes a computer to execute the above.

[0089] (Appendix 22) outputting data for displaying at least one of a blocked range of each of the other person's avatars and a visible range of the human avatar; 22. The program according to claim 21, which causes a computer to execute the above steps.

[0090] (Appendix 23) A process of outputting data for displaying an overlapping range of blocking ranges of a plurality of other avatars; 23. The program according to claim 21 or 22, which causes a computer to execute the above.

[0091] Although the present invention has been described above with reference to the embodiment, the present invention is not limited to the above embodiment. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0092] 10 Visibility range identification device 110 Person Data Acquisition Department 120 Avatar Data Generation Department 130 Visibility range specification unit 140 Data output section 300 Visibility Range Display System 310 HMD 320 Person data storage device 330 Display 340 Model Data Storage Device 600 Computers 610 CPU 620 ROM 630 RAM 640 Storage device 650 Network Interface 690 Recording media

Claims

1. A person data acquisition means for acquiring person data including at least position data, height data, and posture data of a person in a real space; an avatar data generating means for generating human avatar data including at least position data, height data, and posture data of a human avatar representing a human in model data representing a three-dimensional model expressing a real space based on the human data; a visible range specifying means for specifying a visible range of the human avatar in the model data based on the model data and the human avatar data; a data output means for outputting data for displaying a visible range of the human avatar in at least a part of a display range of a display device; A visible range specifying device comprising:

2. The data output means includes: outputting, as data for displaying the visible range of the person avatar, data for displaying the visible range of the person avatar in a part of the visual field of the person on a display device, or data for superimposing and displaying the visible range of the person avatar on a visual field image of the person avatar displayed by a display device; The visible range specifying device according to claim 1 .

3. The data output means outputs data for displaying a visible range in a range or direction different from a visual field range of the person on a display device, or a visible range in a range or direction different from a visual field image range of the person avatar. The visible range specifying device according to claim 1 .

4. the person data acquisition means acquires the person data on a real route along which the person moves in a real space; the avatar data generation means generates, based on the person data on the real route, the person avatar data on a virtual route along which the person avatar moves in the model data; the visible range specifying means specifies a visible range of the human avatar on the virtual route based on the model data and the human avatar data on the virtual route; the data output means outputs data for displaying at least a part of a visible range of the human avatar on the virtual route. The visible range specifying device according to claim 1 .

5. the person data acquisition means acquires other person data including at least position data, height data, and posture data of one or more other people located around the person; the avatar data generation means generates, based on the other person data, other person avatar data for an other person avatar representing a other person in the model data, the other person avatar data including at least position data, height data, and posture data of the other person avatar; the visible range specifying means specifies a visible range of the other person's avatar based on the model data and the other person's avatar data, and specifies a range of the visible range of the human avatar that is included in the visible range of the other person's avatar as a blocked range; the data output means outputs data for displaying at least one of the blocked area and a visible area of ​​the human avatar that is not included in the blocked area. The visible range specifying device according to claim 1 .

6. the data output means outputs data for displaying at least one of the blocking range of each of the other person's avatars and the visible range of the other person's avatar. The visible range specifying device according to claim 5 .

7. A visible range specifying device according to any one of claims 1 to 6, a person data output device that outputs the person's position data and posture data to a visible range specifying device; a storage device for storing height data of the person used by the visible range specifying device; a display device that displays the visible range using the data output by the visible range specifying device; and A visible range display system comprising:

8. Acquire person data including at least position data, height data, and posture data of a person in real space; generating, based on the person data, person avatar data including at least position data, height data, and posture data of a person avatar representing a person in model data representing a three-dimensional model in which a real space is expressed; determining a visible range of the human avatar in the model data based on the model data and the human avatar data; outputting data for displaying a visible range of the human avatar in at least a part of a display range of a display device; Visibility range determination method.

9. a visible range specifying device that executes the visible range specifying method according to claim 8; a person data output device outputs position data and posture data of the person to a visible range specifying device; a storage device stores height data of the person to be used by the visible range specifying device; A display device displays the visible range using the data output by the visible range specifying device. Visibility range display method.

10. A process of acquiring person data including at least position data, height data, and posture data of a person in a real space; generating, based on the person data, person avatar data including at least position data, height data, and posture data of the person avatar, the person avatar representing a person in model data representing a three-dimensional model in which a real space is expressed; determining a visible range of the human avatar in the model data based on the model data and the human avatar data; outputting data for displaying a visible range of the human avatar in at least a part of a display range of a display device; A program that causes a computer to execute the following.

Images