Information processing device, information processing method and program

Abstract

To enhance the realistic sensation in a simulation image.SOLUTION: An information processing device 1 is the device for causing an information terminal 3 to display spatial image data indicating an image of a space of at least one of the inside of a building and the outside of the building. The information processing device 1 comprises: a position specification unit 132 which specifies a plurality of positions of a plurality of users using an information terminal 3 in a spatial image indicated by spatial image data; an image creation unit 133 which creates display image data in which user image data indicating the users are superimposed on the plurality of positions specified by the position specification unit 132; and an image provision unit 134 which provides the display image data to the plurality of information terminals 3.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, a simulation apparatus for conducting evacuation training using a computer has been known (for example, see Patent Document 1). The conventional simulation apparatus is configured such that a training participant can recognize an evacuation route by displaying the evacuation route on a layout diagram of a place where the evacuation training is conducted.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When viewing an image inside a facility using a conventional simulation apparatus, there has been a problem that the sense of presence is low because other participants cannot be seen.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to enhance the sense of presence in a simulation image.

Means for Solving the Problems

[0006] An information processing device according to a first aspect of the present invention is an information processing device for displaying spatial image data showing an image of at least one space inside or outside a building on an information terminal, comprising: a location identification unit that identifies multiple locations of multiple users using the information terminal in the spatial image shown by the spatial image data; an image creation unit that creates display image data by superimposing user image data showing users on the multiple locations identified by the location identification unit in the spatial image data; and an image providing unit that provides the display image data to multiple information terminals.

[0007] The image creation unit may create the display image data by superimposing the user image data, which shows other users located within a predetermined range from the location of the user using the information terminal for which the image provision unit provides the display image data.

[0008] The image provisioning unit may provide the information terminal with spatial image data including destination image data indicating a location to which the user can move, and the location identification unit may identify the user's location after movement in response to the information terminal selecting an image based on the destination image data.

[0009] The image provisioning unit may provide the information terminal with the display image data, including the new destination image data, after the location identification unit has identified the location and a time corresponding to the density of users within a predetermined range from the identified location has elapsed.

[0010] The image provisioning unit may provide the information terminal with the display image data, including the new destination image data, after the position identification unit has identified the position and a time corresponding to the width of the passage at the identified position has elapsed.

[0011] The image provisioning unit may provide the information terminal with the display image data, including the new destination image data, after the position identification unit has identified the position and a time corresponding to the width of the exit beyond the identified position has elapsed.

[0012] The image provisioning unit may provide the information terminal with the display image data corresponding to the location identified by the location identification unit.

[0013] The location identification unit may begin identifying the location after the image provision unit has provided the spatial image data showing the state in which an object is damaged due to vibrations associated with an earthquake to a plurality of information terminals.

[0014] The information processing device further includes a setting reception unit that receives the setting of the type and display position of superimposed image data to be displayed overlaid on the spatial image data, and the image providing unit may provide fire image data to a plurality of information terminals so as to superimpose and display a fire image of the type received by the setting reception unit on the display position in the spatial image data received by the setting reception unit.

[0015] The information processing device further includes a setting reception unit that receives earthquake operation settings for displaying spatial image data showing the state in which objects are damaged due to vibrations caused by an earthquake, and the image providing unit may, when the setting reception unit receives the earthquake operation settings, provide the display image data, including the spatial image data showing the state in which objects are damaged, to a plurality of information terminals.

[0016] The information processing device may further include a storage unit that stores the location and time of each of the multiple users in association with each other, and an analysis unit that calculates the time it took for at least some of the multiple users to reach a predetermined location from the time they started moving until they reached a predetermined location, based on the relationship between the location and time of each of the multiple users stored in the storage unit.

[0017] The information processing device may further include an analysis unit that outputs the results of an analysis of whether or not an object containing information about an exit is included within a predetermined range from the center of a plurality of display image data displayed on the information terminal of each of the plurality of users.

[0018] The image creation unit may create display image data by overlaying a number of user image data, greater than the number of users, onto the spatial image data.

[0019] The information processing device further includes a recording unit that stores the display image data created by the image creation unit in association with a position in the space in a storage unit, and the image creation unit may create new display image data by superimposing the user image data onto the past display image data stored in the storage unit.

[0020] The information processing device may further include an audio processing unit that acquires audio data based on voices emitted by at least some of the users, and outputs audio based on the audio data to the information terminal used by the other users at a volume corresponding to the distance from the user who emitted the voice to the other users.

[0021] A second aspect of the present invention relates to an information processing method which includes the steps of: a computer used to display spatial image data showing an image of at least one space inside or outside a building on an information terminal to identify multiple locations of multiple users using the information terminal in the spatial image data; a computer used to display spatial image data showing an image of at least one space inside or outside a building on an information terminal to identify multiple locations of multiple users in the spatial image data; a computer used to display spatial image data showing an image of at least one space inside or outside a building to an information terminal to identify multiple locations of multiple users in the spatial image data to create display image data by superimposing user image data showing users in the identified multiple locations in the spatial image data; and a computer used to display spatial image data showing an image of at least one space inside or outside a building to an information terminal to identify multiple locations of multiple users using the information terminal to identify multiple locations of multiple users in the spatial image data to display image data to multiple information terminals.

[0022] A program according to a third aspect of the present invention causes a computer used to display spatial image data showing an image of at least one space inside or outside a building on an information terminal to perform the following steps: identify multiple locations of multiple users using the information terminal in the spatial image shown by the spatial image data; create display image data by superimposing user image data showing the users at the identified multiple locations in the spatial image data; and provide the display image data to the multiple information terminals. [Effects of the Invention]

[0023] According to the present invention, an effect of enhancing the sense of presence in the simulation image is achieved.

Brief Description of Drawings

[0024] [Figure 1] It is a diagram for explaining the outline of the information processing system S. [Figure 2] It is a diagram showing an example of a display image displayed on the screen of the information terminal 3. [Figure 3] It is a diagram showing the configuration of the information processing apparatus 1. [Figure 4] It is a diagram showing an example of a display image including a destination image. [Figure 5] It is a sequence diagram showing the processing flow in the information processing system S. [Figure 6] It is a flowchart showing the processing flow of the information processing apparatus 1. [Figure 7] It is a diagram showing the configuration of the information processing apparatus 1A according to the first modified example. [Figure 8] It is a diagram showing an example of image data indicating a route. [Figure 9] It is a diagram showing an example in which a guide indicating an emergency exit is displayed. [Figure 10] It is a diagram showing the configuration of the information processing apparatus 1B according to the second modified example. [Figure 11] It is a diagram showing the configuration of the information processing apparatus 1C according to the third modified example.

Modes for Carrying Out the Invention

[0025] [Outline of Information Processing System S] Figure 1 is a diagram illustrating the overview of the information processing system S. The information processing system S is a system for conducting evacuation drills using a computer. The information processing system S consists of an information processing device 1, an administrator terminal 2, and a plurality of information terminals 3 (information terminals 3-1 to 3-M, where M is an integer). The information processing device 1 sends and receives various types of data to and from the administrator terminal 2 and the plurality of information terminals 3 via the network N.

[0026] Information processing device 1 is used to display image data based on spatial image data showing images of at least one space inside or outside a building (hereinafter sometimes referred to as "space inside or outside the building") on information terminal 3. Users of information terminal 3 can virtually move within the space by operating information terminal 3 while viewing the image data corresponding to the space displayed on information terminal 3. The space can be any space that the user can move around in, such as an office, store, or exhibition hall.

[0027] The information processing device 1 identifies the user's position in the spatial image data from the information terminal 3. The information processing device 1 creates display image data by overlaying user image data indicating the presence of multiple identified users onto their respective positions. Because the display image data includes user image data indicating the presence of other users moving within the simulated space, the user viewing the display image data experiences a greater sense of presence.

[0028] The use of the information processing device 1 is arbitrary, but in this specification, the configuration and operation of the information processing device 1 will be mainly described using the use of evacuation drills within a building as an example. In this embodiment, the user may be referred to as a training participant, and the user image data may be referred to as participant image data.

[0029] The information processing device 1 is a server that provides display image data (e.g., video data) used in evacuation drills to multiple information terminals 3, enabling training participants using multiple information terminals 3 to view virtual images showing the evacuation process on their terminals 3. The display image data includes spatial image data created by photographing the area targeted for the evacuation drill or spatial image data created by a computer. In this specification, the area in the virtual space represented by spatial image data corresponding to the area targeted for the evacuation drill is referred to as the training space.

[0030] Administrator terminal 2 is a terminal used by the administrator of the information processing system S, and is, for example, a personal computer, tablet, or smartphone. By operating administrator terminal 2, the administrator can start providing display image data to the information processing device 1 or change the content of the display image data.

[0031] Information terminal 3 is a device used by training participants, and is, for example, a personal computer, tablet, or smartphone. Training participants can move within the training space by performing movement operations on information terminal 3 to change their position within the training space. Information terminal 3 transmits to information processing device 1 that a movement operation has been performed, and receives display image data corresponding to the new position from information processing device 1. By performing movement operations, training participants can see the display image corresponding to their new position, giving them the feeling that they are actually moving within the training space.

[0032] Figure 2 shows an example of a display image shown on the screen of information terminal 3. Figure 2(a) shows an overall view of the screen displayed on information terminal 3. Area R1 shows a layout image showing the layout of the evacuation drill space. Area R2 shows a display image showing the state of the drill space as seen from the position of the drill participants. Area R3 shows information related to the drill, including the number of participants in the drill and the number of drill participants at each of the multiple locations within the drill area.

[0033] Figure 2(b) is a magnified view of the layout image displayed in region R1. The layout image shows images of a desk and chairs. The triangular, square, and hexagonal shapes in the layout image indicate the positions of the training participants. The different shapes of the shapes indicate the number of training participants near the displayed position. For example, the triangular shape corresponds to 3 people, the square shape corresponds to 4 people, and the hexagon corresponds to 6 people.

[0034] Figure 2(c) is a magnified view of the display image shown in area R2. The display image shows desks, chairs, shelves, bookshelves, and passageways installed within the area. The display image also shows participant images G, which are simulated images of other trainees as seen from the trainee's position. As the participant images G of other trainees are displayed on the display image and their positions change as the trainee and other trainees move, the trainee can experience a situation where many participants are evacuating simultaneously. As a result, the effectiveness of computer-based training is enhanced.

[0035] [Configuration of Information Processing Device 1] Figure 3 shows the configuration of the information processing device 1. The information processing device 1 includes a communication unit 11, a storage unit 12, and a control unit 13.

[0036] The communication unit 11 includes a communication interface for sending and receiving data between the administrator terminal 2 and the information terminals 3. The communication unit 11 inputs configuration data received from the administrator terminal 2 into the configuration reception unit 131. The communication unit 11 also inputs location information received from the information terminals 3 into the location identification unit 132. Furthermore, the communication unit 11 transmits display image data input from the image provision unit 134 to multiple information terminals 3.

[0037] The storage unit 12 has storage media such as ROM (Read Only Memory), RAM (Random Access Memory), and SSD (Solid State Drive). The storage unit 12 stores the program executed by the control unit 13. The storage unit 12 also stores various data necessary to provide display image data to multiple information terminals 3.

[0038] As an example, the memory unit 12 stores location information indicating the position of each training participant in the training space, associated with terminal identification information for identifying each of the multiple information terminals 3 or participant identification information for identifying each training participant using the multiple information terminals 3. The format of the location information is arbitrary and can be represented, for example, by a combination of X-coordinates and Y-coordinates with a predetermined position in the training space as the origin. In the example of the training space shown in Figure 2(b), the location information can be represented, for example, by a combination of left-right coordinates and up-down coordinates with the lower left position of the training space as the origin.

[0039] Furthermore, the memory unit 12 stores multiple spatial image data associated with combinations of coordinates of multiple locations in the training space and the viewing direction. In addition, the memory unit 12 may store superimposed image data that is displayed overlaid on the spatial image data. The superimposed image data includes destination image data used by training participants for movement operations, and image data of flames or smoke in the event of a fire. The memory unit 12 may also store, in association with the information terminal 3, the location in the training space where the destination image data is displayed on the information terminal 3.

[0040] The control unit 13 is, for example, a CPU (Central Processor Unit) and performs various processes to provide display image data to multiple information terminals 3. By executing a program stored in the storage unit 12, it functions as a setting reception unit 131, a location identification unit 132, an image creation unit 133, and an image provision unit 134.

[0041] The setting reception unit 131 receives, for example, the settings for the type and display position of the superimposed image data to be displayed overlaid on the spatial image data. The setting reception unit 131 notifies the image provision unit 134 of the received settings.

[0042] As an example, the setting reception unit 131 obtains type setting data from the administrator terminal 2 via the communication unit 11, which selects at least one of the following: an image of flames, an image of smoke, or an image showing an object in a destroyed state. The setting reception unit 131 also obtains position setting data from the administrator terminal 2, which indicates the coordinates of the position where the superimposed image will be displayed. The setting reception unit 131 may also display a layout diagram of the training space on the administrator terminal 2 and accept the position selected in the layout diagram as the position where the superimposed image will be displayed.

[0043] The setting reception unit 131 may accept earthquake action settings for displaying spatial image data that shows the state in which objects are damaged due to vibrations caused by an earthquake. Spatial image data that shows the state in which objects are damaged due to vibrations caused by an earthquake is image data whose display position on the screen of the information terminal 3 changes. The setting reception unit 131 may further accept earthquake action settings indicating the time at which the change in the display position of the image data begins. The setting reception unit 131 may accept earthquake action settings for multiple times in which the display position of the image data changes. In that case, the setting reception unit 131 may accept earthquake action settings indicating the amount of change (corresponding to the magnitude of shaking in the training space) at each time.

[0044] The position identification unit 132 identifies the position of the training participant in the training space and the position of the training participant after movement. The training participant's position is represented, for example, by coordinates in the training space. The position identification unit 132 may further identify the direction in which the training participant is attempting to move.

[0045] The position identification unit 132 identifies the initial position of the trainee at the start of training by, for example, referring to the storage unit 12, which pre-stores the initial position in the training space associated with the trainee. The position identification unit 132 may also identify the position selected by the trainee in the layout diagram displayed on the information terminal 3 as the initial position.

[0046] After the training has started, the position identification unit 132, upon receiving a movement notification from the information terminal 3 that a destination image for selecting the direction of movement has been selected, identifies the location where the destination image is displayed as the position after the training participant has moved. Details of the destination image will be described later, but the destination image is an image that is superimposed on the display image and displayed at a position on the side to which the training participant can move relative to the training participant's current position. For example, the destination image is displayed at a position on the side of the training participant's current position that leads towards the emergency exit.

[0047] The location identification unit 132 identifies the location of a training participant after they have moved, for example, in response to the selection of a destination image on the information terminal 3. Specifically, when the location identification unit 132 receives a movement notification from the information terminal 3 indicating that a destination image has been selected, it identifies the location of the destination image by reading the location of the destination image displayed on the information terminal 3 from the storage unit 12. The location identification unit 132 may also identify the location of the destination image by obtaining location information indicating the location of the destination image from the information terminal 3 via the communication unit 11.

[0048] The position identification unit 132 may determine the orientation of the training participant based on the relationship between the training participant's current position and their position after movement. For example, the position identification unit 132 may determine the orientation from the current position toward the position after movement as the training participant's current orientation. The position identification unit 132 then notifies the image creation unit 133 of the determined position and orientation as the training participant's position and orientation after movement. Specifically, the position identification unit 132 notifies the image creation unit 133 of the coordinates and orientation indicating the position in the training space.

[0049] The image creation unit 133 creates display image data based on the spatial image data stored in the storage unit 12. For example, the image creation unit 133 extracts spatial image data stored in the storage unit 12 as spatial image data to be used to create display image data, in association with the coordinates of the training participant's current position and the orientation of the training participant, as notified by the position identification unit 132.

[0050] The image creation unit 133 creates display image data by overlaying participant image data indicating multiple training participants at multiple locations of multiple training participants identified by the location identification unit 132 in the spatial image data. The image creation unit 133 also creates display image data by overlaying participant image data indicating other training participants located within a predetermined range from the location of the training participant (hereinafter referred to as the "display target participant") using the information terminal 3 on which the image provision unit 134 displays the display image. The predetermined range is, for example, an area where the presence of people may affect the speed of movement during evacuation, and is within 5m from the location of the training participant who views the display image.

[0051] The image creation unit 133 creates display image data that includes, for example, a number of participant image data equal to the number of training participants within a predetermined range from the target participants to be displayed. If the number of training participants within the predetermined range is greater than or equal to a threshold, the image creation unit 133 may create display image data that includes a number of participant images corresponding to the threshold. The threshold is the number of people beyond which the speed of movement during evacuation will no longer be affected, even if the number of training participants within the predetermined range increases beyond that point, for example, 10 people.

[0052] The image creation unit 133 updates the display image data provided to the information terminal 3 used by the identified training participant whenever the location identification unit 132 identifies the training participant's location after movement. The image creation unit 133 may also change the position of the participant image data included in the display image data whenever the location of another training participant changes within a predetermined range from the information terminal 3 providing the display image data. By operating in this manner, the image creation unit 133 allows training participants to have an experience similar to that of an actual evacuation drill, thereby increasing the effectiveness of the training.

[0053] The image provision unit 134 provides spatial image data showing images of the space inside and outside the building where the evacuation drill is conducted to multiple information terminals 3. The image provision unit 134 provides display image data created by the image creation unit 133 to multiple information terminals 3 in response to the location identification unit 132 identifying the location. The image provision unit 134 may also provide the information terminals 3 with display image data in which the location of the participant image data has been changed each time the location of another training participant changes within a predetermined range from the information terminal 3 that provides the display image data.

[0054] The image provision unit 134 provides the information terminal 3 with spatial image data, including destination image data that indicates locations where the training participant can move. The destination image data is image data that indicates locations where the training participant using the information terminal 3 displaying the display image can move, and is, for example, image data in the shape of an arrow.

[0055] Figure 4 shows an example of a display image that includes a destination image. In Figure 4(a), the destination image is displayed as an arrow pointing towards the back of the aisle on the near side of the aisle. Training participants can move in the direction indicated by the destination image by selecting it by clicking or touching it.

[0056] Figure 4(b) is the display image shown after moving from the position shown in Figure 4(a). In Figure 4(b), the participant image showing one other training participant is displayed at the destination image. Figure 4(c) is the display image shown after moving from the position shown in Figure 4(b). In Figure 4(c), the participant images showing multiple (5) other training participants are displayed at the destination image.

[0057] By the way, as shown in Figure 4(c), if there are many other trainees ahead, the trainee cannot move quickly. Therefore, in order to allow the trainee to experience this situation, the image provision unit 134 may provide the information terminal 3 with display image data including a new destination image after the location identification unit 132 has identified the trainee's location and a time corresponding to the density of people within a predetermined range from the identified location has elapsed. That is, after the image provision unit 134 provides the information terminal 3 with new display image data in response to the trainee's movement, the time it takes to display the destination image on the information terminal 3 increases as the number of people within a predetermined range from the trainee increases.

[0058] Specifically, when the image provision unit 134 displays the display image shown in Figure 4(a), it provides the destination image data to the information terminal 3 simultaneously with the display image data. As a result, the information terminal 3 updates the display image and displays the destination image at the same time. This allows training participants using the information terminal 3 to move to the next position by selecting the destination image immediately after the display image is updated.

[0059] In contrast, when the image provision unit 134 displays the display image shown in Figure 4(b), it provides the display image data, which does not include the destination image data, to the information terminal 3, and then provides the destination image data to the information terminal 3 after a first time (e.g., 1 second) has elapsed. As a result, the information terminal 3 displays the destination image 1 second after updating the spatial image. In this case, the training participant using the information terminal 3 cannot move to the next position until 1 second has elapsed after the display image has been updated.

[0060] Furthermore, when the image provision unit 134 displays the display image shown in Figure 4(c), it provides the display image data, which does not include the destination image data, to the information terminal 3, and then provides the destination image data to the information terminal 3 after a second time (for example, 5 seconds) has elapsed. As a result, the information terminal 3 displays the destination image 5 seconds after updating the display image. In this case, the training participant using the information terminal 3 cannot move to the next position until 5 seconds have elapsed after the display image has been updated.

[0061] The image provision unit 134 is configured in this way, allowing trainees to simulate a situation where they cannot move at their desired speed when other trainees are densely packed around them, thereby increasing the effectiveness of the training.

[0062] The image provision unit 134 may also notify the information terminal 3 of the waiting time and display the waiting time on the information terminal 3. By having the image provision unit 134 display the waiting time on the information terminal 3, it is possible to prevent training participants from mistakenly believing that the software is malfunctioning.

[0063] Furthermore, in the example shown in Figure 4, only one destination image is displayed on the display screen, but the image provider 134 may display multiple destination images, each with a different orientation. In this case, the image provider 134 may determine the display time for each destination image based on the number of other training participants within a predetermined range from the candidate destination location. The information terminal 3 will display destination images for locations with fewer other training participants first, and destination images for locations with more other training participants later.

[0064] In this case, the training participants will need to decide whether they should move quickly to a location with fewer other trainees, or move to a location with more other trainees, even if it takes longer. Since such decisions are also necessary when actually evacuating, the effectiveness of the training is further enhanced by the image provision unit 134 displaying multiple destination images on the information terminal 3 in this manner.

[0065] Incidentally, it is thought that the narrower the width of the passage, the slower the movement speed will be. Therefore, the image providing unit 134 may provide the information terminal 3 with display image data including new destination image data after a time corresponding to the width of the passage at the identified location has elapsed since the location identifying unit 132 identified the location. The image providing unit 134 may also provide the information terminal 3 with spatial image data including new destination image data after a time corresponding to the width of the exit beyond the identified location has elapsed since the location identifying unit 132 identified the location. In other words, the narrower the width of the passage or exit that the training participant is moving through, the longer the time it takes for the image providing unit 134 to update the display image data corresponding to the destination location and display the destination image on the information terminal 3.

[0066] The image provisioning unit 134 may determine the time from updating the display image data to providing the destination image data to the information terminal 3, based on the density of training participants calculated based on the width of the passageway and the number of other training participants in that passageway. With the image provisioning unit 134 configured in this way, the sense of presence is further enhanced, and the effectiveness of the training is further increased.

[0067] Incidentally, in the event of an earthquake, fires may break out during evacuation, or aftershocks may cause objects to fall or collapse during evacuation. To allow training participants to experience such situations in a simulated manner, the image provision unit 134 may provide fire image data to multiple information terminals 3 such that a fire image of the type received by the setting reception unit 131 is superimposed on the display position in the spatial image data provided to the information terminal 3. The fire image data may be, for example, an image of flames or smoke. The display position is represented by coordinates indicating a location within the training space. The image provision unit 134 provides fire image data to the information terminal 3 if the display position is included within the range indicated by the spatial image data provided to the information terminal 3. The shape, size, or range of the flames or smoke may change over time.

[0068] The image provision unit 134 may, when the setting reception unit 131 receives an earthquake action setting, provide display image data to multiple information terminals 3, including spatial image data (hereinafter referred to as "earthquake spatial image data") that shows the state in which the training space shakes and objects are damaged due to the occurrence of an earthquake. For example, in response to the setting reception unit 131 receiving the earthquake action setting, the image provision unit 134 provides the information terminal 3 with earthquake spatial image data corresponding to the position corresponding to the spatial image data provided to the information terminal 3. The image provision unit 134 may also provide the earthquake spatial image data to the information terminal 3 when the time indicated by the earthquake action setting arrives.

[0069] It is assumed that evacuation will begin after an earthquake occurs. Therefore, the image provision unit 134 may, after providing earthquake spatial image data to multiple information terminals 3, provide movement image data to multiple information terminals 3 so that training participants can begin moving for evacuation. In this case, the location identification unit 132 will begin acquiring location information after the image provision unit 134 has provided earthquake spatial image data showing the state of damage to objects due to vibrations caused by the earthquake to multiple information terminals 3.

[0070] When the setting reception unit 131 receives earthquake action settings corresponding to multiple time periods, each with a different magnitude of shaking, the image provision unit 134 may provide the information terminal 3 with earthquake spatial image data showing different amounts of change in display position for each of the set time periods, as well as provide the information terminal 3 with image data for movement. By operating in this manner, the image provision unit 134 makes it possible to effectively conduct evacuation drills in the event of repeated aftershocks.

[0071] [Processing flow in information processing system S] Figure 5 is a sequence diagram showing the processing flow in the information processing system S. The sequence diagram shown in Figure 5 starts from the point when the operation to initiate training is performed on the administrator terminal 2. In Figure 5, only information terminals 3-1 and 3-2 are shown, but the number of information terminals 3 is arbitrary.

[0072] First, the image creation unit 133 of the information processing device 1 identifies the position of each training participant using information terminal 3-1 and information terminal 3-2 within the training space (S11). The image creation unit 133 creates display image data in which participant image data is superimposed on the positions of other training participants in the spatial image data corresponding to each training participant's position, and destination image data is superimposed on a position that is movable from each training participant's position (S12). The image creation unit 133 creates first display image data corresponding to the position of the training participant using information terminal 3-1, and second display image data corresponding to the position of the training participant using information terminal 3-2. The image creation unit 133 may store the coordinates of the destination image data in the storage unit 12 in association with image identification information for identifying the display image data.

[0073] The image provision unit 134 transmits the first display image data to the information terminal 3-1 and the second display image data to the information terminal 3-2. Information terminals 3-1 and 3-2 display images based on the received display image data (S13, S14). Information terminals 3-1 and 3-2 accept the training participant's operation to select a destination image (S15, S16). When the training participant selects a destination image, information terminals 3-1 and 3-2 transmit a movement notification to the information processing device 1 indicating that a destination image has been selected.

[0074] When the image creation unit 133 receives a movement notification, it updates the position by referring to the coordinates of the destination image data stored in the storage unit 12 in association with the image identification information to identify the position of the training participant after movement (S17). Similar to S12, the image creation unit 133 creates first display image data and second display image data based on the updated position (S18). The image provision unit 134 transmits the new first display image data to information terminal 3-1 and the second display image data to information terminal 3-2. By having the information processing device 1 and the multiple information terminals 3 repeat these processes, the training participant can perform evacuation training while moving on the screen of the information terminal 3.

[0075] [Processing flow of Information Processing Device 1] Figure 6 is a flowchart showing the processing flow of the information processing device 1. The flowchart shown in Figure 6 starts from the point when the administrator using the administrator terminal 2 launches the application software for evacuation drills.

[0076] The setting reception unit 131 receives various settings from the administrator terminal 2 (S21). When the setting reception unit 131 receives the setting to start the evacuation drill, the location identification unit 132 identifies the location of each drill participant (S22). Next, the image creation unit 133 calculates the number of other drill participants within a predetermined range from the location of each drill participant (S23). Based on the calculated number of people, the image creation unit 133 calculates the waiting time until each drill participant can move (S24), and stores the waiting time in the storage unit 12 in association with participant identification information for identifying the drill participants, or terminal identification information for identifying the information terminal 3 used by the drill participants.

[0077] Next, the image creation unit 133 creates display image data by overlaying participant image data corresponding to the number of other training participants within a predetermined range from each training participant's position onto the spatial image data (S25). The image provision unit 134 transmits the created display image data to each of the multiple information terminals 3 (S26). When the waiting time stored in the storage unit 12 in association with the participant identification information or terminal identification information has elapsed (YES in S27), the image provision unit 134 transmits destination image data to the information terminal 3 corresponding to the participant identification information or terminal identification information (S28).

[0078] Next, when the location identification unit 132 receives a movement notification from the information terminal 3 indicating that an operation to select a destination has been performed (YES in S29), it returns to S22 and identifies the location of the destination stored in the storage unit 12 in association with the information terminal 3 that sent the movement notification. After that, the control unit 13 repeats the processes from S22 to S29.

[0079] If the location identification unit 132 does not receive a movement notification from the information terminal 3 even after a predetermined time has elapsed since the image provision unit 134 transmitted the destination image data (NO in S29), the image provision unit 134 sends a warning message to the information terminal 3 (S30). The warning message may include an explanation of how to select the destination image data. By displaying such a warning message to the information terminal 3, even training participants participating in the training for the first time will be able to perform the operation to select the destination image data.

[0080] [Effects of Information Processing System S] As described above, the information processing device 1 according to this embodiment includes a position identification unit 132 that identifies the positions of multiple training participants in a spatial image shown by spatial image data, an image creation unit 133 that creates display image data by superimposing participant image data showing the training participants at the positions identified by the position identification unit 132, and an image provision unit 134 that provides the display image data to multiple information terminals 3. With the information processing device 1 having such a configuration, the positions and number of other training participants around the training participants change according to the positions of the multiple training participants participating in the evacuation drill, so that a situation in which many participants evacuate simultaneously can be simulated. As a result, the effectiveness of computer-based evacuation drills is enhanced.

[0081] The above explanation focused on the case where the information processing device 1 is used in evacuation drills. However, even when the information processing device 1 is used for purposes other than evacuation drills, such as displaying images of a simulated shopping mall or exhibition hall, the same effect of enhancing the sense of realism can be obtained. By using the information processing device 1 according to this embodiment, users can experience the feeling that they can only move slowly when the shopping mall or exhibition hall is crowded, thereby enhancing the user's sense of realism.

[0082] Furthermore, while the above explanation assumed an application where users could have a simulated experience in the interior and exterior spaces of an already completed building, the information processing device 1 may also be used during the building design process. For example, by using the information processing device 1, building designers can verify where in the interior and exterior spaces of a building it would be most effective to install devices (such as emergency exit signs) to assist in the movement and guidance of people.

[0083] [First variation] Figure 7 shows the configuration of the information processing device 1A according to the first modified example. The information processing device 1A shown in Figure 7 differs from the information processing device 1 shown in Figure 3 in that it further has an analysis unit 135, but is otherwise the same.

[0084] The storage unit 12 of the information processing device 1A stores the location and time associated with each of multiple users (for example, training participants). For example, when the location identification unit 132 receives a movement notification from the information terminal 3 that a destination image has been selected, it stores the location of the destination image displayed on the information terminal 3 and the time the movement notification was received in the storage unit 12, associating them with the user.

[0085] The analysis unit 135 calculates the time it took for at least some of the users to reach a predetermined location from the time they started moving until they reached a predetermined location (hereinafter referred to as "evacuation time"), based on the relationship between the location and time of each of the multiple users stored in the storage unit 12. The time when a user starts moving is, for example, the time when the user starts the training. The time when a user starts moving may also be the time when the image provision unit 134 provides spatial image data to the information terminal 3. The predetermined location is, for example, an exit provided in the space where the evacuation training is conducted. The analysis unit 135 stores the calculated evacuation time in the storage unit 12 in association with the user.

[0086] The analysis unit 135 may, in response to a request from the administrator terminal 2, notify the administrator terminal 2 of the evacuation time stored in the storage unit 12. The analysis unit 135 may select one or more users corresponding to each length of evacuation time entered in the administrator terminal 2 or information terminal 3, and provide the administrator terminal 2 with information indicating the selected users. For example, the analysis unit 135 may notify the user with the shortest evacuation time, the user with an evacuation time of one minute or less, or the user with the longest evacuation time. By providing such information to the administrator terminal 2, the administrator can provide guidance to users who took a long time to evacuate, or take measures to shorten the evacuation time.

[0087] The analysis unit 135 may provide the administrator terminal 2 with image data showing the route taken by the selected user. Figure 8 is a diagram showing an example of image data showing a route. Figure 8(a) shows the route taken by the user at the lower left position to exit E. The movement speed may be indicated by the shape of the line showing the route. In the example shown in Figure 8(a), a thick line corresponds to a movement speed of 2m / s or more, a thin line corresponds to a movement speed of 1m / s or more but less than 2m / s, and a dotted line corresponds to a movement speed of less than 1m / s. By displaying such a diagram on the administrator terminal 2, the administrator can understand where the bottlenecks in movement are and take countermeasures.

[0088] The analysis unit 135 may, in place of, or in conjunction with, the lines of different configurations shown in Figure 8(a), display text or a graphic indicating the time spent at the location where the user stopped on the administrator terminal 2. For example, Figure 8(b) shows black circles whose diameters correspond to the time spent. For example, a small diameter circle indicates a time spent less than 2 seconds, and a large diameter circle indicates a time spent 2 seconds or more. This type of information also makes it easier for administrators to identify the location of bottlenecks.

[0089] The storage unit 12 may store display image data displayed on the information terminal 3 used by each user, associated with multiple users. The analysis unit 135 may output the results of an analysis of whether an object containing information about an exit (hereinafter referred to as "guide object") is included within a predetermined range from the center of the multiple display image data displayed on the information terminal 3 of each of the multiple users, based on the display image data stored in the storage unit 12. The predetermined range from the center is the range in which the user is thought to have seen the object, for example, within 10% of the horizontal width of the screen from the center position of the screen in the horizontal direction of the screen. The predetermined range from the center may also be within 10% of the horizontal width of the screen and within 10% of the vertical width from the center position of the screen.

[0090] The guiding objects are, for example, signs indicating emergency exits, evacuation doors, or sofas placed near exits. Figure 9 shows an example where signs indicating emergency exits are displayed. Figure 9(a) shows an example where signs indicating emergency exits are displayed within a predetermined range from the center of the screen of the information terminal 3, while Figure 9(b) shows an example where the signs are not displayed within a predetermined range from the center of the screen of the information terminal 3. It is thought that the user who saw the image in Figure 9(a) saw the signs indicating emergency exits and moved. On the other hand, it is thought that the user who saw the image in Figure 9(b) moved without seeing the signs indicating emergency exits.

[0091] The analysis unit 135 may identify the percentage of users who are thought to have seen the guidance object among the multiple users who participated in the evacuation drill, and notify the administrator terminal 2 of the results of this identification. If there are multiple guidance objects in the space, the analysis unit 135 may also associate the percentage of users who saw each of the guidance objects with the administrator terminal 2. By notifying the administrator terminal 2 of this information, the analysis unit 135 enables the administrator to understand which guidance objects are effective and which are not, and to improve the placement and size of the guidance objects.

[0092] [Second variation] Figure 10 shows the configuration of the information processing device 1B according to the second modified example. The information processing device 1B shown in Figure 10 differs from the information processing device 1 shown in Figure 3 in that it further has a recording unit 136, but is otherwise the same.

[0093] If there are few participants in an evacuation drill, it is expected that the drill may not be fully effective. Therefore, the information processing device 1B is characterized by displaying not only user images corresponding to users participating in the evacuation drill, but also user images of dummy users who are not participating in the evacuation drill, thereby achieving the same effect as if many users were participating in the evacuation drill.

[0094] To achieve this, the image creation unit 133 creates display image data by overlaying a number of user image data, greater than the number of users, onto the spatial image data. For example, the image creation unit 133 creates display image data by overlaying user image data of a dummy user created through computational processing.

[0095] The image creation unit 133 may create new display image data using display image data from past evacuation drills. For example, the recording unit 136 stores the display image data created by the image creation unit 133 in the storage unit 12, associating it with its position in space. The image creation unit 133 creates new display image data by overlaying user image data onto the past display image data stored in the storage unit 12. If user image data is included in the past display image data, the new display image data will include user image data from more users than the number of users participating in the evacuation drill. As a result, users can conduct an evacuation drill that simulates an environment with more users than the actual number of participants, thus improving the effectiveness of the evacuation drill.

[0096] [Third variation] Figure 11 shows the configuration of the information processing device 1C according to the third modified example. The information processing device 1C shown in Figure 11 differs from the information processing device 1 shown in Figure 3 in that it further includes an audio processing unit 137, but is otherwise the same.

[0097] Information processing device 1C is characterized by enabling users participating in evacuation drills to hear the voices of other users. The voice processing unit 137 acquires voice data based on the voices of administrators using administrator terminal 2 or users using information terminal 3 from administrator terminal 2 or information terminal 3, and provides the acquired voice data to other information terminals 3.

[0098] The voice processing unit 137, for example, acquires voice data based on the voices of at least some of the multiple users, and provides the voice data to the information terminal 3 used by the other users at a volume corresponding to the distance from the user who made the voice to the other users, thereby causing the voice processing unit 137 to output voices based on the voice data. When the voice processing unit 137 operates in this way, users hear the voices of other users who are nearby louder than the voices of users who are far away, which enhances the sense of realism in the evacuation drill and improves its effectiveness.

[0099] Furthermore, with the audio processing unit 137 configured in this way, if some users are in charge of guiding evacuations, the voice they emit to guide the evacuation will be output from the information terminals 3 of other users who are evacuating, allowing the other users to evacuate while listening to the voice of the evacuation guide.

[0100] The voice processing unit 137 may store the voice of the evacuation guide in the storage unit 12. By recording the voice in this way, the administrator can compare the voice of the evacuation guide when the evacuation time is long and when the evacuation time is short, as described in the first modified example, and analyze what kind of voice the evacuation guide should emit to be effective in evacuating. This is also suitable for training evacuation guides.

[0101] The voice processing unit 137 may enable conversation between the first and second users when it receives notification from the information terminal 3 that the first user has selected user image data of the second user. Specifically, it transmits the voice input from the first user's information terminal 3 to the second user's information terminal 3, and transmits the voice input from the second user's information terminal 3 to the first user's information terminal 3. This operation of the voice processing unit 137 further enhances the sense of realism in evacuation drills.

[0102] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments. [Explanation of Symbols]

[0103] 1. Information Processing Device 2 Administrator terminal 3. Information terminals 11 Communications Department 12 Storage section 13 Control Unit 131 Settings Reception Department 132 Location identification part 133 Image Creation Section 134 Image Provider 135 Analysis Department 136 Records Section 137 Audio Processing Unit

Claims

1. An information processing device for displaying spatial image data showing an image of at least one space inside or outside a building on an information terminal, a position specifying unit that specifies one or more positions of one or more users using the information terminal in a spatial image represented by the spatial image data; an image creation unit that creates display image data by superimposing user image data representing a user at the one or more positions in the spatial image data identified by the position identification unit; an image providing unit that provides the display image data to one or more of the information terminals; An information processing device having the above.

2. the image creation unit creates the display image data by superimposing the user image data showing other users located within a predetermined range from the position of the user using the information terminal to which the image provision unit provides the display image data. The information processing device according to claim 1 .

3. the image providing unit provides the spatial image data including destination image data indicating positions to which the user can move to the information terminal; the position specifying unit specifies a position of the user after the user moves in response to selection of an image based on the destination image data on the information terminal; The information processing device according to claim 1 .

4. the image providing unit provides the display image data including the new destination image data to the information terminal after a time corresponding to a density of users within a predetermined range from the identified position has elapsed since the position identifying unit identified the position; The information processing device according to claim 3 .

5. the image providing unit provides the display image data including the new destination image data to the information terminal after a time corresponding to a width of the passage at the identified position has elapsed since the position identifying unit identified the position. The information processing device according to claim 3 .

6. the image providing unit provides the display image data including the new destination image data to the information terminal after a time corresponding to a width of an exit beyond the identified position has elapsed since the position identifying unit identified the position, The information processing device according to claim 3 .

7. the image providing unit provides the information terminal with the display image data corresponding to the position identified by the position identifying unit. The information processing device according to claim 1 .

8. the location specifying unit starts specifying the location after the image providing unit provides the spatial image data showing a state in which an object is damaged due to vibrations caused by an earthquake to the plurality of information terminals. The information processing device according to claim 1 .

9. a setting receiving unit that receives settings for a type and a display position of superimposed image data to be superimposed on the spatial image data; The image providing unit provides fire image data to the plurality of information terminals so that the fire image of the type accepted by the setting accepting unit is superimposed and displayed at the display position in the spatial image data accepted by the setting accepting unit. The information processing device according to claim 1 .

10. The apparatus further includes a setting receiving unit that receives an earthquake operation setting for displaying the spatial image data showing a state in which objects are damaged by vibrations caused by an earthquake, the image providing unit provides the display image data including the spatial image data showing a state in which an object is damaged to the plurality of information terminals when the setting accepting unit accepts the earthquake operation setting. The information processing device according to claim 1 .

11. a storage unit that stores the location and time of each of the one or more users in association with each other; an analysis unit that calculates a time required for at least some of the one or more users to reach a predetermined location after starting to move based on the relationship between the position of each of the one or more users and time stored in the storage unit; and further comprising The information processing device according to claim 1 .

12. an analysis unit that outputs a result of analyzing whether or not an object containing information about an exit is included within a predetermined range from the center of the one or more pieces of display image data displayed on the information terminal of each of the one or more users; The information processing device according to claim 1 .

13. the image creation unit creates display image data in which the user image data, the number of which is greater than the number of the one or more users, is superimposed on the space image data. The information processing device according to claim 1 .

14. a recording unit that stores the display image data created by the image creation unit in a storage unit in association with a position in the space; the image creation unit creates new display image data by superimposing the user image data on the previous display image data stored in the storage unit. The information processing device according to claim 13.

15. and a voice processing unit that acquires voice data based on voices uttered by at least some of the one or more users, and causes the information terminal used by the other users to output voices based on the voice data at a volume corresponding to the distance from the user who uttered the voice to the other users. The information processing device according to claim 1 .

16. A computer is used to display spatial image data showing an image of at least one space inside or outside a building on an information terminal, Identifying one or more positions of one or more users using the information terminal in a spatial image represented by the spatial image data; creating display image data by superimposing user image data showing a user on the one or more positions identified in the spatial image data; providing the display image data to one or more of the information terminals; An information processing method comprising:

17. A computer used to display spatial image data showing an image of at least one space inside or outside a building on an information terminal, Identifying one or more positions of one or more users using the information terminal in a spatial image represented by the spatial image data; creating display image data by superimposing user image data showing a user on the one or more positions identified in the spatial image data; providing the display image data to one or more of the information terminals; A program to execute.

Images