Information processing system

Abstract

This information processing system includes a plurality of user terminals and a server device connected to the user terminals, and shares virtual space information between the plurality of user terminals. The information processing system is provided with a database that has a layered structure comprising layers of respective types of virtual space information, and is configured so as to store the virtual space information in the layered structure. The server device is configured so as to, for each user terminal, extract virtual space information necessary for the user of the user terminal from the database and transmit the virtual space information to the user terminal.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, a server device, and a recording medium.

Background Art

[0002] A system in which a plurality of user terminals share a virtual space has been proposed (for example, Patent Documents 1 and 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] In order to realize smooth communication between users in a virtual space, it is necessary to extract and share the necessary virtual space information between a plurality of user terminals from the virtual space information in real time. However, at present, no effective mechanism has been proposed for extracting and sharing the necessary virtual space information between a plurality of user terminals from the virtual space information, including Patent Documents 1 and 2.

[0005] An object of the present invention is to provide an information processing system that solves the above-described problems.

Means for Solving the Problems

[0006] An information processing system according to an aspect of the present invention is an information processing system including a plurality of user terminals and a server device connected to the user terminals, for sharing virtual space information between the plurality of user terminals, The system includes a database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure. The server device is configured to extract necessary virtual space information from the database for each user terminal and transmit it to the user terminal.

[0007] A server device according to another embodiment of the present invention is: The server device in an information processing system that includes a plurality of user terminals and a server device connected to the user terminals, and which shares virtual space information among the plurality of user terminals, The system includes a database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure. Each user terminal is configured to extract necessary virtual space information from the database and transmit it to the user terminal.

[0008] Furthermore, information processing methods according to other embodiments of the present invention are: An information processing method performed by a server device in an information processing system that includes a plurality of user terminals and a server device connected to the user terminals, wherein virtual space information is shared among the plurality of user terminals, The system has a layer structure consisting of layers for each type of virtual space information, and is configured to store the virtual space information in the layer structure. From this virtual space information database, for each user terminal, the system performs a process of extracting the virtual space information necessary for the user of the user terminal and sending it to the user terminal. It is structured in this way.

[0009] Furthermore, a computer-readable recording medium according to another embodiment of the present invention is: In an information processing system that includes multiple user terminals and a server device connected to the user terminals, and in which virtual space information is shared among the multiple user terminals, the computer constituting the server device includes: A process that extracts the necessary virtual space information for each user terminal from a virtual space information database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure, and transmits it to the user terminal. It is configured to record a program to perform that action. [Effects of the Invention]

[0010] By having the configuration described above, the present invention enables the extraction and sharing of necessary virtual space information in real time among multiple user terminals from virtual space information. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows an example of virtual space information shared between paramedics and doctors in a third embodiment of the present invention. [Figure 2] This figure shows an example of virtual space information shared between paramedics and doctors in a third embodiment of the present invention. [Figure 3] This figure shows an example of a layer structure for data extraction, retrieval, representation, and management in a third embodiment of the present invention. [Figure 4] This figure shows an example of the main operation in the third embodiment of the present invention. [Figure 5] This figure shows an example configuration of an information processing system according to a third embodiment of the present invention. [Figure 6] This figure shows an example of the logical configuration of a server device in a third embodiment of the present invention. [Figure 7] This is a schematic diagram showing a structure for extracting only the data necessary for the user of a user terminal from virtual space information in a third embodiment of the present invention. [Figure 8] This figure shows an example of the logical configuration of a user terminal in a third embodiment of the present invention. [Figure 9] This is a flowchart showing an example of processing by a server device in a third embodiment of the present invention. [Figure 10] A flowchart showing an example of the processing of the user terminal in the third embodiment of the present invention. [Figure 11] A flowchart showing an example of the processing of the information processing system in the third embodiment of the present invention. [Figure 12] A schematic diagram showing an example of virtual space information shared among multiple station staff in the fourth embodiment of the present invention. [Figure 13] A diagram showing an example of the structure of data extraction in the fourth embodiment of the present invention. [Figure 14] A schematic diagram showing an example of virtual space information shared between a delivery staff manager and delivery staff in the fifth embodiment of the present invention. [Figure 15] A diagram showing an example of the structure of data extraction in the fifth embodiment of the present invention. [Figure 16] A schematic diagram showing an example of virtual space information shared between a manager and a worker in the sixth embodiment of the present invention. [Figure 17] A diagram showing an example of the structure of data extraction in the sixth embodiment of the present invention. [Figure 18] A schematic diagram showing an example of virtual space information shared among workers in the seventh embodiment of the present invention. [Figure 19] A diagram showing an example of the structure of data extraction in the seventh embodiment of the present invention. [Figure 20] A block diagram of the first embodiment of the present invention.

Embodiments for Carrying Out the Invention

[0012] Next, embodiments of the present invention will be described in detail with reference to the drawings. [First Embodiment] Figure 20 is a block diagram of an information processing system according to the first embodiment of the present invention. Referring to Figure 20, the information processing system 1 according to this embodiment is configured to include a server device 2, a database 3 connected thereto, and a plurality of user terminals 4 connected to the server device 2 via a network 5 such as the Internet. The server device 2 and the database 3 may be located in the same enclosure or may be connected via a network such as the Internet. Furthermore, the server device 2 and the database 3 may be a virtual server and virtual database on the cloud, or they may be a real server and real database.

[0013] Database 3 is a storage device that stores various types of virtual space information. The stored virtual space information includes, for example, data on three-dimensional buildings and roads, data on characters (avatars, etc.), people, animals, cars and other moving objects, data related to communication such as chats created by users of user terminals, data related to road traffic information, weather-related data such as weather forecasts, and data measured by sensors such as acceleration sensors, temperature sensors, and pressure sensors. However, the virtual space information stored in Database 3 is not limited to the above; it can be any information that can be placed in a virtual space.

[0014] Furthermore, database 3 has a layer structure consisting of layers for each type of virtual space information. Database 3 can record and read virtual space information for each layer. The types and number of virtual space information stored in database 3, as well as the types and number of layers, are arbitrary. For example, layers related to people, layers related to space, layers related to time, and layers related to communication are examples of layers. Other examples of layers include layers for each organization to which the user of user terminal 4 belongs, layers for each industry, layers for each job, and layers for each role. Moreover, one layer may be further divided into multiple layers. For example, a layer that stores a certain type of information may be divided into multiple layers according to the granularity of the information it stores. Alternatively, a layer that stores a certain type of information may be divided into multiple layers according to the freshness of the information it stores. In addition, any multiple layers can be superimposed on each other. Superimposing multiple layers on each other is one method of layer multiplexing. The multiplexed layer structure will have virtual space information that combines the virtual space information stored in each individual layer. Multiple layer structures, where overlapping layers differ from one another, store distinct virtual space information (diverse virtual space information). Users on multiple user terminals can share virtual space information at the individual layer level, as well as at the level of the multiplexed layer structure.

[0015] Furthermore, in database 3, related virtual space information across multiple layers is linked to each other by a tree structure, graph structure, or network structure. Linking multiple layers to each other using a tree structure or similar is another method of layer multiplexing. The types of virtual space information linked to each other using a tree structure or similar, and the types of layers that store it, are arbitrary. For example, data x1 stored in a layer corresponding to organization X1 to which user U1 of a certain user terminal 4 belongs, and data y2 stored in a layer corresponding to role Y2 of user U2 of another user terminal 4 belonging to a different organization X2, may be linked using a tree structure or similar. Such a link allows users belonging to different organizations to efficiently search for and extract necessary virtual space information. The above example is the sharing of virtual space information between different organizations, but of course, the above-mentioned tree structure or similar linking can also be used to share virtual space information between different industries, tasks, and roles.

[0016] Server device 2 consists of hardware such as a CPU (Central Processing Unit) and other processors that perform calculations, various storage devices such as main memory, wired or wireless communication devices, and software such as programs that run on the processor. User terminal 4 is an electronic device such as a personal computer or smartphone and consists of a processor such as a CPU that performs calculations, storage devices such as main memory and auxiliary memory that store data and programs, a display device that displays a virtual space, and an input device that performs input operations.

[0017] Server device 2 is configured to extract the necessary virtual space information for each user terminal 4 from database 3 and transmit it to user terminal 4 via network 5. For example, server device 2 stores information defining the user's organization, industry, work, and role for each user terminal 4. Server device 2 refers to the above definition information to recognize the user's organization, industry, work, and role, and extracts the virtual space information stored in the corresponding layers from database 3 as the virtual space information necessary for that user. Virtual space information is stored in layers of database 3 according to type. Therefore, server device 2 can efficiently extract virtual space information stored in the layers corresponding to the user's organization, industry, work, and role from database 3. In addition, since it is not necessary to extract all the virtual space information stored in database 3, the processing load on server device 2 is reduced. As a result, even a large amount of virtual space information can be shared in real time among multiple user terminals.

[0018] Furthermore, server device 2 searches or extracts virtual space information from database 3 as necessary virtual space information for the user, by linking other layers of virtual space information to the extracted virtual space information using a tree structure or similar method. This allows server device 2 to efficiently search and extract necessary virtual space information for users belonging to different organizations, industries, jobs, and roles.

[0019] User terminal 4 is configured to display a virtual space on its display device based on virtual space information received from server device 2. As mentioned above, only the types of virtual space information necessary for the user of user terminal 4 are distributed from server device 2 to user terminal 4. Therefore, even user terminal 4, which has slow memory capacity and processing speed, can comfortably display the necessary virtual space on its display device, and real-time functionality can be easily ensured.

[0020] Furthermore, the user terminal 4 can perform operations on the virtual space displayed on the display device, such as acquiring data within the virtual space, creating new data, updating data, and deleting data, through user operations (operations via the input device). For example, the user terminal 4 can move around in the virtual space by controlling its own avatar in response to user operations, and communicate with other users' avatars through chat, etc. When the user terminal 4 processes virtual space information in response to user operations, it sends the resulting virtual space information to the server device 2.

[0021] Server device 2 stores the virtual space information received from user terminal 4 in the corresponding layer of database 3. Server device 2 also associates the newly stored virtual space information in database 3 with other virtual space information already stored in other related layers using a tree structure or similar method. Furthermore, for each user terminal 4, server device 2 determines whether the newly stored virtual space information in database 3 is necessary for that user, based on the user's organization, industry, job, role, and / or the existence of associations using a tree structure or similar method. Server device 2 then distributes the newly stored virtual space information to the user terminal 4 of the user who needs it.

[0022] As described above, the information processing system 1 according to this embodiment has a layer structure consisting of layers for each type of virtual space information, and includes a database 3 configured to store virtual space information in a layer structure. The server device 2 is configured to extract the virtual space information necessary for each user terminal 4 from the database 3 and transmit it to the user terminal 4. Therefore, the server device 2 can efficiently search or extract the virtual space information necessary for each user terminal 4 from the database 3 and transmit it to the user terminal 4. As a result, even if a vast amount of virtual space information is stored in the database 3, virtual space information can be easily shared in real time among multiple user terminals 4.

[0023] Furthermore, the database 3 in the information processing system 1 according to this embodiment is configured to associate related virtual space information stored in multiple layers using a tree structure, graph structure, or network structure. Therefore, the server device 2 can search or extract the virtual space information required by the user terminal 4 from the database 3 even more efficiently. In particular, when the database 3 adopts a configuration that associates related virtual space information stored in multiple layers of different organizations, industries, tasks, and roles using a tree structure or the like, the server device 2 can search or extract the necessary virtual space information from the database 3 between different organizations, industries, tasks, and roles. As a result, even a vast amount of virtual space information can be shared in real time among multiple user terminals of different organizations, industries, tasks, and roles.

[0024] [Second Embodiment] Next, a second embodiment of the present invention will be described.

[0025] Traditionally, when communicating with remote personnel in inspection, monitoring, maintenance, and operation tasks, text-based communication such as email and chat, or voice calls such as telephone calls, have been used. Furthermore, when sharing data remotely, spreadsheets and word processing software are used to compile the data, which is then shared via the cloud. However, these methods involve time lags, making real-time information sharing difficult and hindering effective communication. Additionally, relying solely on text and photos makes it difficult to grasp and convey the situation on-site. Therefore, a communication system is needed that allows for real-time, efficient data sharing remotely and is user-friendly in real time. This embodiment is an information processing system that solves the above problems.

[0026] The information processing system according to this embodiment enables real-time and efficient information sharing in inspection, monitoring, maintenance, and operation tasks by constructing a virtual space that mimics the real world on the internet or a computer system. Furthermore, this information processing system is configured to make the current location, actions, and status of workers easily understandable by using avatars, etc., and to enable communication within the virtual space.

[0027] Furthermore, in order to share large amounts of virtual space information, such as 3D data, in real time, this information processing system manages virtual space information consisting of time information, location information, and various other types of information in a layered or tree structure in the server device's database. This allows the server device to efficiently update virtual space information in real time. In addition, in order to efficiently share large amounts of data such as 3D data (efficiently sharing only necessary, related, and useful information) among multiple users, the server device is configured to efficiently extract only the data necessary for each user from the virtual space information managed in the above-mentioned database using a layered or tree structure, and present it to each user.

[0028] According to the information processing system of this embodiment, for example, managers and workers performing inspection and monitoring tasks can share information and communicate in real time and efficiently in a virtual space that mimics the real world (it does not necessarily have to mimic reality). Instead of conventional methods such as telephone, email, and chat, users can enter a virtual three-dimensional space built on the internet using their avatars, and communicate with others within the virtual space using (or not using) their avatars, enabling real-time communication even in vast work sites. For example, this information processing system manages time information, location information, and various other types of information in a database connected to a server device, using a layered or tree structure for multiplexing, in order to share large amounts of data such as 3D data in real time among users on multiple user terminals. This allows for real-time and efficient sharing of virtual space information among multiple users. Furthermore, the information shared or generated can be efficiently shared according to the various organizations, tasks, and roles of the users. For example, in order to efficiently share large amounts of data such as 3D data (efficiently sharing only the necessary, related, and useful information), the server device can efficiently extract only the data necessary for each user from the information managed in the above-mentioned database using a layered or tree structure, and present it to each user.

[0029] The database stores and manages virtual space information in a layered structure, for example, by organization, industry, business, or user role. By adjusting the granularity of information for each layer in the database and extracting and integrating the information on the server device, the processing load can be reduced, and real-time performance can be ensured. The layered structure allows for switching the display / hide status of each layer, reducing the processing load on the user's terminal and improving real-time performance. Furthermore, from the perspective of system construction and development, if a bug exists somewhere, it may be possible to resolve it by checking only that layer, contributing to development efficiency. In other words, because it is not tightly coupled, those who build and develop the system can investigate, verify, and test each layer.

[0030] The layered structure categorizes information, making it easier to manage (insert, extract, modify, update, etc.) virtual space information. Furthermore, because related information stored in layers is interconnected in a tree structure, the server can search or extract information relationships and their temporal relationships, making it easy to find necessary information. Therefore, the server can extract or select only the information important to the user. Moreover, because the tree structure manages relationships in the granularity direction, the server can quickly access necessary information (controlling granularity) when, for example, you want to know more detailed information about a location from a general overview. Also, because layers are related in a tree structure, the server can extract and display not only information from one layer, but also related information from multiple layers, along with information about those relationships, on the user terminal. Furthermore, because information is related in a tree structure in the temporal direction, the server can efficiently search history and simultaneously search in both the temporal and information relationship directions. Additionally, by establishing relationships between information in different spaces within the database, information (space) can be duplicated, allowing a large amount of information to be packed into a limited space without gaps.

[0031] [Third Embodiment] Next, a third embodiment of the present invention will be described. This embodiment is an example of applying the present invention to emergency medical transport.

[0032] In emergency transport situations, paramedics in the ambulance directly call emergency hospitals and other facilities to find a hospital that can accept the patient. The paramedics or hospital staff make a comprehensive decision based on factors such as the patient's location, the distance to the hospital, the specialties and number of on-call doctors, and the number of available beds. As a result, it can be difficult to find a suitable hospital, leading to patients being turned away from multiple facilities. In short, there is a challenge in quickly transporting patients to hospitals.

[0033] Therefore, the information processing system according to this embodiment is not a system that searches for a hospital that will accept the patient by calling around exhaustively as in the past. Instead, for example, it represents a real city or a real city schematically or abstractly in a virtual space, and reflects paramedics and hospital doctors in that virtual space using avatars or the like. This allows the information processing system to share information from other systems, such as patient information, hospital acceptance status, and traffic information, in real time among users of multiple user terminals, enabling smooth communication between paramedics and doctors.

[0034] Figures 1 and 2 illustrate an example of virtual space information shared between paramedics and doctors in this information processing system. In this example, there is one paramedic and three doctors. These four users share virtual space information, including map information, road traffic information, and user location information. When a paramedic operates their avatar in the virtual space displayed on their user terminal and sends a message such as "35-year-old male, accident trauma, please accept emergency transport," the server device that receives this message displays the same message on the user terminals of doctors at hospitals near the paramedic's location. The server device also extracts information related to the hospital to which each doctor belongs from a database and displays it on each doctor's user terminal. For example, hospital-related information may include the number of available doctors, their specialties, and the number of hospital beds. Each doctor decides whether to accept the patient based on the displayed information and sends a response message to the paramedic by operating their avatar displayed on their user terminal. For example, in the examples in Figures 1 and 2, each doctor sends messages such as, "Not accepting patients, on duty: only 3 internists, beds: 5 available," "Accepting patients, on duty: 2 surgeons, 2 internists, beds: 3 available," and "Accepting patients, on duty: 2 surgeons, 1 internist, beds: 5 available." The server device integrates these messages and sends them to the paramedics' user terminals. The paramedics recognize the messages from nearby doctors displayed on their user terminals and decide which hospital to accept the patient at. Once the paramedics select a hospital, that information is sent from the user terminal to the server device. At this time, if sensor information such as the patient's heart rate and blood pressure, or images of the injured area, exists, these are also sent from the user terminal to the server device. The server device then sends the patient information received from the paramedics' user terminals to the user terminals of the doctors at the hospital selected as the receiving hospital. This allows the doctors at the selected hospital to understand the patient's condition in advance.

[0035] Figure 3 shows an example of a layer structure for data extraction, retrieval, representation, and management in emergency transport according to this embodiment. Referring to Figure 3, the database for storing virtual space information in this embodiment is composed of various layers, including a person information layer containing medical information, a hospital information layer containing the number of available doctors and their specialties, the number of hospital beds, etc., a spatial information layer containing maps, user location information, traffic information, etc., a layer of information from other systems, and a time layer that allows checking past records. In this way, virtual space information is multiplexed. Virtual space information is integrated as a layer structure, and the granularity (granularity of information, spatial granularity, temporal granularity, etc.) can be adjusted for each layer. Furthermore, the layers are connected to each other by a tree structure or graph structure (network structure, etc.), and the necessary data can be selected or extracted for each user terminal. In addition, users can add arbitrary virtual layers, virtual information, or virtual structures to the existing virtual space (they may also create (multiplex) another virtual space itself). For example, in the event of a disaster, if a remote doctor or AI doctor (such as an artificial intelligence system like a chatbot) that does not exist in the actual physical space or geographical location is placed in a virtual space within the user's terminal, emergency medical personnel at the disaster site can receive instructions from the virtual doctor, enabling them to provide optimal first aid.

[0036] Figure 4 shows an example of the main operations in the information processing system according to this embodiment. Each user terminal (user terminals of various vendors (organizations, groups, etc.)) 200 may perform operations to collect sensor information obtained from cameras, 3D sensors, etc., location information obtained from GPS, etc., and measurement information and status information obtained from some equipment, facilities, and devices. The server device 100 may receive the above-mentioned collected information, integrate it in the spatial information integration unit 114 (described later) (101), and distribute the integrated virtual space information to the user terminals 200. The server device 100 may also perform operations to extract or select the above-mentioned collected information (102), adjust the granularity of the extracted or selected virtual space information (103), and distribute the adjusted virtual space information to the user terminals 200.

[0037] Figure 5 shows an example of the configuration of the information processing system according to this embodiment. User terminals 200 exchange virtual space information with other user terminals 200 in real time through the server device 100. The server device 100 may be a virtual server on the cloud or a physical server. User terminals 200 include personal computers, tablets, smartphones, glasses-type devices that realize VR (virtual reality), AR (augmented reality), MR (mixed reality), etc., 3D displays, etc. User terminals 200 may be carried by the user, or they may be installed on-site as a system that exchanges information with the user (for example, presenting information to the user with a projector and acquiring information from the user with sensors or voice). With these configurations, it is possible to provide users of user terminals 200 with virtual spaces that mimic the real world, virtual spaces that do not necessarily mimic the real world, and mixed reality spaces that superimpose the virtual world onto the real world. Furthermore, UIs such as avatars can also be provided, enabling mutual exchange of virtual space information and real-time and efficient communication.

[0038] Figure 6 shows an example of the logical configuration of the server device 100. The server device 100 includes a location information acquisition unit 110, an object drawing unit 111, a data collection unit 112, an information management unit 113, and a data distribution unit 120. The information management unit 113 also includes a spatial information integration unit 114, an information storage unit 118, and a data extraction unit 119. The information storage unit 118 corresponds to a database that holds virtual spatial information. In Figure 6, the information storage unit 118 is located inside the server device 100, but it may also be located outside the server device 100. Furthermore, the spatial information integration unit 114 includes a linking unit 115, a layer structure 116, and a tree structure 117.

[0039] The location information acquisition unit 110 acquires location information (spatial information, geographic information, etc.) of user terminals, luggage, etc. The object drawing unit 111 creates, moves, deletes, updates, etc. of objects such as users, people, buildings, equipment, luggage, etc. The data collection unit 112 collects virtual space information edited, integrated, or updated by the location information acquisition unit 110 and the object drawing unit 111, as well as virtual space information transmitted from the user terminal 200. The linking unit 115 of the spatial information integration unit 114 organizes the virtual space information collected by the data collection unit 112 into a layer structure 116 or a tree structure 117 and saves it in the information holding unit 118. In other words, the spatial information integration unit 114 associates, integrates, and aligns the information granularity of all the information acquired by the location information acquisition unit 110, the information generated by the object drawing unit 111, and the information acquired from the user terminal 200.

[0040] Furthermore, the data extraction unit 119 extracts the necessary virtual space information (including historical data) from the virtual space information stored in the information holding unit 118 according to the requests received from each user terminal 200. The data distribution unit 120 transmits the virtual space information extracted by the data extraction unit 119 to the user terminal 200. The user terminal 200 receives the virtual space information transmitted from the data distribution unit 120 using the data collection unit 210 shown in Figure 8. The data extraction unit 119 extracts only the parts that each user terminal wants to check or contact from the information holding unit 118. Alternatively, the data extraction unit 119 extracts information that each user terminal wants to check or contact from the information holding unit 118 at a fine granularity (degree of detail of information), and information that is not so necessary at that time at a coarse granularity, and transmits a combined version of these to the user terminal 200. In this way, the large amount of data held by the information storage unit 118 can be shared in real time, without transmitting all of it as is, but only the necessary and useful information.

[0041] Figure 7 is a schematic diagram showing a structure that extracts only the data necessary for the user on the user terminal from the virtual space information stored in the information holding unit 118. For example, information such as map information, road traffic information, user location information, and message information (time information, location information, and various other information data, as well as information by organization, industry, business, and user role) is all integrated as a layer structure, and the granularity is adjusted for each layer before being stored in the information holding unit 118. The virtual space information stored in multiple layers is related (including temporal relationships) by a tree structure, graph structure, or network structure. The data extraction unit 119 can select, search for, or extract necessary data related to the above data stored in another layer from the data stored in one layer through the tree structure, etc., thereby integrating and efficiently obtaining the data required by each user terminal. If information is extracted for each layer and then integrated while considering relationships, the load is large and time-consuming, but with the above method where relationships are established in advance, the load is small and real-time performance can be ensured. Furthermore, these mechanisms make management (insertion, extraction, modification, update, etc.) easier and enable the duplication of the information space.

[0042] Figure 8 shows an example of the logical configuration of the user terminal 200. Referring to Figure 8, the user terminal 200 includes a data collection unit 210, an information display unit 211, an information assignment unit 212, and a data distribution unit 213. The data collection unit 210 acquires virtual space information stored in the server device 100. The information display unit 211 displays the virtual space information acquired by the data collection unit 210 on the display device of the user terminal 200. The information assignment unit 212 assigns new virtual space information. The information display unit 211 may also display the newly assigned virtual space information on the display device. The information display unit 211 can represent the information acquired by the data collection unit 210 in a virtual space or display it in an easy-to-understand manner using the user's avatar, etc., but the method of representation is not limited to these. The information assignment unit 212 updates and edits the virtual space information acquired by the data collection unit 210, generates information from other functions of the user terminal (such as a camera or GPS), and generates its own information by the user, thereby adding unique information to the information obtained from the server device 100. The data distribution unit 213 transmits (or retrieves from) this virtual space information to the server device 100. The server device 100 receives and stores this transmitted data.

[0043] Figure 9 is a flowchart illustrating an example of the processing performed by the server device 100. Referring to Figure 9, the location information acquisition unit 110 of the server device 100 acquires location information of objects such as users and luggage, and of spaces (Step A1). The data acquisition unit 112 performs data acquisition (Step A2). The object drawing unit 111 performs tasks such as creating, moving, deleting, and updating objects (Step A3). The information management unit 113 saves the processed data to the information holding unit 118 (Step A4). The information management unit 113 also updates the data stored in the information holding unit 118 (Step A5). As a result, the virtual space information stored in the information holding unit 118 can always be displayed to the user terminal as real-time information. The data extraction unit 119 extracts the data necessary for each user terminal from the virtual space information stored in the information holding unit 118 according to requests received from each user terminal 200 (or notifications from the server device or other systems) (Step A6). The data distribution unit 120 transmits the virtual space information extracted by the data extraction unit 119 to each user terminal (step A7).

[0044] Figure 10 is a flowchart illustrating an example of processing performed by the user terminal 200. The data acquisition unit 210 acquires virtual space information from the server device 100 (step B1). The information display unit 211 displays the virtual space information acquired by the data acquisition unit 210 on the display device (step B2). The information assignment unit 212 assigns information such as messages in response to input operations by the user of the user terminal 200 (step B3). The data delivery unit 213 transmits the virtual space information with the assigned messages to the server device 100 (step B4).

[0045] Figure 11 is a flowchart illustrating an example of the processing of the entire information processing system. At the user terminal 200 of the service provider (doctor), the data collection unit 210 acquires data (steps C1-C3), the information display unit 211 displays the acquired information (steps C4-C6), the information addition unit 212 adds further information (steps C7-C9), and the data distribution unit 213 transmits this data to the server device 100 (steps C10-C12). The server device 100 integrates the virtual space information received from the server device 100 (step C13) and transmits it to the user terminal 200 of the administrator (emergency medical technician).

[0046] On the administrator's user terminal 200, the data collection unit 210 acquires virtual space information transmitted from the server device 100 (step C14), the information display unit 211 displays that information (step C15), the information addition unit 212 adds further information (step C16), and the data distribution unit 213 transmits the added virtual space information to the server device 100 (step C17).

[0047] In the server device 100, after storing the virtual space information transmitted from the administrator's user terminal 200 in the information storage unit 118, the data extraction unit 119 extracts the necessary data from the virtual space information stored in the information storage unit 118 (step C18), and the data distribution unit 120 transmits the extracted virtual space information to the vendor's user terminal 200.

[0048] In the user terminals 200 of vendors 1 to 3, the data collection unit 210 acquires virtual space information transmitted from the server device 100 (steps C20 to C22), and the information display unit 211 displays that virtual space information on the display device (steps C23 to C25).

[0049] As explained above, according to this embodiment, when paramedics are searching for a destination for a patient, they can share information in real time with doctors at nearby hospitals in a virtual space, and can contact them more efficiently than by telephone, thus enabling the rapid transport of patients and helping to alleviate the shortage of personnel.

[0050] [Fourth Embodiment] Next, a fourth embodiment of the present invention will be described. This embodiment is an example of applying the present invention to station facilities.

[0051] Currently, telephones and walkie-talkies are used for information sharing among station facility managers. Station staff duties include unlocking doors, roll call, handover, assignment of responsibilities (ticket gates, platform monitoring, station cleaning, administrative work), checking after the last train, locking up, and other tasks (meal service, train arrival and delay announcements, customer assistance, commuter pass sales staff, signal operators who can operate the points within the station, etc.). While station staff duties are diverse, information services, in particular, are not yet digitized and urgently need to be digitized. Also, since station masters are in charge of multiple stations, communication tools between stations also need to be digitized. In large stations, it is difficult for managers in different locations to share information such as the location of medical emergencies, AEDs, suspicious objects, lost and found items, and areas that need cleaning. Furthermore, there is the challenge of delays in the arrival of emergency services when a medical emergency occurs.

[0052] Therefore, the information processing system according to this embodiment represents actual station facilities schematically or abstractly in a virtual space, and reflects station staff in that virtual space using avatars or the like. This allows station staff to grasp the situation of the entire station premises in real time and facilitates communication among station staff. As a result, the work of station staff can be made more efficient. In addition, information can be shared more easily between different stations.

[0053] Figure 12 is a schematic diagram illustrating an example of virtual space information shared among multiple station staff in this information processing system. In this example, multiple station staff share virtual space information including map information of the station premises, user location information, and location information of customers causing trouble or suspicious objects. If a station staff member discovers a suspicious object and operates their avatar in the virtual space displayed on the user terminal to send a message such as "There is a suspicious object," the server device that receives this message displays the same message on the user terminals of other station staff members in the management room. Here, the server device may automatically determine the recipient of the message to be the station staff member in the management room whose job it is to handle suspicious objects, by interpreting the meaning of the message. Also, if the station staff member in the management room operates their avatar to send a message such as "I'm on my way," the server device that receives this message will send the message to the user terminal of the station staff member who discovered the suspicious object. In this way, necessary virtual space information can be shared in real time among multiple station staff members performing the same duties.

[0054] On the other hand, in Figure 12, if another station employee discovers a customer in need of assistance and operates their avatar in the virtual space displayed on the user terminal to send a message such as "Assistance is needed," the server device that receives this message will display the same message on the user terminal of another station employee in the first-aid room. Here, the server device may automatically determine the recipient of the message to be the station employee in the first-aid room by interpreting the meaning of the message. Furthermore, if the station employee in the first-aid room operates their avatar to send a message such as "I'm on my way," the server device that receives this message will send the same message to the user terminal of the station employee who discovered the customer in need of assistance. In this way, necessary virtual space information can be shared in real time among multiple station employees performing the same duties.

[0055] Figure 13 shows an example of a data extraction structure in a station facility. Referring to Figure 13, the database that stores virtual space information in this embodiment is composed of various layers, including a people information layer containing information on customers experiencing trouble, station staff, first-aid room information, and manager's office information; a spatial information layer containing location information of users, customers experiencing trouble, and suspicious objects, as well as a map of the station premises; and a time layer that allows checking past records. In this way, virtual space information is integrated as a layered structure, and the granularity can be adjusted for each layer. Furthermore, the layers are connected and managed in a multiplexed manner using tree structures or graph structures. The server device can select or extract the data necessary for each user terminal from this virtual knowledge information. In addition, users can add (multiplex) arbitrary virtual layers, virtual information, and virtual structures. For example, when a train experiences a major delay due to a personal injury accident and it is necessary to provide information on alternative transportation such as travel time, or when a large-scale event is nearby and congestion is expected, it becomes possible to simulate the flow of people and where personnel need to be allocated in the virtual space.

[0056] Thus, according to this embodiment, when sharing information among station staff performing different duties, or external staff such as paramedics, cleaners, and security guards, it is possible to share only the necessary information and not share unnecessary information. Furthermore, information can be shared at an appropriate level of detail.

[0057] [Fifth Embodiment] Next, a fifth embodiment of the present invention will be described. This embodiment is an example of applying the present invention to logistics.

[0058] In the logistics industry, in addition to labor shortages, the spread of online shopping has increased the burden on businesses. In the future, it is expected that autonomous vehicles based at roadside rest areas will alleviate labor shortages, reduce redeliveries, and enable smoother logistics through increased visibility of product information. In current logistics, there are many transit points in large cities, and it takes time for goods to reach their destinations, so efficient information sharing is necessary to alleviate labor shortages and reduce redeliveries. In the future, when autonomous vehicles are introduced, logistics using autonomous vehicles will become mainstream, and it is possible that the form of delivery will change to one in which many different businesses are involved, with delivery by not only autonomous vehicles but also individual business owners using motorcycles and bicycles.

[0059] Therefore, the information processing system according to this embodiment represents the real world schematically or abstractly in a virtual space, and reflects various delivery companies in that virtual space using avatars or the like. This allows the information processing system to grasp the status of various delivery companies, as well as traffic information and delivery destination information during the delivery process in real time. Furthermore, the information processing system remotely manages various delivery companies in real time, optimally distributes packages to be delivered to each company, and provides an environment in which it can contact users at delivery destinations in the event of trouble. This makes it possible to alleviate labor shortages in the logistics industry and reduce redeliveries.

[0060] Figure 14 is a schematic diagram illustrating an example of virtual space information shared between delivery managers and delivery personnel in this information processing system. In this example, delivery managers at a city branch and delivery personnel from various delivery companies share virtual space information including various information about packages to be delivered (such as size and destination), location information of the branch and delivery company, city map information, and traffic information. When a delivery manager operates their avatar in the virtual space displayed on a user terminal to set various information about packages to be delivered, for example, by sending a message such as "To the XX area, 100 large packages, 50 small packages," the server device that receives this message displays the above message (not shown) on the user terminals of delivery personnel from nearby delivery companies. This allows each nearby delivery person to recognize information about packages to be delivered in real time. Then, each delivery person decides which packages they want to take on and operates their avatar to reply with a message such as "30 small packages, I'll be there in 5 minutes," the server device that receives this message then sends this reply message to the delivery manager's user terminal.

[0061] Figure 15 illustrates an example of a data extraction structure in logistics. Referring to Figure 15, the database storing virtual space information in this embodiment is composed of various layers, including a people information layer containing information on motorcycle and bicycle delivery personnel, sales offices and delivery personnel managers, etc.; a spatial information layer containing location information of packages, delivery personnel, autonomous vehicles and delivery personnel managers, maps, traffic information, etc.; and a time layer that allows users to check past records. The virtual space information is multiplexed. This virtual space information is integrated as a layer structure, and the granularity can be adjusted for each layer. Furthermore, the layers are connected and managed in a multiplexed manner using tree structures or graph structures. The server device selects or extracts the data necessary for each user terminal from the virtual space information managed in this way. In addition, users can add arbitrary virtual layers, virtual information, and virtual structures. For example, by placing a trainer in the virtual space, it is possible to educate and train sales offices, delivery personnel, and delivery personnel managers, or simulate the movements of other delivery personnel, allowing them to become familiar with the actual work environment.

[0062] Thus, according to this embodiment, staff engaged in different tasks such as delivery management and vehicle management can share information uniformly on this system. In this case, they can transmit and share the necessary information according to their assigned tasks and responsibilities, enabling them to perform their duties efficiently.

[0063] [Sixth Embodiment] Next, a sixth embodiment of the present invention will be described. This embodiment is an example of applying the present invention to a logistics warehouse.

[0064] In logistics warehouses, communication between managers and workers located in different areas of the warehouse is done via phone, email, chat, etc., and data sharing is managed using spreadsheet software. However, when data is updated after work is completed, a time lag occurs between the data and the actual situation on site, which can lead to unnecessary inventory movements and incoming shipments. Furthermore, it is difficult to grasp the situation on site using only the above-mentioned data, and even with photos and videos, it is difficult for people away from the site to grasp the spatial and environmental conditions, and it is also difficult for on-site workers to communicate these conditions to on-site managers.

[0065] Therefore, the information processing system according to this embodiment schematically or abstractly represents a real logistics warehouse in a virtual space, and reflects managers and workers in that virtual space using avatars, etc. Furthermore, this information processing system acquires the location information and movement of constantly changing information within the warehouse, such as shelves and goods, as objects in real time and reflects them in the virtual space. In addition, this information processing system facilitates information sharing by enabling managers and workers to communicate smoothly with people in remote locations in real time through avatars, etc.

[0066] Figure 16 is a schematic diagram illustrating an example of virtual space information shared between administrators and workers in this information processing system. In this example, administrators and workers share virtual space information including map information within the logistics warehouse, user location information, and location information of goods stored on shelves. For example, if an administrator operates their avatar in the virtual space displayed on a user terminal and sends a message such as "Move goods in area 2 to shelf D," the server device that receives this message will display the same message on the user terminal of a worker near the administrator. In this way, administrators and workers can share information such as the location of goods on shelves and communicate in real time as needed.

[0067] Figure 17 shows an example of a data extraction structure in a logistics warehouse. Referring to Figure 17, the database that holds virtual space information in this embodiment is composed of various layers, such as a people information layer containing information on managers and warehouse workers, a spatial information layer containing location information of goods, workers, and managers, a map of the warehouse, and a time layer that allows checking past records, and stores virtual space information in multiplexed form. In this way, virtual space information is integrated as a layered structure, and the granularity can be adjusted for each layer. Furthermore, the layers are connected to each other using tree structures or graph structures and managed in multiplexed form. The server device selects or extracts the data necessary for each user terminal from such virtual space information. In addition, users can add arbitrary virtual layers, virtual information, and virtual structures. For example, it can be used to instruct the placement of virtual goods in the correct location, simulate space-saving placement methods using virtual goods, or be used for new employee training.

[0068] Thus, according to this embodiment, managers and workers located in different parts of the warehouse can share information and give instructions in real time in a virtual space, making it easier to change the location of goods in the warehouse, saving space, sharing work status in real time even from a distance, and shortening the training time for new employees.

[0069] [Seventh Embodiment] Next, a seventh embodiment of the present invention will be described. This embodiment is an example of applying the present invention to the maintenance and management of tunnels and the like using a model that visualizes BIM / CIM (Building / Construction Information Modeling / Management).

[0070] The information processing system according to this embodiment schematically or abstractly represents structures (buildings, dams, tunnels, etc.) handled by BIM / CIM in a virtual space, and reflects maintenance workers, waterworks workers, electrical workers, etc., in that virtual space using avatars, etc. Furthermore, this information processing system shares information from construction to maintenance among workers in the virtual space. As a result, workers and managers can grasp the status of the entire site they manage in real time, making communication easier and streamlining their respective tasks. It also facilitates information sharing among workers in different tasks related to the construction and management. Moreover, it is possible to check not only the real-time status of the site but also past records retrospectively.

[0071] Figure 18 is a schematic diagram illustrating an example of virtual space information in this information processing system. In this example, multiple workers involved in tunnel maintenance share virtual space information, including tunnel structure information, user location information, and information on the location and cause of malfunctions. When a maintenance worker discovers a water leak and a light out, and operates their avatar in the virtual space displayed on their user terminal to send messages such as "There is a water leak" and "This light is out," the server device that receives these messages displays the message "There is a water leak" on the user terminal of the waterworks worker and the message "This light is out" on the user terminal of the electrical work worker. Here, the server device may automatically determine the recipient of the messages as described above, by interpreting the meaning of the messages, to be the waterworks worker and the electrical work worker. Also, when a waterworks worker operates their avatar to send a message such as "I will check," the server device that receives this message sends the message to the user terminal of the person who discovered the water leak. Furthermore, if an electrician operates their avatar and sends a message such as "Is it broken? Please provide the history of the last replacement date," the server device that receives this message will send it to the user terminal of the person who discovered the broken light.

[0072] Figure 19 shows an example of a data extraction structure for tunnel maintenance and management using a BIM / CIM visualization model. Referring to Figure 19, the database for storing virtual space information in this embodiment is composed of various layers, including a human information layer containing information on maintenance workers, waterworks workers, electrical workers, etc., a time information layer for reviewing past records, and a spatial information layer containing information such as the location of workers and the work location using the BIM / CIM model. Virtual space information is stored in a multiplexed manner. In this way, virtual space information is integrated as a layer structure, and the granularity can be adjusted for each layer. Furthermore, the layers are connected and managed in a multiplexed manner using tree structures or graph structures. The server device selects or extracts the necessary data for each user terminal from this virtual space information. In addition, users can add arbitrary virtual layers, virtual information, and virtual structures. For example, through MR / AR glasses, it is possible to overlay a virtual completed image, such as a BIM / CIM visualization model, onto the real world and perform simulations.

[0073] Although the present invention has been described above with reference to the embodiments described above, the present invention is not limited to the embodiments described above. Various modifications to the configuration and details of the present invention can be made within the scope of the present invention as can be understood by those skilled in the art. For example, instead of the CPU mentioned above, an information processing device can use a GPU (Graphic Processing Unit), DSP (Digital Signal Processor), MPU (Micro Processing Unit), FPU (Floating Number Processing Unit), PPU (Physics Processing Unit), TPU (Tensor Processing Unit), quantum processor, microcontroller, or a combination of these. Furthermore, this invention benefits from the priority claim based on the patent application No. 2022-051679 filed in Japan on March 28, 2022, and all contents described in said patent application are incorporated herein by reference. [Industrial applicability]

[0074] It can be used in situations where real-time recording, display, and instruction are required in vast areas with constantly changing conditions, such as building maintenance, factory and plant inspections and monitoring of infrastructure facilities. It can also be used for work support purposes and for remote, real-time review of the same data. Furthermore, it can be used for operational monitoring of transportation and logistics systems, facility management of buildings and real estate, and operation and management of event venues.

[0075] Some or all of the above embodiments may also be described as follows, but are not limited to the following: [Note 1] An information processing system comprising a plurality of user terminals and a server device connected to the user terminals, wherein virtual space information is shared among the plurality of user terminals, The system includes a database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure. The server device is configured to extract necessary virtual space information from the database for each user terminal and transmit it to the user terminal. Information processing system. [Note 2] The aforementioned database is configured to associate related virtual space information stored in multiple layers with each other using a tree structure, graph structure, or network structure. The information processing system described in Appendix 1. [Note 3] The user terminal is configured to process virtual space information in response to user operations and transmit it to the server device. The server device is configured to receive the virtual space information from the user terminal and to store the received virtual space information in a layer of the database corresponding to the type of virtual space information received. The information processing system described in Appendix 1 or 2. [Note 4] The aforementioned layer structure is composed of layers corresponding to the organization, industry, business, or role to which the user of the user terminal belongs. An information processing system as described in any of the appendices 1 to 3. [Note 5] The aforementioned database is configured to associate related virtual space information stored in multiple layers of different affiliated organizations, industries, tasks, or roles with each other using a tree structure, graph structure, or network structure. The information processing system described in Appendix 4. [Note 6] The server device in an information processing system that includes a plurality of user terminals and a server device connected to the user terminals, and which shares virtual space information among the plurality of user terminals, The system includes a database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure. Each user terminal is configured to extract the virtual space information necessary for the user of that user terminal from the database and transmit it to the user terminal. Server device. [Note 7] The aforementioned database is configured to associate the stored, related virtual space information with each other using a tree structure, graph structure, or network structure. The server device described in Appendix 6. [Note 8] Furthermore, the system is configured to receive virtual space information from the user terminal, which is configured to process virtual space information in response to user operations and transmit it to the server device, and to store the received virtual space information in a layer of the database corresponding to the type of virtual space information received. The server device described in Appendix 6 or 7. [Note 9] The aforementioned layer structure is composed of layers corresponding to the organization, industry, business, or role to which the user of the user terminal belongs. A server device as described in any of the appendices 6 through 8. [Note 10] The aforementioned database is configured to associate related virtual space information stored in multiple layers of different affiliated organizations, industries, tasks, or roles with each other using a tree structure, graph structure, or network structure. The server device described in Appendix 9. [Note 11] An information processing method performed by a server device in an information processing system that includes a plurality of user terminals and a server device connected to the user terminals, wherein virtual space information is shared among the plurality of user terminals, The system has a layer structure consisting of layers for each type of virtual space information, and is configured to store the virtual space information in the layer structure. From this virtual space information database, for each user terminal, the system performs a process of extracting the virtual space information necessary for the user of the user terminal and sending it to the user terminal. Information processing methods. [Note 12] In an information processing system that includes multiple user terminals and a server device connected to the user terminals, and in which virtual space information is shared among the multiple user terminals, the computer constituting the server device includes: A process that extracts the necessary virtual space information for each user terminal from a virtual space information database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure, and transmits it to the user terminal. A program to perform that action. [Explanation of Symbols]

[0076] 1. Information Processing System 2 Server devices 3 Databases 4. User terminals 5 Network

Claims

1. An information processing system comprising a plurality of user terminals and a server device connected to the user terminals, wherein virtual space information is shared among the plurality of user terminals, The system includes a database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure. The server device is configured to extract necessary virtual space information from the database for each user terminal and transmit it to the user terminal. The aforementioned layer structure is composed of layers corresponding to the organization, industry, business, or role to which the user of the user terminal belongs. Information processing system.

2. The aforementioned database is configured to associate related virtual space information stored in multiple layers with each other using a tree structure, graph structure, or network structure. The information processing system according to claim 1.

3. The user terminal is configured to process virtual space information in response to user operations and transmit it to the server device. The server device is configured to receive the virtual space information from the user terminal and to store the received virtual space information in a layer of the database corresponding to the type of virtual space information received. The information processing system according to claim 1 or 2.

4. The server device in an information processing system that includes a plurality of user terminals and a server device connected to the user terminals, and which shares virtual space information among the plurality of user terminals, The system includes a database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure. Each user terminal is configured to extract the virtual space information necessary for the user of that user terminal from the database and transmit it to the user terminal. The aforementioned layer structure is composed of layers corresponding to the organization, industry, business, or role to which the user of the user terminal belongs. Server device.

5. The aforementioned database is configured to associate the stored, related virtual space information with each other using a tree structure, graph structure, or network structure. The server device according to claim 4.

6. Furthermore, the system is configured to receive virtual space information from the user terminal, which is configured to process virtual space information in response to user operations and transmit it to the server device, and to store the received virtual space information in a layer of the database corresponding to the type of virtual space information received. The server device according to claim 4 or 5.

7. The aforementioned database is configured to associate related virtual space information stored in multiple layers of different organizations, industries, tasks, or roles with each other using a tree structure, graph structure, or network structure. The server device according to claim 4.

8. An information processing method performed by a server device in an information processing system that includes a plurality of user terminals and a server device connected to the user terminals, wherein virtual space information is shared among the plurality of user terminals, An information processing method that performs the process of extracting virtual space information necessary for the user of a user terminal from a virtual space information database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure, for each user terminal, and transmitting it to the user terminal, The aforementioned layer structure is composed of layers corresponding to the organization, industry, business, or role to which the user of the user terminal belongs. Information processing methods.

9. In an information processing system that includes multiple user terminals and a server device connected to the user terminals, and in which virtual space information is shared among the multiple user terminals, the computer constituting the server device includes: A process that extracts the necessary virtual space information for each user terminal from a virtual space information database having a layer structure consisting of layers for each type of virtual space information, and configured to store the virtual space information in the layer structure, and transmits it to the user terminal. A program to perform the following: The aforementioned layer structure is composed of layers corresponding to the organization, industry, business, or role to which the user of the user terminal belongs. program.

Images