Information processing apparatus and method

Abstract

To provide an information processing apparatus and a method for enabling information sharing between control devices that control running of movable bodies belonging to respective organizations.SOLUTION: Provided is an information processing apparatus 1 that integrates controlling operations with use of a metaverse environment, including: a processor 10; and a memory 11 and a communication unit 12 to be used by the processor. The control devices that control running of movable bodies belonging to a plurality of organizations are metaverse control devices 2A, 2B provided in the metaverse environment. The processor acquires design information about the plurality of metaverse control devices via the communication unit and stores the acquired design information in the memory, constitutes an integrated metaverse by connecting the plurality of metaverse controlling devices in a predetermined level on a basis of the acquired design information, and arranges objects used by the plurality of metaverse controlling devices in the integrated metaverse.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device and method. [Background technology]

[0002] Different railway companies sometimes share lines, but in order to ensure smooth operation, it is necessary for the railway companies to share information.

[0003] Although it is not a technology for integrating metaverse control devices constructed in a metaverse environment, there are known technologies for linking different information processing systems (Patent Documents 1 and 2).Furthermore, although it is not a technology for integrating metaverse control devices, there is also known a technology for sharing information with third parties using virtual reality technology (Patent Document 3). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7414690 [Patent Document 2] Patent No. 6674887 [Patent Document 3] Patent No. 7391317 Summary of the Invention [Problem to be solved by the invention]

[0005] In order for vehicles (such as trains) operated by different organizations to use the routes of other companies and realize mutual access, it is necessary for information to be shared in real time between the control devices that control the operation of the vehicles.However, since it is difficult to completely physically integrate the control devices of organizations (such as railway companies) that operate vehicles in different ways, it is difficult to share information between each control device.

[0006] The present invention has been made in consideration of the above problems, and its purpose is to provide an information processing device and method that enables information to be shared in a metaverse environment between control devices that control the operation of mobile vehicles belonging to each organization. [Means for solving the problem]

[0007] An information processing device according to one aspect of the present invention is an information processing device that integrates control operations using a metaverse environment, and is equipped with a processor, memory used by the processor, and a communication unit, and a control device that controls the operation of mobile objects belonging to multiple organizations is a metaverse control device provided in the metaverse environment, and the processor acquires design information for the multiple metaverse control devices via the communication unit and stores it in memory, and based on the acquired design information, constructs an integrated metaverse in which the multiple metaverse control devices are connected at a predetermined level, and places objects used in the multiple metaverse control devices in the integrated metaverse. [Effects of the Invention]

[0008] According to the present invention, multiple metaverse control devices can be integrated. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is an overall diagram of an information processing system including an integrated metaverse control device as an "information processing device." [Figure 2] This is a diagram showing the configuration of a VR (Virtual Reality) device. [Figure 3] FIG. 10 is an explanatory diagram showing an example of the relationship between each company's metaverse control device and the integrated metaverse control device. [Figure 4] FIG. 2 is a functional configuration diagram of a metaverse control device. [Figure 5] FIG. 10 is an explanatory diagram of design information for a metaverse control device. [Figure 6] 10 is an example of a control metaverse object management function that manages objects used in the metaverse control device. [Figure 7] FIG. 2 is a functional configuration diagram of an integrated metaverse control device. [Figure 8] FIG. 8 is a diagram showing details of some of the functions in FIG. 7. [Figure 9] FIG. 10 is a sequence diagram showing a process for integrating multiple metaverse control devices. [Figure 10] FIG. 10 is a sequence diagram illustrating an access control process. [Figure 11] FIG. 10 is an explanatory diagram showing an example of a user authentication and access control function. [Figure 12] FIG. 1 is a schematic diagram showing the integrated metaverse control device. [Figure 13] FIG. 10 is a schematic diagram showing how the configuration of the integrated metaverse control device changes depending on the access authority of the user. [Figure 14] This is a schematic diagram showing how only specific systems among the multiple systems owned by the metaverse control device are collected and integrated. [Figure 15] FIG. 1 is an explanatory diagram showing how multiple metaverse control devices are connected in series to form an integrated metaverse control device. [Figure 16] FIG. 1 is an explanatory diagram showing how a plurality of metaverse control devices are integrated into one integrated metaverse control device, each of which has a plurality of systems (functions). [Figure 17] FIG. 10 is a sequence diagram showing a process in which only users permitted by a group owner can view the integrated metaverse control device. [Figure 18] FIG. 10 is a sequence diagram showing a function of managing the visual recognition status of a certain user in real time or in a log. [Figure 19] FIG. 10 is an explanatory diagram illustrating a concept in which traffic control systems held by a plurality of metaverse control devices are integrated according to a second embodiment. [Figure 20] FIG. 1 is an explanatory diagram for setting mutual access points of traffic control systems. [Figure 21] 10 is an example of an object configuration table for managing objects used in a traffic control system of a certain railway company. [Figure 22]10 is an example of an object configuration table for managing objects used in a traffic control system of another railway company. [Figure 23] 10 is a flowchart showing details of the integrated object configuration in FIG. 9. [Figure 24] This is a table for managing an integrated object that integrates an object used by one railway company for traffic control with an object used by another railway company for traffic control. [Figure 25] FIG. 10 is an explanatory diagram showing an example of a display that integrates the traffic control systems of multiple metaverse control devices. DETAILED DESCRIPTION OF THE INVENTION

[0010] An embodiment of the present invention will be described below with reference to the drawings. In this embodiment, control devices that control the operation of mobile objects belonging to different organizations are constructed in a metaverse environment, thereby preparing metaverse control devices, and these prepared metaverse control devices are integrated into a single integrated metaverse control device.

[0011] In this embodiment, a single integrated metaverse control device is obtained by making as few modifications as possible to existing metaverse control devices. This allows the metaverse control devices operated by each organization in the metaverse environment to be linked together in the metaverse environment and share information in real time. This allows information to be quickly shared between users belonging to each organization, even in situations where every minute counts, such as responding to an accident during peak commuting hours, thereby improving the usability and reliability of control.

[0012] In this embodiment, real-time information sharing is realized while the access range of users who can use the integrated metaverse control device is managed. Users who use the integrated metaverse control device can share information only to the extent necessary.

[0013] In this embodiment, an existing metaverse control device operated by one organization is connected to an existing metaverse control device operated by another organization at a predetermined level in a metaverse environment, so that an integrated metaverse control device can be obtained without incurring significant construction and operating costs.

[0014] In this embodiment, when a metaverse control device is connected to another metaverse control device to obtain an integrated metaverse control device, the functions of the metaverse control device are expanded, changed, or restricted depending on the access rights of the user who uses the integrated metaverse control device. In other words, in this embodiment, an integrated metaverse control device with different specifications can be provided for each user, which eliminates the sharing of unnecessary information for the user and improves usability for the user. Furthermore, because the scope of information sharing is controlled for each user, the risk of information leakage can be reduced.

[0015] Here, the metaverse control device in this embodiment is a virtual control device that is a reproduction of an actual control device within the metaverse. A user such as a railway company controller enters the metaverse using a VR device and manages train operations using the metaverse control device.

[0016] The mobile body is not limited to a train, but can also be applied to, for example, a bus, a ship, an airplane, a self-propelled robot, and the like. [Example]

[0017] A first embodiment will be described with reference to Figures 1 to 18. In this embodiment, a railway company is used as an example of an organization, and a train is used as an example of a moving object. Users in this embodiment include not only railway company traffic controllers, but also those who are temporarily permitted to use the system, such as members of the press.

[0018] 1 is an overall diagram of an information processing system including an integrated metaverse control device 1. This information processing system includes, for example, one integrated metaverse control device 1 and multiple control metaverses 2.

[0019] The integrated metaverse control device 1 is constructed on a computer using the computer's own computer resources. The computer resources include, for example, a processor (CPU in the figure) 10, memory 11, a communication interface (communication IF in the figure) 12, and a user interface (UI in the figure) unit 13. Here, the integrated control device does not exist as a physical entity. The integrated metaverse control device 1 is a virtual entity generated by appropriately connecting multiple metaverse control devices 2.

[0020] Memory 11 stores a predetermined computer program for integrating multiple metaverse control devices 2. Processor 10 loads and executes the predetermined computer program to realize each function of integrated metaverse control device 1. Integrated metaverse control device 1 (more specifically, the computer on which integrated metaverse control device 1 is installed) is connected to multiple metaverse control devices 2 via communication interface 12 and communication network CN1 for bidirectional communication. An administrator (not shown) managing integrated metaverse control device 1 can input information to integrated metaverse control device 1 or obtain information from integrated metaverse control device 1 using user interface unit 13. User interface unit 13 includes an information input device and an information output device. Examples of information input devices include a keyboard, a switch, a controller, a voice input device, and a touch panel. Examples of information output devices include a display, a printer, and a voice synthesizer. A device that serves as both an information input device and an information output device may be used as user interface unit 13.

[0021] The integrated metaverse control device 1 can be connected to a storage medium MM. The storage medium MM is configured, for example, as a memory device, hard disk device, optical disk device, magneto-optical disk device, or magnetic tape device, and non-temporarily stores computer programs and data. The storage medium MM can transfer and store computer programs and data to the memory 11 of the integrated metaverse control device 1. Computer programs and data can also be transferred and stored from the memory 11 to the storage medium MM. A computer program that realizes the functions of the integrated metaverse control device 1 can be stored in the storage medium MM, and the storage medium MM can be connected to another computer (not shown) and the computer program stored in the storage medium MM can be installed on the other computer, causing the other computer to function as the integrated metaverse control device 1.

[0022] The metaverse control device 2 is a virtual control device constructed on a computer that imitates a real control device (not shown). The information exchange section (screen and operations on the screen, etc.) where the metaverse control device 2 exchanges information with users such as controllers is constructed in the metaverse using the computer resources of the computer. The metaverse control device 2 acquires information from the real control device and displays it on a virtual display, and transmits input from the virtual display or virtual control console to the real control device.

[0023] In Figure 1, railway company A and railway company B are shown as examples of multiple organizations, but as will be described later, the integrated metaverse control device 1 is not limited to these two companies and can individually integrate metaverse control devices 2 of many more organizations for each user. For ease of explanation, we will refer to Company A (which can also be called the first organization or first railway company, or a certain organization or a certain railway company) and Company B (which can also be called the second organization or second railway company, or another certain organization or another certain railway company).

[0024] Here, the metaverse control device of Company A will be given the code "2A," and the metaverse control device of Company B will be given the code "2B." When not distinguishing between railway companies, they will be called Metaverse Control Device 2. When referring to each company in general terms, they will be called Company X.

[0025] Users 3A and 3B are connected to the metaverse control devices 2A and 2B of each company using VR equipment 5. As mentioned above, users 3A and 3B are mainly employees (controllers) of each railway company. When no distinction is made, they are referred to as users 3. The VR equipment 5 includes not only handheld controllers but also goggles worn on the head.

[0026] VR devices 5 used by multiple users 3A are connected to a metaverse control device 2A of Company A via a communication network CN2A. Similarly, VR devices 5 used by multiple users 3B are connected to a metaverse control device 2B of Company B via a communication network CN2B.

[0027] When there is no need to distinguish between the communication networks CN2A and CN2B, they are referred to as the communication network CN2. The communication networks CN1 and CN2 may be the same network or different networks.

[0028] 2 is a configuration diagram of the VR device 5. The VR device 5 is worn by the user 3 and allows the user 3 to perform activities in the metaverse.

[0029] The VR device 5 includes, for example, a processor 51, a memory 52, an auxiliary storage device 53, a communication unit 54, an audio system 55, a sensor unit 56, an input / output controller 57, a monitor controller 58, a display 59, and a battery 50. In the drawing, the processor is represented as a CPU, but the processor is not limited to a CPU. The processor may include a GPU (Graphics Processing Unit) or an ASIC (Application Specific Integrated Circuit), etc.

[0030] The memory 52 and / or the auxiliary storage device 53 store a predetermined computer program for realizing the functions of the VR device 5. The processor 51 executes the predetermined computer program to realize the function of providing the metaverse to the user.

[0031] Communication unit 54 communicates with metaverse control device 2 via communication network CN2. Sound system 55 includes a microphone and a speaker, and transmits voices from other users using metaverse control device 2 and voices emitted by the user to other users. Metaverse control device 2 can output various sounds, such as warning sounds, warning messages, and calls.

[0032] The sensor unit 56 includes a group of sensors that detect various states of the VR device 5, and transmits detection signals from the group of sensors to the metaverse control device 2. The detection signals from the group of sensors may be transmitted to the metaverse control device 2 as is, or may be processed in some way before being transmitted to the metaverse control device 2. The group of sensors may include, for example, a GPS (Global Positioning System) sensor, an acceleration sensor, a gyro sensor, a vibration sensor, a gaze detection sensor, and a temperature sensor.

[0033] The input / output controller 57 acquires signals according to user operations and transmits them to the metaverse control device 2. The input / output controller 57 includes, for example, a button, a trackpad, a joystick, and the like.

[0034] The monitor controller 58 outputs a video signal to a display 59 placed in front of the user's eyes, and provides the metaverse control device 2 to the user.

[0035] The battery 50 supplies a predetermined amount of power to each of the units 51 to 59 of the VR device 5. The battery 50 may be built into the VR headset, or may be formed separately from the VR headset and worn by the user 3.

[0036] FIG. 3 shows an example of the relationship between integrated metaverse control device 1 and metaverse control device 2. Integrated metaverse control device 1 is generated by integrated metaverse control device generation system 7, which generates integrated metaverse control device 1. Railway company A's metaverse control device 2A is generated by metaverse control device generation system 6A. Similarly, railway company B's metaverse control device 2B is generated by metaverse control device generation system 6B.

[0037] The metaverse control devices 2A and 2B of each company can be independently generated by their respective generation systems 6A and 6B. In this case, the integrated metaverse control device 1 integrates the metaverse control devices 2A and 2B, each with different specifications, at a predetermined level (organizational unit, group unit, route unit, etc.).

[0038] On the other hand, metaverse control device generation systems 6A and 6B can also be generated using the specifications of integrated metaverse control device generation system 1. In this case, since the basic design is common, integrated metaverse control device 1 can more easily integrate metaverse control devices 2A and 2B. Either method may be used in this embodiment.

[0039] 4 is a functional configuration diagram of the metaverse control device 2. The metaverse control device 2 includes, for example, a real-time train position display function 211, a train operation status monitoring function 212, a train schedule management function 213, a track and facility management function 214, an incident management function 221, a communication function 222, a data collection and analysis function 223, an event notification function 224, a cabin crew support function 231, a map display function 232, a vehicle tracking function 233, a device control function 234, an integrated metaverse space provision function 241, a control metaverse object management function 242, a control metaverse room blueprint provision function 243, a network communication function 251, and a user authentication and access control function 252.

[0040] The real-time train position display function 211 is a function for displaying the current position of the train in real time.

[0041] The train operation status monitoring function 212 is a function that monitors the train operation status, delays, etc., and notifies the controller.

[0042] The train schedule management function 213 is a function that manages train operation schedules and makes appropriate operation adjustments. The train schedule management function 213 can also control signals on the tracks.

[0043] The track and facility management function 214 is a function for managing facilities such as tracks, stations, and platforms, and for planning maintenance and repairs.

[0044] The incident management function 221 is a function for managing incidents such as train accidents and breakdowns, and for taking appropriate measures.

[0045] The communication function 222 is a function such as chat and voice call that provides communication between controllers and between train drivers and controllers.

[0046] The data collection and analysis function 223 is a function that collects and analyzes train operation data, contributing to improving the efficiency and safety of operations.

[0047] The event notification function 224 is a function for notifying important events and alerts that affect train operations.

[0048] The cabin attendant support function 231 is a function that supports cabin attendants and contributes to passenger service and safety on the train.

[0049] The map display function 232 is a function that displays maps of railway lines, stations, and facilities, allowing the controller to grasp the position and route of the train.

[0050] The vehicle tracking function 233 is a function that tracks the vehicle information and status of each train and contributes to operation management.

[0051] The device control function 234 is a function that controls signals, points, etc., and manages train operations.

[0052] The network communication function 251 is a function for communicating with other devices (for example, the VR device 5).

[0053] The user authentication and access control function 252 is a function that manages the accounts of air traffic controllers and controls access according to their authority.

[0054] The integrated metaverse space provision function 241 is a function that integrates the virtual spaces of different metaverse control devices 2 and provides data for reconstructing them into a single metaverse. This function 241 seamlessly integrates different virtual spaces and systems. This function 241 allows users to move transparently between different metaverse control devices 2, synchronizes user avatars and content in an integrated environment, and provides a consistent user experience.

[0055] The control metaverse object management function 242 is a function that manages objects used in the metaverse control device 2. The metaverse control device 2 (virtual control room) needs to manage objects and resources in the virtual space. This function 242 centrally manages the objects and resources used in each metaverse control device 2, and appropriately arranges and manages a group of objects in the integrated virtual space. For example, this function 242 can integrate objects such as buildings, scenery, and avatars in the control room and provide them to the user in an organized state.

[0056] The control metaverse room blueprint provision function 243 is a function that provides the blueprints of the metaverse control device 2 to the integrated metaverse control device 1. When multiple metaverse control devices 2 each have their own virtual space or system, design information is required to integrate those metaverse control devices 2 into one. This function 243 collects the blueprints and structures of the virtual spaces of each metaverse control device 2 and provides an integrated blueprint for integrating them into one.

[0057] 5 is an explanatory diagram of design information for the metaverse control device 2. The metaverse control device 2 has a control room 200 set up in a virtual space, in which a display 202, an avatar 31 of a controller 3, and the like are placed.

[0058] Here, important information when integrating multiple metaverse control devices 2 generated with different specifications into one includes the floor area, length and width dimensions, height dimensions, dimensions and placement of openings (windows, doors, etc.) of the metaverse control device 2, and the coordinates of intersections 201 that can serve as connection points. By setting the height of the controller 3's avatar 31 in the metaverse to a preset standard height and adjusting the values ​​of each dimension to match that standard height, the spaces (control rooms) 200 of different metaverse control devices 2 can be seamlessly connected.

[0059] FIG. 6 shows an example of the control metaverse object management function 242 that manages objects used in the metaverse control device 2.

[0060] This management function 242 manages objects using items such as a target 2421, a role 2422, a role 2423, a content 2424, an ID (identification information) 2425, and a location 2426, for example.

[0061] Target 2421 is the type of target of the object. Target types include, for example, people and things. Role 2422 is a name that distinguishes the object by its role. Roles include, for example, controller, assistant controller, room, display, desk, keyboard, etc. Role 2423 is information indicating the role of the object.

[0062] The content 2424 is a supplementary explanation of the object. For example, for the object "controller," there are the actual hours worked as a controller, the number of serious disasters handled, the average time required to respond to one disaster, etc. For example, if a controller of a certain railway company A requests access to the metaverse control device 2B of another railway company B, the person in charge of managing the access rights to the metaverse control device 2B of Company B can decide whether to grant access rights based on the "content" of the controller of Company A. The "content" of the "display" may display, for example, the current position and progress of the train, the vehicle's signal status, schedule and operation information, information on disruptions and delays, communication and contact information, etc.

[0063] ID 2425 is information that uniquely identifies an object. Placement location 2426 indicates a location where the object can be placed in the metaverse. A human-like avatar such as an air traffic controller can be placed anywhere as long as it does not interfere with other objects. Physical objects (displays, windows, desks, keyboards, etc.) have clearly defined installation locations.

[0064] 7 is a functional configuration diagram of the integrated metaverse control device 1. The integrated metaverse control device 1 includes, for example, a version management function 111, an interface customization function 112, a communication function 113, a security function 121, an event management function 122, a voice / video recognition function 123, a simulation function 131, a data analysis function 132, a data sharing function 133, a control metaverse object management function 141, a personal comprehensive metaverse reintegration function 142, an integrated metaverse space creation / operation function 143, a network communication function 151, a user authentication / authorization function 152, a metaverse connection function 153, a real-time data synchronization function 154, and a device control function 155.

[0065] The version management function 111 is a function that manages changes and updates to the metaverse space and can restore it to a previous state.

[0066] The interface customization function 112 allows controllers to customize the interface according to their individual needs and environment. The communication function 113 is a chat and voice call function that enables real-time communication between controllers and between controllers and other related parties.

[0067] The security function 121 is a function for managing access to highly confidential data and systems and ensuring the safety of information.

[0068] The event management function 122 is a function that manages events and alerts that occur in each of the integrated metaverse control devices 2 and notifies the controller.

[0069] The voice / video recognition function 123 is a function for recognizing voice and video. The controller can issue commands and give instructions by voice within the metaverse.

[0070] The simulation function 131 is a function that executes simulations of train operation and abnormal conditions, and allows controllers to respond to abnormal situations and conduct training. Although not shown in the figure, the integrated metaverse control device 1 may also have a report generation function. The report function is a function that generates reports from operation data, event logs, etc., and provides them to managers and related parties.

[0071] The data analysis function 132 is a function that collects and analyzes data in the metaverse space to evaluate train operation status and system performance.

[0072] The data sharing function 133 is a function that allows controllers to share data and information within the metaverse space and work together.

[0073] The control metaverse object management function 141 is a function for managing objects used in the metaverse control device 1.

[0074] The personal integrated metaverse reintegration function 142 is a function that provides an integrated metaverse control device 1 for each controller of each company. In other words, the integrated metaverse control device 1 integrates the metaverse control devices 2 of each company, and at the same time, adjusts the access range for each controller and provides an integrated metaverse control device 1 for each controller.

[0075] The integrated metaverse space creation / operation function 143 is a function that creates and operates the space of the integrated metaverse control device 1.

[0076] The network communication function 151 is a function for communicating with each metaverse control device 2 via the communication network CN1.

[0077] The user authentication and authorization function 152 is a function that manages the accounts and access rights of controllers, and performs user authentication and management between each of the integrated metaverse control devices 2.

[0078] The metaverse connection function 153 is a function that integrates a plurality of metaverse control devices 2 and enables a controller with access authority to access each metaverse control device 2.

[0079] The real-time data synchronization function 154 is a function that synchronizes information from each integrated metaverse control device 2 (control room as metaverse space) in real time and shares data such as train positions and operation status.

[0080] The device control function 155 is a function for controlling devices and equipment used in the metaverse space. Device control includes, for example, control of traffic lights and sensors.

[0081] Fig. 8 shows details of the personalized integrated metaverse reintegration function 142 in Fig. 7. The reintegration function 142 includes, for example, a customization interface function 1421, an object addition / deletion function 1422, an object arrangement change function 1423, a custom avatar function 1424, a theme / skin change function 1425, a scene save / load function 1426, an object arrangement save function 1427, a collaboration function 1428, a plug-in / extension function 1429, a grouping function 142A, a personal viewing information provision function 142B, and a personal viewing information recording function 142C.

[0082] The customization interface function 1421 is a function that provides an interface for the user to customize the appearance and layout of the metaverse space.

[0083] The object addition / deletion function 1422 is a function that allows a user to add a new object to the metaverse space or delete an existing object.

[0084] The object rearrangement function 1423 allows the user to rearrange objects in the metaverse, allowing the user to tailor the metaverse to suit the preferences and needs of their company.

[0085] The custom avatar function 1424 is a function that allows a user to customize their own avatar and change its appearance and behavior within the metaverse space.

[0086] The theme / skin change function 1425 is a function that allows the user to change the theme or skin of the metaverse space and customize the appearance.

[0087] The scene save / load function 1426 is a function that allows a user to save a scene in the metaverse space that he or she has created and share it with other users.

[0088] The object placement saving function 1427 is a function for saving information on the placement of objects in the metaverse.

[0089] The collaboration function 1428 is a function that allows multiple users to simultaneously edit the metaverse space and work together.

[0090] Plug-ins / extensions 1429 is a function that allows a user to add various plug-ins and extensions to the metaverse space to extend its functionality.

[0091] The grouping function 142A is a function for creating groups of people involved, regardless of whether they are from the same company or another company. Examples of groups include a route-based group, an accident response group, a manager group, and a media group.

[0092] Personal viewing information provision function 142B is a function that provides information viewed by a user's avatar in the metaverse to other users. For example, a security officer at a railway company can monitor information viewed by other users in almost real time.

[0093] The personal viewing information recording function 142C is a function for recording information that a user's avatar has viewed within the metaverse.

[0094] FIG. 9 shows the process of integrating multiple metaverse control devices 2 into one. The multiple metaverse control devices 2 are referred to as X Company's metaverse control devices 2. Here, we will explain the case where a metaverse control device 2A of Company A and a metaverse control device 2B of Company B are integrated. The following explanation can also be applied to the case where metaverse control devices 2 of three or more companies are integrated into one.

[0095] Integrated metaverse space creation / operation function 143 is provided with design plan information for Company A's metaverse control device 2A from Company A's control metaverse room design plan provision function 243A (S100), and is also provided with design plan information for Company B's metaverse control device 2B from Company B's control metaverse room design plan provision function 243B (S101). The order of provision does not matter.

[0096] The integrated metaverse space creation / operation function 143 reads the blueprint information of each control metaverse room (S102), integrates the control rooms of each metaverse control device 2A, 2B based on the blueprint information (S103), and constructs an integrated object (S104).

[0097] The integrated metaverse space creation / operation function 143 provides the configured integrated metaverse environment to the integrated metaverse space provision function 241B of Company B and the integrated metaverse space provision function 241A of Company A (S105, S106). The order of provision does not matter.

[0098] As a result, a controller using Company A's metaverse control device 2A can access Company B's metaverse control device 2B through the integrated metaverse space to the extent necessary. Similarly, a controller using Company B's metaverse control device 2B can also access Company A's metaverse control device 2A through the integrated metaverse space to the extent necessary.

[0099] 10 is a sequence diagram showing the access control process. When a user 3, such as a controller, logs in to use his or her company's metaverse control device 2 (S110), the user authentication and access control function 252 performs user authentication. If the user authentication is successful (S111), the control metaverse object management function 242 requests the integrated metaverse space creation / operation function 143 of the integrated metaverse control device 1 to create an integrated metaverse (S112).

[0100] The integrated metaverse space creation / operation function 143 refers to the information of the user 3 who desires access (S113), and requests the individual integrated metaverse reintegration function 142 to reintegrate the integrated metaverse for that user.

[0101] The personal integrated metaverse reintegration function 142 checks the information of the group to which the user 3 belongs (S114) and places the object corresponding to the identified group in the integrated metaverse space (S115). To do this, the personal integrated metaverse reintegration function 142 deletes, adds, and modifies objects. As a result, an integrated control metaverse is provided according to the group to which the user 3 belongs (S115, S117).

[0102] 11 shows an example of the user authentication and access control function 252. This function 252 manages items such as a group name 2521, a role 2522, a recruitment control metaverse 2523, a group owner 2524, a regular member 2525, and an associate member 2526, for example.

[0103] Group name 2521 is, for example, a company-specific group such as "Company A Control," or a group of users in charge of a specific role such as "Signal Control Group" or "Railway and Facility Management Group." Role 2522 indicates the role of each group. Adopted Control Metaverse 2523 is information identifying the metaverse control device that adopts the group. Group owner 2524 is information identifying the user who has ownership of the group. Full member 2525 is information identifying users who can move freely within the group's control metaverse space. Associate member 2526 is information identifying users who can move except for a portion of the group's metaverse space. For example, a user who is permitted to enter the control metaverse for a short period of time, such as a member of the press, becomes an associate member.

[0104] Here, if we look at the regular members 2525 of "Signal Control G" and "Railway and Facility Management G", they contain the IDs of users belonging to different companies. "Signal Control G", for which Company A has management authority (ownership), includes not only users of Company A but also users of Company B. Therefore, a specific signal control can be handled collaboratively by users (controllers) of Company A and users (controllers) of Company B. "Railway and Facility Management G", for which Company B has management authority, includes not only users of Company B but also users of Company A as regular members. Therefore, a specific railway or facility can be managed collaboratively by users of Company A and users of Company B.

[0105] Fig. 12 is a schematic diagram showing the state of an integrated metaverse control device 1. When multiple metaverse control devices 1 are integrated, an unrestricted user can see multiple displays 101, 102, and 103, multiple consoles 104, 105, 106, and 107, and avatars 31(1) to 31(5) of other users, as shown in Fig. 12.

[0106] 13 shows how the configuration of the integrated metaverse control device 1 changes depending on the access authority of the user. Since the integrated metaverse control device 1 controls the configuration of the integrated metaverse control device 1 according to the access authority of the user, the dotted line portion in FIG. 13 is not provided to some users.

[0107] Figure 14 shows how only specific systems from among the multiple systems held by each metaverse control device 2 are collected and integrated. Figure 14 shows how, for example, only traffic management systems are collected and integrated from among the systems held by each company's metaverse control device 2. Only the controllers of each company in charge of the traffic management systems can view and operate the status of the traffic management systems that are shared between them.

[0108] FIG. 15 shows how multiple metaverse control devices 2 are connected in series to form an integrated metaverse control device 1. For example, metaverse control devices 2 for each railway company can be arranged in a ring or polygonal shape. Users who enter the accessible space inside each metaverse control device 2 can view and operate the information displayed by the metaverse control device 2 for which they have authorization. FIG. 15 shows how three of the five metaverse control devices 2, metaverse control devices 2A to 2C, are connected together.

[0109] As shown in Figure 16, multiple systems (functions) possessed by multiple metaverse control devices 2 can also be integrated. The examples shown on the left side of Figure 16 show the following cases: when only the real-time train position systems of each metaverse control device 2 are integrated into one; when only the train schedule management functions of each metaverse control device 2 are integrated into one; when only the signal control functions of each metaverse control device 2 are integrated into one; when only the incident management functions of each metaverse control device 2 are integrated into one; and when only the vehicle tracking functions of each metaverse control device 2 are integrated into one. In Figure 16, the names of the functions have been simplified.

[0110] As shown on the right side of Figure 16, a user who is only permitted to access the real-time train location system cannot access (view or operate) any other system.

[0111] FIG. 17 is a sequence diagram showing a process in which only users permitted by the group owner can view the integrated metaverse control device.

[0112] When a user 3 (hereinafter also referred to as a participant 3) who wishes to participate in a certain group accesses the metaverse control device 2 of the company (S201), the user authentication and access control function 252 performs user authentication of the participant 3.

[0113] If user authentication of the participant 3 is successful, the application to join the group is transmitted to the integrated metaverse space creation / operation function 143 of the integrated metaverse control device 1 via the control metaverse object management function 242 (S202).

[0114] The personal integrated metaverse reintegration function 142 determines whether the person wishing to join 3 has been granted permission to join the group, and if not, notifies the group owner 3OW, who is the owner of the group, that the person wishing to join the group has requested to join (S203).

[0115] When the group owner 3OW allows the participant 3 to join the group (S204), the integrated metaverse space creation / operation function 143 allows the participant 3 to join the group (S205) and notifies the personal integrated metaverse re-integration function 142.

[0116] The personal integrated metaverse reintegration function 142 records that the participant wishing to join 3 has been permitted to join the group, and notifies the participant wishing to join 3 (S207).

[0117] The group owner 3OW can set conditions for group participation, such as allowing participation for a certain period of time, not allowing comments, and prohibiting the copying of images.

[0118] FIG. 18 is a sequence diagram showing a function that allows another user 3(2) to check the visibility status of a certain user 3(1) in real time.

[0119] For example, to ensure reliability and security, another user 3(2), such as an administrator, can monitor in real time what a certain user 3(1) is viewing. The administrator, or other user 3(2), can also check what the user 3(1) viewed and when using the personal viewing information recording function 142C described in FIG.

[0120] According to this embodiment, which is configured in this manner, the control devices that control the train operations of different railway companies are metaverseized to prepare a metaverse control device 2, and these metaverse control devices can be integrated into a single integrated metaverse control device 1.

[0121] In this embodiment, a single integrated metaverse control device 1 can be generated with minimal modification to existing metaverse control devices 2, and each metaverse control device 2 can be linked to share information in real time, improving usability and reliability.

[0122] In this embodiment, real-time information sharing is realized, while the access range of users who can use the integrated metaverse control device 1 is managed, so that users who use the integrated metaverse control device 1 can share information only to the extent necessary. This makes it possible to maintain the security of the integrated metaverse control device 1 and increase its reliability.

[0123] In this embodiment, an existing metaverse control device is connected to other existing metaverse control devices at a predetermined level (function unit, system unit, organization unit, group unit, etc.), thereby making it possible to obtain an integrated metaverse control device while reducing construction costs and operating costs.

[0124] In this embodiment, the functions of the metaverse control device can be expanded, changed, or restricted depending on the user's access authority, making it possible to provide an integrated metaverse control device with different specifications for each user. This eliminates the need to share information that is unnecessary for the user, improving usability for that user. Furthermore, because the scope of information sharing is controlled for each user, the risk of information leakage can be reduced.

[0125] In this embodiment, users such as administrators can check the viewing status of, for example, controllers from other companies or users who have been temporarily allowed to participate in real time or in logs, thereby further improving reliability and security. [Example]

[0126] A second embodiment will be described with reference to Figures 19 to 25. In this embodiment, an example of generating an integrated object will be described.

[0127] Figure 19 shows the concept of integrating the traffic control systems of multiple metaverse control devices 2. Railway company A and railway company B share a specific line, and the example illustrates the case where the route map of company B shown on the left and the route map of company A shown on the right are connected.

[0128] FIG. 20 is an explanatory diagram for setting a mutual access point in a traffic control system. Information about the access node on Company B's route map includes, for example, coordinates, whether it is a single track or double track, and the name of the company that will be using the access. The same applies to information about the access node on Company A's route map. When setting up an access point, the controller as a user specifies the mutual access point.

[0129] Fig. 21 is an example of an object configuration table T242B that manages objects used in the traffic control system of Company B. Fig. 22 is an example of an object configuration table T242A that is used in Company A's traffic control system.

[0130] Both the object configuration tables T242B and T242A include items such as "object element," "shape," "color," and "other," for example.

[0131] "Object elements" are elements displayed on a route map, such as stations, routes, trains, etc. "Trains" can also be classified according to their status, such as running, stopped, delayed, etc.

[0132] "Shape" refers to, for example, the shape of the object to be displayed. "Color" refers to, for example, the color of the object. "Other" refers to the font size when the object is accompanied by text. Dynamic objects may be used in addition to static objects.

[0133] Fig. 23 shows details of the integrated object configuration step S104 in Fig. 9. The integrated metaverse space creation / operation function 143 acquires each object configuration table T242B, T242A related to access (S1041), and creates an integrated object configuration table T141 (described later in Fig. 24) (S1042).

[0134] The integrated object configuration table T141 shown in Fig. 24 includes items such as "object element," "shape," "color," and "other." The contents of each item are as described in Figs.

[0135] The values ​​of "shape," "color," and "other" are set for the integrated object used in the integrated metaverse control device 1 so that it does not overlap with the objects used in each of the integrated metaverse control devices 2. For example, the color of the integrated object element may be an intermediate color between the colors of the object elements used in the metaverse control device 2.

[0136] FIG. 25 shows an example of a display in which the traffic control systems of multiple metaverse control devices 2 are integrated.

[0137] The present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with the configuration of another embodiment. Furthermore, each embodiment can be combined as appropriate unless there is an obvious contradiction.

[0138] This embodiment includes the following configurations.

[0139] (Configuration 1) An information processing device that integrates control operations using a metaverse environment, comprising a processor, a memory used by the processor, and a communication unit, wherein a control device that controls the operation of mobile objects belonging to multiple organizations is a metaverse control device installed in the metaverse environment, and the processor executes a predetermined computer program stored in the memory to acquire design information for the multiple metaverse control devices via the communication unit and store it in the memory, and based on the acquired design information, constructs an integrated metaverse of the multiple metaverse control devices connected at a predetermined level, and places objects used in the multiple metaverse control devices in the integrated metaverse.

[0140] (Configuration 2) The integrated metaverse control device according to Configuration 1, which integrates and arranges objects used in the plurality of metaverse control devices in the integrated metaverse.

[0141] (Configuration 3) An integrated metaverse control device described in either configuration 1 or 2, wherein the multiple metaverse control devices have multiple functions, and the specified level relates to a specified function selected from the multiple functions.

[0142] (Configuration 4) An integrated metaverse control device described in any one of configurations 1 to 3, wherein the multiple metaverse control devices are used by multiple organizations, and the specified level relates to a specified organization selected from the multiple organizations.

[0143] (Configuration 5) An integrated metaverse control device described in any one of configurations 1 to 4, wherein the multiple metaverse control devices are used by multiple groups, and the specified level relates to a specified group selected from the multiple groups.

[0144] (Configuration 6) The integrated metaverse control device according to any one of configurations 1 to 5, further comprising an access control unit that controls access to objects in the integrated metaverse.

[0145] (Configuration 7) An integrated metaverse control device described in any one of configurations 1 to 6, in which an integration destination metaverse in which an integration destination metaverse control device in which an integration source metaverse control device is installed is connected and expanded to an integration source metaverse in which an integration destination metaverse control device in which an integration destination metaverse control device is installed.

[0146] (Configuration 8) An integrated metaverse control device according to any one of configurations 1 to 7, having a function that enables a user's visibility status to be confirmed in real time or by a log.

[0147] (Configuration 9) An information processing method for integrating control operations using a metaverse environment with a computer, wherein a control device that controls the operation of mobile objects belonging to multiple organizations is realized as a metaverse control device installed in the metaverse environment, the computer having a processor, memory and a communication unit used by the processor, and the information processing method includes the steps of: acquiring design information for the multiple metaverse control devices by the processor executing a predetermined computer program stored in the memory; constructing an integrated metaverse connected at a predetermined level among the multiple metaverse control devices based on the acquired design information; and placing objects used in the multiple metaverse control devices in the integrated metaverse.

[0148] (Configuration 10) In the step of placing objects used by the multiple metaverse control devices in the integrated metaverse, an integrated control metaverse generation method as described in Configuration 1 is used to integrate and place objects used by the multiple metaverse control devices. [Explanation of symbols]

[0149] 1: Integrated Metaverse Control Device, 2: Metaverse Control Device, 5: VR Equipment

Claims

1. An information processing device that integrates air traffic control operations using a metaverse environment, A processor, a memory and a communication unit used by the processor, The control device that controls the operation of vehicles belonging to multiple organizations is a metaverse control device installed in the metaverse environment. The processor executes a predetermined computer program stored in the memory, acquiring design information of the plurality of metaverse control devices via the communication unit and storing the acquired design information in the memory; Based on the acquired design information, an integrated metaverse is constructed in which the plurality of metaverse control devices are connected at a predetermined level; Placing objects used by the plurality of metaverse control devices in the integrated metaverse. Information processing device.

2. The objects used in the plurality of metaverse control devices are integrated and arranged in the integrated metaverse. The information processing device according to claim 1 .

3. The plurality of metaverse control devices have a plurality of functions, The predetermined level relates to a predetermined function selected from the plurality of functions. The information processing device according to claim 1 .

4. the plurality of metaverse control devices are used by a plurality of organizations; The predetermined level is related to a predetermined organization selected from the plurality of organizations. The information processing device according to claim 1 .

5. the plurality of metaverse control devices are used by a plurality of groups; the predetermined level relates to a predetermined group selected from the plurality of groups, The information processing device according to claim 1 .

6. an access control unit for controlling access to objects in the integrated metaverse; The information processing device according to claim 1 .

7. The source metaverse, which is provided by the source metaverse control device among the plurality of metaverse control devices, is connected to and expanded by the destination metaverse, which is provided by the destination metaverse control device. The information processing device according to claim 1 .

8. It has a function that allows users to check their visibility in real time or through logs. The information processing device according to claim 1 .

9. An information processing method for integrating air traffic control operations using a metaverse environment by a computer, comprising: A control device that controls the operation of mobile objects belonging to multiple organizations is realized as a metaverse control device provided in a metaverse environment, and the computer includes a processor, a memory and a communication unit used by the processor, and the processor executes a predetermined computer program stored in the memory to acquire design information for the multiple metaverse control devices; A step of configuring an integrated metaverse in which the plurality of metaverse control devices are connected at a predetermined level based on the acquired design information; placing objects used by the plurality of metaverse control devices in the integrated metaverse; is executed Information processing methods.

10. In the step of arranging the objects used by the plurality of metaverse control devices in the integrated metaverse, the objects used by the plurality of metaverse control devices are integrated and arranged. The information processing method according to claim 9.

Images