Information processing method, program, and information processing system

Abstract

Provided is an information processing method executed by a computer, in which when an event occurs in one or more moving bodies among a plurality of moving bodies that autonomously move, a coping person should rush to the position of the moving body for coping (YES in S103), and the coping person should rush to the position of the moving body to cope with the event. In the present invention, first information relating to a service executed by each of one or more moving bodies is obtained (S104), on the basis of the obtained first information, a dealing necessity indicating the degree to deal with an event is calculated for each of the one or more moving bodies (S105), and second information relating to the calculated dealing necessity is output (S106).

Description

Technical Field

[0001] The present disclosure relates to an information processing method, a program, and an information processing system for outputting information related to a mobile object that moves by autonomous movement. Background Art

[0002] When a moving object that moves by autonomous movement becomes unable to move autonomously for some reason, it is necessary to send a response person to the scene in order to quickly restore or recover the moving object or to prevent the moving object from interfering with traffic.

[0003] Patent document 1 discloses a management system that manages the vehicle status of an autonomous driving vehicle by periodically communicating with the autonomous driving vehicle through an autonomous driving support center. In the management system, when the communication between the autonomous driving support center and the autonomous driving vehicle is interrupted, it is determined whether to contact a supporter supporting the autonomous driving vehicle based on the communication status.

[0004] (Prior art literature)

[0005] (Patent Document)

[0006] Patent Document 1: International Publication No. 2021 / 085101 Summary of the invention

[0007] Problems to be solved by the invention

[0008] However, Patent Document 1 does not envision a situation where the communication between the autonomous driving support center and the plurality of autonomous driving vehicles is interrupted, that is, a situation where autonomous movement becomes difficult for each of the plurality of moving bodies. Therefore, the problem with the technology disclosed in Patent Document 1 is that when a situation where autonomous movement becomes difficult for each of the plurality of moving bodies occurs, the supporter (response personnel) cannot efficiently improve the situation.

[0009] Therefore, the present disclosure provides an information processing method and the like that enables a responding person to easily and efficiently improve a situation in which a situation becomes difficult for each of a plurality of moving bodies to move autonomously.

[0010] Means for solving problems

[0011] An information processing method involved in one embodiment of the present invention is an information processing method executed by a computer. In the information processing method, when the following events occur in one or more mobile bodies among a plurality of mobile bodies performing autonomous movement, first information related to services performed by each of the one or more mobile bodies is obtained, the event being an event for which response personnel should rush to the location of the mobile body to respond, and based on the obtained first information, a necessary degree of response is calculated for each of the one or more mobile bodies, the necessary degree of response indicating the degree to which the event should be responded to, and second information related to the calculated necessary degree of response is output.

[0012] In addition, these general or specific methods can be implemented by systems, methods, integrated circuits, computer programs, or computer-readable recording media such as CD-ROMs, or by any combination of systems, methods, integrated circuits, computer programs, and recording media.

[0013] Effects of the Invention

[0014] According to the information processing method and the like according to one embodiment of the present disclosure, when a situation occurs in which autonomous movement becomes difficult for each of a plurality of moving objects, a responding person can easily and efficiently improve the situation. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a block diagram showing an example of the information processing system involved in Embodiment 1.

[0016] Figure 2 An example of service information is shown.

[0017] Figure 3 This is a flowchart showing a basic operation example of the information processing system involved in the first embodiment.

[0018] Figure 4 This is a flowchart showing an example of a determination operation of whether or not a response by a response person is required in the information processing system according to the first embodiment.

[0019] Figure 5 This is a flowchart showing an example of the operation of calculating the required degree of response in the information processing system according to the first embodiment.

[0020] Figure 6 An example of position information is shown.

[0021] Figure 7 An example of status information is shown.

[0022] Figure 8This is a flowchart showing a first operation example of the information processing system according to the first embodiment.

[0023] Fig. 9 This is a flowchart showing an operation example of calculating the required degree of response in the first operation example.

[0024] Fig.10 This is a flowchart showing another example of calculation operation of the required degree of response in the first example of operation.

[0025] Fig.11 An evaluation example of a phenomenon occurring in a moving object is shown.

[0026] Fig.12 An example of the response personnel information is shown.

[0027] Fig.13 This is a flowchart showing a second operation example of the information processing system according to the first embodiment.

[0028] Fig.14 It is a flowchart of a calculation operation example showing the response procedure in the second operation example.

[0029] Fig.15 An example of position information and the degree of necessity of response is shown.

[0030] Fig.16 A first example of an image displayed on the display unit of the information terminal is shown.

[0031] Fig.17 A second example of an image displayed on the display unit of the information terminal is shown.

[0032] Fig.18 This is a block diagram showing an example of an information processing system according to the second embodiment.

[0033] Fig.19 Another example of the service information is shown.

[0034] Fig. 20 This is a flowchart showing a first operation example in the information processing system according to the second embodiment.

[0035] Fig.21 An example of surrounding information is shown.

[0036] Fig. 22 This is a flowchart showing an operation example of calculating the required degree of response in the first operation example.

[0037] Fig.23 This is a flowchart showing a second operation example in the information processing system according to the second embodiment.

[0038] Fig.24 This is a flowchart showing a third operation example in the information processing system according to the second embodiment.

[0039] Fig.25 An example of process information is shown.

[0040] Fig.26 An example of allocation of response personnel is shown.

[0041] Fig. 27 A third example of an image displayed on the display unit of the information terminal is shown.

[0042] Fig.28 A fourth example of an image displayed on the display unit of the information terminal is shown.

[0043] Fig.29 A fifth example showing an image displayed on the display unit of the information terminal

[0044] Fig.30 A sixth example of an image displayed on the display unit of the information terminal is shown.

[0045] Fig.31 A seventh example of an image displayed on the display unit of the information terminal is shown.

[0046] Fig.32 An eighth example of an image displayed on the display unit of the information terminal is shown.

[0047] Fig.33 A ninth example of an image displayed on the display unit of the information terminal is shown.

[0048] Fig.34 An example of an image displayed on the display unit of the operator terminal is shown. DETAILED DESCRIPTION

[0049] An information processing method involved in one embodiment of the present invention is an information processing method executed by a computer. In the information processing method, when the following events occur in one or more mobile bodies among a plurality of mobile bodies performing autonomous movement, first information related to services performed by each of the one or more mobile bodies is obtained, the event being an event for which response personnel should rush to the location of the mobile body to respond, and based on the obtained first information, a necessary degree of response is calculated for each of the one or more mobile bodies, the necessary degree of response indicating the degree to which the event should be responded to, and second information related to the calculated necessary degree of response is output.

[0050] According to this, the responding personnel refer to the second information, for example, when an event occurs in each of a plurality of moving bodies.

[0051] , it is possible to determine which mobile body should be prioritized for response. Therefore, there is an advantage that when a situation occurs in which autonomous movement becomes difficult in each of the multiple mobile bodies, the responding personnel can easily and efficiently improve the situation.

[0052] For example, third information on the states of the respective moving objects may be further obtained, and whether the event has occurred may be determined for each of the moving objects based on the obtained third information.

[0053] According to this, the information indicating that an event has occurred in each of one or more moving objects can be obtained through the own system.

[0054] For example, the third information may include information indicating whether each of the plurality of moving objects is capable of autonomous movement.

[0055] This makes it easy to determine whether an event has occurred in each of one or more moving objects.

[0056] For example, the plurality of moving objects may be movable by remote control performed by an operator, and the third information may include information indicating whether each of the plurality of moving objects can communicate with the operator.

[0057] According to this, whether or not an event has occurred can also be determined for a movable object that can be moved by remote control by an operator.

[0058] For example, the first information may include information indicating whether the service is being executed, information indicating a scheduled end time of the service, or information indicating a priority of the service, with respect to each of the one or more mobile bodies.

[0059] This makes it easy to improve the accuracy of calculating the required degree of response for each of one or more moving objects.

[0060] For example, it may be possible to further obtain third information related to the respective states of the one or more mobile bodies and fourth information related to the respective positions of the one or more mobile bodies, and further calculate the necessary degree of response for each of the one or more mobile bodies based on the obtained third information and fourth information.

[0061] This makes it easy to improve the accuracy of calculating the required degree of response for each of one or more moving objects.

[0062] For example, it is also possible to further obtain the fifth information related to the position of the response personnel, and calculate the response order in which the response personnel should respond to the one or more mobile bodies based on the calculated degree of necessary response, the obtained fourth information, and the obtained fifth information.

[0063] According to this, by referring to the response order, when an event occurs in each of a plurality of moving bodies, for example, the responding personnel do not need to judge by themselves which moving body should be responded to first with priority.

[0064] For example, sixth information on the presence or absence of surrounding objects of each of the one or more moving bodies may be further obtained, and the degree of necessary response may be calculated for each of the one or more moving bodies based on the obtained sixth information.

[0065] This makes it easy to improve the accuracy of calculating the required degree of response for each of one or more moving objects.

[0066] For example, operator input information including the required degree of response specified by an operator may be further obtained, and the required degree of response may be calculated for each of the one or more moving bodies based on the obtained operator input information.

[0067] According to this, the degree of necessity of the response for each of one or more moving objects can be calculated in consideration of the instruction given by the operator.

[0068] For example, the second information may be output to an information terminal used by the responding personnel, and the second information may be displayed on a display unit included in the information terminal.

[0069] According to this, the responding personnel can judge which moving object should be responded to first by looking at the display unit of the information terminal.

[0070] For example, the information indicating the degree of necessary response of each of the one or more moving objects and a map indicating the position of each of the one or more moving objects may be displayed on the display unit.

[0071] According to this, the responding personnel can easily determine which moving object should be prioritized for response by looking at the display unit of the information terminal.

[0072] For example, fifth information related to the position of the response personnel may be further obtained, and the response order in which the response personnel should respond to the one or more mobile bodies may be calculated based on the calculated degree of necessary response and the obtained fifth information, and information showing the response order may also be displayed on the display unit.

[0073] According to this, the responding personnel do not need to judge which moving object should be prioritized for response by themselves by looking at the display unit of the information terminal.

[0074] For example, when the response personnel inputs through the information terminal an indication that a response is to be taken with respect to a certain moving body among the one or more moving bodies, response information indicating that the moving body is being responded to is output to the operator terminal used by the operator, and an image captured by the moving body and the response information are displayed on a display unit of the operator terminal.

[0075] According to this, the operator can understand the moving object that the responding personnel are responding to by viewing the display unit of the operator terminal.

[0076] A program according to one aspect of the present disclosure is for causing a computer to execute the above-mentioned information processing method.

[0077] This has the advantage that, by referring to the second information, the responding personnel can determine which mobile body should be responded to first when, for example, an event occurs in each of the plurality of mobile bodies. Therefore, when a situation occurs in which autonomous movement becomes difficult in each of the plurality of mobile bodies, the responding personnel can easily and efficiently improve the situation.

[0078] An information processing system according to one embodiment of the present disclosure includes an acquisition unit, a processing unit, and an output unit. The acquisition unit acquires first information related to services performed by each of the one or more mobile bodies when the following event occurs in one or more mobile bodies among a plurality of mobile bodies performing autonomous movement, wherein the event refers to an event for which a response personnel should rush to the location of the mobile body to respond. The processing unit calculates a necessary response degree for each of the one or more mobile bodies based on the first information acquired by the acquisition unit, wherein the necessary response degree indicates the degree to which the event should be responded to. The output unit outputs second information related to the necessary response degree calculated by the processing unit.

[0079] This has the advantage that, by referring to the second information, the responding personnel can determine which mobile body should be responded to first when, for example, an event occurs in each of the plurality of mobile bodies. Therefore, when a situation occurs in which autonomous movement becomes difficult in each of the plurality of mobile bodies, the responding personnel can easily and efficiently improve the situation.

[0080] Hereinafter, the embodiments will be described in detail with reference to the drawings.

[0081] In addition, the embodiments to be described below are all general or specific examples. The values, shapes, materials, components, configuration positions of components, connection methods, steps, and order of steps shown in the following embodiments are all examples, and their purpose is not to limit the present disclosure.

[0082] (Implementation Method 1)

[0083] Hereinafter, the information processing system and the information processing method according to the first embodiment will be described.

[0084] [1. Composition]

[0085] Figure 1 1 is a block diagram showing an example of the information processing system 1 according to Embodiment 1. The information processing system 1 is a system for outputting information on a moving object 2 that moves by autonomous movement.

[0086] The moving body 2 includes, for example, an autonomous mobile robot such as an automatic delivery robot. The moving body 2 only needs to be an autonomous mobile body, and may include, for example, vehicles other than robots, such as cars or motorcycles. Furthermore, in Embodiment 1, the moving body 2 is not a completely autonomous mobile body, but a mobile body remotely monitored by an operator via a remote control system. Therefore, the moving body 2 can be moved by remote control performed by an operator via a remote control system according to the situation. In the following, the moving body 2 will be described as an automatic delivery robot, especially an automatic delivery robot that moves on a sidewalk instead of a roadway. Of course, the moving body 2 may also be an automatic delivery robot that moves on a roadway.

[0087] Here, the remote control system is a system that is operated in a remote control center or a server device where a plurality of operators are located, and is a system for each operator to remotely monitor a plurality of moving objects 2 or remotely operate them according to the situation. Each operator uses an operator terminal composed of an information terminal such as a personal computer to monitor the status of each moving object 2 displayed on a display attached to the operator terminal. And, each operator remotely operates the moving object 2, for example, when the moving object 2 issues a request for remote operation or when it is determined that the moving object 2 is in a state where the remote operation should be accepted.

[0088] The information processing system 1 is an example of a computer that executes the information processing method. The components constituting the information processing system 1 may be arranged in a single frame or in a distributed configuration. When the components constituting the information processing system 1 are distributed, the information processing method may be executed by a plurality of computers. In the first embodiment, the information processing system 1 is implemented by a server device.

[0089] like Figure 1 As shown, the mobile body 2 includes a communication unit 21, a position acquisition unit 22, a state acquisition unit 23, a processing unit 24, a remote operation control unit 25, and an automatic driving control unit 26. The communication unit 21, the position acquisition unit 22, the state acquisition unit 23, the processing unit 24, the remote operation control unit 25, and the automatic driving control unit 26 are implemented by a processor that executes a program stored in a memory and a communication interface. The memory is a ROM (Read Only Memory) and a RAM (Random Access Memory), etc., and can store the program executed by the processor.

[0090] The communication unit 21 is, for example, a wireless communication interface for communicating with the information processing system 1 via a network N1 such as the Internet. The communication unit 21 transmits position information related to the position of the mobile body 2 obtained by the position obtaining unit 22 and state information related to the state of the mobile body 2 obtained by the state obtaining unit 23 to the information processing system 1. In addition, the communication unit 21 receives an instruction signal indicating an instruction for remote control of the mobile body 2, which is transmitted from, for example, a remote control system.

[0091] The position acquisition unit 22 acquires position information by detecting the position of the moving object 2. The position acquisition unit 22 detects the position of the moving object 2 based on the positioning result of a positioning system such as GPS (Global Positioning System).

[0092] The state acquisition unit 23 acquires state information related to the state of the mobile body 2. The state information may include, for example, information indicating whether the mobile body 2 is autonomously moving, information indicating whether the mobile body 2 is being remotely operated by an operator, or information indicating whether the mobile body 2 is waiting. In addition, the state information may include, for example, information indicating whether a failure has occurred in the mobile body 2, or information indicating whether the mobile body 2 is stagnant. The state acquisition unit 23 acquires the state information by, for example, requesting the processing unit 24 for the state of the mobile body 2.

[0093] The processing unit 24 is a main controller of the mobile body 2. The processing unit 24 manages and controls the entire mobile body 2 by working in cooperation with the communication unit 21, the position acquisition unit 22, the state acquisition unit 23, the remote operation control unit 25, and the automatic driving control unit 26.

[0094] The remote operation control unit 25 controls the mobile body 2 according to the contents of the instruction issued from the remote control system to the mobile body 2 via the network N1, thereby making the mobile body 2 move autonomously. Thus, the mobile body 2 is remotely operated according to the instruction of the operator.

[0095] The automatic driving control unit 26 controls the mobile body 2 according to the content of the instruction sent from the remote control system to the mobile body 2 via the network N1, thereby making the mobile body 2 move autonomously. The instruction here is different from the instruction of the operator mentioned above. For example, when the mobile body 2 is an automatic delivery robot, the automatic driving control unit 26 makes the mobile body 2 move autonomously according to the instruction to move to one or more delivery destinations.

[0096] like Figure 1 As shown, the information processing system 1 includes a communication unit (output unit) 11, an acquisition unit 12, and a processing unit 13. The communication unit 11, the acquisition unit 12, and the processing unit 13 are implemented by a processor that executes a program stored in a memory and a communication interface. The memory is a ROM and a RAM, etc., which can store the program executed by the processor. In addition, the information processing system 1 communicates with the storage device 4 via the network N1, so as to read out the information stored in the storage device 4 and refer to it. In addition, the storage device 4 can also be mounted on the same server device as the information processing system 1.

[0097] The communication unit 11 is a wireless communication interface for communicating with each of the plurality of mobile bodies 2 as the target of the information processing system 1 via the network N1. The communication unit 11 receives the position information and the state information transmitted from the mobile body 2 for each mobile body 2. Figure 1 Only one moving body 2 is shown in the figure, but there are a plurality of moving bodies 2 in reality.

[0098] Furthermore, the communication unit 11 communicates with the information terminal 3 used by the responding personnel via the network N1. The information terminal 3 is, for example, a terminal such as a smartphone, a tablet terminal, or a personal computer. In the following, the information terminal 3 is described as a smartphone. Figure 1 Only one information terminal 3 is shown in the figure, but, for example, if there are multiple responders, there are multiple information terminals 3 used by each of the multiple responders. In this case, the communication unit 11 communicates with each of the multiple information terminals 3.

[0099] Here, the response personnel are personnel who rush to the location of the mobile body 2 and respond to the event when an event occurs to the mobile body 2. The event refers to a situation where the mobile body 2 falls into a state where autonomous movement and remote operation become difficult. That is, when an event occurs, the mobile body 2 becomes difficult to move autonomously or becomes unable to move autonomously for some reason. Furthermore, when an event occurs, the mobile body 2 becomes difficult to move or cannot move even if it accepts remote operation by an operator via a remote control system.

[0100] The event includes, for example, a situation where the vehicle 2 cannot travel due to a failure of part or all of the driving functions of the vehicle 2. Also, the event includes a situation where the communication between the remote control system and the vehicle 2 is interrupted, making it impossible to remotely control the vehicle 2.

[0101] Specifically, the response personnel rush to the location of the mobile body 2, manually drive the mobile body 2 and move it to an appropriate location, or recover the mobile body 2 by resolving an abnormality (such as a failure of equipment, etc.) that occurs in the mobile body 2, or try to resolve the incident by retrieving the mobile body 2. In addition, if the mobile body 2 is an automatic delivery robot, the response personnel arrange a replacement robot to continue the delivery.

[0102] Furthermore, in the first embodiment, the communication unit 11 transmits information related to the mobile body 2, and in particular, transmits second information related to the degree of necessary response to the information terminal 3 via the network N1. The degree of necessary response will be described later. That is, the communication unit 11 functions as an output unit that outputs the second information related to the degree of necessary response.

[0103] Here, if Figure 1 As shown, the information terminal 3 includes a communication unit 31, a processing unit 32, and a display unit 33. The communication unit 31 and the processing unit 32 are implemented by a processor that executes a program stored in a memory and a communication interface. The memory is a ROM and a RAM, etc., and can store the program executed by the processor.

[0104] The communication unit 31 is a wireless communication interface for communicating with the information processing system 1 via the network N1. The communication unit 31 receives information on the mobile object 2 transmitted from the information processing system 1, and in particular, receives second information on the degree of necessity of response.

[0105] The processing unit 32 is a main controller of the information terminal 3. The processing unit 32 manages and controls the entire information terminal 3 by working in cooperation with the communication unit 31 and the display unit 33.

[0106] The display unit 33 is, for example, a liquid crystal display, and displays information processed by the processing unit 32. In Embodiment 1, the second information is displayed on the display unit 33. The specific form of the second information displayed on the display unit 33 is described in detail in "3. UI (User Interface)".

[0107] Returning to the description of the information processing system 1, the acquisition unit 12 acquires various information via the communication unit 11 and the network N1. The acquisition unit 12 acquires service information related to the service performed by each of the one or more mobile bodies 2 in which the event occurred from the service management DB (Database) 41 of the storage device 4 described later. Hereinafter, the service information of each of the one or more mobile bodies 2 in which the event occurred is collectively referred to as the first information.

[0108] Figure 2 An example of service information is shown. Figure 2 The service information shown is information related to the service when the mobile body 2 is an automatic delivery robot, that is, information related to the service of delivering goods designated by the user to a designated place (for example, the user's home). Figure 2 In , "mobile number" indicates a unique number assigned to mobile 2. Figure 2 In the example, the “delivery status” indicates whether the mobile body 2 is delivering goods or returning to the base point. Figure 2 In the above, "delivery to the scheduled time" means the scheduled time when the mobile body 2 delivers the designated goods to the designated place. Figure 2 In the delivery service, "delivery priority" indicates the priority of delivering the specified goods to the specified location, and is set by the user when using the delivery service. For example, if the user pays an additional fee to use the delivery service, the delivery priority will be higher, and if the user does not specify the delivery date and time, the delivery priority will be lower. The delivery priority here is expressed in three levels: "low", "medium", and "high". And in Figure 2 The "number of delivered goods" indicates the number of goods delivered to the specified location. Figure 2 (a) shows the service information of the mobile body 2 to which the mobile body number "70" is assigned. Figure 2 (b) shows the service information of the mobile body 2 to which the mobile body number "71" is assigned.

[0109] Furthermore, the acquisition unit 12 acquires state information related to the state of the mobile body 2 from each of the plurality of mobile bodies 2. Hereinafter, the state information of each of the plurality of mobile bodies 2 is collectively referred to as third information. In addition, among the state information, information related to communication abnormality such as interruption of communication between the remote control system and the mobile body 2 can be acquired from the remote control system. Furthermore, information related to communication abnormality can also be acquired from the mobile body 2 when the information processing system 1 and the mobile body 2 are in a communication state such that the operator cannot remotely operate the mobile body 2 even though communication is possible between the information processing system 1 and the mobile body 2.

[0110] Furthermore, the acquisition unit 12 acquires position information related to the position of the mobile body 2 from each of the one or more mobile bodies 2 where the event occurred. Hereinafter, the position information of each of the one or more mobile bodies 2 where the event occurred is collectively referred to as the fourth information. Furthermore, the acquisition unit 12 acquires the response personnel information related to the response personnel from the information terminal 3. The response personnel information includes information related to the position of the response personnel. Hereinafter, the information related to the position of the response personnel is referred to as the fifth information.

[0111] The processing unit 13 is a main controller of the information processing system 1. The processing unit 13 performs management and control of the entire information processing system 1 by working in cooperation with the communication unit 11 and the acquisition unit 12. The processing unit 13 includes a determination unit 131, a response necessity calculation unit 132, and a response order calculation unit 133. The determination unit 131, the response necessity calculation unit 132, and the response order calculation unit 133 are all implemented as functions executed by the processing unit 13.

[0112] The judgment unit 131 judges whether an event has occurred for each of the plurality of moving bodies 2 based on the third information obtained by the obtaining unit 12. Here, the third information includes information indicating whether each of the plurality of moving bodies 2 can move autonomously. Furthermore, the third information includes information indicating whether each of the plurality of moving bodies 2 can communicate with an operator, in other words, includes information indicating whether the moving body 2 can be remotely operated by the operator. Based on this information, the judgment unit 131 judges whether an event has occurred for each moving body 2, that is, judges whether the moving body 2 is in a situation where autonomous movement and remote operation become difficult. The operation of the judgment unit 131 will be described in detail in "2. Operation".

[0113] When an event occurs in one or more of the plurality of mobile bodies 2, the response necessity calculation unit 132 calculates the response necessity indicating the degree to which the event should be addressed for each of the one or more mobile bodies 2 based on the first information obtained by the acquisition unit 12. That is, the response necessity indicates the degree to which the event should be resolved with priority based on the progress of the service (here, the delivery service) performed by each of the one or more mobile bodies 2. Thus, by referring to the response necessity, the responding personnel can determine which mobile body 2 should be addressed with priority, for example, when an event occurs in each of the plurality of mobile bodies 2.

[0114] Here, as described above, the service information includes "delivery status", "delivery to scheduled time", and "delivery priority". That is, the first information includes the following information related to each of the one or more mobile bodies 2, namely: information indicating whether the service is being executed ("delivery status"), or information indicating the scheduled end time of the service ("delivery to scheduled time"), or information indicating the priority of the service ("delivery priority"). The response necessity calculation unit 132 calculates the response necessity of each of the one or more mobile bodies 2 based on this information. The operation of the response necessity calculation unit 132 will be described in detail in "2. Operation".

[0115] The response sequence calculation unit 133 calculates the response sequence in which the response personnel should respond to one or more mobile bodies 2 based on the response necessity calculated by the response necessity calculation unit 132 and the fifth information obtained by the acquisition unit 12. That is, the response sequence calculation unit 133 calculates the sequence in which the response personnel should respond to one or more events that have occurred based on the response necessity of each of the one or more mobile bodies 2 and the relative positional relationship between the response personnel and the one or more mobile bodies 2. Thus, by referring to the response sequence, the response personnel do not need to judge by themselves which mobile body 2 should be given priority in responding, for example, when an event occurs in each of the multiple mobile bodies 2. The operation of the response sequence calculation unit 133 will be described in detail in "2-3. Second Operation Example" of "2. Operation".

[0116] The storage device 4 stores a service management DB 41. The service management DB 41 stores service information related to services performed by the mobile body 2 for each mobile body 2. The service management DB 41 obtains and stores the service information of each mobile body 2 from, for example, an operation management server that performs vehicle allocation control of the mobile body 2, such as a remote control system. The service information of each mobile body 2 stored in the service management DB 41 is updated every time the service information of each mobile body 2 is obtained from the operation management server.

[0117] [2. Work]

[0118] Hereinafter, the operation of the information processing system 1 according to the first embodiment will be described.

[0119] [2-1. Basic work]

[0120] First, use Figure 3 The basic operation of the information processing system 1 will be described. Figure 31 is a flowchart showing a basic operation example of the information processing system 1 according to Embodiment 1. First, the acquisition unit 12 periodically acquires third information, i.e., status information of each of the plurality of mobile bodies 2 (S101). Next, the determination unit 131 of the processing unit 13 determines whether an event has occurred for each of the plurality of mobile bodies 2 based on the third information acquired by the acquisition unit 12 (S102).

[0121] Here, using Figure 4 A specific operation example of the determination unit 131 will be described. Figure 4 This is a flowchart showing an example of a determination operation of whether or not a response by a response person is required in the information processing system 1 according to the first embodiment. Figure 4 The determination operation for one moving object 2 is shown. Figure 4 The determination operation shown is performed for each moving body 2 .

[0122] First, the judgment unit 131 judges whether the moving body 2 is capable of automatic driving (autonomous movement) by referring to the state information of the moving body 2 that is the object (S201). When the moving body 2 is capable of automatic driving ("Yes" of S201), the judgment unit 131 judges that no event has occurred in the moving body 2 (S202). In addition, when the moving body 2 cannot be driven automatically (S201), the judgment unit 131 then judges whether the moving body 2 can be remotely controlled (S203). When the moving body 2 can be remotely controlled ("Yes" of S203), the judgment unit 131 judges that no event has occurred in the moving body 2 (S202). In addition, when the moving body 2 cannot be remotely controlled ("No" of S203), the judgment unit 131 judges that an event has occurred in the moving body 2 (S204).

[0123] Return to Figure 3 If no event occurs in any of the mobile bodies 2 (No in S103), the processing unit 13 does not perform any operation. If an event occurs in more than one mobile body 2 (Yes in S103), the acquisition unit 12 acquires the first information, i.e., the service information of each of the more than one mobile body 2 (S104). And, the necessary degree of response calculation unit 132 of the processing unit 13 calculates the necessary degree of response of each of the more than one mobile body 2 based on the acquired first information (S105).

[0124] Here, using Figure 5 A specific operation example of the necessary degree calculation unit 132 will be described. Figure 5 1 is a flowchart showing an example of a calculation operation of the required degree of response in the information processing system 1 according to the first embodiment. Figure 5 The calculation operation for one moving body 2 is shown. Figure 5The calculation work shown is performed for each moving body 2 where an event occurs. Figure 5 In the calculation work shown, the response necessity calculation unit 132 calculates the response necessity of the mobile body 2 where the event occurred in five levels of "lowest", "low", "medium", "high", and "highest". As an example, when the response personnel need to rush to the mobile body 2 within 5 minutes, the response necessity is "high", when the response personnel need to rush to the mobile body 2 within 10 minutes, the response necessity is "medium", and when the response personnel need to rush to the mobile body 2 within 15 minutes, the response necessity is "low".

[0125] First, the necessary degree of response calculation unit 132 refers to the service information of the target mobile body 2 to confirm whether the delivery status of the mobile body 2 is being delivered (S301). If the delivery status of the mobile body 2 is not being delivered ("No" in S301), the necessary degree of response calculation unit 132 calculates the necessary degree of response of the mobile body 2 as "minimum" (S302). In addition, if the delivery status of the mobile body 2 is being delivered ("Yes" in S301), the necessary degree of response calculation unit 132 then confirms whether the delivery priority of the mobile body 2 is "medium" or above (S303).

[0126] If the delivery priority of the mobile body 2 is less than "medium" (i.e., the delivery priority is "low") ("No" in S303), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "low" (S304). In addition, if the delivery priority of the mobile body 2 is "medium" or higher ("Yes" in S303), the necessary degree of response calculation unit 132 then confirms whether the delivery priority of the mobile body 2 is "high" (S305).

[0127] If the delivery priority of the mobile body 2 is not "high" (that is, if the delivery priority is "medium") ("No" in S305), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "medium" (S306). In addition, if the delivery priority of the mobile body 2 is "high" ("Yes" in S305), the necessary degree of response calculation unit 132 then confirms whether the time from the current time to the scheduled delivery time for the mobile body 2 is less than a threshold value (S307). The threshold value is a preset time, for example, 10 minutes.

[0128] If the time from the current moment to the scheduled time for the mobile body 2 is longer than the threshold value (No in S307), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "high" (S308). In addition, if the time from the current moment to the scheduled time for the mobile body 2 is less than the threshold value (Yes in S307), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "highest" (S309).

[0129] Return to Figure 3 The communication unit (output unit) 11 outputs the second information related to the degree of response required calculated by the degree of response required calculation unit 132 (S106). In the first embodiment, the communication unit 11 outputs the second information by sending the second information to the information terminal 3 used by the response personnel. Hereinafter, during the operation of the information processing system 1, the above steps S101 to S106 are repeatedly performed.

[0130] [2-2. First working example]

[0131] The following describes the first operation example that can be executed by the information processing system 1. In addition, the information processing system 1 only needs to be able to execute the basic operation example, and whether to execute the first operation example is optional. In the first operation example, the necessary response degree calculation unit 132 calculates the necessary response degree of each of the one or more moving bodies 2 by further referring to the third information and the fourth information, i.e., the position information and state information of the moving body 2.

[0132] Figure 6 An example of location information is shown. Figure 6 The "mobile number" in FIG. 1 represents a unique number assigned to the mobile 2. Figure 6 In , "position (latitude)" indicates the latitude of the position of the moving body 2, and "position (longitude)" indicates the longitude of the position of the moving body 2. Figure 6 In , "area name" indicates the name of the area where the moving body 2 is located (for example, the name of a road, etc.). Figure 6 In the figure, the “area type” indicates the type of the area where the moving body 2 is located (for example, a sidewalk, an intersection, or a crosswalk, etc.). Figure 6 (a) shows the position information of the moving body 2 to which the moving body number "70" is assigned. Figure 6 (b) shows the position information of the moving body 2 to which the moving body number "71" is assigned.

[0133] Figure 7 An example of status information is shown in Figure 7 In , "mobile number" indicates a unique number assigned to mobile 2. Figure 7In the automatic driving system state, the moving body 2 is shown as being in automatic driving (autonomous movement) or stopped. Figure 7 In the example, “whether the vehicle 2 can travel” indicates whether the vehicle 2 can travel, that is, whether the vehicle 2 can travel manually even though it cannot move autonomously or accept remote control. Figure 7 In , "status" indicates the status of the system installed in the mobile body 2 (for example, normal, faulty, or communication abnormality). Figure 7 In the above description, "Details" indicates the details of the status of the system installed in the mobile body 2. For example, when "Status" is a fault, "Details" indicates which specific part has failed. Also, when "Status" is a communication abnormality, "Details" indicates what specific communication abnormality has occurred. Figure 7 (a) shows the status information of the mobile body 2 to which the mobile body number "70" is assigned. Figure 7 (b) shows the status information of the mobile body 2 to which the mobile body number "71" is assigned.

[0134] Figure 8 1 is a flowchart showing a first operation example of the information processing system 1 according to the first embodiment. Figure 8 In the first working example, steps S101 to S103 in the basic working example are omitted. That is, in the first working example, the information processing system 1 executes Figure 8 Steps S401 to S405 shown replace steps S104 to S106 in the basic operation example.

[0135] First, the acquisition unit 12 obtains the first information, i.e., the service information of each of more than one mobile body 2 (S401). Next, the acquisition unit 12 obtains the third information, i.e., the position information of each of more than one mobile body 2 (S402). Further, the acquisition unit 12 obtains the fourth information, i.e., the status information of each of more than one mobile body 2 (S403). The order of executing steps S401 to S403 is not limited to this order. In addition, the response necessity calculation unit 132 calculates the response necessity of each of more than one mobile body 2 based on the obtained first information, third information, and fourth information (S404). Thereafter, the communication unit (output unit) 11 outputs the second information related to the response necessity calculated by the response necessity calculation unit 132 (S405).

[0136] Here, using Fig. 9 A specific operation example of the necessary-degree calculation unit 132 in the first operation example will be described. Fig. 9 This is a flowchart showing an operation example of calculating the required degree of response in the first operation example.

[0137] First, the necessary response degree calculation unit 132 confirms whether the moving body 2 is stopped in the crosswalk or the roadway by referring to the position information of the moving body 2 (S501). If the moving body 2 is stopped in the crosswalk or the roadway ("Yes" in S501), the necessary response degree calculation unit 132 calculates the necessary response degree of the moving body 2 as "highest" (S511). In addition, if the moving body 2 is not stopped in the crosswalk or the roadway ("No" in S501), the necessary response degree calculation unit 132 then confirms whether the moving body 2 cannot travel by referring to the state information of the moving body 2 (S502).

[0138] If the mobile body 2 cannot travel ("Yes" in S502), the necessary degree calculation unit 132 then executes step S509 described later. If the mobile body 2 can travel ("No" in S502), the necessary degree calculation unit 132 then confirms whether the delivery status of the mobile body 2 is being delivered by referring to the service information of the target mobile body 2 (S503).

[0139] If the delivery status of the mobile body 2 is not being delivered (No in S503), the required degree of response of the mobile body 2 calculated by the required degree of response calculation unit 132 is "minimum" (S504). If the delivery status of the mobile body 2 is being delivered (Yes in S503), the required degree of response calculation unit 132 then checks whether the delivery priority of the mobile body 2 is "medium" or above (S505).

[0140] If the delivery priority of the mobile body 2 is less than "medium" (i.e., the delivery priority is "low") ("No" in S505), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "low" (S506). In addition, if the delivery priority of the mobile body 2 is "medium" or higher ("Yes" in S505), the necessary degree of response calculation unit 132 then confirms whether the delivery priority of the mobile body 2 is "high" (S507).

[0141] If the delivery priority of the mobile body 2 is not "high" (that is, if the delivery priority is "medium") ("No" in S507), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "medium" (S508). In addition, if the delivery priority of the mobile body 2 is "high" ("Yes" in S507), the necessary degree of response calculation unit 132 then confirms whether the time from the current time to the scheduled delivery time for the mobile body 2 is less than the threshold value (S509). Step S509 is also executed when the mobile body 2 cannot travel as described above.

[0142] If the time from the current moment to the scheduled time for the mobile body 2 is longer than the threshold value (No in S509), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "high" (S510). In addition, if the time from the current moment to the scheduled time for the mobile body 2 is less than the threshold value (Yes in S509), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "highest" (S511).

[0143] However, in the first operation example, the response necessity calculation unit 132 may evaluate the phenomenon occurring in the moving object 2 with a score by referring to the service information, position information, and state information of the moving object 2 as a target, and calculate the response necessity based on the score. Fig.10 This is a flowchart showing another example of calculation operation of the required degree of response in the first example of operation. Fig.11 An evaluation example of a phenomenon occurring in the moving object 2 is shown.

[0144] exist Fig.11 In the example, if the question “Is the moving object 2 in the crosswalk or the roadway?” is “Yes”, the result is 100 points, and if it is “No”, the result is 0 points. Fig.11 In the example, regarding the moving body 2, if the phenomenon "Is it unable to travel due to a malfunction?" is "Yes", it is evaluated as 70 points, and if it is "No", it is evaluated as 0 points. Fig.11 In the example, regarding the mobile body 2, if the phenomenon "Is the delivery status in delivery?" is "Yes", it is evaluated as 20 points, and if it is "No", it is evaluated as 0 points. Fig.11 In the example, when the "delivery priority" phenomenon of the mobile body 2 is "high", it is evaluated as 50 points, when it is "medium", it is evaluated as 30 points, and when it is "low", it is evaluated as 10 points. Fig.11 In the example, regarding the moving body 2, if the question "Is the time until the vehicle is delivered to the scheduled time equal to or less than the threshold?" is "Yes", the result is 20 points, and if it is "No", the result is 10 points.

[0145] In this way, Fig.10As shown, first, the necessary degree of response calculation unit 132 calculates the total score of the scores of each phenomenon of the target moving body 2 (S601). And, if the total score is less than 20 points ("No" of S602), the necessary degree of response of the moving body 2 calculated by the necessary degree of response calculation unit 132 is "lowest" (S603). And, if the total score is greater than 20 points ("Yes" of S602) and less than 40 points ("No" of S604), the necessary degree of response of the moving body 2 calculated by the necessary degree of response calculation unit 132 is "low" (S605). And, if the total score is greater than 40 points ("Yes" of S604) and less than 60 points ("No" of S606), the necessary degree of response of the moving body 2 calculated by the necessary degree of response calculation unit 132 is "medium" (S607). Furthermore, if the total score is greater than 60 points ("Yes" in S606) and less than 80 points ("No" in S608), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "high" (S609). Furthermore, if the total score is greater than 80 points ("Yes" in S608), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "highest" (S610).

[0146] [2-3. Second working example]

[0147] The following describes the second operation example that can be executed by the information processing system 1. In addition, the information processing system 1 only needs to be able to execute the basic operation example, and whether to execute the second operation example is optional. When the second operation example is not executed, the information processing system 1 may not include the response order calculation unit 133.

[0148] In the second working example, the information processing system 1 further calculates the response order after calculating the response necessity degree of each of the more than one mobile bodies 2. That is, in the second working example, the response order calculation unit 133 calculates the response order based on the response necessity degree of each of the more than one mobile bodies 2, the fourth information (i.e., the position of each of the more than one mobile bodies 2), and the fifth information (i.e., the position of the response personnel).

[0149] Fig.12 An example of response personnel information is shown. Fig.12 In , "response personnel ID" indicates a unique number assigned to a response personnel. Fig.12 In the above, "Location (latitude)" indicates the latitude of the location of the responding personnel, and "Location (longitude)" indicates the longitude of the location of the responding personnel. Fig.12 In the figure, “status” indicates the status of the responding personnel (for example, waiting, patrolling, or responding).

[0150] Fig.131 is a flowchart showing a second operation example of the information processing system 1 according to the first embodiment. Fig.13 In the figure, only the process executed after each step in the first working example (except the step of outputting the second information) is illustrated. That is, in the second working example, after the information processing system 1 executes steps S401 to S404 in the first working example, it executes Fig.13 Steps S701 to S703 are shown instead of step S405.

[0151] First, the acquisition unit 12 acquires the fifth information, i.e., information related to the location of the responding personnel (S701). Here, the acquisition unit 12 acquires the information related to the location of the responding personnel by acquiring the responding personnel information from the information terminal 3 via the communication unit 11. Moreover, although it is assumed here that there is only one responding personnel, when there are multiple responding personnel, the acquisition unit 12 acquires the information related to the location of the responding personnel for each responding personnel.

[0152] Next, the response order calculation unit 133 of the processing unit 13 calculates the response order (S702) based on the response necessary degree of each of the one or more mobile bodies 2 calculated by the response necessary degree calculation unit 132, the fourth information obtained by the acquisition unit 12 (refer to step S403 of the first operation example), and the fifth information obtained by the acquisition unit 12. In addition, the communication unit (output unit) 11 outputs the second information related to the response necessary degree calculated by the response necessary degree calculation unit 132 (S703). Here, the response order calculated based on the response necessary degree is also included in the second information.

[0153] Here, using Fig.14 A specific operation example of the response order calculation unit 133 in the second operation example will be described. Fig.14 1 is a flowchart showing a calculation operation example of the response sequence in the second operation example. First, the response sequence calculation unit 133 assigns "1st" to the mobile body 2 with the highest response necessity and the shortest distance to the response personnel among one or more mobile bodies 2 (S801). Here, in the case where there are multiple response personnel, the response sequence calculation unit 133 determines the response personnel with the shortest distance to the mobile body 2 with the highest response necessity among the multiple response personnel as the response personnel to respond to the one or more mobile bodies 2.

[0154] Next, the response order calculation unit 133 extracts the mobile body 2 with the highest response necessity from the remaining mobile bodies 2 (S802). And, the response order calculation unit 133 assigns the next rank to the mobile body 2 with the shortest distance from the mobile body 2 assigned a rank in the previous trial (S803). For example, if the mobile body 2 assigned a rank in the previous trial is the mobile body 2 assigned "No. 1", "No. 2" is assigned to the mobile body 2 with the shortest distance from the mobile body 2.

[0155] If all the moving bodies 2 are not ranked (No in S804), the corresponding order calculation unit 133 repeatedly executes step S802 and step S803. If all the moving bodies 2 are ranked (Yes in S804), the corresponding order calculation unit 133 ends the process of calculating the corresponding order.

[0156] Here, refer to Fig.15 The positions and required response levels of the four moving bodies 2 shown, and Fig.12 A specific example of calculating the response order by the response order calculation unit 133 will be described based on the positions of the response personnel shown. Fig.15 An example of position information and the degree of necessity of response is shown. Fig.15 (a) Fig.15 (b) Fig.15 (c) and Fig.15 (d) shows the positions and the degree of necessary response of the moving bodies 2 having moving body numbers "70", "71", "72" and "73", respectively.

[0157] First, the response order calculation unit 133 assigns "1st" to the mobile body 2 with the highest degree of response necessity among the four mobile bodies 2 (here, the two mobile bodies 2 with the mobile body numbers "70" and "71") and the shortest distance from the response personnel, which is the mobile body 2 with the mobile body number "71". Next, the response order calculation unit 133 extracts the mobile body 2 with the highest degree of response necessity among the remaining mobile bodies 2 (here, the three mobile bodies 2 with the mobile body numbers "70", "72", and "73"), which is the mobile body 2 with the mobile body number "70". Here, since there is only one mobile body 2 extracted, "2nd" is assigned to the mobile body with the mobile body number "70".

[0158] Next, the response order calculation unit 133 extracts the mobile body 2 with the highest degree of response necessity from among the remaining mobile bodies 2 (here, the two mobile bodies 2 with the mobile body numbers "72" and "73"), which is the mobile body 2 with the mobile body numbers "72" and "73". Furthermore, the response order calculation unit 133 assigns "No. 3" to the mobile body 2 with the shortest distance from the mobile body 2 assigned a rank in the previous trial (here, the mobile body 2 assigned "No. 2" and the mobile body number "70") among the two extracted mobile bodies 2, which is the mobile body 2 with the mobile body number "73".

[0159] Next, the response order calculation unit 133 extracts the mobile body 2 with the highest degree of response necessity from among the remaining mobile bodies 2 (here, the mobile body 2 with the mobile body number "72"), which is the mobile body 2 with the mobile body number "72". Here, since there is only one mobile body 2 extracted, "4th" is assigned to the mobile body 2 with the mobile body number "72". In this way, since the ranks are assigned to all the mobile bodies 2, the response order calculation unit 133 ends the process of calculating the response order. Accordingly, the four mobile bodies 2 with the mobile body numbers "70", "71", "72", and "73" are assigned the ranks of "2nd", "1st", "4th", and "3rd", respectively.

[0160] [3. UI (User Interface)]

[0161] Hereinafter, a specific form of the UI which is a specific form of the second information displayed on the display unit 33 of the information terminal 3 will be described.

[0162] [3-1.Example 1]

[0163] Fig.16 FIG. 1 shows a first example of an image displayed on the display unit 33 of the information terminal 3. Fig.16 As shown, in the first example, the display unit 33 displays a first area A1 showing details of one or more moving bodies 2 where an event has occurred, and a second area A2 showing the positions of one or more moving bodies 2 on a map. Here, the details of the moving body 2 include the degree of necessary response of the moving body 2 described later. That is, the display unit 33 displays information showing the degree of necessary response of each of the one or more moving bodies 2 and a map showing the positions of each of the one or more moving bodies 2.

[0164] exist Fig.16In the example shown in (a), details of two moving bodies 2 are displayed in the first area A1. Specifically, an area A11 showing details of the moving body 2 with moving body number "70" and an area A12 showing details of the moving body 2 with moving body number "71" are displayed in the first area A1. Fig.16 In the example shown in (b), only the details of the moving object 2 with the highest degree of correspondence requirement are displayed in the second area A1. Specifically, only the area A11 showing the details of the moving object 2 with the moving object number "70" is displayed in the first area A1.

[0165] In the first area A1, "Number" indicates the mobile body number, "Service Status" indicates the status of the service being performed by the mobile body 2, "Vehicle Status" indicates the status of the mobile body 2, "Parking Position" indicates the category of the area where the mobile body 2 is parked, and "Response Requirement Degree" indicates the response necessity degree of the mobile body 2.

[0166] And, in Fig.16 In the example shown, icons A21 and A22 showing the positions of the two moving bodies 2 on the map, numbers showing the moving body numbers of the moving bodies 2 corresponding to the icons A21 and A22, and an icon D1 showing the position of the responding personnel on the map are displayed in the second area A2. Furthermore, the moving paths B1 and B2 of the two moving bodies 2 are displayed in the second area A2.

[0167] The responding personnel can refer to the details of the one or more moving objects 2 where the event occurred, especially the degree of response required, by viewing the display unit 33 of the information terminal 3, and can determine which moving object 2 should be responded to first.

[0168] [3-2.Example 2]

[0169] Fig.17 FIG. 2 shows a second example of an image displayed on the display unit 33 of the information terminal 3. Fig.17 As shown in FIG. 1 , the second example is different from the first example in that the column C1 indicating the response order is displayed in the first area A1 . Note that, since the second example is the same as the first example except for the above, the description thereof is omitted here.

[0170] exist Fig.17 In the example shown, the ranking of the moving object 2 with the moving object number "70" is "1st", and the ranking of the moving object 2 with the moving object number "71" is "2nd" and are displayed in the column C1. Fig.17 In the example shown in (b), Fig.17 Unlike the example shown in (a) of FIG. 1 , movement paths E1 and E2 along which the response personnel move along the response sequence are displayed in the second area A2 .

[0171] The responding personnel can refer to the details of one or more moving objects 2 where an event has occurred, especially the response order, by viewing the display unit 33 of the information terminal 3, and thus do not need to judge which moving object 2 should be responded to first.

[0172] In the second example, numbers indicating the response order may be displayed in the second area A2.

[0173] [4. Advantages, etc.]

[0174] As described above, the information processing method and information processing system 1 involved in embodiment 1 calculate the necessary degree of response of each of more than one mobile body 2 where an event has occurred, and output the second information related to the calculated necessary degree of response. Thus, the response personnel can refer to the second information, for example, when an event has occurred in each of the multiple mobile bodies 2, and can determine which mobile body 2 should be prioritized for response. Therefore, the advantage is that when a situation occurs in each of the multiple mobile bodies 2 where autonomous movement becomes difficult, the response personnel can easily and efficiently improve the situation. This advantage is effective when the number of response personnel is smaller than the number of mobile bodies 2, and is particularly effective when one response personnel needs to respond to multiple mobile bodies 2.

[0175] (Implementation Method 2)

[0176] Hereinafter, an information processing system and an information processing method according to the second embodiment will be described.

[0177] [1. Composition]

[0178] Fig.18 1 is a block diagram showing an example of an information processing system 1A according to Embodiment 2. Embodiment 2 is different from Embodiment 1 in that the mobile body 2 further includes a surrounding information obtaining unit 27 and the storage device 4 further includes a process DB 42. In Embodiment 2, the configuration of the operator terminal 5 is described. The operator terminal 5 is also connected to the network N1 in the same manner as in Embodiment 1. Hereinafter, description of the configuration common to Embodiment 1 will be appropriately omitted.

[0179] The surrounding information acquisition unit 27 of the mobile body 2 acquires surrounding information related to the presence or absence of objects around the mobile body 2 based on images captured by a camera mounted on the mobile body 2 or detection results of sensors such as LiDAR (Light Detection And Ranging) mounted on the mobile body 2 that detect the surrounding environment.

[0180] The process DB 42 of the storage device 4 stores process information related to the process of how the responding personnel should respond to the occurred event according to the type of event. The process may include, for example, the operation method of the mobile body 2, the recovery method of the mobile body 2, or the maintenance method of the mobile body 2. The process DB 42 obtains and stores the process information of each event from, for example, an operation management server that performs vehicle allocation control of the mobile body 2 such as a remote control system. The process information of each event stored in the process DB 42 is updated every time the process information of each event is obtained from the operation management server.

[0181] The acquisition unit 12 of the information processing system 1A acquires the surrounding information of the mobile body 2 from each of the one or more mobile bodies 2 where the event has occurred. The surrounding information is information related to the presence or absence of objects around the mobile body 2. Hereinafter, the surrounding information of each of the one or more mobile bodies 2 where the event has occurred is collectively referred to as the sixth information. In addition, the acquisition unit 12 acquires the process information of each of the one or more mobile bodies 2 where the event has occurred from the process DB 42 of the storage device 4. Hereinafter, the process information of each of the one or more mobile bodies 2 where the event has occurred is collectively referred to as the seventh information.

[0182] The operator terminal 5 includes a communication unit 51 , a processing unit 52 , a display unit 53 , and an input unit 54 .

[0183] The communication unit 51 is a communication interface for communicating with the information processing system 1A via the network N1. The communication unit 51 may be a wired communication interface or a wireless communication interface.

[0184] The processing unit 52 is a main controller of the operator terminal 5. The processing unit 52 manages and controls the entire operator terminal 5 by working in cooperation with the communication unit 51 and the display unit 53.

[0185] The display unit 53 is, for example, a liquid crystal display, and displays information processed by the processing unit 52. In Embodiment 2, the display unit 53 is formed of a touch panel display. The specific form of the information displayed on the display unit 53 will be described in detail in "3. UI".

[0186] The input unit 54 is an interface for receiving input from an operator. In the second embodiment, as described above, the display unit 53 is composed of a touch panel display, so the display unit 53 also serves as the input unit 54. The input unit 54 may include, for example, a keyboard or a pointing device such as a mouse.

[0187] [2. Work]

[0188] Hereinafter, the operation of the information processing system 1A according to Embodiment 2 will be described. Hereinafter, the differences from the operation of the information processing system 1 according to Embodiment 1 will be mainly described, and the description of the common points will be appropriately omitted.

[0189] [2-1. Basic work]

[0190] First, the basic operation of the information processing system 1A will be described. In the information processing system 1A, the necessary degree of response calculation unit 132 calculates the necessary degree of response by referring to the service information of the target mobile body 2. Specifically, the necessary degree of response calculation unit 132 calculates the necessary degree of response according to the Figure 5 The point that the degree of necessary response is calculated according to the flowchart shown in the figure is basically the same as the basic operation of the information processing system 1. In addition, the service information referred to in the information processing system 1A is different from the service information referred to in the information processing system 1.

[0191] Fig.19 Another example of service information is shown. Fig.19 As shown, the service information includes not only "mobile body number", "delivery status", "delivery to scheduled time", "delivery priority", and "number of delivered goods", but also "allowed waiting time", "delivery goods weight", and "total size of delivered goods". "Allowed waiting time", "delivery goods weight", and "total size of delivered goods" are all parameters that mainly consider the use of mobile body 2 to transport goods in the factory. "Allowed waiting time" indicates the waiting time allowed from the scheduled time of delivery if the delivery of the goods has not been completed until the scheduled time of delivery. "Delivery goods weight" indicates the total weight of the goods delivered by mobile body 2. "Total size of delivered goods" indicates the total volume of the goods delivered by mobile body 2.

[0192] Furthermore, the necessary degree of response calculation unit 132 of the information processing system 1A calculates Figure 5 In step S307 shown, it is further confirmed whether the time from the current time to the scheduled time of delivery of the mobile body 2 and the time after the addition of the allowed waiting time are below the threshold. If the added time is longer than the threshold ("No" in S307), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "high" (S308). In addition, if the added time is below the threshold ("Yes" in S307), the necessary degree of response of the mobile body 2 calculated by the necessary degree of response calculation unit 132 is "highest" (S309). In addition, the "weight of the delivered goods" and the "total size of the delivered goods" are not referred to in the calculation of the necessary degree of response, but are referred to in the display of the second information displayed on the display unit 33 of the information terminal 3, for example.

[0193] [2-2. First working example]

[0194] The following describes the first operation example that the information processing system 1A can execute. It is not necessary for the information processing system 1A to execute the basic operation example, and whether to execute the first operation example is optional. When the first operation example is not executed, the mobile body 2 may not include the surrounding information acquisition unit 27.

[0195] Fig. 20 403A is a flowchart showing the first working example in the information processing system 1A according to the second embodiment. In the first working example of the information processing system 1A, the difference from the first working example of the information processing system 1 is that the necessary response degree calculation unit 132 refers to the sixth information, i.e., the surrounding information of the mobile body 2, in addition to the third information and the fourth information, to calculate the necessary response degree of each of the one or more mobile bodies 2. Specifically, the acquisition unit 12 further obtains the sixth information, i.e., the surrounding information of each of the one or more mobile bodies 2 (S403A). And, the necessary response degree calculation unit 132 calculates the necessary response degree of each of the one or more mobile bodies 2 based on the obtained first information, third information, fourth information, and sixth information (S404).

[0196] Fig.21 An example of surrounding information is shown. Fig.21 In , "mobile number" indicates a unique number assigned to mobile 2. Fig.21 In , “object ID” represents the identifier of the object detected around the mobile body 2. Fig.21 In , “object category” indicates the type of object detected. And, in Fig.21 In the above, “relative position” indicates the relative position of the detected object relative to the moving object 2. Fig.21 In , “relative speed” means the relative speed of the detected object with respect to the moving body 2. Fig.21 In the figure, “behavior” represents the behavior of the mobile body 2 with respect to the detected object. Fig.21 (a) shows the surrounding information of the moving body 2 assigned the moving body number "70", Fig.21 (b) shows the surrounding information of the moving object 2 to which the moving object number "71" is assigned.

[0197] Fig. 22 1 is a flowchart showing an example of calculating the degree of response required in the first example of operation. In the first example of operation of the information processing system 1A, the example of calculating the degree of response required in the first example of operation of the information processing system 1 (see Fig. 9) before steps S501 to S511, step S500A is executed. Specifically, the necessary degree calculation unit 132 checks whether the moving body 2 is in contact with an object by referring to the surrounding information of the moving body 2 (S500A). If the moving body 2 is not in contact with the object ("No" in S500A), the necessary degree calculation unit 132 then executes Fig. 9 If the moving body 2 is in contact with the object (“Yes” in S500A), the necessary degree calculation unit 132 does not need to execute Fig. 9 According to the steps S501 to S503, S505, S507, and S509 shown, it is calculated that the degree of necessary response of the mobile body 2 is "highest" (S511).

[0198] However, in the first operation example of the information processing system 1A, the necessary response degree calculation unit 132 may be combined with other necessary response degree calculation operation examples in the first operation example of the information processing system 1 (see Fig.10 ) Similarly, the phenomenon occurring in the mobile body 2 is evaluated with a score, and the degree of necessary response is calculated based on the score. In this case, in the first operation example of the information processing system 1A, in addition to the Fig.11 In addition to the evaluation example of the phenomenon occurring in the mobile body 2 shown in FIG. 1 , the phenomenon of “is the mobile body 2 in contact with an object?” is also evaluated. If the phenomenon is “yes”, the evaluation is 100 points, and if it is “no”, the evaluation is 0 points. Then, the necessity degree calculation unit 132 is executed. Fig.10 Steps S601 to S610 are shown.

[0199] Alternatively, in the first operation example, the necessary response degree calculation unit 132 may change the necessary response degree according to the type of the object when the object contacts the moving body 2. For example, the necessary response degree calculation unit 132 may change the necessary response degree when the object is another moving body and when the object is a pedestrian.

[0200] [2-3. Second working example]

[0201] The following describes the second operation example that can be executed by the information processing system 1A. In addition, the information processing system 1A only needs to be able to execute the basic operation example, and whether to execute the second operation example is optional. When the second operation example is not executed, the acquisition unit 12 of the information processing system 1A does not need to obtain the operator input information from the operator terminal 5.

[0202] Fig.231A is a flowchart showing an example of calculating the degree of response required in the second example of operation. In the second example of operation of the information processing system 1A, the example of calculating the degree of response required in the first example of operation of the information processing system 1 (see Fig. 9 ), step S500B is executed before steps S501 to S511 of the operator terminal 5. Specifically, the acquisition unit 12 acquires the operator input information sent from the operator terminal 5. And the necessary response degree calculation unit 132 confirms whether there is an input from the operator by referring to the operator input information (S500B). Here, the operator input information is information input by the operator to the input unit 54 of the operator terminal 5. The necessary response degree specified by the operator is included in the operator input information.

[0203] If there is no input from the operator ("No" in S500B), the necessary degree calculation unit 132 then executes Fig. 9 If there is an input from the operator ("Yes" in S500B), it is then confirmed whether the required level of response designated by the operator is "minimum" (S512).

[0204] If the designated necessary level of response is "lowest" ("Yes" in S512), the necessary level of response of the mobile body 2 calculated by the necessary level of response calculation unit 132 is "lowest" (S504). If the designated necessary level of response is not "lowest" ("No" in S512), the necessary level of response calculation unit 132 then confirms whether the designated necessary level of response is "low" (S513).

[0205] If the designated level of necessary response is "low" ("Yes" in S513), the necessary response level calculation unit 132 calculates the necessary response level of the mobile body 2 as "low" (S506). If the designated level of necessary response is not "low" ("No" in S513), the necessary response level calculation unit 132 then checks whether the designated level of necessary response is "medium" (S514).

[0206] If the designated necessary level of response is "medium" ("Yes" in S514), the necessary level of response calculation unit 132 calculates the necessary level of response of the mobile body 2 as "medium" (S508). If the designated necessary level of response is not "medium" ("No" in S514), the necessary level of response calculation unit 132 then checks whether the designated necessary level of response is "high" (S515).

[0207] If the designated necessary level of response is "high" ("Yes" in S515), the necessary level of response of the mobile body 2 calculated by the necessary level of response calculation unit 132 is "high" (S510). In addition, if the designated necessary level of response is not "high" ("No" in S515), but the input necessary level of response is "highest", the necessary level of response of the mobile body 2 calculated by the necessary level of response calculation unit 132 is "highest" (S511).

[0208] [2-4. Example 3 of the work]

[0209] The following describes the third operation example that can be executed by the information processing system 1A. In addition, the information processing system 1A only needs to be able to execute the basic operation example, and whether to execute the third operation example is optional. When the third operation example is not executed, the acquisition unit 12 of the information processing system 1A does not need to obtain the process information from the process DB 42.

[0210] Fig.24 1A is a flowchart showing a third operation example in the information processing system 1A according to the second embodiment. In the third operation example of the information processing system 1A, the information processing system 1A executes the basic operation example of the information processing system 1 (see Figure 8 ) after step S405, further execute Fig.24 Steps S901 to S903 are shown.

[0211] Specifically, the acquisition unit 12 of the information processing system 1A acquires the seventh information, that is, the process information of each of one or more moving bodies 2 in which an event has occurred, from the process DB 42 of the storage device 4 ( S901 ).

[0212] Fig.25 An example of process information is shown. Fig.25 In , "process ID" indicates a unique number assigned to a process. Fig.25 In the example, “whether the vehicle 2 can travel” indicates whether the vehicle 2 can travel, that is, whether the vehicle 2 can travel manually even though it cannot move autonomously or accept remote control. Fig.25 In , "status" indicates the status of the system installed in the mobile body 2 (for example, normal, faulty, or communication abnormality). Fig.25 In the above description, “details” indicates the details of the status of the system installed in the mobile body 2. Fig.25 In , “area type” indicates the type of area where the moving body 2 is located (for example, a sidewalk, an intersection, or a crosswalk, etc.). Fig.25 In the example, the “delivery status” indicates whether the mobile body 2 is delivering goods or returning to the base point. Fig.25In , “surrounding environment state” represents the state of the surrounding environment of the mobile body 2. Fig.25 In the context of the response, "response content" refers to the process that the response personnel should perform. Fig.25 In the standard response time, the standard response time means the standard time required for the response personnel to complete the process. Fig.25 In the , "required skills" means the skills that the respondent needs to perform the process. Fig.25 In the table, "Required tools" means tools that the responder needs to perform the process.

[0213] Fig.25 (a) shows the process information of the process to which the process ID "220614" is assigned. Fig.25 (b) shows the process information of the process to which the process ID "939913" is assigned. Fig.25 (c) shows the process information of the process to which the process ID "920816" is assigned. Fig.25 (d) shows the process information of the process to which the process ID "140920" is assigned.

[0214] The acquisition unit 12 acquires the process information to be handled according to the content of the event that occurred in each of the one or more moving bodies 2. For example, for a moving body 2 that cannot travel and has a malfunction in the front camera, the acquisition unit 12 acquires the process information to be handled according to the content of the event that occurred in each of the more than one moving bodies 2. Fig.25 The process information shown in (a).

[0215] Return to Fig.24 Then, the processing unit 13 confirms whether the response by the response personnel has started for each of the one or more moving bodies 2 where the event occurred (S902). Specifically, the response personnel looks at the image displayed on the display unit 33 of the information terminal 3 (refer to Fig.16 or Fig.17 ), when deciding which mobile body 2 to respond to, the "response start" icon is selected for the mobile body 2 to be responded to. Then, the communication unit 31 of the information terminal 3 sends a response start signal including the mobile body number of the mobile body 2 to be responded to and the responder ID to the information processing system 1A. When the communication unit 11 receives the response start signal, the processing unit 13 of the information processing system 1A determines that the response by the responder has started.

[0216] When the response by the responder starts (Yes in S902), the communication unit 11 outputs the process information (S903) by sending the process information to the information terminal 3 that sent the response start signal. As a result, the process information is displayed on the display unit 33 of the information terminal 3, so the responder can understand what process should be performed.

[0217] Alternatively, the communication unit 11 of the information processing system 1A may output the second information together with the process information. In this case, step S902 is unnecessary.

[0218] [2-5. Other working examples]

[0219] Other operation examples that can be executed by the information processing system 1A will be described below. It is only necessary for the information processing system 1A to be able to execute the basic operation example, and whether or not to execute other operation examples is optional.

[0220] The necessary response degree calculation unit 132 of the information processing system 1A may also periodically calculate and update the necessary response degree as time passes until the response personnel start to respond. Specifically, the necessary response degree calculation unit 132 may obtain the third information and the fourth information, i.e., the position information and the state information of the mobile body 2, at each timing for calculating the necessary response degree, and calculate and update the necessary response degree with reference to the obtained third information and fourth information. When the necessary response degree is updated, the communication unit 11 outputs the second information including the updated necessary response degree.

[0221] Alternatively, the necessary-coping degree calculation unit 132 may calculate and update the necessary-coping degree at a timing when the communication unit 11 receives a completion signal indicating that the handling with respect to the mobile object 2 has been completed from a certain information terminal 3 .

[0222] For example, it is assumed that when an event occurs in a certain moving body 2, the response necessity calculation unit 132 calculates the response necessity as "low" based on the need for response personnel to arrive at the moving body 2 within 15 minutes. In this case, if 10 minutes have passed since the event occurred and the response personnel have not started to respond, the response necessity calculation unit 132 calculates the response necessity as "high" based on the need for response personnel to arrive at the moving body 2 within 5 minutes and updates the calculation.

[0223] Furthermore, the response necessity calculation unit 132 of the information processing system 1A may calculate and update the response necessity at the set time when the time is already set. That is, the response necessity calculation unit 132 may calculate and update the response necessity at a future time after the time, instead of calculating the response necessity at the time when an event occurs in a certain mobile body 2. For example, the response personnel may view the image displayed on the display unit 33 of the information terminal 3 (see the following description) Fig.28), while setting a future time after the current time. Then, the communication unit 31 of the information terminal 3 sends a setting signal including the mobile body number of the mobile body 2 to be handled and the set time to the information processing system 1A. When the communication unit 11 receives the setting signal, the necessary degree of handling calculation unit 132 of the information processing system 1A calculates the necessary degree of handling at the set time and updates it. When the necessary degree of handling is updated, the communication unit 11 outputs the second information including the updated necessary degree of handling.

[0224] Furthermore, in the second operation example of the first embodiment, when there are multiple response personnel and multiple mobile bodies 2 where an event has occurred, the response sequence calculation unit 133 of the information processing system 1A may equally allocate multiple response personnel to each mobile body 2. For example, when there are four mobile bodies 2 and two response personnel, one response personnel is allocated to the two mobile bodies 2. In this case, the response sequence calculation unit 133 allocates the response personnel located closest to the mobile body 2.

[0225] Fig.26 An example of the allocation of response personnel is shown. Fig.26 In the example shown, the responder whose responder ID is "910424" and who is located closest to the moving bodies 2 is assigned to the two moving bodies 2 whose moving body numbers are "70" and "71". In addition, the responder whose responder ID is "200920" and who is located closest to the moving bodies 2 is assigned to the two moving bodies 2 whose moving body numbers are "72" and "73".

[0226] Then, the response order calculation unit 133 performs the following operations for each response personnel: Fig.14 Steps S801 to S804 are shown to thereby calculate the response order.

[0227] [3.UI]

[0228] Hereinafter, the specific form of the second information displayed on the display unit 33 of the information terminal 3 and the specific form of the information displayed on the display unit 53 of the operator terminal 5, that is, the specific form of the UI will be described. Hereinafter, the differences from the UI in the first embodiment will be mainly described, and the description of the common points will be appropriately omitted.

[0229] [3-1.Example 3]

[0230] Fig. 27 FIG. 3 shows a third example of an image displayed on the display unit 33 of the information terminal 3. In the third example, Fig.16Unlike the first example shown in (b) of FIG. 1 , an area A110 showing the process to be performed by the responding personnel is further displayed on the display unit 33. That is, the third example is an example of a UI corresponding to the third operation example of the information processing system 1A.

[0231] In the area A110 , “Response content” indicates the process that the response personnel should perform, “Required skills” indicates the skills that the response personnel need to perform the process, and “Required tools” indicates the tools that the response personnel need to perform the process.

[0232] The responding personnel can understand what process should be performed on the moving object 2 by viewing the display unit 33 of the information terminal 3 .

[0233] [3-2. 4th example]

[0234] Fig.28 FIG. 4 shows a fourth example of an image displayed on the display unit 33 of the information terminal 3. In the fourth example, Fig.17 Unlike the second example shown in (a), a third area A3 including a slide bar for setting the time is further displayed on the display unit 33. That is, the fourth example is an example of a UI corresponding to an operation example of setting the time among other operation examples of the information processing system 1A.

[0235] The responder can set the time to calculate the required degree of response by operating the slide bar displayed in the third area A3. Here, the responder can freely set the time to calculate the required degree of response within the period from now to 50 minutes later.

[0236] [3-3.Example 5]

[0237] Fig.29 A fifth example of an image displayed on the display unit 33 of the information terminal 3 is shown. In the fifth example, Fig.17 Unlike the second example shown in (a), the first area A1 displays the regularly updated degree of necessary response. That is, the fifth example is an example of a UI corresponding to a work example in which the degree of necessary response is updated over time among other work examples of the information processing system 1A.

[0238] exist Fig.29 In the example shown in (a) of FIG. 1 , in the column C1 showing the response order, when the ranking is changed as the required degree of response is updated, the fact that it has been changed is emphasized. For example, if the ranking in the response order is raised, the box surrounding the changed ranking flashes red (in Fig.29 In the example, when the ranking in the response order is lowered, the box surrounding the changed ranking flashes blue ( Fig.29, with dotted lines in blue). And, Fig.29 In the example shown in (b), Fig.29 Unlike the example shown in (a), an area A111 showing the reason for the ranking change is also displayed on the display unit 33. Here, the display unit 33 shows that the ranking of the moving body 2 with the moving body number "70" has been raised to "1st" because the scheduled delivery time is urgent.

[0239] The responding personnel can understand in real time which moving object 2 should be prioritized for responding by viewing the display unit 33 of the information terminal 3 .

[0240] [3-4.Example 6]

[0241] Fig.30 FIG. 6 shows a sixth example of an image displayed on the display unit 33 of the information terminal 3. In the sixth example, Fig.17 Unlike the second example shown in (a), information related to other responders is displayed on the display unit 33. Specifically, in addition to the icon D1, an icon D2 is displayed in the second area A2. The icon D1 shows the position of the responder on the map, and the icon D2 shows the position of the other responders on the map.

[0242] exist Fig.30 In the example shown in (a), an icon "Other personnel are responding" is displayed in area A11 of area A1, indicating that other responding personnel are responding to the moving object 2 with the moving object number "70". Therefore, the responding personnel cannot respond to the moving object 2 with the moving object number "70".

[0243] exist Fig.30 In the example shown in (b), icons A23 and A24 are also displayed in the second area A2, and icons A23 and A24 respectively show the respective positions of the two moving bodies 2 with moving body numbers "72" and "73" on the map. In addition, area A13 and area A14 are also displayed in the first area A1, and area A13 shows the details of the moving body 2 with moving body number "72", and area A14 shows the details of the moving body 2 with moving body number "73". In addition, a "rush start" icon and a "response start" icon are displayed in each area A11 to A14, and the "rush start" icon shows that the response personnel start moving to the location of the moving body 2 to be responded to, and the "response start" icon shows that the response personnel start responding to the moving body 2.

[0244] In addition, in area A13, since the other responders have already started to move, the "on the way" icon is displayed instead of the "starting to move" icon. As a result, in the second area A2, an arrow showing that the icon D2 of the other responders is moving in the direction of the moving body 2 with the moving body number "72" is displayed.

[0245] The responder can understand which moving object 2 other responders are responding to by looking at the display unit 33 of the information terminal 3. Thus, the responder can determine whether to respond to the moving object 2 that other responders have not responded to.

[0246] [3-5.Example 7]

[0247] Fig.31 FIG. 7 shows a seventh example of an image displayed on the display unit 33 of the information terminal 3. Fig.31 In the example shown in (a), Fig.30 Unlike the sixth example shown in (b), the "starting to arrive" icon and the "arriving to arrive" icon are not displayed in the areas A11 to A14 of the first area A1. Fig.31 In the example shown in (a) of FIG. 1 , an “assignment” icon showing to which mobile body 2 the responding personnel are assigned is displayed in the first area A1. Fig.31 In the example shown in (a), "dispatch" icons are displayed in areas A11 and A12, respectively. Thus, the responding personnel can understand that the responding personnel should respond to the moving bodies 2 with moving body numbers "70" and "71" by looking at the display unit 33 of the information terminal 3.

[0248] And, in Fig.31 In the example shown in (b), Fig.31 Unlike the example shown in (a), in the second area A2, the moving paths E1 and E2 along which the responding personnel (the responding personnel represented by the icon D1) move in the response sequence are displayed, along with the moving paths E3 and E4 along which other responding personnel (the responding personnel represented by the icon D2) move in the response sequence. Thus, the responding personnel can understand in what order to respond to the moving body 2 by looking at the display unit 33 of the information terminal 3, and can also understand in what order other responding personnel respond to the moving body 2.

[0249] [3-6.Example 8]

[0250] Fig.32 FIG. 8 shows an eighth example of an image displayed on the display unit 33 of the information terminal 3. In the eighth example, Fig.16 Unlike the first example shown in (b) of FIG. 8 , the surrounding information of the mobile object 2 is also displayed on the display unit 33. That is, the eighth example is an example of a UI corresponding to the first operation example of the information processing system 1A.

[0251] exist Fig.32 In the example shown in (a) of FIG. 1 , an area A112 indicating the surrounding conditions of the mobile object 2 by a character string is displayed on the display unit 33. Fig.32 In the example shown in (b), the display unit 33 displays areas A41 and A42 that represent the surrounding conditions of the mobile body 2 in the form of images. Area A41 displays an image captured by a camera mounted on the mobile body 2. The image includes a frame surrounding an object detected by the mobile body 2 and a line showing the moving path of the mobile body 2. In addition, area A42 displays an image showing the detection results of the sensor mounted on the mobile body 2. The image includes an icon showing the mobile body 2 and a point cloud showing the detected object.

[0252] The responding personnel can understand the situation around the moving object 2 by looking at the display unit 33 of the information terminal 3 .

[0253] [3-7.Example 9]

[0254] Fig.33 The ninth example of the image displayed on the display unit 33 of the information terminal 3 is shown. The ninth example shows that Fig.16 In the first example shown in (a), the response to the mobile body 2 with the mobile body number "70" should be started and the responding person selects the "response start" icon in the area A11. In the ninth example, as an area showing information of the mobile body 2 to be responded to by the responding person, the display unit 33 displays not only the above-mentioned area A11 but also the fifth area A5 showing detailed information of the mobile body 2.

[0255] Specifically, the fifth area A5 displays: an area showing the detailed status of the mobile body 2, the status of the GPS carried by the mobile body 2, and the destination of the goods delivered to the mobile body 2; an area for the responder to input in order to operate the mobile body 2 (hereinafter, also referred to as the "vehicle operation input area"); and an area for the responder to input in order to communicate with the operator (hereinafter, also referred to as the "communication input area"). In addition, an icon B11 showing the destination of the goods is also displayed in the second area A2. In addition, in area A11, the "response start" icon is replaced by the "response end" icon, and the "agent delivery" icon and the "delivery end" icon are displayed in the fifth area A5.

[0256] In the vehicle operation input area, when the responding personnel selects the "forced abnormality cancellation" icon, information indicating that the event to be handled that occurred in the mobile body 2 has been forcibly terminated is sent to the information processing system 1A and the mobile body 2. Based on this, the processing unit 13 of the information processing system 1A determines that no event to be handled has occurred in the mobile body 2 until a new event to be handled occurs. And, based on this, the abnormal state of the mobile body 2 is cancelled, and the mobile body 2 can receive instructions or operations to start automatic driving thereafter.

[0257] Furthermore, when the responder selects the "manual operation switching" icon, information indicating an instruction for switching to a mode in which the mobile body 2 can be driven manually is sent to the mobile body 2. Accordingly, the mobile body 2 is switched to a mode in which the mobile body 2 can be driven manually, and the responder can drive the mobile body 2 manually thereafter.

[0258] Furthermore, when the responding personnel selects the "manual setting of vehicle position" icon, information indicating instructions for setting the moving destination of the moving body 2 is sent to the moving body 2. Accordingly, the moving body 2 can accept the instructions of the responding personnel and change the moving destination. Thereafter, when the responding personnel selects the "automatic driving start" icon after specifying the moving destination of the moving body 2 on the second area A2, for example, the moving body 2 starts to move autonomously to the specified moving destination. Furthermore, when the responding personnel selects the "automatic driving stop" icon, the moving body 2 stops moving autonomously.

[0259] In the call input area, when the responding staff selects the "call start" icon, information indicating a request to talk to the operator is sent to the operator terminal 5 via the information processing system 1A. Accordingly, the responding staff can talk to the operator. Furthermore, when the responding staff selects the "call end" icon, the call with the operator can be ended.

[0260] In the fifth area A5, when the responding personnel selects the "delivery by proxy" icon, information indicating that the responding personnel delivers the goods to the delivery destination location B on behalf of the mobile body 2 is sent to the operator terminal 5 via the information processing system 1A. Based on this, the operator can understand that the responding personnel is performing the delivery by proxy. Alternatively, the first information stored in the service management DB 41 may be updated based on the above information. Specifically, in the service information of the mobile body 2 that is the object of the delivery by proxy in the first information stored in the service management DB 41, the "delivery status" may be updated from "delivering" to "delivery by proxy".

[0261] Furthermore, when the responding personnel selects the "delivery completed" icon after completing the delivery of the goods, information indicating that the responding personnel has completed the delivery of the goods is sent to the operator terminal 5 via the information processing system 1A. Based on this, the operator can understand that the responding personnel has completed the proxy delivery. Alternatively, the first information stored in the service management DB 41 may be updated based on the above information. Specifically, in the service information of the mobile body 2 that is the object of delivery completion in the first information stored in the service management DB 41, the "delivery status" may be updated from "delivering" to "delivery completed".

[0262] In area A11, when the responder selects the "response completion" icon after completing the response to the mobile object 2, information indicating that the responder has completed the response to the mobile object 2 is sent to the operator terminal 5 via the information processing system 1A. The operator can thereby understand that the responder has completed the response to the mobile object 2.

[0263] [3-8. Operator terminal UI]

[0264] Fig.34 FIG. 5 shows an example of an image displayed on the display unit 53 of the operator terminal 5. Fig.34 As shown, the display unit 53 displays an image F1 for remote monitoring of a plurality of (here, four) moving bodies 2. In the image F1, image F11 is an image for remote monitoring of the moving body 2 with the moving body number "51", image F12 is an image for remote monitoring of the moving body 2 with the moving body number "60", image F13 is an image for remote monitoring of the moving body 2 with the moving body number "71", and image F14 is an image for remote monitoring of the moving body 2 with the moving body number "70". Images F11 to F14 respectively display images (front image, rear image, left image, right image) taken by a camera mounted on the moving body 2 to be responded to. In addition, although in Fig.34 In the figure, each image is the same image, but in reality, each image is different for each moving object 2.

[0265] Icons G1 for the operator to request a response from a responding person are displayed in images F11 and F13, respectively. In image F13, the frame of icon G1 is highlighted with a bold line because the response requirement is relatively high. The operator can request a response from a responding person by selecting icon G1.

[0266] The image F12 displays an icon H1 indicating that the responding personnel are responding. In addition, the image F12 displays an icon G2 instead of the icon G1. The icon G2 is an icon for communicating with the responding personnel. The operator can communicate with the responding personnel by selecting the icon G2.

[0267] Here, the icon H1 receives the response information sent from the information processing system 1A through the communication unit 51 of the operator terminal 5, and is displayed on the display unit 53. That is, when the response personnel selects the "response start" icon for a certain moving body 2 through the information terminal 3 (that is, input indicating the response for a certain moving body 2 is made), the communication unit 31 of the information terminal 3 sends the response information indicating that the moving body 2 is receiving the response to the information processing system 1A. When the communication unit 11 of the information processing system 1A receives the response information, it outputs the response information by sending the response information to the operator terminal 5. In this way, as shown in the image F12, the image captured by the moving body 2 and the icon H1 (that is, the response information) are displayed on the display unit 53 of the operator terminal 5.

[0268] Image F14 shows an image in which icon G1 is selected. Image F14 shows icon G4 for canceling a response request and icon G5 for inputting a necessary response degree and response content. By selecting icon G4, the operator can cancel a response request issued to a certain response person. Furthermore, by selecting icon G5, the operator can input a necessary response degree and response content. Specifically, when icon G5 is selected, an input image I1 for inputting a necessary response degree and response content is displayed. After inputting the necessary response degree and response content, the operator selects the "Send" icon. Accordingly, a response request including a necessary response degree and response content can be made.

[0269] (Other Embodiments)

[0270] The above describes the information processing method and information processing system 1 involved in one or more embodiments of the present disclosure based on Implementation Examples 1 and 2, but the present disclosure is not limited to Implementation Examples 1 and 2. Without departing from the gist of the present disclosure, various modifications that can be thought of by a person skilled in the art are performed on each Implementation Example 1 and 2, and the methods formed by combining constituent elements in different implementation examples may also be included in the scope of one or more embodiments of the present disclosure.

[0271] For example, in the first and second embodiments, the information processing system 1 and 1A includes the determination unit 131, but the present invention is not limited thereto. When the information processing system 1 and 1A does not include the determination unit 131, the acquisition unit 12 of the information processing system 1 and 1A may acquire information indicating that an event has occurred in one or more mobile bodies 2 from an external system such as a remote control system via the communication unit 11.

[0272] For example, in Embodiments 1 and 2, the communication unit (output unit) 11 sends the second information to the information terminal 3 used by the responding personnel, but the present invention is not limited to this. For example, the communication unit (output unit) 11 may also output the second information to other systems. In this case, other systems may also perform processing with reference to the second information.

[0273] For example, in the first and second embodiments, although the mobile body 2 is in a form that can be remotely operated by an operator, the present invention is not limited thereto, and the mobile body 2 may also be in a form that cannot be remotely operated by an operator. In this case, the mobile body 2 may not have the remote operation control unit 25. Furthermore, in this case, the determination unit 131 of the information processing system 1 or 2 may not perform step S203 of determining whether remote operation is possible. That is, in this case, the determination unit 131 determines that no event has occurred if the mobile body 2 can travel automatically, and determines that an event has occurred if the mobile body 2 cannot travel automatically.

[0274] For example, in embodiments 1 and 2, the mobile body 2 only needs to be able to move autonomously, and in addition to the automatic delivery robot, it may also include a security robot, an elevator, or a working robot, etc. Of course, the security robot, the elevator, or the working robot, etc. may also be in a form that can be remotely operated by an operator.

[0275] For example, the present disclosure can be implemented as a program for causing a processor to execute the steps included in the information processing method. Furthermore, the present disclosure can also be implemented as a non-transitory computer-readable recording medium such as a CD-ROM recording the program.

[0276] For example, when the present disclosure is implemented by a program (software), each step is executed by executing the program using hardware resources such as a computer's CPU, memory, and input / output circuits. In other words, each step is executed by the CPU obtaining data from the memory or input / output circuits and performing calculations, or outputting calculation results to the memory or input / output circuits.

[0277] In the above-mentioned embodiments 1 and 2, each component included in the information processing system 1 and 1A may be constituted by dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0278] Part or all of the functions of the information processing systems 1 and 1A involved in the above-mentioned embodiments 1 and 2 are implemented as a typical integrated circuit, that is, LSI. These can be made into one chip, or part or all of them can be made into one chip. In addition, integrated circuitization is not limited to LSI, and can also be implemented by a dedicated circuit or a general-purpose processor. It is also possible to use a programmable FPGA (Field Programmable Gate Array) after LSI manufacturing, or a reconfigurable processor in which the connection or setting of the circuit unit inside the LSI can be reconfigured.

[0279] Furthermore, various modifications of the embodiments of the present disclosure that are modified within the scope that can be conceived by those skilled in the art are also included in the scope of the present disclosure without departing from the gist of the present disclosure.

[0280] Industrial Applicability

[0281] The present disclosure can be applied to a system that manages a moving object that moves by autonomous movement.

[0282] Explanation of symbols

[0283] 1,1A Information Processing System

[0284] 11Communication unit (output unit)

[0285] 12 Obtaining Department

[0286] 13 Processing Department

[0287] 2 Mobile body

[0288] 3 Information Terminal

[0289] 33 Display

[0290] 5 Operator Terminal

[0291] 53 Display

Claims

1. An information processing method is an information processing method executed by a computer. In the information processing method, When the following event occurs in one or more of the plurality of autonomously moving moving bodies, first information related to services performed by each of the one or more moving bodies is obtained, wherein the event is an event for which a response personnel should rush to the position of the moving body to respond, Based on the obtained first information, a necessary degree of response is calculated for each of the one or more moving objects, the necessary degree of response indicating the degree to which the event should be responded to, The second information related to the calculated degree of necessity of the response is output.

2. The information processing method according to claim 1, In the information processing method, further obtaining third information related to the states of each of the plurality of moving objects, Based on the obtained third information, it is determined whether the event has occurred for each of the plurality of moving objects.

3. The information processing method according to claim 2, The third information includes information indicating whether each of the plurality of moving objects is capable of autonomous movement.

4. The information processing method according to claim 3, The plurality of moving bodies can be moved by remote control performed by an operator, The third information includes information indicating whether each of the plurality of mobile objects can communicate with the operator.

5. The information processing method according to any one of claims 1 to 4, The first information includes information indicating whether the service is being executed, information indicating a scheduled end time of the service, or information indicating a priority of the service, with respect to each of the one or more mobile bodies.

6. The information processing method according to any one of claims 1 to 4, In the information processing method, further obtaining third information related to the state of each of the one or more moving objects and fourth information related to the position of each of the one or more moving objects, Furthermore, the degree of necessary response is calculated for each of the one or more moving objects based on the obtained third information and the fourth information.

7. The information processing method according to claim 6, In the information processing method, further obtaining fifth information related to the location of the response personnel, The response order in which the response personnel should respond to the one or more moving objects is calculated based on the calculated response necessity degree, the obtained fourth information, and the obtained fifth information.

8. The information processing method according to any one of claims 1 to 4, In the information processing method, further obtaining sixth information related to the presence or absence of surrounding objects of each of the one or more moving bodies, Furthermore, based on the obtained sixth information, the degree of necessary response is calculated for each of the one or more moving objects.

9. The information processing method according to any one of claims 1 to 4, In the information processing method, further obtaining operator input information including the necessary degree of response specified by an operator, Furthermore, the degree of necessary response is calculated for each of the one or more moving objects based on the obtained operator input information.

10. The information processing method according to any one of claims 1 to 4, outputting the second information to an information terminal used by the responding personnel, The second information is displayed on a display unit included in the information terminal.

11. The information processing method according to claim 10, The display unit displays information indicating the degree of necessary response of each of the one or more moving objects and a map indicating the position of each of the one or more moving objects.

12. The information processing method according to claim 11, In the information processing method, further obtaining fifth information related to the location of the response personnel, The response order in which the response personnel should respond to the one or more moving objects is calculated based on the calculated response necessity degree and the obtained fifth information, Information showing the response sequence is also displayed on the display unit.

13. The information processing method according to claim 10, In the information processing method, When the responding personnel inputs an indication that a response is to be taken on a certain moving body among the one or more moving bodies through the information terminal, response-in-progress information indicating that the moving body is being responded to is output to the operator terminal used by the operator, The image captured by the moving object and the handling information are displayed on a display unit included in the operator terminal.

14. A program for causing a computer to execute the information processing method according to any one of claims 1 to 4.

15. An information processing system comprising: an obtaining unit for obtaining first information related to a service performed by each of the one or more moving bodies when an event occurs in one or more moving bodies among a plurality of moving bodies that are autonomously moving, wherein the event is an event for which a responding person should rush to a position of the moving body to respond; a processing unit that calculates a degree of necessary response for each of the one or more moving bodies based on the first information obtained by the obtaining unit, the degree of necessary response indicating a degree to which response should be taken to the event; as well as The output unit outputs second information related to the degree of necessity of the response calculated by the processing unit.

Images