Information processing apparatus, information processing method, and operation management system

Abstract

A current information acquisition unit that acquires current information, which is information received at the current time; a conversation type information control unit that outputs a conversation sentence related to a response task by a virtual responder and a conversation type image including an operation area, the conversation sentence and the operation area being generated based on the current information and know-how information for each past responder related to the operation of the mobile body; and a corresponding operation signal output unit that receives an operation on the operation area and outputs a control signal for instructing an operation related to the response task. An information processing apparatus comprising the above components.

Description

Technical Field

[0001] The disclosed technology relates to an information processing technology for processing information that supports the operation management of a moving object.

Background Art

[0002] Conventionally, there has been a technology for supporting the operation management of a moving object. Patent Document 1 discloses that, from vehicle information and operation information transmitted from a plurality of vehicles, risks (driving risk, route risk) are comprehensively considered, and the priority of vehicles to be monitored by a manager is presented to the manager. This reduces the monitoring burden on the manager in that it supports the manager to appropriately select the vehicles to be monitored.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, the response to an event that occurred during monitoring is entrusted to the manager. Therefore, there is a problem that, depending on the experience of the manager, the manager may not necessarily be able to appropriately respond to the event to be responded to.

[0005] The present disclosure aims to solve the above problems and enable support for appropriate response to events that the manager should respond to.

Means for Solving the Problems

[0006] The information processing apparatus of the present disclosure includes a current information acquisition unit that acquires current information, which is information received at the current time, An interactive information control unit that outputs an interactive image including a conversation sentence and an operation area related to a response task by a virtual responder generated based on the current information and the know-how information for each past responder related to the operation of the mobile body. A corresponding operation signal output unit that receives an operation on the operation area and outputs a control signal for instructing an operation related to the response task. It is provided with.

Effect of the Invention

[0007] According to the present disclosure, there is an effect that support for response can be provided so that an administrator can appropriately respond to an event to be responded to.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, in order to explain the present disclosure in more detail, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0010] Embodiment 1. In Embodiment 1, the basic form of the present disclosure will be described.

[0011] FIG. 1 is a diagram showing a configuration example of an operation management system including an information processing apparatus according to Embodiment 1 of the present disclosure. FIG. 1 is a diagram showing a configuration example of an operation management system 10 including an information processing apparatus 500 according to Embodiment 1 of the present disclosure. The operation management system 10 will be described assuming that there are a plurality of operation managers who use the same system and a plurality of operation areas by mobile bodies. Each operation manager can use the system by logging in to the system with his / her user ID. The operation manager is hereinafter also referred to as a "user". The operation management system 10 shown in FIG. 1 is a system for managing the operation of mobile bodies 100 (100-1, ···, 100-n (n≧1)). The operation management system 10 includes an information processing apparatus 500 that communicates with a mobile body-mounted device mounted on each mobile body. The operation management system 10 shown in FIG. 1 includes a mobile body 100 (100-1, ···, 100-n (n≧1)), an information source 200, an input / output device 300, and an information processing apparatus 500.

[0012] The mobile bodies 100 (100-1, ···, 100-n (n≧1)) are, for example, commercial vehicles. Alternatively, the mobile bodies 100 (100-1, ···, 100-n (n≧1)) may be general passenger vehicles. When the moving body is a commercial vehicle, the moving body is a bus, a cart, a taxi, a personal mobility device, or a truck, etc. In the present disclosure, the moving body 100 (100-1, ···, 100-n (n≧1)) may be one type among a bus, a cart, a taxi, a personal mobility device, and a truck, etc., or may be a combination of two or more types. When the moving body 100 (100-1, ···, 100-n (n≧1)) is a moving body as a public transportation vehicle, the moving body 100 (100-1, ···, 100-n (n≧1)) is operationally managed based on an operation schedule such as an operation timetable. The moving body 100 (100-1, ···, 100-n (n≧1)) is provided with a moving body-mounted device (not shown). In the present disclosure, the moving body-mounted device may be one type of device per moving body, or may be a plurality of devices of a plurality of types.

[0013] The information source 200 outputs current information used in the information processing device 500. The current information is information at the current time. The current information output by the information source 200 is information such as sensor information by a plurality of sensors including sensors mounted on the moving body, road traffic information, and operation information. Specifically, the current information includes, for example, failures, traffic jams, delays, and communication failures. The current information assumes information related to troubles in the moving body, but is not limited to the above examples. In the present disclosure, as long as the know-how information in the information processing device 500 described later indicates the correspondence to any current information related to the operation of the moving body.

[0014] The input / output device 300 is configured to receive information from the information processing device 500 and present the received information to the user by image and sound. In addition, the input / output device 300 is configured such that the user can operate, request, and input information with respect to each information presented by the information processing device 500. The input / output device 300 is, for example, a display device with a touch panel function.

[0015] The information processing apparatus 500 outputs, based on the current information and the know-how information for each past responder, a conversation sentence related to a task (corresponding task) that the user should handle and a conversation-type image including an operation area. The know-how information indicates the response to past tasks. The know-how information includes information such as "date and time", metadata for each responder ("attribute information" of the responder and "identification information" of the responder), "task", and "response". "Date and time" indicates the year, month, day, and time related to the past response. "Attribute information" indicates the attributes of the responder. The attributes of the responder are, for example, information such as affiliation, position, years of experience, age, etc. The attributes of the responder may include, for example, gender, personality, etc. "Identification information" indicates information for identifying the responder. The identification information is, for example, name, identification number, etc. "Task" assumes responses to any troubles related to the moving body. The task includes troubles related to the living body such as the physical condition and stress of the passengers in the moving body. "Response" assumes "function", "instruction", "scene", "response result", etc. "Function" indicates which screen function was used for the task. The screen functions are, for example, map, camera image, reservation list, route creation, operation schedule, etc. "Instruction" is the content of what control instructions were given to the moving body or the operation system for the task. The control instructions are, for example, route change, vehicle stop, traffic stop setting, alternative vehicle setting, addition or deletion of flights, etc. "Scene" indicates in what situation and what response was made. For example, when the number of people in the vehicle is large, it is ○○, and when it is small, it is ○○, etc. "Response result" indicates which response quickly resolved the trouble and whether the subsequent operation was smooth. That is, based on the above know-how information, the information processing apparatus 500 can output a conversational image by taking into account past responders and including responses and response candidates for cases similar to past errors and trouble events based on the current information.

[0016] The conversational image assumes a form similar to a chat. Therefore, the conversational image can also be expressed as a chat image. The conversational image includes a "conversation sentence" and an "operation area". The "conversation sentence" indicates, for example, the utterance of a virtual responder. The "conversation sentence" of the virtual responder is a sentence that expresses the content related to the task (response task) for the current information in a conversational form (spoken form). The virtual responder is assumed to be, in the operation management system as an information processing system including the information processing apparatus 500 of the present disclosure, a concierge like a chatbot within the system, a responder that simulates another operation manager who has used the same operation management system, or a responder that simulates an operation manager for each attribute of the said responder. Also, the "conversation sentence" indicates, for example, the utterance of the user. The "conversation sentence" of the user is based on the text sentence input by the user to the information processing apparatus 500. The "conversation sentence" is used, for example, by displaying the utterances of the virtual responder and the user in chronological order. The "operation area" is an image that accepts a response operation related to a task (response task) for the current information in relation to the "conversation sentence" of the virtual responder. The "operation area" is an image that is displayed in association with the "conversation sentence" and is displayed adjacent to the "conversation sentence" image. The "operation area" includes text indicating the operation content. The operation content includes, for example, an execution button for the operation content related to the response operation indicated in the "conversation sentence" to the virtual responder, a stop button for stopping the ongoing response operation, and the like.

[0017] In addition, the conversational image may include icon images for each virtual counterpart. This makes it possible to output a conversational image that differentiates between a chatbot-like concierge within the system, a counterpart that simulates another operation manager who has used the same operation management system, or a counterpart that simulates an operation manager for each attribute of the counterpart.

[0018] In addition, the conversational image may include the images shown in each embodiment. For example, the conversational image may include a "status flag" indicating the status of the response to the task. The "status flag" indicates, for example, "unsolved" or "solved" for the task.

[0019] A configuration example of the information processing apparatus according to Embodiment 1 of the present disclosure will be described. FIG. 2 is a diagram showing a basic configuration example of the information processing apparatus according to Embodiment 1 of the present disclosure. The information processing apparatus 500A shown in FIG. 2 includes a current information acquisition unit 510, a conversational information control unit 520, and a response operation signal output unit 530.

[0020] The current information acquisition unit 510 acquires current information that is information received at the current time. The current information acquisition unit 510 acquires current information from the mobile body 100 and the information source 200. The current information may include the state inside and outside the mobile body.

[0021] The conversational information control unit 520A outputs a conversational sentence related to the response task by a virtual counterpart and a conversational image including an operation area, which are generated based on the current information and the know-how information for each past counterpart related to the operation of the mobile body 100. The know-how information includes metadata for each past counterpart. The metadata includes identification information and attribute information for each past counterpart. The virtual counterpart is generated based on the identification information or the attribute information. The conversation-type information control unit 520A may be configured to search for corresponding tasks using pre-stored table data and current information. Alternatively, the conversation-type information control unit 520A may include an AI that learns know-how information, takes the current information as input, and outputs corresponding tasks. Alternatively, the conversation-type information control unit 520A may include a generative AI that takes the current information as input and outputs a conversation-type image including a conversation sentence and an operation area related to the corresponding task by a virtual responder. Note that the functions of the AI and the generative AI may be configured to be realized via an external server.

[0022] The corresponding operation signal output unit 530 receives an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task. The corresponding operation signal output unit 530 outputs a control signal for instructing an operation related to the corresponding task to the vehicle-mounted device of the mobile body 100.

[0023] In addition to the above configuration, the information processing device 500A includes a control unit (not shown), a storage unit (not shown), and a communication unit (not shown). The control unit (not shown) controls the entire information processing device 500A and each component. The control unit (not shown) activates the information processing device 500A according to a command from the outside, for example. Further, the control unit (not shown) controls the state of the information processing device 500A (operation states such as startup, shutdown, and sleep). The storage unit (not shown) stores each data used in the information processing device 500A. The storage unit (not shown) stores, for example, the output (output data) by each component in the information processing device 500A, and outputs the data requested for each component to the component that requested it. A communication unit (not shown) communicates with an external device. For example, it communicates between an information processing apparatus 500A and a peripheral device (e.g., a vehicle-mounted device). For example, when the information processing apparatus 500A and the vehicle-mounted device are not connected by wire, the communication unit (not shown) has a function of communicating between the information processing apparatus 500A and the vehicle-mounted device. Further, the communication unit (not shown) has a function of communicating with a server device which is an external device. The same applies to the control unit (not shown), the storage unit (not shown), and the communication unit (not shown) in the information processing apparatuses 500B and 500C according to the embodiments described later.

[0024] A processing example of the information processing apparatus 500A will be described. FIG. 3 is a flowchart showing an example of the processing of the information processing apparatus according to Embodiment 1 of the present disclosure. The processing shown in FIG. 3 is an information processing method by the information processing apparatus 500A. For example, the information processing apparatus 500A shown in FIG. 2 starts the processing shown in FIG. 3 in a normal monitoring state, for example. The normal monitoring state is a state in which the information processing apparatus 500A has not acquired the current information to be handled.

[0025] The information processing apparatus 500A then executes a current information acquisition determination process (step ST1001). In the current information acquisition process, the current information acquisition unit 510 of the information processing apparatus 500A determines whether it has received the current information to be handled at the current time. When the current information acquisition unit 510 determines that it has not received the current information to be handled (step ST1001 “NO”), it proceeds to the process of step ST1005. When the current information acquisition unit 510 determines that it has received the current information to be handled (step ST1001 “YES”), it acquires the current information, which is the information received at the current time, from the information source 200.

[0026] The information processing apparatus 500A then executes a conversational information output process (step ST1002). In the conversational information output process, the conversational information control unit 520 of the information processing apparatus 500A outputs a conversation sentence related to a response task by a virtual responder and a conversational image including an operation area, which are generated based on the current information and the know-how information for each past responder related to the operation of the moving body.

[0027] The information processing apparatus 500A then executes an operation reception determination process (step ST1003). In the operation reception determination process, the corresponding operation signal output unit 530 of the information processing apparatus 500A determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that an operation on the operation area has not been received within a certain period of time (step ST1003 “NO”), the information processing apparatus 500B proceeds to the process of step ST1001. If the corresponding operation signal output unit 530 determines that an operation on the operation area has been received (step ST1003 “YES”), the information processing apparatus 500B proceeds to the process of step ST1004.

[0028] The information processing apparatus 500A then executes a corresponding operation signal output process (step ST1004). In the corresponding operation signal output process, the corresponding operation signal output unit 530 of the information processing apparatus 500A outputs a corresponding operation signal related to the operation area where the operation has been received to the apparatus that executes the corresponding operation.

[0029] The information processing apparatus 500A then proceeds to an end determination process (step ST1005). In the end determination process, a control unit (not shown) of the information processing apparatus 500A determines whether to end the process of the information processing apparatus 500A. The control unit (not shown) determines whether to end the process of the information processing apparatus 500A according to, for example, an end command from the outside or an execution program. At this time, the conversational information control unit 520 of the information processing apparatus 500A checks whether the corresponding task has been solved by the output of the corresponding operation signal by the corresponding operation signal output unit 530. When a control unit (not shown) determines that the processing of the information processing apparatus 500A is not completed (step ST1005 “NO”), the process proceeds to the process of step ST1001, and the repetitive process is performed from the process of step ST1001. When a control unit (not shown) determines that the processing of the information processing apparatus 500A is completed (step ST1005 “YES”), the information processing apparatus 500A ends the processing. At this time, the conversational information control unit 520 of the information processing apparatus 500A changes, for example, the status flag in the conversational image from “unsolved” to “solved”.

[0030] According to the above-described disclosure, the present disclosure can assist in making an appropriate response to an event that an administrator should handle.

[0031] This embodiment has disclosed the following configuration. a current information acquisition unit that acquires current information, which is information received at the current time; a conversational information control unit that outputs a conversational sentence and a conversational image including an operation area related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of the moving body; a corresponding operation signal output unit that receives an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task; an information processing apparatus comprising: According to this configuration, an information processing apparatus can be provided that has an effect of enabling support for making an appropriate response to an event that an administrator should handle.

[0032] This embodiment has disclosed the following configuration. An information processing method by an information processing apparatus, wherein a current information acquisition unit of the information processing apparatus acquires current information, which is information received at the current time, The conversation-type information control unit of the information processing apparatus outputs a conversation sentence and a conversation-type image including an operation area related to a response task by a virtual responder generated based on the current information and the know-how information for each past responder related to the operation of the mobile body. The response operation signal output unit of the information processing apparatus receives an operation on the operation area and outputs a control signal for instructing an operation related to the response task. Information processing method. With this configuration, it is possible to provide an information processing method that enables support for responses so that an administrator can appropriately respond to events to be responded to.

[0033] This embodiment has disclosed the following configuration. A computer A current information acquisition unit that acquires current information, which is information received at the current time, A conversation-type information control unit that outputs a conversation sentence and a conversation-type image including an operation area related to a response task by a virtual responder generated based on the current information and the know-how information for each past responder related to the operation of the mobile body, A response operation signal output unit that receives an operation on the operation area and outputs a control signal for instructing an operation related to the response task, An information processing apparatus provided with An information processing program that operates as With this configuration, it is possible to provide an information processing program that enables support for responses so that an administrator can appropriately respond to events to be responded to.

[0034] This embodiment has disclosed the following configuration. An operation management system including an information processing apparatus that communicates with a mobile body-mounted apparatus mounted on each mobile body, The information processing apparatus A current information acquisition unit that acquires current information, which is information received at the current time, A conversation type information control unit that outputs a conversation sentence and a conversation type image including an operation area related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of the moving body, A corresponding operation signal output unit that receives an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task to the moving body-mounted device, A running management system characterized by comprising: With this configuration, it is possible to provide a running management system that has the effect of enabling support for responses so that an administrator can appropriately respond to events to be responded to.

[0035] Embodiment 2. Embodiment 2 will describe a configuration form that realizes more detailed functions in addition to the functions of the configuration according to Embodiment 1. In Embodiment 2, among the components according to Embodiment 2, duplicate descriptions of the components similar to those according to Embodiment 1 that have already been described will be appropriately omitted.

[0036] A configuration example of an information processing apparatus according to Embodiment 2 of the present disclosure will be described. FIG. 4 is a diagram showing a configuration example of an information processing apparatus according to Embodiment 2 of the present disclosure. The information processing apparatus 500B shown in FIG. 4 includes a current information acquisition unit 510, a conversation type information control unit 520, a judgment support information generation unit 521, a conversation sentence adjustment unit 522, a conversation sentence prediction unit 523, a corresponding operation signal output unit 530, a conversation sentence reception unit 540, a designation reception unit 550, and a know-how information acquisition unit 560.

[0037] The current information acquisition unit 510 acquires current information, which is information received at the current time, in the same manner as the current information acquisition unit 510 already described.

[0038] Similar to the conversational information control unit 520A described above, the conversational information control unit 520B outputs a conversational sentence and a conversational image including an operation area related to a response task by a virtual responder generated based on the current information and the know-how information for each past responder related to the operation of the mobile body 100. Furthermore, the conversational image including the conversational sentence by the virtual responder output by the conversational information control unit 520B includes a plurality of the operation areas. Furthermore, when there are a plurality of response tasks to be responded to simultaneously, the conversational information control unit 520B newly outputs a task selection image for each response task, and when a response task is selected via the task selection image, outputs the conversational image related to the selected response task. The conversational information control unit 520B shown in FIG. 4 includes a judgment support information generation unit 521, a conversational sentence prediction unit 523, and a conversational sentence adjustment unit 522.

[0039] The judgment support information generation unit 521 generates judgment support information based on the response task for each operation area and the operation history related to the response task. In this case, the conversational image output by the conversational information control unit 520B includes the judgment support information for each operation area.

[0040] FIG. 5 is a diagram showing a detailed configuration example of the judgment support information generation unit 521 in the information processing apparatus 500 according to Embodiment 2 of the present disclosure. The judgment support information generation unit 521 shown in FIG. 5, for example, accepts and sets in advance an operation for selecting the type of judgment support, and outputs the judgment support information of the selected type. The judgment support information generation unit 521 includes a statistical information output unit 524, a priority calculation unit 525, and a supplementary information output unit 526.

[0041] The statistical information output unit 524 outputs statistical information on operation candidates related to the operation area. The statistical information output unit 524 calculates statistical information based on know-how information including metadata for each responder. The statistical information output unit 524 outputs the statistical information as decision support information. In this case, the decision support information is statistical information based on know-how information including metadata for each responder.

[0042] The priority calculation unit 525 calculates the priority of operation candidates related to the corresponding task. The priority calculation unit 525 outputs, as decision support information, the priority for each operation candidate related to the operation area. In this case, the decision support information is the priority of the operation related to the operation area.

[0043] The supplementary information output unit 526 outputs supplementary information related to the corresponding task. The supplementary information related to the corresponding task is, for example, decision support information that is information for determining the corresponding operation related to the corresponding task. The supplementary information output unit 526 outputs, as decision support information, selection reason information including the reason for selecting the operation area for each operation related to the operation area. In this case, the decision support information is selection reason information including the reason for selecting the operation area.

[0044] Return to the description of the configuration example in FIG. 4. The conversation sentence prediction unit 523 predicts candidates for the conversation sentences of the user based on the feature information indicating the characteristics of the responses by the user stored in advance, the current information, and the know-how information.

[0045] The conversation sentence adjustment unit 522 adjusts the conversation sentences of the user based on the operations by the user. Specifically, when the conversation sentence prediction unit 523 predicts the conversation sentence of the user, the conversation sentence adjustment unit 522 accepts the operation by the user and adjusts the conversation sentence predicted by the conversation sentence prediction unit 523 based on the operation by the user.

[0046] The corresponding operation signal output unit 530, similar to the corresponding operation signal output unit 530 already described, receives an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task.

[0047] The conversation sentence reception unit 540 receives a user's conversation sentence. The conversation sentence reception unit 540 receives a conversation sentence from the user via the input / output device 300. In this case, the conversation type information control unit 520B outputs a conversation type image using further the conversation sentence received by the conversation sentence reception unit 540.

[0048] The designation reception unit 550 receives designation information for designating the virtual counterpart via the conversation sentence reception unit 540. In this case, the conversation type information control unit 520B further outputs a conversation type image including a conversation sentence by the virtual counterpart based on the designation information.

[0049] When an operation related to the corresponding task is instructed, the conversation type information control unit 520B outputs a conversation type image including a know-how input area for receiving input of know-how information related to the counterpart. The know-how information acquisition unit 560 attaches metadata for each counterpart to the know-how information acquired via the know-how input area and stores it. The know-how information includes metadata for each past counterpart. The metadata includes identification information and attribute information for each past counterpart.

[0050] [First Function in Embodiment 2] A processing example and an operation image example related to the first function of the information processing apparatus 500B will be described. FIG. 6 is a flowchart showing an example of the first processing in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 7 is a diagram for explaining the function by the first processing in the information processing apparatus according to Embodiment 2 of the present disclosure. The processing shown in FIG. 6 is an information processing method by the information processing apparatus 500B. For example, when current information is input to the information processing apparatus 500B shown in FIG. 4, the process shown in FIG. 6 is started. Here, a processing example when the current information is traffic jam information will be described.

[0051] The information processing apparatus 500B then executes a traffic jam information acquisition determination process (step ST2101). In the traffic jam information acquisition determination process, the current information acquisition unit 510 of the information processing apparatus 500B determines whether the current information is the current information to which it should correspond. In FIG. 6, the current information acquisition unit 510 determines whether the current information is the traffic jam information to which it should correspond. When the current information acquisition unit 510 determines that it is not the current information (traffic jam information) to which it should correspond (step ST2101 “NO”), the process proceeds to the process of step ST2109. When the current information acquisition unit 510 determines that it is the current information (traffic jam information) to which it should correspond (step ST2101 “YES”), it acquires the traffic jam information as the current information to which it should correspond. The current information acquisition unit 510 outputs the traffic jam information to the dialogue type information control unit 520.

[0052] The information processing apparatus 500B then executes a process of outputting a dialogue sentence and an operation area related to route recommendation change (step ST2102). In this process, when the dialogue type information control unit 520 of the information processing apparatus 500B receives the traffic jam information from the current information acquisition unit 510 and confirms the recommended route and changes the recommended route based on the traffic jam information, it outputs a dialogue sentence and an operation area related to route recommendation change as shown in FIG. 7. The dialogue type image display area shown in FIG. 7 includes an icon 1101, a dialogue type image (operation area) 1102, an execution button (operation area) 1103, a cancel button (operation area) 1104, a corresponding task related image (operation area) 1105, and an unresolved display 1106. The icon 1101 indicates a virtual corresponding person who uttered the dialogue type image (operation area) 1102. The virtual corresponding person is a corresponding person when all the know-how information is summarized, or a corresponding person generated from the identification information and attribute information of each past corresponding person. The execution button (operation area) 1103 is an operation area that accepts an operation to execute an operation related to the corresponding task and conversation sentence. The cancel button (operation area) 1104 is an operation area that accepts an operation to cancel the corresponding operation. The corresponding task-related image (operation area) 1105 shown in FIG. 7 is a map showing traffic jams and recommended route changes due to traffic jams. The unresolved display 1106 is an image (an example of a status flag) indicating that the corresponding task related to the conversation image is unresolved.

[0053] The information processing apparatus 500B then executes operation reception determination processing (step ST2103). In the operation reception determination processing, the corresponding operation signal output unit 530 of the information processing apparatus 500B determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that an operation on the operation area has not been received within a certain period of time (step ST2103 “NO”), the information processing apparatus 500B proceeds to the processing of step ST2104. If the corresponding operation signal output unit 530 determines that an operation on the operation area has been received (step ST2103 “YES”), the information processing apparatus 500B proceeds to the processing of step ST2108.

[0054] The information processing apparatus 500B then executes conversation sentence reception determination processing (step ST2104). In the conversation sentence reception determination processing, if the conversation sentence reception unit 540 of the information processing apparatus 500B determines that a conversation sentence has not been received (step ST2104 “NO”), the information processing apparatus 500B proceeds to the processing of step ST2101. If the conversation sentence reception unit 540 determines that a conversation sentence has been received (step ST2104 “YES”), the information processing apparatus 500B proceeds to the processing of step ST2105.

[0055] The information processing apparatus 500B then executes conversation sentence input processing (step ST2105). In the conversation text input process, the conversation text reception unit 540 of the information processing apparatus 500B inputs input conversation text information indicating the received input conversation text to the conversation type information control unit 520B.

[0056] The information processing apparatus 500B then executes a conversation text image output process (step ST2106). In the conversation text image output process, the conversation type information control unit 520B of the information processing apparatus 500B outputs a conversation text image (operation area) 1107 as shown in FIG. 7, for example, based on the input conversation text information.

[0057] The information processing apparatus 500B then executes a process of outputting a conversation text and an operation area based on the conversation text input by the user (step ST2107). In this process, the conversation type information control unit 520B of the information processing apparatus 500B outputs a conversation text image including a conversation text indicating a reply and an operation area for the conversation text input by the user. In FIG. 7, for the conversation type image 1107 indicating the question input by the user, the conversation type image (operation area) 1108 indicating the answer includes a running diagram display button (operation area) 1109 and a history details button (operation area) 1110. By operating the running diagram display button (operation area) 1109, a function of displaying the running diagram can be realized. Also, by operating the history details button (operation area) 1110, a function of displaying the details of the history can be realized. The information processing apparatus 500B then proceeds to the process of step ST2101. In the process from step ST2101 to step ST2102, if there is congestion information currently being output, the information processing apparatus 500B maintains the output of the conversation type image. Also, in the process from step ST2101 to step ST2102, if new congestion information is acquired, the information processing apparatus 500B maintains the output of the conversation type image and outputs a new conversation type image.

[0058] In the process of step ST2103, when the information processing apparatus 500B determines that the corresponding operation signal output unit 530 has received an operation on the operation area (step ST2103 “YES”), the process proceeds to the process of step ST2108.

[0059] Next, the information processing apparatus 500B executes operation command processing (step ST2108). In the operation command processing, when the corresponding operation signal output unit 530 of the information processing apparatus 500B receives an operation on the operation area, it outputs a control signal for commanding an operation related to the corresponding task.

[0060] Next, the information processing apparatus 500B proceeds to end determination processing (step ST2109). In the end determination processing, a control unit (not shown) of the information processing apparatus 500B determines whether to end the processing of the information processing apparatus 500B. The control unit (not shown) determines whether to end the processing of the information processing apparatus 500B, for example, according to an end command from the outside or an execution program. When the control unit (not shown) determines that the processing of the information processing apparatus 500B is not to be ended (step ST2109 “NO”), the process proceeds to the process of step ST2101, and repetitive processing is performed from the process of step ST2101. When the control unit (not shown) determines that the processing of the information processing apparatus 500B is to be ended (step ST2109 “YES”), the information processing apparatus 500B ends the processing.

[0061] When a large amount of similar know-how information is accumulated by the first function, the know-how information can be aggregated and supported.

[0062] [Second Function in Embodiment 2] A processing example and an operation image example related to the second function of the information processing apparatus 500B will be described. FIG. 8 is a flowchart showing an example of a second process in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 9 is a diagram for explaining the function by the second process in the information processing apparatus according to Embodiment 2 of the present disclosure. The process shown in FIG. 8 is an information processing method by the information processing apparatus 500B. For example, when current information is input, the information processing apparatus 500B shown in FIG. 4 starts the process shown in FIG. 8. Here, a processing example in the case where the current information is traffic jam information will be described.

[0063] The information processing apparatus 500B then executes a traffic jam information acquisition determination process (step ST2201). In the traffic jam information acquisition determination process, the current information acquisition unit 510 of the information processing apparatus 500B determines whether the current information is the current information to which it should correspond. In FIG. 6, the current information acquisition unit 510 determines whether the current information is the traffic jam information to which it should correspond. When the current information acquisition unit 510 determines that it is not the current information (traffic jam information) to which it should correspond (step ST2201 “NO”), it causes the process to shift to the process of step ST2211. When the current information acquisition unit 510 determines that it is the current information (traffic jam information) to which it should correspond (step ST2201 “YES”), it acquires the traffic jam information as the current information to which it should correspond.

[0064] The information processing apparatus 500B then executes a process of outputting a conversation type image including an operation area related to batch change of the recommended route (step ST2202). In this process, the conversation type information control unit 520 of the information processing apparatus 500B outputs a conversation sentence and a conversation type image including an operation area related to a response task by a virtual responder generated based on the current information and the know-how information for each past responder related to the operation of the moving body 100. At this time, as shown in FIG. 9, an icon 1201 indicating a virtual responder and a conversation type image (operation area) 1202 by the virtual responder are output. The conversation type image (operation area) 1202 includes an execution button (operation area) 1203, a stop button (operation area) 1204, and an unresolved display 1205. The execution button (operation area) 1203 is an operation area that accepts an operation to execute a batch change to the recommended route due to traffic congestion.

[0065] The information processing apparatus 500B then executes operation reception determination processing (step ST2203). In the operation reception determination processing, the corresponding operation signal output unit 530 of the information processing apparatus 500B determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that no operation on the operation area has been received within a certain period of time (step ST2203 “NO”), the information processing apparatus 500B proceeds to the processing of step ST2204. If the corresponding operation signal output unit 530 determines that the corresponding operation signal output unit 530 has received an operation on the operation area (step ST2203 “YES”), the information processing apparatus 500B proceeds to the processing of step ST2210.

[0066] The information processing apparatus 500B then executes conversation sentence reception determination processing (step ST2204). In the conversation sentence reception determination processing, the conversation sentence reception unit 540 of the information processing apparatus 500B determines whether a conversation sentence from the user has been received. If the conversation sentence reception unit 540 determines in the conversation sentence reception determination processing that the conversation sentence reception unit 540 of the information processing apparatus 500B has not received a conversation sentence (step ST2204 “NO”), the information processing apparatus 500B proceeds to the processing of step ST2201. In the processing from step ST2201 to step ST2202, if there is traffic information being currently output, the information processing apparatus 500B maintains the output of the conversation type image. Also, in the processing from step ST2201 to step ST2202, if new traffic information is acquired, the information processing apparatus 500B maintains the output of the conversation type image and outputs a new conversation type image. If the conversation sentence reception unit 540 determines that a conversation sentence has been received (step ST2204 “YES”), the information processing apparatus 500B proceeds to the processing of step ST2205.

[0067] The information processing apparatus 500B then executes conversation sentence input processing (step ST2205). In the conversation sentence input processing, the conversation sentence reception unit 540 of the information processing apparatus 500B inputs input conversation sentence information indicating the received input conversation sentence to the conversation type information control unit 520B.

[0068] The information processing apparatus 500B then executes designated reception determination processing (step ST2207). In the designated reception determination processing, the designated reception unit 550 of the information processing apparatus 500B determines whether it has received designated information for designating the virtual counterpart via the conversation sentence reception unit 540. If the designated reception unit 550 has not received designated information (step ST2207 “NO”), the information processing apparatus 500B proceeds to the processing of step ST2209.

[0069] If the designated reception unit 550 has received designated information (step ST2207 “YES”), the information processing apparatus 500B then executes designated input processing (step ST2208). In the designated input processing, the designated reception unit 550 of the information processing apparatus 500B inputs the designated information to the conversation type information control unit 520B.

[0070] The information processing apparatus 500B then executes processing for outputting a conversation sentence and an operation area (step ST2209). In this processing, the conversation type information control unit 520B of the information processing apparatus 500B outputs a conversation sentence and an operation area according to whether it has received or not received the designated information. Specifically, when the designated information is not input (step ST2207 “NO”), the conversation type information control unit 520B outputs a conversation type image including a conversation sentence and an operation area based on the conversation sentence information. When the call-type information control unit 520B receives the designation information from the designation reception unit 550 (step ST2207 “YES”), in addition to the conversation sentence information, it outputs a conversation-type image including the conversation sentence by the virtual counterpart and the operation area based on the designation information. As shown in FIG. 9, the call-type information control unit 520B outputs a call-type image 1206 including a mention (designation information) 1207. For example, based on the words of “veteran” mentioned (designation information) 1207, the call-type information control unit 520B generates a virtual counterpart corresponding to a plurality of past counterparts corresponding to the veteran, and outputs a call-type image (operation area) 1209 including an icon 1208 indicating the virtual counterpart, an operation button (operation area) 1210 for displaying the operation diagram related to the corresponding task, and a history detail button (operation area) 1211. Next, the information processing apparatus 500B proceeds to the process of step ST2201. In the process from step ST2201 to step ST2202, when there is traffic jam information being currently output, the information processing apparatus 500B maintains the output of the call-type image. Also, in the process from step ST2201 to step ST2202, when newly acquiring traffic jam information, the information processing apparatus 500B maintains the output of the call-type image and outputs a new call-type image.

[0071] When it is determined that the corresponding operation signal output unit 530 has received an operation on the operation area (step ST2203 “YES”), the information processing apparatus 500B then executes operation command processing (step ST2210). In the operation command processing, when the corresponding operation signal output unit 530 of the information processing apparatus 500B receives an operation on the operation area, it outputs a control signal for commanding an operation related to the corresponding task. Here, in FIG. 9, when an operation command is issued via the execution button (operation area) 1203, the conversational information control unit 520B then outputs an icon 1212 indicating a virtual counterpart different from the virtual counterpart shown by the icon 1208, together with a conversational image (operation area) 1213 indicating that the operation command has been confirmed. In this way, in one correspondence task, a plurality of different virtual counterparts can be generated, and a conversational image can be output for each virtual counterpart. As shown in FIG. 9, when the user receives mentions (designation information) 1207, 1216, a conversational image by the virtual counterpart corresponding to the designation information is generated.

[0072] The information processing apparatus 500B then proceeds to the end determination process (step ST2211). In the end determination process, a control unit (not shown) of the information processing apparatus 500B determines whether to end the processing of the information processing apparatus 500B. The control unit (not shown) determines, for example, whether to end the processing of the information processing apparatus 500B according to an end command from the outside or an execution program. If the control unit (not shown) determines not to end the processing of the information processing apparatus 500B (step ST2211 “NO”), the process proceeds to the process of step ST2201, and the repetitive process is performed from the process of step ST2201. If the control unit (not shown) determines to end the processing of the information processing apparatus 500B (step ST2211 “YES”), the information processing apparatus 500B ends the processing. Note that in the above description, it has been described that the operation reception determination and the conversation sentence reception determination are performed in order, but they may be processed in parallel or the order may be reversed. The same applies in the following description within a range that does not conflict with the realization of each function.

[0073] An output example by the second function in the second embodiment is shown. FIG. 9 shows an image of the conversational image area. In the conversational image area, there are icon 1201, conversational image (operation area) 1202, execution button (operation area) 1203, stop button (operation area) 1204, unsolved display 1205, conversational image (operation area) 1206, mention (designation information) 1207, icon (virtual counterpart) 1208, conversational image (operation area) 1209, operation display button (operation area) 1210, history details button (operation area) 1211, icon (virtual counterpart) 1212, conversational image (operation area) 1213, history details button (operation area) 1214, conversational image (operation area) 1215, and mention (designation information) 1216 are shown. As shown in icon (virtual counterpart) 1208 and icon (virtual counterpart) 1212, it is possible to output a conversational image as if a plurality of people are reacting. Also, it can be output as if another operation administrator is answering the user's question (when there are two or more people, the icons are split and displayed and grouped into one balloon). The information processing apparatus 500B outputs a conversational image by a virtual counterpart in response to a designation from the user. Thereby, it is possible to select a virtual counterpart according to the situation with which the user deals. Since it can be dealt with by a virtual counterpart, no manual labor is required. It is possible to deeply explore an individual's experience according to the situation with which the user deals. The information processing apparatus 500B can present that it is an automatic response by attaching a badge (icon 1201). The information processing apparatus 500B can generate virtual counterparts by attribute, such as "veteran", "road", "resort", "cold region", "morning shift", etc., by receiving a mention (designation information). Similarly, it is possible to return a question by designating a person or an attribute. The information processing apparatus 500B can receive operations on icons (operation areas) 1208 and 1212, and can make a phone call to the operation administrator indicated by the operated icon.

[0074] [Third Function in Embodiment 2] Describe a processing example and an operation image example related to the third function of the information processing apparatus 500B. FIG. 10 is a flowchart showing an example of a third process in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 11 is a diagram for explaining the function by the third process in the information processing apparatus according to Embodiment 2 of the present disclosure. The process shown in FIG. 10 is an information processing method by the information processing apparatus 500B. For example, when the information processing apparatus 500B shown in FIG. 4 acquires current information, it starts the process shown in FIG. 10. Here, a processing example when the current information is traffic jam information will be described.

[0075] The information processing apparatus 500B then executes a process of selecting a plurality of response candidates for the traffic jam (step ST2301). In this process, the conversation type information control unit 520B of the information processing apparatus 500B outputs a conversation type image including a plurality of the operation areas.

[0076] The information processing apparatus 500B then executes a statistical process related to a plurality of response candidates (step ST2302). In this process, the statistical information output unit 524 in the decision support information generation unit 521 of the information processing apparatus 500B outputs statistical information of operation candidates for each of the plurality of operation areas. The statistical information output unit 524 calculates statistical information based on know-how information including metadata for each responder. The statistical information output unit 524 outputs the statistical information as decision support information.

[0077] The information processing apparatus 500B then executes a process of outputting a conversation type image including statistical information for each operation area (step ST2303). In this process, the conversation type information control unit 520B of the information processing apparatus 500B outputs a conversation type image (operation area) 1302 including selection support information 1320 (1321, 1322, 1323) corresponding to each of the plurality of operation areas 1310 (1311, 1312, 1313), for example, as shown in FIG. 11.

[0078] An example of the display according to the third function will be described. FIG. 11 shows an icon 1301, a conversational image (operation area) 1302, an unresolved display 1303, an operation area 1310, an operation area (corresponding operation candidate) 1311, an operation area (corresponding operation candidate) 1312, an operation area (corresponding operation candidate) 1313, selection support information 1320, statistical information 1321, statistical information 1322, and statistical information 1323. As shown in FIG. 11, a conversational image including operation areas for a plurality of corresponding candidates is output. Further, it can be displayed together with statistical information (recommendation %) for each corresponding candidate.

[0079] [Fourth Function in Embodiment 2] A processing example and an operation image example related to the fourth function of the information processing apparatus 500C will be described. FIG. 12 is a flowchart showing an example of a fourth process in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 13 is a diagram for explaining the function by the fourth process in the information processing apparatus according to Embodiment 2 of the present disclosure. The process shown in FIG. 12 is an information processing method by the information processing apparatus 500B. For example, when the information processing apparatus 500B shown in FIG. 4 acquires current information, it starts the process shown in FIG. 12. Here, a processing example when the current information is traffic jam information will be described.

[0080] The information processing apparatus 500B then executes a process of selecting a plurality of corresponding candidates for the traffic jam (step ST2401). In this process, the conversational information control unit 520B of the information processing apparatus 500B uses the traffic jam information to select a plurality of operation candidates related to the corresponding tasks based on the know-how information, and generates operation candidate information for each operation candidate.

[0081] The information processing apparatus 500B then executes a priority calculation process related to a plurality of corresponding candidates (step ST2402). In the priority calculation process, the priority calculation unit 525 of the information processing apparatus 500B calculates the priority of the operation candidates related to the corresponding task. The priority calculation unit 525 calculates the priority of the operation candidates related to the corresponding task based on the know-how information related to the correspondence selected for the corresponding candidate. The priority calculation unit 525 determines the priority for each operation candidate related to the operation area as judgment support information and outputs it.

[0082] Next, the information processing apparatus 500B executes a process of outputting a conversational image including the operation area in the order of priority (step ST2403). In this process, the conversational information control unit 520B of the information processing apparatus 500B acquires the priority for each operation candidate as judgment support information from the priority calculation unit 525 and outputs it in the order of priority.

[0083] When the information processing apparatus 500B executes the process of step ST2403, it ends the process shown in FIG. 12.

[0084] An example of the display by the fourth function will be described. FIG. 13 shows an icon 1401, a conversational image (operation area) 1402, an unresolved display 1403, an operation area 1410, an operation area (corresponding operation candidate, selection support information) 1411, an operation area (corresponding operation candidate, selection support information) 1412, and an operation area (corresponding operation candidate, selection support information) 1413. As shown in FIG. 13, by outputting the priority order of the corresponding candidates based on the know-how information, the accumulation of the know-how information can be utilized to show more appropriate corresponding candidates. Alternatively, the priority may be output.

[0085] [The Fifth Function in Embodiment 2] A processing example and an operation image example related to the fifth function of the information processing apparatus 500C will be described. FIG. 14 is a flowchart showing an example of the fifth process in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 15 is a diagram for explaining the function by the fifth process in the information processing apparatus according to Embodiment 2 of the present disclosure. The process shown in FIG. 14 is an information processing method by the information processing apparatus 500B. For example, when the information processing apparatus 500B shown in FIG. 4 acquires current information, it starts the process shown in FIG. 14. Here, a processing example when the current information is traffic jam information will be described.

[0086] The information processing apparatus 500B then executes a process of selecting a plurality of response candidates for the traffic jam (step ST2501). In this process, the dialogue type information control unit 520B of the information processing apparatus 500B outputs a dialogue sentence related to the response task by the virtual responder generated based on the traffic jam information (current information) and the know-how information for each past responder related to the operation of the moving body 100, and a dialogue type image including an operation area. The dialogue type information control unit 520B selects a plurality of response candidates.

[0087] The information processing apparatus 500B then executes a process of outputting selection reason information related to a plurality of response candidates (step ST2502). In this process, the supplementary information output unit 526 of the information processing apparatus 500B outputs the selection reason information including the reason for selecting the operation area for each operation related to the operation area as judgment support information.

[0088] The information processing apparatus 500B then executes a process of outputting a dialogue type image including the selection reason information for each operation area (step ST2503). In this process, the dialogue type information control unit 520B of the information processing apparatus 500B receives the judgment support information and further outputs a dialogue type image using the judgment support information.

[0089] When the information processing apparatus 500B executes the process of step ST2503, it ends the process shown in FIG. 14.

[0090] The fifth function outputs a dialogue type image including the context of the selection reason for the response candidate. FIG. 15 shows an icon 1501, a conversational image (operation area) 1502, an unresolved display 1503, an operation area 1510, operation areas (corresponding operation candidates) 1511, 1512, 1513, selection support information 1520, supplementary information 1521, supplementary information 1522, and supplementary information 1523. For example, as shown in FIG. 15, a conversational image including selection support information 1520 (1521, 1522, 1523) is output corresponding to each operation area (corresponding operation candidate) 1510 (1511, 1512, 1513) for each corresponding candidate. Thereby, by outputting the reason for the selection, it is possible to assist in determining whether it is appropriate for the situation. In addition, it is possible to output a conversational image showing a natural response, such as an answer when actually asking a past responder about the reason for the selection.

[0091] [Sixth Function in Embodiment 2] A processing example and an operation image example related to the sixth function of the information processing apparatus 500B will be described. FIG. 16 is a flowchart showing an example of the sixth process in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 17 is a diagram for explaining the function by the sixth process in the information processing apparatus according to Embodiment 2 of the present disclosure. The process shown in FIG. 16 is an information processing method by the information processing apparatus 500B. For example, when the information processing apparatus 500B shown in FIG. 4 acquires current information, it starts the process shown in FIG. 16. Here, a processing example when the current information is traffic jam information will be described. The processes from step ST2601 to step ST2609 are the same as the processes already described, so the description will be partially omitted.

[0092] The information processing apparatus 500B then executes a process of determining whether a conversational image including an operation area related to a batch change of the recommended route has been output (step ST2601). In this process, the conversation-type information control unit 520 of the information processing apparatus 500B determines whether a conversation-type image including an operation area related to a batch change of the recommended route has been output based on the acquired traffic information. Here, in this process, the information processing apparatus 500B may perform the same processing as the processing of steps ST2201 and ST2202 described above.

[0093] Next, the information processing apparatus 500B executes an operation reception determination process (step ST2602). In the operation reception determination process, the corresponding operation signal output unit 530 of the information processing apparatus 500B determines whether an operation on the operation area has been received. If it is determined that the corresponding operation signal output unit 530 has not received an operation on the operation area within a certain period of time (step ST2602 “NO”), the information processing apparatus 500B proceeds to the process of step ST2603. If it is determined that the corresponding operation signal output unit 530 has received an operation on the operation area (step ST2602 “YES”), the information processing apparatus 500B proceeds to the process of step ST2609.

[0094] Next, the information processing apparatus 500B executes a conversation sentence reception determination process (step ST2603). In the conversation sentence reception determination process, the conversation sentence reception unit 540 of the information processing apparatus 500B determines whether a conversation sentence from the user has been received. If it is determined in the conversation sentence reception determination process that the conversation sentence reception unit 540 of the information processing apparatus 500B has not received a conversation sentence (step ST2603 “NO”), the information processing apparatus 500B proceeds to the process of step ST2601. If it is determined that the conversation sentence reception unit 540 has received a conversation sentence (step ST2603 “YES”), the information processing apparatus 500B proceeds to the process of step ST2604. In the processes from step ST2601 to step ST2602, if there is currently output traffic information, the information processing apparatus 500B maintains the output of the conversation-type image. Also, when the information processing apparatus 500B newly acquires traffic jam information in the process from step ST2601 to step ST2602, it maintains the output of the conversation-type image and outputs a new conversation-type image.

[0095] Next, the information processing apparatus 500B executes conversation sentence input processing (step ST2604). In the conversation sentence input processing, the conversation sentence reception unit 540 of the information processing apparatus 500B inputs input conversation sentence information indicating the received input conversation sentence to the conversation-type information control unit 520B.

[0096] Next, the information processing apparatus 500B executes designated person reception determination processing (step ST2606). In the designated person reception determination processing, the designated person reception unit 550 of the information processing apparatus 500B determines whether it has received designated person information for designating a virtual counterpart. When the designated person reception unit 550 has not received designated person information for designating a virtual counterpart (step ST2606 “NO”), the information processing apparatus 500B proceeds to the processing of step ST2608. When the designated person reception unit 550 has received designated person information for designating a virtual counterpart (step ST2606 “YES”), the designated person reception unit 550 receives the designated person information for designating the virtual counterpart.

[0097] When the designated person reception unit 550 has received designated person information for designating a virtual counterpart (step ST2606 “YES”), the information processing apparatus 500B then executes designated person input processing (step ST2607). In the designated person input processing, the designated person reception unit 550 of the information processing apparatus 500B inputs the designated person information to the conversation-type information control unit 520B.

[0098] Next, the information processing apparatus 500B executes processing for outputting a conversation sentence and an operation area (step ST2608). In this processing, the conversation-type information control unit 520B of the information processing apparatus 500B outputs a conversation sentence and an operation area according to whether it has received or is receiving the designated person information. Specifically, when no designation information is input (step ST2606 “NO”), the conversation-type information control unit 520B outputs a conversation-type image including a conversation sentence and an operation area based on the conversation sentence information. When the designation reception unit 550 receives designation information (step ST2606 “YES”), the conversation-type information control unit 520B receives the designation information from the designation reception unit 550, and outputs a conversation-type image including a conversation sentence by the virtual counterpart and an operation area based on the designation information in addition to the conversation sentence information. Next, the information processing apparatus 500B proceeds to the process of step ST2601.

[0099] When it is determined that the corresponding operation signal output unit 530 has received an operation on the operation area (step ST2602 “YES”), the information processing apparatus 500B then executes operation command processing (step ST2609).

[0100] Next, the information processing apparatus 500B executes corresponding task completed determination processing (step ST2610). In the corresponding task completed determination processing, the conversation-type information control unit 520B of the information processing apparatus 500B determines whether the corresponding task has been completed. When the know-how information acquisition unit 560 determines that the corresponding task has not been completed (step ST2610 “NO”), the information processing apparatus 500B proceeds to the process of step ST2601. When the know-how information acquisition unit 560 determines that the corresponding task has been completed (step ST2610 “YES”), the information processing apparatus 500B proceeds to the process of step ST2611.

[0101] Next, the information processing apparatus 500B executes know-how input image output processing (step ST2611). In the know-how input image output process, in the corresponding task processed determination process of the information processing apparatus 500B, when an operation related to the corresponding task is instructed, the conversation type information control unit 520B of the information processing apparatus 500B outputs a conversation type image including a know-how input area for receiving the input of know-how information related to the responder.

[0102] The information processing apparatus 500B then executes a know-how input determination process (step ST2612). In the know-how input determination process, the know-how information acquisition unit 560 of the information processing apparatus 500B determines whether know-how information has been input. If the know-how information acquisition unit 560 determines that no know-how information has been input during a certain period of time (step ST2612 “NO”), the information processing apparatus 500B proceeds to an end determination process (step ST2614). If the know-how information acquisition unit 560 determines that know-how information has been input (step ST2612 “YES”), the information processing apparatus 500B proceeds to step ST2613.

[0103] The information processing apparatus 500B then executes a know-how information acquisition process (step ST2613). In the know-how information acquisition process, the know-how information acquisition unit 560 of the information processing apparatus 500B attaches responder-specific metadata to the know-how information acquired via the know-how input area and stores it in a storage unit (not shown).

[0104] After executing the process of step ST2613, the information processing apparatus 500B ends the series of processes shown in FIG. 16.

[0105] An example of a conversation type image according to the sixth function will be described. FIG. 17 shows icon 1601, conversational image (operation area) 1602, execution button (operation area) 1603, cancellation button (operation area) 1604, image (solution display) 1605, know-how input (operation area) 1606, detailed requirement (operation area) 1607, conversational image 1610, conversational image (operation area) 1620, conversational image (operation area) 1621, operation diagram display button (operation area) 1622, history details button (operation area) 1623, and conversational image 1630. When the execution button 1603 is operated and the corresponding operation is completed, operation areas such as know-how input (operation area) 1606 are output. When an operation on the know-how input (operation area) 1606 is received, know-how information can be input.

[0106] [Seventh Function in Embodiment 2] A processing example and an operation image example related to the seventh function of the information processing apparatus 500C will be described. FIG. 18 is a flowchart showing an example of the seventh process in the information processing apparatus according to Embodiment 2 of the present disclosure. FIG. 19 is a diagram for explaining the function by the seventh process in the information processing apparatus according to Embodiment 2 of the present disclosure. The process shown in FIG. 18 is an information processing method by the information processing apparatus 500B. For example, when the information processing apparatus 500B shown in FIG. 4 acquires current information, it starts the process shown in FIG. 18. Here, a processing example when the current information is traffic jam information will be described.

[0107] The information processing apparatus 500B then executes a multiple tasks existence determination process (step ST2701). In the multiple tasks existence determination process, when the conversational information control unit 520B of the information processing apparatus 500B determines that there are no multiple corresponding response tasks to be processed simultaneously (step ST2701 “NO”), the process shown in FIG. 18 ends. In the multiple-task presence determination process, when there are multiple corresponding tasks to be handled simultaneously in the conversational information control unit 520B of the information processing apparatus 500B (step ST2701 "YES"), the information processing apparatus 500B proceeds to step ST2702.

[0108] The information processing apparatus 500B then executes a process of outputting a task selection image for each corresponding task (step ST2702). In this process, the conversational information control unit 520B of the information processing apparatus 500B newly outputs a task selection image for each corresponding task.

[0109] The information processing apparatus 500B then executes a task selection image selection determination process (step ST2703). In the task selection image selection determination process, the conversational information control unit 520B of the information processing apparatus 500B determines whether a task selection image has been selected. If the conversational information control unit 520B determines that the task selection image has not been selected (step ST2703 "NO"), the determination is repeated. If the conversational information control unit 520B determines that the task selection image has been selected (step ST2703 "YES"), the process proceeds to the process of step ST2704.

[0110] The information processing apparatus 500B then executes a process of outputting a conversational image related to the corresponding task (step ST2704). In this process, the conversational information control unit 520B of the information processing apparatus 500B outputs a conversational image related to the corresponding task.

[0111] The information processing apparatus 500B then executes a multiple-task presence determination (step ST2705). In the multiple-task presence determination process, if the conversational information control unit 520B of the information processing apparatus 500B determines that there are multiple tasks (step ST2705 "YES"), the information processing apparatus 500B proceeds to the process of ST2702.

[0112] When the information processing apparatus 500B determines in the process of step ST2705 that there are no multiple tasks, it ends the process shown in FIG. 18.

[0113] An example of a conversational image according to the seventh function will be described. FIG. 19 shows a task selection image (operation area) 1701, a selection-in progress display 1702, a task selection image (operation area) 1711, and a response required display 1712. In FIG. 19, a case is shown where there are a corresponding task of "Accident traffic jam at intersection A" and multiple corresponding tasks such as "Vehicle sensor failure 01", and task selection images 1701 and 1711 for each corresponding task are newly output. When a selection operation is received via the task selection image (operation area) 1701 and the task selection image (operation area) 1711, the conversational images of the task selection image (operation area) 1701 and the task selection image (operation area) 1711 corresponding to the selection operation can be selected and output. The selection-in progress display 1702 shows a state where the corresponding task of "Accident traffic jam at intersection A" is selected. The response required display 1712 indicates that it is a non-responded corresponding task based on a state flag indicating the corresponding state.

[0114] According to the above-described disclosure, the present disclosure can assist a selection operation when a conversational image including an operation area related to a plurality of response candidates is output.

[0115] The present embodiment further discloses the following configuration. It includes a conversation sentence reception unit that receives a user's conversation sentence, The conversational information control unit outputs a conversational image by further using the conversation sentence received by the conversation sentence reception unit. Information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can assist in a response in a dialogue format so that a user (operation manager) can appropriately respond to an event to be responded to. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, the present disclosure can provide an information processing method, the above information processing program, or an operation management system that has the same effect as the above effect.

[0116] This embodiment further discloses the following configuration. A designation reception unit that receives designation information for designating the virtual counterpart via the conversation sentence reception unit. The conversation type information control unit further outputs a conversation type image including a conversation sentence by the virtual counterpart based on the designation information. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that enables a user (operation manager) to provide a conversation sentence by a virtual person in charge desired by the user according to the generated event. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, the present disclosure can provide an information processing method, the above information processing program, or an operation management system that has the same effect as the above effect.

[0117] This embodiment further discloses the following configuration. The conversation type image including the conversation sentence by the virtual counterpart output by the conversation type information control unit includes a plurality of the operation areas. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that enables selection from among a plurality of operation candidates related to a response task by a virtual counterpart. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, an information processing method, an information processing program, or an operation management system having the same effects as the above can be provided, achieving the effect of.

[0118] This embodiment further discloses the following configuration. A conversation sentence reception unit that receives a user's conversation sentence. The conversation type information control unit further outputs a conversation type image using the conversation sentence received by the conversation sentence reception unit. The conversation type image including the conversation sentence by the virtual counterpart output by the conversation type information control unit includes a plurality of the operation areas. An information processing apparatus. With this configuration, an information processing apparatus can be provided that can support responses in a dialogue format so that a user (operation manager) can appropriately respond to events to be addressed. Also, an information processing apparatus can be provided that enables selection from among a plurality of operation candidates related to response tasks by a virtual counterpart, achieving the effect of. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, an information processing method, an information processing program, or an operation management system having the same effects as the above can be provided, achieving the effect of.

[0119] This embodiment further discloses the following configuration. The conversation type image including the conversation sentence by the virtual counterpart output by the conversation type information control unit includes a plurality of the operation areas. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can provide a user (operation manager) with a conversation sentence by a virtual person in charge according to the event that has occurred. It is possible to provide an information processing apparatus that can select from among a plurality of operation candidates related to the response task by the virtual responder. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or an operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system having the same effect.

[0120] This embodiment has disclosed the following configuration. The conversation-type image including the conversation sentence by the virtual responder output by the conversation-type information control unit includes a plurality of the operation areas. A determination support information generation unit that generates determination support information based on the response task for each operation area and the operation history related to the response task. The conversation-type image output by the conversation-type information control unit includes the determination support information for each operation area. Information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can support the determination of selecting from among a plurality of operation candidates. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or an operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system having the same effect.

[0121] This embodiment has disclosed the following configuration. A determination support information generation unit that generates determination support information based on the response task for each operation area and the operation history related to the response task. The conversational image output by the conversational information control unit includes the judgment support information for each of the operation areas. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can assist in making a determination to select from among a plurality of operation candidates. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or an operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system that has the same effect.

[0122] This embodiment has disclosed the following configuration. It includes a judgment support information generation unit that generates judgment support information based on the corresponding task for each operation area and the operation history related to the corresponding task. The conversational image output by the conversational information control unit includes the judgment support information for each of the operation areas. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can assist in making a determination to select from among a plurality of operation candidates. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or an operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system that has the same effect.

[0123] This embodiment has disclosed the following configuration. The judgment support information is statistical information based on know-how information including metadata for each corresponding person. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that supports selection from among a plurality of operation candidates based on the statistical results of know-how information, and thus has the effect of achieving this. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system that has the same effect as the above effect, and thus has the effect of achieving this.

[0124] This embodiment has disclosed the following configuration. The determination support information is the priority of the operation related to the operation area. Information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that supports selection from among a plurality of operation candidates using the priority based on know-how information, and thus has the effect of achieving this. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system that has the same effect as the above effect, and thus has the effect of achieving this.

[0125] This embodiment has disclosed the following configuration. The determination support information is selection reason information including the reason for selecting the operation area. Information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that supports selection using the selection reason based on know-how information, and thus has the effect of achieving this. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system that has the same effect as the above effect, and thus has the effect of achieving this.

[0126] This embodiment has disclosed the following configuration. When an operation related to the corresponding task is instructed, the conversation type information control unit outputs a conversation type image including a know-how input area for receiving an input of know-how information related to the corresponding person, and includes a know-how information acquisition unit that attaches metadata for each corresponding person to the know-how information acquired via the know-how input area and stores it. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can accumulate the current response result in know-how information, and has the effect of being able to do so. With this configuration, furthermore, since new know-how information can be accumulated, it is possible to provide response support that is more suitable for the user, and has the effect of being able to do so. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system having the same effect as the above, and has the effect of being able to do so.

[0127] This embodiment has disclosed the following configuration. When there are a plurality of corresponding tasks to be handled simultaneously, the conversation type information control unit newly outputs a task selection image for each corresponding task, and when a corresponding task is selected via the task selection image, outputs the conversation type image related to the selected corresponding task. An information processing apparatus. With this configuration, when there are a plurality of corresponding tasks to be handled simultaneously, it is possible to provide an information processing apparatus that can output a conversation type image for each corresponding task, and has the effect of being able to do so. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, the present disclosure can provide an information processing method, the above information processing program, or an operation management system having the same effects as the above effects.

[0128] Embodiment 3. Embodiment 3 will describe a configuration form that realizes a function in which operations on conversational images and operations on detailed information images are coordinated in addition to the functions of the configurations according to Embodiment 1 or Embodiment 2. In Embodiment 3, among the components according to Embodiment 3, for components similar to the components according to Embodiment 1 and Embodiment 2 that have already been described, duplicate descriptions will be omitted as appropriate.

[0129] A configuration example of an information processing apparatus according to Embodiment 3 of the present disclosure will be described. FIG. 20 is a diagram showing a configuration example of an information processing apparatus according to Embodiment 3 of the present disclosure. The information processing apparatus 500C has a function of coordinating a conversational image and a detailed information image. The information processing apparatus 500C includes a current information acquisition unit 510, a conversational information control unit 520, a judgment support information generation unit 521, a conversation sentence adjustment unit 522, a conversation sentence prediction unit 523, a statistical information output unit 524, a priority calculation unit 525, a supplementary information output unit 526, a corresponding operation signal output unit 530, a conversation sentence reception unit 540, a designation reception unit 550, a know-how information acquisition unit 560, and a detailed information control unit 570.

[0130] The current information acquisition unit 510 acquires current information, which is information received at the current time, in the same manner as the current information acquisition unit 510 already described.

[0131] The conversational information control unit 520 outputs voice data using the conversation sentence predicted by the conversation sentence prediction unit 523.

[0132] The judgment support information generation unit 521 generates judgment support information based on the corresponding task for each operation area and the operation history related to the corresponding task, in the same manner as the judgment support information generation unit 521 already described.

[0133] The conversation sentence adjustment unit 522 adjusts the user's conversation sentence based on the user's operation. In this case, the conversation type information control unit outputs the conversation type image including the conversation sentence adjusted by the conversation sentence adjustment unit.

[0134] The conversation sentence prediction unit 523 predicts candidates for the user's conversation sentence. The conversation sentence prediction unit 523 predicts candidates for the user's conversation sentence based on the feature information indicating the characteristics of the correspondence by the user stored in advance, the current information, and the know-how information. In relation to this configuration, the conversation sentence reception unit 540 receives the conversation sentence selected from among the candidates for the conversation sentence predicted by the conversation sentence prediction unit 523.

[0135] The statistical information output unit 524 outputs statistical information on operation candidates related to the operation area, in the same manner as the statistical information output unit 524 already described.

[0136] The priority calculation unit 525 calculates the priority of operation candidates related to the corresponding task, in the same manner as the priority calculation unit 525 already described.

[0137] The supplementary information output unit 526 outputs, as judgment support information, selection reason information including the reason for selecting the operation area for each operation related to the operation area, in the same manner as the supplementary information output unit 526 already described.

[0138] The corresponding operation signal output unit 530 receives an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task, in the same manner as the corresponding operation signal output unit 530 already described.

[0139] The conversation sentence reception unit 540 receives the user's conversation sentence, in the same manner as the conversation sentence reception unit 540 already described.

[0140] The named reception unit 550 receives naming information for naming the virtual counterpart through the conversation sentence reception unit 540, in the same manner as the named reception unit 550 already described.

[0141] The know-how information acquisition unit 560 outputs a conversation-type image including a know-how input area for receiving input of know-how information related to the counterpart when an operation related to the corresponding task is instructed, in the same manner as the know-how information acquisition unit 560 already described. The know-how information acquisition unit 560 attaches metadata for each counterpart to the know-how information acquired through the know-how input area and stores it.

[0142] The conversation-type image output by the conversation-type information control unit 520 includes a detailed request operation area for receiving an operation for requesting details of the corresponding task shown in the conversation-type image. When the detailed information control unit 570 receives a detailed request through the detailed request operation area, it acquires the current information related to the corresponding task for which the detailed request is made and outputs a detailed information image based on the current information. The detailed information control unit 570 outputs the detailed information image including a selection operation area for receiving a selection operation. In the case of having this configuration, the conversation-type information control unit 520 outputs the conversation-type image using the current information related to the selection operation area for which the selection operation has been performed.

[0143] A processing example of the information processing apparatus according to Embodiment 3 of the present disclosure will be described. FIG. 21 is a flowchart showing an example of the processing of the conversation-type information control unit in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 22 is a flowchart showing an example of the processing of the detailed information control unit in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 23 is a diagram showing an image of the functions in the information processing apparatus according to Embodiment 3 of the present disclosure.

[0144] The processing shown in FIG. 21 is an information processing method by the conversation-type information control unit 520C of the information processing apparatus 500C. For example, when the information processing apparatus 500C shown in FIG. 20 is displaying an operation management image during normal monitoring via an input / output device, it starts the process shown in FIG. 21.

[0145] The information processing apparatus 500C then executes an individual detail request reception determination process (step ST3001). In the individual detail request reception determination process, the conversational information control unit 520C of the information processing apparatus 500C determines whether an individual detail request has been received via the conversational image. If the conversational information control unit 520C determines that an individual detail request has not been received via the conversational image (step ST3001 “NO”), it repeats the process of step ST3001. If the conversational information control unit 520C determines that an individual detail request has been received via the conversational image (step ST3001 “YES”), it proceeds to the process of step ST3002.

[0146] The information processing apparatus 500C then executes an individual detail request notification process (step ST3002). In the individual detail request notification process, the conversational information control unit 520C of the information processing apparatus 500C notifies the detailed information control unit 570 that an individual detail request has been received.

[0147] The information processing apparatus 500C then executes an individual detail end request reception determination process (step ST3003). In the individual detail end request reception determination process, the conversational information control unit 520C of the information processing apparatus 500C determines whether an individual detail end request has been received via the conversational image. If the conversational information control unit 520C determines that an individual detail end request has not been received via the conversational image (step ST3003 “NO”), it repeats the process of step ST3003. If the conversational information control unit 520C determines that an individual detail end request has been received via the conversational image (step ST3003 “YES”), it proceeds to the process of step ST3004.

[0148] The information processing apparatus 500C then executes an individual detail end request notification process (step ST3004). In the individual detail end request notification process, when an individual detail end request is received, the conversation type information control unit 520C of the information processing apparatus 500C notifies the detailed information control unit 570 of the individual detail end request.

[0149] When the information processing apparatus 500C executes an individual detail end request notification in the process of step ST3004, it then ends a series of processes related to FIG. 21.

[0150] The process shown in FIG. 22 is an information processing method by the detailed information control unit 570 of the information processing apparatus 500C. For example, when the information processing apparatus 500C shown in FIG. 20 is displaying an operation management image during normal monitoring via an input / output device, the process shown in FIG. 22 is started.

[0151] The information processing apparatus 500C then executes a normal monitoring image output process (step ST3011). In the normal monitoring image output process, the detailed information control unit 570 of the information processing apparatus 500C outputs a detailed information image set in advance for normal management to the input / output device 300.

[0152] The information processing apparatus 500C then executes an individual detail request determination process (step ST3012). In the individual detail request determination process, the detailed information control unit 570 of the information processing apparatus 500C determines whether an individual detail request has been made from the conversation type information control unit 520C. If the detailed information control unit 570 determines that no individual detail request has been made from the conversation type information control unit 520C (step ST3012 “NO”), it returns to the process of step ST3011. If the detailed information control unit 570 determines that an individual detail request has been made from the conversation type information control unit 520C (step ST3012 “YES”), it proceeds to the process of step ST3013.

[0153] The information processing apparatus 500C then executes individual detailed image output processing (step ST3013). In the individual detailed image output processing, the detailed information control unit 570 of the information processing apparatus 500C acquires current information from the current information acquisition unit 510, and outputs an individual detailed image using the current information related to the individual detailed request.

[0154] The information processing apparatus 500C then executes individual detailed end determination processing (step ST3014). In the individual detailed end determination processing, the detailed information control unit 570 of the information processing apparatus 500C determines whether a notification of the end of individual details has been received from the conversation type information control unit 520C. When the detailed information control unit 570 determines that a notification of the end of individual details has not been received from the conversation type information control unit 520C (step ST3014 “NO”), the process proceeds to the process of step ST3013. When the detailed information control unit 570 determines that a notification of the end of individual details has been received from the conversation type information control unit 520C (step ST3014 “YES”), the process ends.

[0155] In the process of step ST3014, when the output of the individual detailed image is completed, the information processing apparatus 500C then ends the series of processes related to FIG. 22.

[0156] The image of the function of Embodiment 3 will be described. FIG. 23 shows an operation management image 2000, a conversation type image display area 2010, and a detailed information image 2020. The operation management image 2000 is composed of the conversation type image display area 2010 and the detailed information image 2020. The conversation type image display area 2010 is an area for displaying the conversation type image described in Embodiment 1 and Embodiment 2. The detailed information image 2020 outputs a detailed information image related to the corresponding task shown in the conversation type image display area 2010 in response to an operation received via the operation area 2011 of the conversation type image display area 2010. In addition, the conversational image display area 2010 outputs a conversational image related to the corresponding task according to the operation received via the operation area 2021 of the detailed information image 2020.

[0157] [First Function in Embodiment 3] A processing example and an operation image example related to the first function of the information processing apparatus 500C will be described. FIG. 24 is a flowchart showing an example of the first processing in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 25 is a first diagram for explaining the function by the first processing in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 26 is a second diagram for explaining the function by the first processing in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 27 is a third diagram for explaining the function by the first processing in the information processing apparatus according to Embodiment 3 of the present disclosure. The processing shown in FIG. 24 is an information processing method by the information processing apparatus 500C. For example, the information processing apparatus 500C shown in FIG. 20 starts the processing shown in FIG. 24 in a state where the operation management image during normal monitoring is being displayed via the input / output device.

[0158] The information processing apparatus 500C then executes an individual detailed request reception determination process (step ST3101). In the individual detailed request reception determination process, the detailed information control unit 570 of the information processing apparatus 500C determines whether it has received an individual detailed request via a conversational image from the conversational information control unit 520C. If the detailed information control unit 570 has not received an individual detailed request via a conversational image from the conversational information control unit 520C (step ST3101 “NO”), it proceeds to the process of step ST3104. If it has received an individual detailed request via a conversational image from the conversational information control unit 520C (step ST3101 “YES”), it proceeds to the process of step ST3102.

[0159] The information processing apparatus 500C then executes a process of acquiring current information related to the corresponding task for which an individual detail request has been made (step ST3102). In this process, the detailed information control unit 570 of the information processing apparatus 500C acquires current information from the information source 200.

[0160] The information processing apparatus 500C then executes a process of outputting a detailed information image based on the current information related to the individual detail request (step ST3103). In this process, the detailed information control unit 570 of the information processing apparatus 500C outputs a detailed information image based on the current information.

[0161] The information processing apparatus 500C then proceeds to an end determination process (step ST3104). In the end determination process, a control unit (not shown) of the information processing apparatus 500C determines whether to end the processing of the information processing apparatus 500C. The control unit (not shown) determines, for example, whether to end the processing of the information processing apparatus 500C according to an end command from the outside or an execution program. If the control unit (not shown) determines not to end the processing of the information processing apparatus 500C (step ST3104 “NO”), the process proceeds to the process of step ST3101, and repetitive processing is performed from the process of step ST3101. If the control unit (not shown) determines to end the processing of the information processing apparatus 500C (step ST3104 “YES”), the information processing apparatus 500C ends the processing.

[0162] A display example according to the first function in the third embodiment will be described. Figure 25 shows the operation management image 2100, the conversational image display area 2110, the conversational image 2111, the conversational image (operation area) 2120, the corresponding task-related image (operation area) 2121, the detail button (operation area) 2122, the solution button (operation area) 2123, and the detailed information image (normal management state) 2140 in the normal management state. The detailed information image (normal management state) 2140 is an image showing detailed information related to the moving body. The detailed information image (normal management state) 2140 is an image including information for identifying the moving body, along with information such as an image captured by an imaging device mounted on the moving body, the time related to the operation, the duration of the operation, the position related to the operation, and the state related to the operation. Figure 26 shows a state in which the detailed information image has switched to the detailed information image related to the corresponding task in the operation management image. The detailed information image related to the corresponding task (individual detailed state) 2150 has the conversational image (operation area) 2120 and the detail button (operation area) 2122 displayed in the conversational image display area 2110. When an operation from the user is received via the detail button (operation area) 2122, an image including detailed information related to the corresponding task shown in the conversational image (operation area) 2120 is displayed. The detailed information is, for example, information for identifying the moving body related to the corresponding task and information indicating the situation in the moving body. Figure 27 shows the conversational image display area, and in the conversational image display area, it shows the icon 2160, the conversational image (operation area) 2161, the corresponding task-related image (operation area) 2162, the status level (corresponding level high) 2163, the status level (corresponding level medium) 2164, the in-vehicle situation list display button (operation area) 2165, the solution button (operation area) 2166, the unsolved display 2167, the conversational image 2170, the mention (designation information) 2171, the conversational image (operation area) 2180, the highlight button (operation area) 2181, the history detail button (operation area) 2182, the conversational image (operation area) 2190, the highlight button (operation area) 2191, and the history detail button (operation area) 2192. The operation management image 2100 is composed of the conversational image display area 2110 and the detailed information image (normal management state) 2140. The detailed information image 2140 is an image in the normal management state. In the state of FIG. 25, when the current information acquisition unit 510 acquires, as current information, that the stress of the occupant in the vehicle has increased according to the sensor mounted on the moving body, the conversation type information control unit 520C outputs a conversation type image 2120 including a corresponding task related image (operation area) 2121 related to the occupant, based on the current information. When the conversation type information control unit 520C receives an operation via the corresponding task related image (operation area) 2121, the detailed information control unit 570 acquires current information related to the corresponding task, in place of the current information acquired in the normal management state, and outputs a detailed information image 2151 indicating the state of the occupant in each moving body, based on the current information. As a result, the detailed information image comes to show the detailed information related to the corresponding task shown in the conversation type image.

[0163] [Second function in Embodiment 3] A processing example and an operation image example related to the second function of the information processing apparatus 500C will be described. FIG. 28 is a flowchart showing an example of a second process in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 29 is a first diagram for explaining the function by the second process in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 30 is a second diagram for explaining the function by the second process in the information processing apparatus according to Embodiment 3 of the present disclosure. The process shown in FIG. 28 is an information processing method by the information processing apparatus 500C. For example, the information processing apparatus 500C shown in FIG. 20 starts the process shown in FIG. 28 in a state where a predicted conversation sentence 2240 (FIG. 29) is being output during normal monitoring.

[0164] The information processing apparatus 500C then executes a detailed information output determination process related to an individual detailed request (step ST3201). In the detailed information output determination process, the conversation type information control unit 520 of the information processing apparatus 500C determines whether detailed information related to the individual detailed request has been output. When the conversation-type information control unit 520 determines that it has not output the detailed information related to the individual detailed request (step ST3201 “NO”), the information processing apparatus 500C proceeds to the process of step ST3209. When the conversation-type information control unit 520 determines that it has output the detailed information related to the individual detailed request (step ST3201 “YES”), the information processing apparatus 500C is caused to proceed to the process of step ST3202.

[0165] The information processing apparatus 500C then executes a conversation sentence prediction process (step ST3202). In the conversation sentence prediction process, the conversation sentence prediction unit 523 of the information processing apparatus 500C predicts candidates for the user's conversation sentence using the current information related to the corresponding task. The conversation sentence prediction unit 523 predicts candidates for the user's conversation sentence based on the feature information indicating the corresponding characteristics by the user stored in advance, the current information, and the know-how information.

[0166] The information processing apparatus 500C then executes a conversation sentence candidate output process (step ST3203). In the conversation sentence candidate output process, the conversation sentence prediction unit 523 of the information processing apparatus 500C outputs the predicted candidates for the conversation sentence.

[0167] The information processing apparatus 500C then executes a conversation sentence candidate selection determination process (step ST3204). In the conversation sentence candidate selection determination process, the conversation sentence reception unit 540 of the information processing apparatus 500C determines whether a candidate for the conversation sentence has been selected. When the conversation sentence reception unit 540 determines that a candidate for the conversation sentence has not been selected within a certain period of time (step ST3204 “NO”), it proceeds to the process of step ST3206. When the conversation sentence reception unit 540 determines that a candidate for the conversation sentence has been selected (step ST3204 “YES”), it proceeds to the process of step ST3205.

[0168] The information processing apparatus 500C then executes a conversation sentence output process (step ST3205). In the conversation sentence output process, the conversation sentence reception unit 540 of the information processing apparatus 500C outputs the conversation sentence selected from the candidates of the conversation sentence.

[0169] The information processing apparatus 500C then executes a selection operation reception determination process for the detailed information image (step ST3206). In the selection operation reception determination process, the conversation sentence reception unit 540 of the information processing apparatus 500C determines whether a selection operation for the detailed information image has been received. Determines whether the conversation sentence selected from among the candidates of the conversation sentence predicted by the conversation sentence prediction unit 523 has been received. If the conversation sentence reception unit 540 determines that no selection operation for the detailed information image has been received within a certain period of time (step ST3206 “NO”), the process proceeds to the process of step ST3204. If the conversation sentence reception unit 540 determines that a selection operation for the detailed information image has been received (step ST3206 “YES”), the process proceeds to the process of step ST3207.

[0170] The information processing apparatus 500C then executes a conversation sentence prediction process (step ST3207). In the conversation sentence prediction process, the conversation sentence prediction unit 523 of the information processing apparatus 500C predicts candidates for the conversation sentence of the user based on the selection operation for the detailed information image, the feature information indicating the characteristics of the correspondence by the user stored in advance, the current information, and the know-how information.

[0171] The information processing apparatus 500C then executes a conversation sentence candidate output process (step ST3208). In the conversation sentence candidate output process, the conversation sentence prediction unit 523 of the information processing apparatus 500C outputs the predicted conversation sentence candidates.

[0172] The information processing apparatus 500C then proceeds to an end determination process (step ST3209). In the end determination process, a control unit (not shown) of the information processing apparatus 500C determines whether to end the processing of the information processing apparatus 500C. The control unit (not shown) determines whether to end the processing of the information processing apparatus 500C according to, for example, an end command from the outside or an execution program. When the control unit (not shown) determines not to end the processing of the information processing apparatus 500C (step ST3209 “NO”), the process proceeds to the process of step ST3201, and the repetitive process is performed from the process of step ST3201. When the control unit (not shown) determines to end the processing of the information processing apparatus 500C (step ST3209 “YES”), the information processing apparatus 500C ends the processing.

[0173] A display example according to the second function in the third embodiment will be described. FIG. 29 shows an operation management image 2200, a conversational image display area 2210, a conversational image 2211, a conversational image (operation area) 2220, a state level (corresponding level high) 2221, a detailed request button (operation area) 2222, a solution notification button (operation area) 2223, a detailed information image (individual detailed state) 2230, and a predicted conversation sentence 2240. FIG. 30 shows a predicted conversation sentence (before detailed request operation) 2241 and a predicted conversation sentence (after detailed request operation) 2242. For example, in the detailed information image (individual detailed state) 2230 of the operation management image 2200 shown in FIG. 29, first, when a detailed information image related to a corresponding task is displayed, a predicted conversation sentence (before detailed request operation) 2241 is shown. Next, when one moving object is selected from a plurality of moving objects in the detailed information image, a predicted conversation sentence (after detailed request operation) 2242 is shown according to the selection operation. In this way, the predicted conversation sentence is configured to change according to an operation on the detailed information image.

[0174] [The Third Function in the Third Embodiment] A processing example and an operation image example related to the third function of the information processing apparatus 500C will be described. FIG. 31 is a flowchart showing an example of a third process in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 32 is a first diagram for explaining the function by the third process in the information processing apparatus according to Embodiment 3 of the present disclosure. FIG. 33 is a second diagram for explaining the function by the third process in the information processing apparatus according to Embodiment 3 of the present disclosure. The process shown in FIG. 31 is an information processing method by the information processing apparatus 500C. For example, the information processing apparatus 500C shown in FIG. 20 starts the process shown in FIG. 31 in a state where an operation management image is being displayed.

[0175] The information processing apparatus 500C then executes a detailed information output determination process related to an individual detailed request (step ST3301). In this determination process, the conversation sentence prediction unit 523 of the information processing apparatus 500C determines whether detailed information related to an individual detailed request has been output. If the conversation sentence prediction unit 523 determines that the detailed information related to the individual detailed request has not been output (step ST3301 “NO”), the information processing apparatus 500C proceeds to the process of step ST3309. If the conversation sentence prediction unit 523 determines that the detailed information related to the individual detailed request has been output (step ST3301 “YES”), the information processing apparatus 500C proceeds to the process of step ST3302.

[0176] The information processing apparatus 500C then executes a conversation sentence request determination process (step ST3302). In this process, the conversation sentence prediction unit 523 of the information processing apparatus 500C determines whether a conversation sentence has been requested. If the conversation sentence prediction unit 523 determines that a conversation sentence has not been requested within a certain period of time (step ST3302 “NO”), it proceeds to the process of step ST3309. If the conversation sentence prediction unit 523 determines that a conversation sentence has been requested (step ST3302 “YES”), it proceeds to the process of step ST3303.

[0177] The information processing apparatus 500C then executes a process of outputting a conversation sentence corresponding to the request (step ST3303). In this process, the conversation sentence prediction unit 523 of the information processing apparatus 500C outputs the conversation sentence corresponding to the request to the conversation type information control unit 520.

[0178] The information processing apparatus 500C then executes a process of outputting a conversation type image including the conversation sentence and the adjustment request operation area (step ST3304). In this process, the conversation type information control unit 520 of the information processing apparatus 500C outputs the conversation type image. The conversation type information control unit 520 acquires the conversation sentence from the conversation sentence prediction unit 523 and outputs a conversation type image including the conversation sentence and the adjustment request operation area. FIG. 33 shows an example of a conversation type image including an adjustment request operation area. The conversation type image in FIG. 33 includes a conversation type image 2370, an icon 2380, a conversation type image (operation area) 2381, a predicted conversation sentence 2382, a predicted conversation sentence 2383, an adjustment button (operation area) 2384, and an execution button (operation area) 2385. The adjustment button (operation area) 2384 corresponds to the adjustment request operation area.

[0179] The information processing apparatus 500C then executes an operation reception determination process for the adjustment request operation area (step ST3305). In the operation reception determination process, the conversation sentence adjustment unit 522 of the information processing apparatus 500C determines whether an operation on the adjustment request operation area has been received. If the conversation sentence adjustment unit 522 determines that no operation has been received within a certain period of time (step ST3305 “NO”), it proceeds to step ST3307. If the conversation sentence adjustment unit 522 determines that an operation has been received (step ST3305 “YES”), it proceeds to the process of step ST3306.

[0180] The information processing apparatus 500C then executes a process of adjusting the conversation sentence (step ST3306). In this process, the conversation sentence adjustment unit 522 of the information processing apparatus 500C adjusts the conversation sentence of the user based on the operation by the user.

[0181] The information processing apparatus 500C then executes a voice output determination process (step ST3307). In this process, when the conversation type information control unit 520C of the information processing apparatus 500C acquires the adjusted conversation sentence from the conversation sentence adjustment unit 522, it determines whether to perform voice output. If the conversation type information control unit 520C determines not to perform voice output (step ST3307 “NO”), it causes the process to shift to the process of step ST3301. If the conversation type information control unit 520C determines to perform voice output (step ST3307 “YES”), it shifts to the process of step ST3308.

[0182] The information processing apparatus 500C then executes a voice output process (step ST3308). In this process, the conversation type information control unit 520C of the information processing apparatus 500C outputs voice using the conversation sentence.

[0183] The information processing apparatus 500C then shifts to an end determination process (step ST3309). In the end determination process, a control unit (not shown) of the information processing apparatus 500C determines whether to end the process of the information processing apparatus 500C. The control unit (not shown) determines whether to end the process of the information processing apparatus 500C, for example, according to an end command from the outside or an execution program. If the control unit (not shown) determines not to end the process of the information processing apparatus 500C (step ST3309 “NO”), it shifts to the process of step ST3301 and repeats the process from the process of step ST3301. If the control unit (not shown) determines to end the process of the information processing apparatus 500C (step ST3309 “YES”), the information processing apparatus 500C ends the process.

[0184] A display example according to the third function in the third embodiment will be described. Figures 32 to 34 show display examples when assisting in responses according to the situation. Figure 32 shows an example of the operation management image 2300, which includes a conversational image display area 2310, a conversational image 2311, a conversational image (operation area) 2320, a status level (high response level) 2321, a detailed request button (operation area) 2322, a solution notification button (operation area) 2323, a detailed information image (individual detailed status) 2330, a detailed information image for each mobile body 2340, and a batch announcement button (operation area) 2341. Figure 33 shows the conversational image display area, in which an icon 2380, a conversational image (operation area) 2381, a predicted conversation sentence 2382, a predicted conversation sentence 2383, an adjustment button (operation area) 2384, an execution button (operation area) 2385, and a conversational image 2390 are shown. When the operation management image 2300 shown in Figure 32 detects an increase in the stress value of the passenger by the in-vehicle sensor, a response task is notified. In this case, as shown in Figure 33, when the information processing device 500C receives an input of the user's desire to make a broadcast to the vehicle, it examines the automatic voice guidance sentence (conversation sentence) and outputs it as the conversational image 2381 (predicted conversation sentence 2382, predicted conversation sentence 2383). The conversational image 2381 includes an operation area such as an adjustment button for adjusting the conversation sentence and an execution button for executing the broadcast, and by operating on this operation area, the conversation sentence can be adjusted and voice output can be performed.

[0185] This embodiment discloses the following configuration. A conversation sentence prediction unit that predicts candidates for the user's conversation sentence based on the characteristic information indicating the characteristics of the response by the pre-stored user (operation manager), the current information, and the know-how information. The conversation sentence reception unit receives a conversation sentence selected from among the candidates for the conversation sentence predicted by the conversation sentence prediction unit. An information processing device. With this configuration, an information processing apparatus can be provided that enables a user (operation manager) to simply select and engage in a conversation with a virtual respondent, achieving the effect of enabling such interaction. Also, with this configuration, when a user (operation manager) is required to respond quickly, it is possible to omit the input operation and enable a conversation, achieving the effect of enabling such interaction. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or an operation management system, an information processing method, the above information processing program, or an operation management system similar to the above effects can be provided, achieving the effect of enabling such provision.

[0186] This embodiment has disclosed the following configuration. The conversation type information control unit outputs voice data using the conversation sentence predicted by the conversation sentence prediction unit. Information processing apparatus. With this configuration, an information processing apparatus can be provided that enables a user (operation manager) to easily make announcements when corresponding, achieving the effect of enabling such facilitation. Also, with this configuration, it is possible to support corresponding considerations for passenger conditions and surrounding vehicles regardless of the presence or absence and degree of experience of the user (operation manager), achieving the effect of enabling such support. Also, with this configuration, a user (operation manager) can simultaneously respond to a plurality of moving bodies alone, achieving the effect of enabling such simultaneous response. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or an operation management system, an information processing method, the above information processing program, or an operation management system similar to the above effects can be provided, achieving the effect of enabling such provision.

[0187] This embodiment has disclosed the following configuration. It includes a conversation sentence adjustment unit that adjusts the conversation sentence of the user based on an operation by the user. The conversation-type information control unit outputs the conversation-type image including the conversation sentence adjusted by the conversation sentence adjustment unit. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that enables a user to adjust a conversation sentence presented by a virtual counterpart. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system having the same effect.

[0188] This embodiment has disclosed the following configuration. The conversation-type image output by the conversation-type information control unit includes a detailed request operation area that receives an operation for requesting details of the corresponding task shown in the conversation-type image. When a detailed request is received via the detailed request operation area, it includes a detailed information control unit that acquires the current information related to the corresponding task for which the detailed request has been made and outputs a detailed information image based on the current information. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that links a conversation-type image and a detailed information image. Furthermore, by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, it is possible to provide an information processing method, the above information processing program, or an operation management system having the same effect.

[0189] This embodiment has disclosed the following configuration. The detailed information control unit outputs the detailed information image including a selection operation area that receives a selection operation. The conversation-type information control unit Output the conversation image using the current information related to the selected operation area that has been selected. An information processing apparatus. With this configuration, it is possible to provide an information processing apparatus that can link a conversation image and a detailed information image, which has the effect of. Furthermore, the present disclosure can provide an information processing method, the information processing program, or an operation management system similar to the above effects by applying the above configuration to the above information processing method, the above information processing program, or the operation management system, which has the effect of.

[0190] Here, a hardware configuration for realizing the functions of the present disclosure will be described. FIG. 34 is a diagram showing a first example of a hardware configuration for realizing the functions according to the configuration of the present disclosure. FIG. 35 is a diagram showing a second example of a hardware configuration for realizing the functions according to the configuration of the present disclosure. The information processing apparatuses 500, 500A, 500B, 500C of the present disclosure are each realized by hardware as shown in FIG. 34 or FIG. 36.

[0191] The information processing apparatuses 500, 500A, 500B, 500C are each composed of, for example, a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004, as shown in FIG. 34. The processor 10001 and the memory 10002 are, for example, those installed in a computer. The memory 10002 stores a program for causing the computer to function as a current information acquisition unit 510, a conversation type information control unit 520, a judgment support information generation unit 521, a conversation sentence adjustment unit 522, a conversation sentence prediction unit 523, a statistical information output unit 524, a priority calculation unit 525, a supplementary information output unit 526, a corresponding operation signal output unit 530, a conversation sentence reception unit 540, a naming reception unit 550, a know-how information acquisition unit 560, a detailed information control unit 570, and a control unit (not shown). By the processor 10001 reading out and executing the program stored in the memory 10002, the functions of the current information acquisition unit 510, the conversation type information control unit 520, the judgment support information generation unit 521, the conversation sentence adjustment unit 522, the conversation sentence prediction unit 523, the statistical information output unit 524, the priority calculation unit 525, the supplementary information output unit 526, the corresponding operation signal output unit 530, the conversation sentence reception unit 540, the naming reception unit 550, the know-how information acquisition unit 560, the detailed information control unit 570, and the control unit (not shown) are realized. Also, a storage unit (not shown) is realized by the memory 10002 or another memory (not shown). Also, a communication unit (not shown) is realized by the communication circuit 10004.

[0192] The processor 10001 uses, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a microprocessor, a microcontroller, or a DSP (Digital Signal Processor). The memory 10002 may be a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory), or flash memory, or may be a magnetic disk such as a hard disk or flexible disk, or may be an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or may be a magneto-optical disk. The processor 10001, the memory 10002, and the communication circuit 10004 are connected in a state where they can transmit data to each other. Also, the processor 10001, the memory 10002, and the communication circuit 10004 are connected in a state where they can transmit data to and from other hardware via the input / output interface 10003.

[0193] Alternatively, the functions of the current information acquisition unit 510, the conversation type information control unit 520, the judgment support information generation unit 521, the conversation sentence adjustment unit 522, the conversation sentence prediction unit 523, the statistical information output unit 524, the priority calculation unit 525, the supplementary information output unit 526, the corresponding operation signal output unit 530, the conversation sentence reception unit 540, the naming reception unit 550, the know-how information acquisition unit 560, the detailed information control unit 570, and the control unit (not shown) in the information processing apparatuses 500, 500A, 500B, 500C may be realized by a dedicated processing circuit 20001 as shown in FIG. 35.

[0194] The processing circuit 20001 is implemented using, for example, a single circuit, a composite circuit, a programmed processor, a parallel-programmed processor, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), a SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration), etc. Also, a storage unit (not shown) is realized by the memory 20002 or another memory (not shown). The memory 20002 may be a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable Read Only Memory), or a flash memory, or may be a magnetic disk such as a hard disk or a flexible disk, or may be an optical disk such as a CD (Compact Disc) or a DVD (Digital Versatile Disc), or may be a magneto-optical disk. Also, a communication unit (not shown) is realized by the communication circuit 20004. The processing circuit 20001 and the memory 20002 or the communication circuit 20004 are connected so as to be able to transmit data to each other. Also, the processing circuit 20001, the memory 20002, and the communication circuit 20004 are connected so as to be able to transmit data to and from other hardware via the input / output interface 20003. Note that, in the information processing apparatuses 500, 500A, 500B, and 500C, the functions of the current information acquisition unit 510, the conversation-type information control unit 520, the judgment support information generation unit 521, the conversation sentence adjustment unit 522, the conversation sentence prediction unit 523, the statistical information output unit 524, the priority calculation unit 525, the supplementary information output unit 526, the corresponding operation signal output unit 530, the conversation sentence reception unit 540, the designation reception unit 550, the know-how information acquisition unit 560, the detailed information control unit 570, and the control unit (not shown) may be realized by separate processing circuits, or may be realized collectively by a processing circuit.

[0195] Alternatively, in the information processing apparatuses 500, 500A, 500B, and 500C, some of the functions of the current information acquisition unit 510, the conversation-type information control unit 520, the judgment support information generation unit 521, the conversation sentence adjustment unit 522, the conversation sentence prediction unit 523, the statistical information output unit 524, the priority calculation unit 525, the supplementary information output unit 526, the corresponding operation signal output unit 530, the conversation sentence reception unit 540, the designation reception unit 550, the know-how information acquisition unit 560, the detailed information control unit 570, and the control unit (not shown) may be realized by the processor 10001 and the memory 10002, and the remaining functions may be realized by the processing circuit 20001.

[0196] Note that, within the scope of this disclosure, free combinations of each embodiment, modifications of any component of each embodiment, or omissions of any component of each embodiment are possible.

Industrial Applicability

[0197] This disclosure can assist in making appropriate responses to events that the operation manager should handle, and thus is suitable for use in, for example, a mobile body operation management system.

Description of Reference Numerals

[0198] 10 Operation management system, 100 (100-1, ···, 100-n (n≧1)) mobile bodies, 200 information sources, 300 input / output devices, 500, 500A, 500B, 500C information processing devices, 510 current information acquisition unit, 520 conversational information control unit, 521 judgment support information generation unit, 522 conversational sentence adjustment unit, 523 conversational sentence prediction unit, 524 statistical information output unit, 525 priority calculation unit, 526 supplementary information output unit, 530 corresponding operation signal output unit, 540 conversational sentence reception unit, 550 call reception unit, 560 know-how information acquisition unit, 570 detailed information control unit, 1101 image (icon), 1102 image (conversational image (operation area)), 1103 image (execution button (operation area)), 1104 image (abort button (operation area)), 1105 image (corresponding task-related image (operation area)), 1106 image (unsolved display), 1107 image (conversational image (operation area)), 1108 image (conversational image (operation area)), 1109 image (operation diagram display button (operation area)), 1110 image (history details button (operation area)), 1201 image (icon), 1202 image (conversational image (operation area)), 1203 image (execution button (operation area)), 1204 image (abort button (operation area)), 1205 image (unsolved display), 1206 image (conversational image (operation area)), 1207 image (mention (call information)), 1208 image (icon (virtual corresponding person)), 1209 image (conversational image (operation area)), 1210 image (operation diagram display button (operation area)), 1211 image (history details button (operation area)), 1212 image (icon (virtual corresponding person)), 1213 image (conversational image (operation area)), 1214 image (history details button (operation area)), 1215 image (conversational image (operation area)), 1216 image (mention (call information)), 1301 image (icon), 1302 image (conversational image (operation area)), 1303 image (unsolved display), 1310 image (operation area), 1311 image (operation area (corresponding operation candidate)), 1312 image (operation area (corresponding operation candidate)), 1313 image (operation area (corresponding operation candidate)), 1320 image (selection support information), 1321 image (statistical information), 1322 image (statistical information), 1323 image (statistical information), 1401 image (icon), 1402Image (Conversation Image (Operation Area)), 1403 Image (Unsolved Display), 1410 Image (Operation Area), 1411 Image (Operation Area (Corresponding Operation Candidates, Selection Support Information)), 1412 Image (Operation Area (Corresponding Operation Candidates, Selection Support Information)), 1413 Image (Operation Area (Corresponding Operation Candidates, Selection Support Information)), 1501 Image (Icon), 1502 Image (Conversation Image (Operation Area)), 1503 Image (Unsolved Display), 1510 Image (Operation Area), 1511 Image (Operation Area (Corresponding Operation Candidates)), 1512 Image (Operation Area (Corresponding Operation Candidates)), 1513 Image (Operation Area (Corresponding Operation Candidates)), 1520 Image (Selection Support Information), 1521 Image (Supplementary Information), 1522 Image (Supplementary Information), 1523 Image (Supplementary Information), 1601 Image (Icon), 1602 Image (Conversation Image (Operation Area)), 1603 Image (Execution Button (Operation Area)), 1604 Image (Abort Button (Operation Area)), 1605 Image (Solution Display), 1606 Image (Know-how Input (Operation Area)), 1607 Image (Detailed Requirement (Operation Area)), 1610 Image (Conversation Image), 1620 Image (Conversation Image (Operation Area)), 1621 Image (Conversation Image (Operation Area)), 1622 Image (Operation Area (Operation Display Button)), 1623 Image (Operation Area (History Detail Button)) 1630 Image (Conversation-Type Image), 1701 Image (Task Selection Image (Operation Area)), 1702 Image (Selection Display), 1711 Image (Task Selection Image (Operation Area)), 1712 Image (Response Required Display), 2000 Image (Operation Management Image), 2010 Image (Conversation-Type Image Display Area), 2011 Operation Area, 2020 Image (Detailed Information Image), 2021 Operation Area, 2100 Image (Operation Management Image), 2110 Image (Conversation-Type Image Display Area), 2111 Image (Conversation-Type Image), 2120 Image (Conversation-Type Image (Operation Area)), 2121 Image (Corresponding Task-Related Image (Operation Area)), 2122 Image (Detail Button (Operation Area)), 2123 Image (Solution Button (Operation Area)), 2140 Image (Detailed Information Image (Normal Management State)), 2150 Image (Detailed Information Image (Individual Detail State)), 2160 Image (Icon), 2161 Image (Conversation-Type Image (Operation Area)), 2162 Image (Corresponding Task-Related Image (Operation Area)), 2163 Image (Status Level (High Corresponding Level)), 2164 Image (Status Level (Medium Corresponding Level)), 2165 Image (In-Vehicle Situation List Display Button (Operation Area)), 2166 Image (Solution Button (Operation Area)), 2167 Image (Unsolved Display), 2170 Image (Conversation-Type Image), 2171 Image (Mention (Designation Information)), 2180 Image (Conversation-Type Image (Operation Area)), 2181 Image (Highlight Button (Operation Area)), 2182 Image (History Detail Button (Operation Area)), 2190 Image (Conversation-Type Image (Operation Area)), 2191 Image (Highlight Button (Operation Area)), 2192 Image (History Detail Button (Operation Area)), 2200 Image (Operation Management Image), 2210 Image (Conversation-Type Image Display Area), 2211 Image (Conversation-Type Image), 2220 Image (Conversation-Type Image (Operation Area)), 2221 Image (Status Level (High Corresponding Level)), 2222 Image (Detailed Requirement Button (Operation Area)), 2223 Image (Solution Notification Button (Operation Area)), 2230 Image (Detailed Information Image (Individual Detail State)), 2240 Image (Predicted Conversation Text), 2241 Image (Predicted Conversation Text (Before Detailed Requirement Operation)), 2242 Image (Predicted Conversation Text (After Detailed Requirement Operation)), 2300 Image (Operation Management Image), 2310 Image (Conversation-Type Image Display Area), 2311 Image (Conversation-Type Image), 2320 Image (Conversation-Type Image (Operation Area)), 2321Image (status level (corresponding level high)), 2322 Image (detail request button (operation area)), 2323 Image (solution notification button (operation area)), 2330 Image (detail information image (individual detail status)), 2370 Image (conversation type image), 2380 Image (icon), 2381 Image (conversation type image (operation area)), 2382 Image (predicted conversation sentence), 2383 Image (predicted conversation sentence), 2384 Image (adjustment button (operation area)), 2385 Image (execution button (operation area)), 2390 Image (conversation type image), 10001 Processor, 10002 Memory, 10003 Input / output interface, 10004 Communication circuit, 20001 Processing circuit, 20002 Memory, 20003 Input / output interface, 20004 Communication circuit.

Claims

1. A current information acquisition unit that acquires current information, which is information received at the current time; A conversation type information control unit that outputs a conversation sentence related to a response task by a virtual responder and a conversation type image including an operation area, the conversation sentence and the operation area being generated based on the current information and the know-how information for each past responder related to the operation of the mobile body; A corresponding operation signal output unit that receives an operation on the operation area and outputs a control signal for instructing an operation related to the response task; An information processing apparatus comprising the above.

2. A conversation sentence reception unit that receives a user's conversation sentence, and the conversation type information control unit outputs a conversation type image further using the conversation sentence received by the conversation sentence reception unit. The information processing apparatus according to Claim 1.

3. A nomination reception unit that receives nomination information for nominating the virtual responder via the conversation sentence reception unit, and the conversation type information control unit further outputs a conversation type image including a conversation sentence by the virtual responder based on the nomination information. The information processing apparatus according to Claim 2.

4. The conversation type image including the conversation sentence by the virtual responder output by the conversation type information control unit includes a plurality of the operation areas. The information processing apparatus according to Claim 1.

5. The conversation type image including the conversation sentence by the virtual responder output by the conversation type information control unit includes a plurality of the operation areas. The information processing apparatus according to Claim 2.

6. The conversation type image including the conversation sentence by the virtual responder output by the conversation type information control unit includes a plurality of the operation areas. The information processing apparatus according to Claim 3.

7. A judgment support information generation unit that generates judgment support information based on the response task for each operation area and the operation history related to the response task, and the conversation type image output by the conversation type information control unit includes the judgment support information for each operation area. The information processing apparatus according to Claim 4.

8. A judgment support information generation unit that generates judgment support information based on the response task for each operation area and the operation history related to the response task, and the conversation type image output by the conversation type information control unit includes the judgment support information for each operation area. The information processing apparatus according to Claim 5.

9. A judgment support information generation unit that generates judgment support information based on the response task for each operation area and the operation history related to the response task, and The conversation-type image output by the conversation-type information control unit includes the determination support information for each of the operation areas. The information processing apparatus according to claim 6.

10. The determination support information is statistical information based on know-how information including metadata for each corresponding person. The information processing apparatus according to any one of claims 7 to 9.

11. The determination support information is the priority of an operation related to the operation area. The information processing apparatus according to any one of claims 7 to 9.

12. The determination support information is selection reason information including the reason for selecting the operation area. The information processing apparatus according to any one of claims 7 to 9.

13. When an operation related to the corresponding task is commanded, the conversation-type information control unit outputs a conversation-type image including a know-how input area for receiving input of know-how information related to the corresponding person, A know-how information acquisition unit that attaches metadata for each corresponding person to the know-how information acquired through the know-how input area and stores it. The information processing apparatus according to any one of claims 1 to 9.

14. When there are a plurality of corresponding tasks to be handled simultaneously, the conversation-type information control unit newly outputs a task selection image for each corresponding task, and when a corresponding task is selected through the task selection image, outputs the conversation-type image related to the selected corresponding task. The information processing apparatus according to any one of claims 1 to 9.

15. A conversation sentence prediction unit that predicts candidates for the user's conversation sentence based on the feature information indicating the characteristics of the user's response stored in advance, the current information, and the know-how information. The conversation sentence reception unit receives a conversation sentence selected from among the candidates for the conversation sentence predicted by the conversation sentence prediction unit. The information processing apparatus according to any one of claims 2, 3, 5, 6, 8, and 9.

16. The conversation-type information control unit outputs voice data using the conversation sentence predicted by the conversation sentence prediction unit. The information processing apparatus according to claim 15.

17. A conversation sentence adjustment unit that adjusts the user's conversation sentence based on the user's operation. The conversation-type information control unit outputs the conversation-type image including the conversation sentence adjusted by the conversation sentence adjustment unit. The information processing apparatus according to claim 15.

18. The conversation-type image output by the conversation-type information control unit includes a detailed request operation area that accepts an operation for requesting details of the corresponding task shown in the conversation-type image. When a detailed request is received via the detailed request operation area, a detailed information control unit that acquires the current information related to the corresponding task for which the detailed request has been made and outputs a detailed information image based on the current information. The information processing apparatus according to any one of claims 1 to 9.

19. The detailed information control unit outputs the detailed information image including a selection operation area that accepts a selection operation. The conversation-type information control unit Outputs the conversation-type image using the current information related to the selected selection operation area. The information processing apparatus according to claim 18.

20. An information processing method by an information processing apparatus, A current information acquisition unit of the information processing apparatus acquires current information that is information received at the current time. The conversation-type information control unit of the information processing apparatus outputs a conversation-type image including a conversation sentence and an operation area related to a corresponding task by a virtual corresponding person generated based on the current information and know-how information for each past corresponding person related to the operation of the moving body. A corresponding operation signal output unit of the information processing apparatus accepts an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task. Information processing method.

21. An operation management system including an information processing apparatus that communicates with a mobile body-mounted apparatus mounted on each mobile body, The information processing apparatus A current information acquisition unit that acquires current information that is information received at the current time, A conversation-type information control unit that outputs a conversation-type image including a conversation sentence and an operation area related to a corresponding task by a virtual corresponding person generated based on the current information and know-how information for each past corresponding person related to the operation of the moving body, A corresponding operation signal output unit that accepts an operation on the operation area and outputs a control signal for instructing an operation related to the corresponding task to the mobile body-mounted apparatus, Characterized in that it comprises. An operation management system.

Images