Information processing device, information processing method, and operation management system

Abstract

This information processing device comprises: a current information acquisition unit that acquires current information that is information received at a current time; a conversational information control unit that outputs a conversational image including a conversation sentence and operation area related to a response task by a virtual responder generated on the basis of the current information and know-how information for each past responder, the know-how information being related to operation of a mobile body; and a response operation signal output unit that receives an operation on the operation area, and outputs a control signal for giving an instruction for an operation related to the response task.

Description

Information processing device, information processing method, and operation management system

[0001] The disclosed technology relates to an information processing technology for processing information that supports the operation management of a mobile object.

[0002] There is a conventional technology for supporting the operation management of mobile objects. Patent Document 1 discloses a technology that comprehensively considers risks (driving risk, route risk) from vehicle information and operation information transmitted from multiple vehicles, and presents the administrator with a priority order of vehicles to be monitored. This reduces the administrator's monitoring burden by supporting the administrator in appropriately selecting vehicles to monitor.

[0003] Japanese Patent Application Laid-Open No. 2020-61121

[0004] However, in conventional technologies, the response to events that occur during monitoring is left up to the administrator, which poses a problem in that depending on the administrator's level of experience, the administrator may not always be able to respond appropriately to events that require their attention.

[0005] The present disclosure is intended to solve the above-mentioned problems, and aims to enable support for responding so that an administrator can appropriately respond to events that require response.

[0006] The information processing device of the present disclosure includes: a current information acquisition unit that acquires current information, which is information received at the current time; a conversational information control unit that outputs a conversational image including an operation area and dialogue related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of a mobile body; and a response operation signal output unit that receives an operation on the operation area and outputs a control signal instructing an operation related to the response task.

[0007] According to the present disclosure, it is possible to provide support for the administrator to take appropriate action against an event that requires a response.

[0008] FIG. 1 is a diagram illustrating an example configuration of an operation management system including an information processing device according to a first embodiment of the present disclosure. FIG. 2 is a diagram illustrating an example basic configuration of the information processing device according to the first embodiment of the present disclosure. FIG. 3 is a flowchart illustrating an example of processing by the information processing device according to the first embodiment of the present disclosure. FIG. 4 is a diagram illustrating an example configuration of an information processing device according to a second embodiment of the present disclosure. FIG. 5 is a diagram illustrating a detailed example configuration of a support information generation unit in the information processing device according to the second embodiment of the present disclosure. FIG. 6 is a flowchart illustrating an example of a first processing by the information processing device according to the second embodiment of the present disclosure. FIG. 7 is a diagram illustrating a function based on the first processing by the information processing device according to the second embodiment of the present disclosure. FIG. 8 is a flowchart illustrating an example of a second processing by the information processing device according to the second embodiment of the present disclosure. FIG. 9 is a diagram illustrating a function based on the second processing by the information processing device according to the second embodiment of the present disclosure. FIG. 10 is a flowchart illustrating an example of a third processing by the information processing device according to the second embodiment of the present disclosure. FIG. 11 is a diagram illustrating a function based on the third processing by the information processing device according to the second embodiment of the present disclosure. FIG. 12 is a flowchart illustrating an example of a fourth processing by the information processing device according to the second embodiment of the present disclosure. FIG. 13 is a diagram for explaining a function based on a fourth process in an information processing device according to embodiment 2 of the present disclosure. FIG. 14 is a flowchart illustrating an example of a fifth process in the information processing device according to embodiment 2 of the present disclosure. FIG. 15 is a diagram for explaining a function based on the fifth process in the information processing device according to embodiment 2 of the present disclosure. FIG. 16 is a flowchart illustrating an example of a sixth process in the information processing device according to embodiment 2 of the present disclosure. FIG. 17 is a diagram for explaining a function based on the sixth process in the information processing device according to embodiment 2 of the present disclosure. FIG. 18 is a flowchart illustrating an example of a seventh process in the information processing device according to embodiment 2 of the present disclosure. FIG. 19 is a diagram for explaining a function based on the seventh process in the information processing device according to embodiment 2 of the present disclosure. FIG. 20 is a diagram illustrating a configuration example of an information processing device according to embodiment 3 of the present disclosure.FIG. 21 is a flowchart showing an example of processing by a conversational information control unit in an information processing device according to Embodiment 3 of the present disclosure. FIG. 22 is a flowchart showing an example of processing by a detailed information control unit in an information processing device according to Embodiment 3 of the present disclosure. FIG. 23 is a diagram showing an image of functions in the information processing device according to Embodiment 3 of the present disclosure. FIG. 24 is a flowchart showing an example of first processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 25 is a first diagram for describing functions based on the first processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 26 is a second diagram for describing functions based on the first processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 27 is a third diagram for describing functions based on the first processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 28 is a flowchart showing an example of second processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 29 is a first diagram for describing functions based on the second processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 30 is a second diagram for describing functions based on the second processing in the information processing device according to Embodiment 3 of the present disclosure. FIG. 31 is a flowchart showing an example of third processing in the information processing device according to Embodiment 3 of the present disclosure. Fig. 32 is a first diagram for explaining a function achieved by a third process in an information processing device according to embodiment 3 of the present disclosure. Fig. 33 is a second diagram for explaining a function achieved by a third process in an information processing device according to embodiment 3 of the present disclosure. Fig. 34 is a diagram illustrating a first example of a hardware configuration for realizing a function achieved by the configuration of the present disclosure. Fig. 35 is a diagram illustrating a second example of a hardware configuration for realizing a function achieved by the configuration of the present disclosure.

[0009] In order to explain the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.

[0010] First Embodiment In the first embodiment, a basic form of the present disclosure will be described.

[0011] FIG. 1 illustrates an example configuration of a traffic management system including an information processing device according to the present disclosure. FIG. 1 illustrates an example configuration of a traffic management system 10 including an information processing device 500 according to the first embodiment of the present disclosure. The traffic management system 10 will be described assuming that there are multiple traffic managers using the same system and multiple traffic areas operated by mobile objects. Each traffic manager can use the system by logging in to the system with their own user ID. The traffic managers will also be referred to as "users" hereinafter. The traffic management system 10 illustrated in FIG. 1 is a system for managing the traffic of mobile objects 100 (100-1, ..., 100-n (n≧1)). The traffic management system 10 includes an information processing device 500 that communicates with a mobile object-mounted device mounted on each mobile object. The traffic management system 10 illustrated in FIG. 1 includes mobile objects 100 (100-1, ..., 100-n (n≧1)), an information source 200, an input / output device 300, and an information processing device 500.

[0012] The mobile bodies 100 (100-1, ..., 100-n (n≧1)) are, for example, commercial vehicles. Alternatively, the mobile bodies 100 (100-1, ..., 100-n (n≧1)) may be ordinary private vehicles. When the mobile bodies are commercial vehicles, the mobile bodies may be buses, carts, taxis, personal mobility vehicles, trucks, or the like. In the present disclosure, the mobile bodies 100 (100-1, ..., 100-n (n≧1)) may be one type of bus, cart, taxi, personal mobility vehicle, truck, or the like, or may be a combination of two or more types. When the mobile bodies 100 (100-1, ..., 100-n (n≧1)) are public transportation mobile bodies, the operation of the mobile bodies 100 (100-1, ..., 100-n (n≧1)) is managed based on a schedule such as a train timetable. The mobile bodies 100 (100-1, ..., 100-n (n≧1)) are equipped with a mobile body-mounted device (not shown). In the present disclosure, the mobile body-mounted device may be one type of device per mobile body, or multiple types of multiple devices per mobile body.

[0013] The information source 200 outputs current information used in the information processing device 500. The current information is information at the current time. The current information output by the information source 200 is, for example, sensor information from multiple sensors including sensors mounted on the mobile object, road traffic information, and operation information. Specifically, the current information includes, for example, breakdowns, congestion, delays, and communication failures. The current information is assumed to be information related to troubles in the mobile object, but is not limited to the above examples. In the present disclosure, the know-how information in the information processing device 500 described later may be any information that indicates a response to any current information related to the operation of the mobile object.

[0014] The input / output device 300 is configured to receive information from the information processing device 500 and present the received information to the user in the form of images and sounds. The input / output device 300 is also configured to allow the user to operate, make requests, and input information for each piece of information presented by the information processing device 500. The input / output device 300 is, for example, a display device with a touch panel function.

[0015] The information processing device 500 outputs a conversational image including dialogue and an operation area related to a task (response task) to be handled by the user based on current information and past know-how information for each responder. The know-how information indicates responses to past tasks. The know-how information includes information such as "date and time," metadata for each responder (the responder's "attribute information" and "identification information"), "task," and "response." "Date and time" indicates the date and time of the past response. "Attribute information" indicates the attributes of the responder. Examples of the responder's attributes include affiliation, position, years of experience, and age. The attributes of the responder may include, for example, gender and personality. "Identification information" indicates information identifying the responder. Examples of identification information include name and identification number. "Task" refers to any trouble related to a vehicle. Tasks include biological troubles such as the physical condition and stress of the vehicle's occupants. "Response" refers to "function," "instruction," "scene," and "response result." "Function" indicates which screen function was used for the task. Examples of screen functions include maps, camera footage, reservation lists, route creation, and operation schedules. "Instructions" indicate what control instructions were given to the vehicle or operation system for the task. Examples of control instructions include route changes, vehicle stoppage, road closures, alternate vehicle settings, and increasing or decreasing service. "Scene" indicates the situation and the response taken. For example, "XX" is used when there are many passengers on board, and "XX" is used when there are few passengers. "Response results" indicate which response quickly resolved the problem and whether the subsequent operation was smooth. In other words, the information processing device 500 can output a conversational image based on the above know-how information and current information, providing responses and potential responses for cases similar to past errors and trouble events, taking into account past responders.

[0016] The conversational image is assumed to be in a chat-like format. Therefore, the conversational image can also be expressed as a chat image. The conversational image includes a "conversational text" and an "operation area." The "conversational text" refers to, for example, a sentence spoken by a virtual responder. The "conversational text" of the virtual responder is a sentence expressing content related to a task (response task) for current information in a conversational (colloquial) format. In a traffic management system serving as an information processing system including the information processing device 500 of the present disclosure, the virtual responder is assumed to be a chatbot-like concierge within the system, a responder simulating another traffic manager who has used the same traffic management system, or a responder simulating a traffic manager based on the attributes of the responder. Furthermore, the "conversational text" refers to, for example, a user's speech. The user's "conversational text" is based on text entered by the user into the information processing device 500. The "conversational text" is used to display the speech of the virtual responder and the user's speech in chronological order. The "operation area" is an image that accepts response operations related to a task (response task) for current information in relation to the "conversational text" of the virtual responder. The "operation area" is an image that is displayed in relation to the "conversational text" and is displayed adjacent to the "conversational text" image. The "operation area" includes text that indicates the operation content. The operation content includes, for example, an execute button for the virtual responder to perform the operation content related to the response operation indicated in the "conversational text", and a stop button that causes the virtual responder to stop the response operation in progress.

[0017] The conversational image may also include an icon image for each virtual responder, which allows output of a conversational image that distinguishes between a chatbot-like concierge in the system, a responder simulating another dispatcher who has used the same dispatching system, or a responder simulating a dispatcher according to the attributes of the responder.

[0018] The conversational image may also include the images shown in each embodiment. For example, the conversational image may include a "status flag" that indicates the status of the response to the task. The "status flag" indicates, for example, whether the task is "unresolved" or "resolved."

[0019] An example configuration of an information processing device according to the first embodiment of the present disclosure will be described. Fig. 2 is a diagram showing an example basic configuration of the information processing device according to the first embodiment of the present disclosure. The information processing device 500A shown in Fig. 2 includes a current information acquisition unit 510, an interactive information control unit 520, a corresponding operation signal output unit 530, and the like.

[0020] The current information acquisition unit 510 acquires current information, which is information received at the current time. The current information acquisition unit 510 acquires current information from the mobile object 100 and the information source 200. The current information may include the state of the inside and outside of the mobile object.

[0021] The conversational information control unit 520A outputs a conversational image including a dialogue and an operation area related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of the mobile body 100. The know-how information includes metadata for each past responder. The metadata includes identification information and attribute information for each past responder. The virtual responder is generated based on the identification information or the attribute information. The conversational information control unit 520A may be configured to search for a response task using pre-stored table data and current information. Alternatively, the conversational information control unit 520A may be configured to include an AI that learns know-how information, inputs current information, and outputs a response task. Alternatively, the conversational information control unit 520A may be configured to include a generation AI that inputs current information and outputs a conversational image including a dialogue and an operation area related to a response task by a virtual responder. Note that the functions of the AI ​​and the generation AI may be configured to be realized via an external server.

[0022] The corresponding operation signal output unit 530 receives an operation on the operation area and outputs a control signal instructing an operation related to the corresponding task. The corresponding operation signal output unit 530 outputs the control signal instructing an operation related to the corresponding task to the mobile body-mounted device of the mobile body 100.

[0023] In addition to the above components, the information processing device 500A also includes a control unit (not shown), a storage unit (not shown), and a communication unit (not shown). The control unit (not shown) controls the entire information processing device 500A and each of its components. For example, the control unit (not shown) starts up the information processing device 500A in accordance with an external command. The control unit (not shown) also controls the state of the information processing device 500A (operating state = startup, shutdown, sleep, etc.). The storage unit (not shown) stores various data used by the information processing device 500A. For example, the storage unit (not shown) stores output (output data) from each component of the information processing device 500A and outputs data requested by each component to the requesting component. The communication unit (not shown) communicates with an external device. For example, communication is performed between the information processing device 500A and a peripheral device (e.g., a device mounted on a mobile body). For example, if the information processing device 500A and the device mounted on a mobile body are not connected via a wire, the communication unit (not shown) has a function of communicating between the information processing device 500A and the device mounted on a mobile body. The communication unit (not shown) has a function of communicating with a server device, which is an external device. The control unit (not shown), the storage unit (not shown), and the communication unit (not shown) also have the same functions in the information processing devices 500B and 500C according to the embodiments described below.

[0024] An example of processing by the information processing device 500A will be described. Fig. 3 is a flowchart showing an example of processing by the information processing device according to the first embodiment of the present disclosure. The processing shown in Fig. 3 is an information processing method by the information processing device 500A. For example, the information processing device 500A shown in Fig. 2 starts the processing shown in Fig. 3 in, for example, a normal monitoring state. The normal monitoring state is a state in which the information processing device 500A has not acquired current information that should be addressed.

[0025] The information processing device 500A then executes a current information acquisition determination process (step ST1001). In the current information acquisition process, the current information acquisition unit 510 of the information processing device 500A determines whether current information to be acted upon at the current time has been received. If the current information acquisition unit 510 determines that current information to be acted upon has not been received (step ST1001 "NO"), the information processing device 500A proceeds to the process of step ST1005. If the current information acquisition unit 510 determines that current information to be acted upon has been received (step ST1001 "YES"), the information processing device 500A acquires the current information, which is the information received at the current time, from the information source 200.

[0026] The information processing device 500A then executes an interactive information output process (step ST1002). In the interactive information output process, the interactive information control unit 520 of the information processing device 500A outputs an interactive image including a conversational sentence and an operation area related to a response task by a virtual responder generated based on the current information and past know-how information for each responder related to the operation of the mobile object.

[0027] The information processing device 500A then executes an operation reception determination process (step ST1003). In the operation reception determination process, the corresponding operation signal output unit 530 of the information processing device 500A determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that an operation on the operation area has not been received within a certain period of time (step ST1003 "NO"), the information processing device 500B proceeds to the process of step ST1001. If the corresponding operation signal output unit 530 determines that an operation on the operation area has been received (step ST1003 "YES"), the information processing device 500B proceeds to the process of step ST1004.

[0028] Next, the information processing device 500A executes a corresponding operation signal output process (step ST1004). In the corresponding operation signal output process, the corresponding operation signal output unit 530 of the information processing device 500A outputs a corresponding operation signal related to the operation area in which the operation has been accepted, to a device that executes the corresponding operation.

[0029] The information processing device 500A then proceeds to termination determination processing (step ST1005). In the termination determination processing, a control unit (not shown) of the information processing device 500A determines whether to terminate the processing of the information processing device 500A. The control unit (not shown) determines whether to terminate the processing of the information processing device 500A, for example, in accordance with an external termination command or an execution program. At this time, the interactive information control unit 520 of the information processing device 500A checks whether the corresponding task has been resolved by the output of a corresponding operation signal by the corresponding operation signal output unit 530. If the control unit (not shown) determines not to terminate the processing of the information processing device 500A (step ST1005 "NO"), the information processing device 500A proceeds to processing of step ST1001 and repeats processing from step ST1001. If the control unit (not shown) determines to terminate the processing of the information processing device 500A (step ST1005 "YES"), the information processing device 500A terminates processing. At this time, the interactive information control unit 520 of the information processing device 500A changes the status flag in the interactive image from "unresolved" to "resolved," for example.

[0030] The present disclosure, based on the above disclosure, can support a manager in taking appropriate action against an event that requires a response.

[0031] This embodiment discloses the following configuration: an information processing device including: a current information acquisition unit that acquires current information, which is information received at the current time; an interactive information control unit that outputs an interactive image including an operation area and dialogue related to a response task by a virtual responder generated based on the current information and know-how information for each responder related to the operation of a mobile object; and a response operation signal output unit that receives an operation on the operation area and outputs a control signal instructing an operation related to the response task. This configuration has the effect of providing an information processing device that enables support for a manager to respond appropriately to an event that requires response.

[0032] This embodiment discloses the following configuration: an information processing method by an information processing device, wherein a current information acquisition unit of the information processing device acquires current information that is information received at a current time, an interactive information control unit of the information processing device outputs an interactive image including an operation area and conversational text related to a response task by a virtual responder generated based on the current information and know-how information for each responder related to the operation of a mobile object in the past, and a response operation signal output unit of the information processing device accepts an operation on the operation area and outputs a control signal instructing an operation related to the response task. This configuration has the effect of providing an information processing method that enables support for a manager to respond appropriately to an event that requires response.

[0033] This embodiment discloses the following configuration: An information processing program that causes a computer to operate as an information processing device including: a current information acquisition unit that acquires current information, which is information received at the current time; an interactive information control unit that outputs an interactive image including an operation area and dialogue related to a response task by a virtual responder generated based on the current information and know-how information for each responder related to the operation of a mobile object in the past; and a response operation signal output unit that receives an operation on the operation area and outputs a control signal instructing an operation related to the response task. This configuration has the effect of providing an information processing program that enables support for a manager to respond appropriately to an event that requires response.

[0034] This embodiment discloses the following configuration: A traffic management system including an information processing device that communicates with a mobile-body-mounted device mounted on each mobile body, wherein the information processing device includes: a current information acquisition unit that acquires current information, which is information received at the current time; an interactive information control unit that outputs an interactive image including an operation area and dialogue related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of the mobile body; and a response operation signal output unit that accepts an operation on the operation area and outputs a control signal to the mobile-body-mounted device to instruct an operation related to the response task. This configuration has the effect of providing a traffic management system that enables a manager to support the manager in taking appropriate action against events that require response.

[0035] Embodiment 2. In embodiment 2, a configuration that realizes more detailed functions in addition to the functions of the configuration according to embodiment 1 will be described. In embodiment 2, among the components according to embodiment 2, duplicated descriptions of components similar to the components according to embodiment 1 already described will be omitted as appropriate.

[0036] A configuration example of an information processing device according to embodiment 2 of the present disclosure will be described. Fig. 4 is a diagram showing a configuration example of an information processing device according to embodiment 2 of the present disclosure. An information processing device 500B shown in Fig. 4 includes a current information acquisition unit 510, a conversation-type information control unit 520, a decision support information generation unit 521, a conversation sentence adjustment unit 522, a conversation sentence prediction unit 523, a corresponding operation signal output unit 530, a conversation sentence reception unit 540, a nomination reception unit 550, and a know-how information acquisition unit 560.

[0037] The current information acquisition unit 510 acquires current information, which is information received at the current time, in the same manner as the current information acquisition unit 510 already described.

[0038] Similar to the conversational information control unit 520A already described, the conversational information control unit 520B outputs a conversational image including a conversational sentence and an operation area related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of the mobile body 100. Furthermore, the conversational image including the conversational sentence by the virtual responder output by the conversational information control unit 520B includes a plurality of the operation areas. Furthermore, when there are multiple response tasks to be simultaneously handled, the conversational information control unit 520B outputs a new task selection image for each response task, and when a response task is selected via the task selection image, outputs the conversational image related to the selected response task. The conversational information control unit 520B shown in FIG. 4 is configured to include a judgment support information generation unit 521, a conversational sentence prediction unit 523, and a conversational sentence adjustment unit 522.

[0039] The decision support information generating unit 521 generates decision support information based on the corresponding task for each operation area and the operation history related to the corresponding task. In this case, the interactive image output by the interactive information control unit 520B includes the decision support information for each operation area.

[0040] 5 is a diagram illustrating a detailed configuration example of a decision support information generation unit 521 in an information processing device 500 according to the second embodiment of the present disclosure. The decision support information generation unit 521 illustrated in FIG. 5 receives and sets in advance, for example, an operation to select a type of decision support, and outputs decision support information of the selected type. The decision support information generation unit 521 is configured to include a statistical information output unit 524, a priority calculation unit 525, and a supplemental information output unit 526.

[0041] The statistical information output unit 524 outputs statistical information of operation candidates related to the operation area. The statistical information output unit 524 calculates statistical information based on know-how information including metadata for each responder. The statistical information output unit 524 converts the statistical information into judgment support information and outputs it. In this case, the judgment support information is statistical information based on know-how information including metadata for each responder.

[0042] The priority calculation unit 525 calculates the priority of the operation candidate related to the corresponding task. The priority calculation unit 525 outputs the priority of each operation candidate related to the operation area as decision support information. In this case, the decision support information is the priority of the operation related to the operation area.

[0043] The supplemental information output unit 526 outputs supplemental information related to the corresponding task. The supplemental information related to the corresponding task is, for example, judgment support information that is information for determining a corresponding operation related to the corresponding task. For each operation related to an operation area, the supplemental information output unit 526 outputs selection reason information including a reason why the operation area is likely to be selected as judgment support information. In this case, the judgment support information is selection reason information including a reason why the operation area is likely to be selected.

[0044] Returning to the description of the configuration example in Fig. 4, the conversation sentence prediction unit 523 predicts conversation sentence candidates of the user based on pre-stored feature information indicating the features of the user's response, the current information, and the know-how information.

[0045] The conversation sentence adjustment unit 522 adjusts the conversation sentence of the user based on an operation by the user. Specifically, when the conversation sentence prediction unit 523 predicts the conversation sentence of the user, the conversation sentence adjustment unit 522 accepts an operation by the user and adjusts the conversation sentence predicted by the conversation sentence prediction unit 523 based on the operation by the user.

[0046] The corresponding operation signal output unit 530, like the corresponding operation signal output unit 530 already described, accepts an operation on the operation area and outputs a control signal instructing an operation related to the corresponding task.

[0047] The conversational sentence receiving unit 540 receives a conversational sentence from the user. The conversational sentence receiving unit 540 receives the conversational sentence from the user via the input / output device 300. In this case, the conversational information control unit 520B further uses the conversational sentence received by the conversational sentence receiving unit 540 to output a conversational image.

[0048] The nomination receiving unit 550 receives nomination information for nominating the virtual respondent via the conversational text receiving unit 540. In this case, the conversational information control unit 520B further outputs a conversational image including a conversational text by the virtual respondent based on the nomination information.

[0049] When an operation related to the response task is instructed, the interactive information control unit 520B outputs an interactive image including a know-how input area for accepting input of know-how information related to the responder. The know-how information acquisition unit 560 stores the know-how information acquired via the know-how input area with metadata for each responder. The know-how information includes metadata for each past responder. The metadata includes identification information and attribute information for each past responder.

[0050] [First Function in Second Embodiment] A processing example and an example operation image related to the first function of the information processing device 500B will be described. FIG. 6 is a flowchart showing an example of the first processing in the information processing device according to the second embodiment of the present disclosure. FIG. 7 is a diagram for explaining the function of the first processing in the information processing device according to the second embodiment of the present disclosure. The processing shown in FIG. 6 is an information processing method performed by the information processing device 500B. For example, the information processing device 500B shown in FIG. 4 starts the processing shown in FIG. 6 when current information is input. Here, a processing example when the current information is traffic congestion information will be described.

[0051] The information processing device 500B then executes a congestion information acquisition determination process (step ST2101). In the congestion information acquisition determination process, the current information acquisition unit 510 of the information processing device 500B determines whether the current information is current information that should be addressed. In FIG. 6, the current information acquisition unit 510 determines whether the current information is congestion information that should be addressed. If the current information acquisition unit 510 determines that the current information (congestion information) is not current information that should be addressed (step ST2101 "NO"), it proceeds to the process of step ST2109. If the current information acquisition unit 510 determines that the current information (congestion information) is current information that should be addressed (step ST2101 "YES"), it acquires the congestion information as current information that should be addressed. The current information acquisition unit 510 outputs the congestion information to the interactive information control unit 520.

[0052] The information processing device 500B then executes a process for outputting a conversational statement and an operation area related to the recommended route change (step ST2102). In this process, the conversational information control unit 520 of the information processing device 500B receives traffic congestion information from the current information acquisition unit 510. If the conversational information control unit 520 confirms the recommended route based on the traffic congestion information and changes the recommended route, the conversational statement and operation area related to the recommended route change are output as shown in FIG. 7. The conversational image display area shown in FIG. 7 includes an icon 1101, a conversational image (operation area) 1102, an execute button (operation area) 1103, a cancel button (operation area) 1104, a corresponding task-related image (operation area) 1105, and an unresolved display 1106. The icon 1101 represents a virtual responder issuing the conversational image (operation area) 1102. The virtual responder is a responder when all know-how information is compiled, or a responder generated from the identification information and attribute information of each past responder. The execute button (operation area) 1103 is an operation area that accepts an operation to execute a response related to a response task and a conversation sentence. The cancel button (operation area) 1104 is an operation area that accepts an operation to cancel a response. The response task related image (operation area) 1105 shown in FIG. 7 is a map that shows traffic congestion and recommended route changes due to traffic congestion. The unresolved display 1106 is an image (an example of a status flag) that indicates that a response task related to a conversation image is unresolved.

[0053] The information processing device 500B then executes an operation reception determination process (step ST2103). In the operation reception determination process, the corresponding operation signal output unit 530 of the information processing device 500B determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that an operation on the operation area has not been received within a certain period of time (step ST2103 "NO"), the information processing device 500B proceeds to the process of step ST2104. If the corresponding operation signal output unit 530 determines that an operation on the operation area has been received (step ST2103 "YES"), the information processing device 500B proceeds to the process of step ST2108.

[0054] The information processing device 500B then executes a conversational sentence acceptance determination process (step ST2104). If the conversational sentence acceptance unit 540 of the information processing device 500B determines in the conversational sentence acceptance determination process that the conversational sentence has not been accepted (step ST2104 "NO"), the information processing device 500B proceeds to the process of step ST2101. If the conversational sentence acceptance unit 540 determines that the conversational sentence has been accepted (step ST2104 "YES"), the information processing device 500B proceeds to the process of step ST2105.

[0055] The information processing device 500B then executes a conversation sentence input process (step ST2105). In the conversation sentence input process, the conversation sentence receiving unit 540 of the information processing device 500B inputs input conversation sentence information indicating the received input conversation sentence to the conversation-type information control unit 520B.

[0056] The information processing device 500B then executes a conversation sentence image output process (step ST2106). In the conversation sentence image output process, the conversation-type information control unit 520B of the information processing device 500B outputs, for example, a conversation sentence image (operation area) 1107 as shown in FIG. 7 based on the input conversation sentence information.

[0057] The information processing device 500B then executes a process of outputting a conversational sentence and an operation area based on the conversational sentence input by the user (step ST2107). In this process, the conversational information control unit 520B of the information processing device 500B outputs a conversational sentence image including a conversational sentence indicating a reply and an operation area in response to the conversational sentence input by the user. In FIG. 7 , a conversational image (operation area) 1108 indicating an answer to a conversational image 1107 indicating a question input by the user includes a bus schedule display button (operation area) 1109 and a history details button (operation area) 1110. Operating the bus schedule display button (operation area) 1109 can realize a function of displaying a bus schedule. Operating the history details button (operation area) 1110 can also realize a function of displaying history details. The information processing device 500B then proceeds to the process of step ST2101. In the processes from step ST2101 to step ST2102, if there is currently traffic congestion information being output, the information processing device 500B maintains the output of the conversational image. Furthermore, when new congestion information is acquired in the processing from step ST2101 to step ST2102, information processing device 500B maintains the output of the conversational image and outputs a new conversational image.

[0058] If the information processing device 500B determines in the process of step ST2103 that the corresponding operation signal output unit 530 has received an operation on the operation area ("YES" in step ST2103), the information processing device 500B proceeds to the process of step ST2108.

[0059] Next, information processing device 500B executes operation command processing (step ST2108). In the operation command processing, corresponding operation signal output unit 530 of information processing device 500B outputs a control signal instructing an operation related to the corresponding task when the corresponding operation signal output unit 530 receives an operation on the operation area.

[0060] The information processing device 500B then proceeds to termination determination processing (step ST2109). In the termination determination processing, a control unit (not shown) of the information processing device 500B determines whether to terminate the processing of the information processing device 500B. The control unit (not shown) determines whether to terminate the processing of the information processing device 500B, for example, in accordance with an external termination command or an execution program. If the control unit (not shown) determines not to terminate the processing of the information processing device 500B (step ST2109 "NO"), the information processing device 500B proceeds to processing of step ST2101 and repeats processing from the processing of step ST2101. If the control unit (not shown) determines to terminate the processing of the information processing device 500B (step ST2109 "YES"), the information processing device 500B terminates processing.

[0061] The first function allows, when a large amount of similar know-how information has been accumulated, the know-how information to be consolidated and provided as support.

[0062] [Second Function in Second Embodiment] A processing example and an example operation image related to the second function of the information processing device 500B will be described. FIG. 8 is a flowchart showing an example of the second processing in the information processing device according to the second embodiment of the present disclosure. FIG. 9 is a diagram for explaining the function of the second processing in the information processing device according to the second embodiment of the present disclosure. The processing shown in FIG. 8 is an information processing method by the information processing device 500B. For example, the information processing device 500B shown in FIG. 4 starts the processing shown in FIG. 8 when current information is input. Here, a processing example when the current information is traffic congestion information will be described.

[0063] The information processing device 500B then executes a congestion information acquisition determination process (step ST2201). In the congestion information acquisition determination process, the current information acquisition unit 510 of the information processing device 500B determines whether the current information is current information that should be acted upon. In FIG. 6, the current information acquisition unit 510 determines whether the current information is congestion information that should be acted upon. If the current information acquisition unit 510 determines that the current information is not current information (congestion information) that should be acted upon ("NO" in step ST2201), the current information acquisition unit 510 proceeds to the process of step ST2211. If the current information acquisition unit 510 determines that the current information is current information (congestion information) that should be acted upon ("YES" in step ST2201), the current information acquisition unit 510 acquires the congestion information as current information that should be acted upon.

[0064] The information processing device 500B then executes a process to output a conversational image including an operation area related to a batch change of the recommended route (step ST2202). In this process, the conversational information control unit 520 of the information processing device 500B outputs a conversational image including an operation area and a dialogue related to a response task by a virtual responder generated based on the current information and past know-how information for each responder related to the operation of the mobile object 100. At this time, as shown in FIG. 9 , an icon 1201 indicating the virtual responder and a conversational image (operation area) 1202 by the virtual responder are output. The conversational image (operation area) 1202 includes an execute button (operation area) 1203, a cancel button (operation area) 1204, and an unresolved indicator 1205. The execute button (operation area) 1203 is an operation area that accepts an operation to execute a batch change to the recommended route due to congestion.

[0065] The information processing device 500B then executes an operation reception determination process (step ST2203). In the operation reception determination process, the corresponding operation signal output unit 530 of the information processing device 500B determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that an operation on the operation area has not been received within a certain period of time (step ST2203 "NO"), the information processing device 500B proceeds to the process of step ST2204. If the corresponding operation signal output unit 530 determines that an operation on the operation area has been received (step ST2203 "YES"), the information processing device 500B proceeds to the process of step ST2210.

[0066] The information processing device 500B then executes a conversational sentence acceptance determination process (step ST2204). In the conversational sentence acceptance determination process, the conversational sentence acceptance unit 540 of the information processing device 500B determines whether a conversational sentence from the user has been accepted. If the conversational sentence acceptance unit 540 of the information processing device 500B determines in the conversational sentence acceptance determination process that the conversational sentence acceptance unit 540 of the information processing device 500B has not accepted a conversational sentence (step ST2204 "NO"), the information processing device 500B proceeds to the process of step ST2201. In the processes from step ST2201 to step ST2202, if there is traffic congestion information currently being output, the information processing device 500B maintains the output of the conversational image. Furthermore, in the processes from step ST2201 to step ST2202, if new traffic congestion information is acquired, the information processing device 500B maintains the output of the conversational image and outputs a new conversational image. If the conversation sentence receiving section 540 determines that a conversation sentence has been received ("YES" in step ST2204), the information processing device 500B proceeds to the process of step ST2205.

[0067] The information processing device 500B then executes a conversation sentence input process (step ST2205). In the conversation sentence input process, the conversation sentence receiving unit 540 of the information processing device 500B inputs input conversation sentence information indicating the received input conversation sentence to the conversation-type information control unit 520B.

[0068] The information processing device 500B then executes a nomination acceptance determination process (step ST2207). In the nomination acceptance determination process, the nomination acceptance unit 550 of the information processing device 500B determines whether nomination information nominating the virtual correspondent has been accepted via the conversation sentence acceptance unit 540. If the nomination acceptance unit 550 has not accepted nomination information ("NO" in step ST2207), the information processing device 500B proceeds to the process of step ST2209.

[0069] If the nomination receiving unit 550 has received the nomination information ("YES" in step ST2207), the information processing device 500B then executes nomination input processing (step ST2208). In the nomination input processing, the nomination receiving unit 550 of the information processing device 500B inputs the nomination information to the interactive information control unit 520B.

[0070] The information processing device 500B then executes a process for outputting a conversational sentence and an operation area (step ST2209). In this process, the conversational information control unit 520B of the information processing device 500B outputs a conversational sentence and an operation area depending on whether or not nomination information has been received. Specifically, if nomination information has been input (step ST2207 "NO"), the conversational information control unit 520B outputs a conversational image including a conversational sentence and an operation area based on the conversational sentence information. If the nomination receiving unit 550 receives nomination information (step ST2207 "YES"), the conversational information control unit 520B outputs a conversational image including a conversational sentence by the virtual respondent and an operation area based on the nomination information in addition to the conversational sentence information. As shown in FIG. 9, the conversational information control unit 520B outputs a conversational image 1206 including a mention (nomination information) 1207. The interactive information control unit 520B generates a virtual responder corresponding to multiple past responders who are veterans, for example, based on the word "veteran" mentioned (designation information) 1207, and outputs an interactive image (operation area) 1209 including an icon 1208 indicating the virtual responder, a bus schedule display button (operation area) 1210 related to the response task, and a history details button (operation area) 1211. The information processing device 500B then proceeds to the processing of step ST2201. In the processing of steps ST2201 to ST2202, if there is congestion information currently being output, the information processing device 500B maintains the output of the interactive image. Furthermore, in the processing of steps ST2201 to ST2202, if new congestion information is acquired, the information processing device 500B maintains the output of the interactive image and outputs a new interactive image.

[0071] If the response operation signal output unit 530 determines that an operation on the operation area has been received (step ST2203 "YES"), the information processing device 500B then executes an operation command process (step ST2210). In the operation command process, when the response operation signal output unit 530 of the information processing device 500B receives an operation on the operation area, it outputs a control signal instructing an operation related to the response task. Here, in FIG. 9 , when an operation command is issued via the execute button (operation area) 1203, the conversational information control unit 520B then outputs a conversational image (operation area) 1213 indicating that the operation command has been confirmed, as well as an icon 1212 indicating a virtual responder different from the virtual responder indicated by icon 1208. In this way, multiple different virtual responders can be generated for one response task, and a conversational image can be output for each virtual responder. As shown in FIG. 9 , when mentions (designation information) 1207 and 1216 are received from the user, a conversational image is generated featuring a virtual responder corresponding to the designation information.

[0072] The information processing device 500B then proceeds to termination determination processing (step ST2211). In the termination determination processing, a control unit (not shown) of the information processing device 500B determines whether to terminate the processing of the information processing device 500B. The control unit (not shown) determines whether to terminate the processing of the information processing device 500B, for example, in accordance with an external termination command or an execution program. If the control unit (not shown) determines not to terminate the processing of the information processing device 500B (step ST2211 "NO"), the information processing device 500B proceeds to processing of step ST2201 and repeats processing from the processing of step ST2201. If the control unit (not shown) determines to terminate the processing of the information processing device 500B (step ST2211 "YES"), the information processing device 500B terminates processing. Note that in the above description, the operation acceptance determination and the conversation sentence acceptance determination are performed in order, but they may be processed in parallel, or the order may be reversed. The same applies to the following description within the scope of not contradicting the implementation of each function.

[0073] 9 shows an example of output by the second function in embodiment 2. Fig. 9 shows an image of a conversational image area, in which an icon 1201, a conversational image (operation area) 1202, an execute button (operation area) 1203, a cancel button (operation area) 1204, an unresolved indication 1205, a conversational image (operation area) 1206, a mention (designation information) 1207, an icon (virtual responder) 1208, a conversational image (operation area) 1209, a bus schedule display button (operation area) 1210, a history details button (operation area) 1211, an icon (virtual responder) 1212, a conversational image (operation area) 1213, a history details button (operation area) 1214, a conversational image (operation area) 1215, and a mention (designation information) 1216 are shown. As shown by icons (virtual responders) 1208 and 1212, a conversational image can be output to make it appear as if multiple people are responding. Furthermore, an image can be output to make it appear as if another dispatcher is responding to the user's question (if two or more dispatchers are involved, the icons are displayed in separate segments and combined into a single speech bubble). The information processing device 500B outputs a conversational image featuring a virtual responder designated by the user. This allows the user to select a virtual responder appropriate to the situation. Because the virtual responder can respond, no human intervention is required. Users can delve deeper into their personal experiences depending on the situation. The information processing device 500B can indicate an automatic response by adding a badge (icon 1201). By accepting mentions (designation information), the information processing device 500B can generate virtual responders by attribute, such as "veteran," "public road," "resort," "cold region," or "morning shift." Similarly, questions can be answered by specifying a person or attribute. The information processing device 500B can accept operations on the icons (operation areas) 1208 and 1212 and make a call to the operations manager indicated by the operated icon.

[0074] [Third Function in Second Embodiment] A process example and an example operation image related to the third function of the information processing device 500B will be described. FIG. 10 is a flowchart showing an example of the third process in the information processing device according to the second embodiment of the present disclosure. FIG. 11 is a diagram for explaining the function of the third process in the information processing device according to the second embodiment of the present disclosure. The process shown in FIG. 10 is an information processing method performed by the information processing device 500B. For example, the information processing device 500B shown in FIG. 4 starts the process shown in FIG. 10 when it acquires current information. Here, a process example when the current information is traffic congestion information will be described.

[0075] Next, information processing device 500B executes a process of selecting a plurality of candidate ways to deal with the traffic jam (step ST2301). In this process, interactive information control unit 520B of information processing device 500B outputs an interactive image including a plurality of the operation areas.

[0076] The information processing device 500B then executes statistical processing on the multiple candidate actions (step ST2302). In this processing, the statistical information output unit 524 in the decision support information generation unit 521 of the information processing device 500B outputs statistical information on the candidate actions for each of the multiple operation areas. The statistical information output unit 524 calculates statistical information based on know-how information including metadata for each responder. The statistical information output unit 524 outputs the statistical information as decision support information.

[0077] Next, information processing device 500B executes a process of outputting an interactive image including statistical information for each operation area (step ST2303). In this process, interactive information control unit 520B of information processing device 500B outputs interactive image (operation area) 1302 including selection support information 1320 (1321, 1322, 1323) corresponding to each of a plurality of operation areas 1310 (1311, 1312, 1313), for example, as shown in FIG.

[0078] A display example using the third function will now be described. Fig. 11 shows an icon 1301, a conversational image (operation area) 1302, an unsolved message 1303, an operation area 1310, an operation area (candidate countermeasure operation) 1311, an operation area (candidate countermeasure operation) 1312, an operation area (candidate countermeasure operation) 1313, selection support information 1320, statistical information 1321, statistical information 1322, and statistical information 1323. As shown in Fig. 11, a conversational image including an operation area for each of a plurality of candidate countermeasure operations is output. It is also possible to display statistical information (recommended percentage) for each candidate countermeasure operation.

[0079] [Fourth Function in Second Embodiment] A processing example and an example operation image related to the fourth function of the information processing device 500C will be described. FIG. 12 is a flowchart showing an example of the fourth processing in the information processing device according to the second embodiment of the present disclosure. FIG. 13 is a diagram for explaining the function of the fourth processing in the information processing device according to the second embodiment of the present disclosure. The processing shown in FIG. 12 is an information processing method performed by the information processing device 500B. For example, the information processing device 500B shown in FIG. 4 starts the processing shown in FIG. 12 when it acquires current information. Here, a processing example when the current information is traffic congestion information will be described.

[0080] The information processing device 500B then executes a process of selecting a plurality of candidate operations for handling the traffic jam (step ST2401). In this process, the interactive information control unit 520B of the information processing device 500B uses the traffic jam information to select a plurality of candidate operations for handling tasks based on the know-how information, and generates candidate operation information for each candidate operation.

[0081] The information processing device 500B then executes a priority calculation process for a plurality of response candidates (step ST2402). In the priority calculation process, the priority calculation unit 525 of the information processing device 500B calculates the priority of an operation candidate related to the response task. The priority calculation unit 525 calculates the priority of the operation candidate related to the response task based on know-how information related to the response selected as the response candidate. The priority calculation unit 525 outputs the priority of each operation candidate related to the operation area as decision support information.

[0082] Next, the information processing device 500B executes a process of outputting an interactive image including an operation region in order of priority (step ST2403). In this process, the interactive information control unit 520B of the information processing device 500B acquires the priority of each operation candidate as decision support information from the priority calculation unit 525 and outputs the priority.

[0083] After executing the process of step ST2403, information processing device 500B ends the process shown in FIG.

[0084] A display example using the fourth function will be described. Fig. 13 shows an icon 1401, a conversational image (operation area) 1402, an unsolved display 1403, an operation area 1410, an operation area (candidate countermeasure operation, selection support information) 1411, an operation area (candidate countermeasure operation, selection support information) 1412, and an operation area (candidate countermeasure operation, selection support information) 1413. As shown in Fig. 13, by outputting the priority ranking of candidate countermeasure operations based on know-how information, it is possible to utilize accumulated know-how information to display more appropriate candidate countermeasure operations. Alternatively, the priority ranking may be output.

[0085] [Fifth Function in Second Embodiment] A processing example and an operation image example relating to the fifth function of the information processing device 500C will be described. FIG. 14 is a flowchart illustrating an example of the fifth processing in the information processing device according to the second embodiment of the present disclosure. FIG. 15 is a diagram for explaining the function of the fifth processing in the information processing device according to the second embodiment of the present disclosure. The processing illustrated in FIG. 14 is an information processing method performed by the information processing device 500B. For example, the information processing device 500B illustrated in FIG. 4 starts the processing illustrated in FIG. 14 upon acquiring current information. Here, a processing example in which the current information is traffic congestion information will be described.

[0086] The information processing device 500B then executes a process of selecting a plurality of response candidates for the traffic jam (step ST2501). In this process, the interactive information control unit 520B of the information processing device 500B outputs an interactive image including a conversational sentence and an operation area related to a response task by a virtual responder generated based on the traffic jam information (current information) and know-how information for each past responder related to the operation of the mobile object 100. The interactive information control unit 520B selects a plurality of response candidates.

[0087] The information processing device 500B then executes a process of outputting selection reason information related to the plurality of response candidates (step ST2502). In this process, the supplemental information output unit 526 of the information processing device 500B outputs selection reason information including a reason why the operation region is likely to be selected, as judgment support information, for each operation related to the operation region.

[0088] Next, information processing device 500B executes a process of outputting an interactive image including selection reason information for each operation area (step ST2503). In this process, interactive information control unit 520B of information processing device 500B accepts the decision support information and further outputs an interactive image using the decision support information.

[0089] After executing the process of step ST2503, information processing device 500B ends the process shown in FIG.

[0090] The fifth function outputs a conversational image including the context of the reason for selecting a candidate response. FIG. 15 shows an icon 1501, a conversational image (operation area) 1502, an unresolved display 1503, an operation area 1510, an operation area (candidate response operation) 1511, an operation area (candidate response operation) 1512, an operation area (candidate response operation) 1513, selection support information 1520, supplemental information 1521, supplemental information 1522, and supplemental information 1523. For example, as shown in FIG. 15 , a conversational image including selection support information 1520 (1521, 1522, 1523) corresponding to each operation area (candidate response operation) 1510 (1511, 1512, 1513) for each candidate response is output. This allows the output of the reason for the selection to assist in determining whether the selection is appropriate for the situation. Furthermore, a conversational image showing natural responses, such as those given when the reason for the selection is actually asked to a past responder, can be output.

[0091] [Sixth Function in Second Embodiment] A processing example and an example operation image related to the sixth function of the information processing device 500B will be described. FIG. 16 is a flowchart illustrating an example of the sixth processing in the information processing device according to the second embodiment of the present disclosure. FIG. 17 is a diagram illustrating a function based on the sixth processing in the information processing device according to the second embodiment of the present disclosure. The processing illustrated in FIG. 16 is an information processing method performed by the information processing device 500B. For example, when the information processing device 500B illustrated in FIG. 4 acquires current information, it starts the processing illustrated in FIG. 16. Here, a processing example in the case where the current information is traffic congestion information will be described. The processing from step ST2601 to step ST2609 is the same as the processing already described, and therefore some of the description will be omitted.

[0092] Next, information processing device 500B executes a process of determining whether an interactive image including an operation area for batch recommended route change has been output (step ST2601). In this process, interactive information control unit 520 of information processing device 500B determines whether an interactive image including an operation area for batch recommended route change has been output based on the acquired congestion information. Here, in this process, information processing device 500B may perform the same processes as those of steps ST2201 and ST2202 already described.

[0093] The information processing device 500B then executes an operation reception determination process (step ST2602). In the operation reception determination process, the corresponding operation signal output unit 530 of the information processing device 500B determines whether an operation on the operation area has been received. If the corresponding operation signal output unit 530 determines that an operation on the operation area has not been received within a certain period of time (step ST2602 "NO"), the information processing device 500B proceeds to the process of step ST2603. If the corresponding operation signal output unit 530 determines that an operation on the operation area has been received (step ST2602 "YES"), the information processing device 500B proceeds to the process of step ST2609.

[0094] The information processing device 500B then executes a conversational sentence acceptance determination process (step ST2603). In the conversational sentence acceptance determination process, the conversational sentence acceptance unit 540 of the information processing device 500B determines whether a conversational sentence from the user has been accepted. If the conversational sentence acceptance unit 540 of the information processing device 500B determines in the conversational sentence acceptance determination process that the conversational sentence acceptance unit 540 of the information processing device 500B has not accepted a conversational sentence ("NO" in step ST2603), the information processing device 500B proceeds to the process of step ST2601. If the conversational sentence acceptance unit 540 determines that a conversational sentence has been accepted ("YES" in step ST2603), the information processing device 500B proceeds to the process of step ST2604. In the processes from step ST2601 to step ST2602, if there is traffic congestion information currently being output, the information processing device 500B maintains the output of the conversational image. Furthermore, when new congestion information is acquired in the processes from step ST2601 to step ST2602, information processing device 500B maintains the output of the conversational image and outputs a new conversational image.

[0095] The information processing device 500B then executes a conversation sentence input process (step ST2604). In the conversation sentence input process, the conversation sentence receiving unit 540 of the information processing device 500B inputs input conversation sentence information indicating the received input conversation sentence to the conversation-type information control unit 520B.

[0096] The information processing device 500B then executes a nomination acceptance determination process (step ST2606). In the nomination acceptance determination process, the nomination acceptance unit 550 of the information processing device 500B determines whether nomination information nominating a virtual person has been accepted. If the nomination acceptance unit 550 has not accepted nomination information nominating a virtual person ("NO" in step ST2606), the information processing device 500B proceeds to the process of step ST2608. If the nomination acceptance unit 550 has accepted nomination information nominating a virtual person ("YES" in step ST2606), it accepts the nomination information nominating a virtual person.

[0097] When the nomination receiving unit 550 receives nomination information for nominating a virtual associate ("YES" in step ST2606), the information processing device 500B then executes nomination input processing (step ST2607). In the nomination input processing, the nomination receiving unit 550 of the information processing device 500B inputs the nomination information to the interactive information control unit 520B.

[0098] The information processing device 500B then executes a process of outputting a conversational sentence and an operation area (step ST2608). In this process, the conversational information control unit 520B of the information processing device 500B outputs a conversational sentence and an operation area depending on whether or not nomination information has been received. Specifically, if nomination information has been input (step ST2606 "NO"), the conversational information control unit 520B outputs a conversational image including a conversational sentence and an operation area based on the conversational sentence information. If the nomination receiving unit 550 receives nomination information (step ST2606 "YES"), the conversational information control unit 520B receives nomination information from the nomination receiving unit 550 and outputs a conversational image including a conversational sentence by the virtual person and an operation area based on the nomination information in addition to the conversational sentence information. The information processing device 500B then proceeds to the process of step ST2601.

[0099] If the corresponding operation signal output section 530 determines that it has received an operation on the operation area ("YES" in step ST2602), the information processing device 500B then executes an operation command process (step ST2609).

[0100] The information processing device 500B then executes a corresponding task handling completion determination process (step ST2610). In the corresponding task handling completion determination process, the interactive information control unit 520B of the information processing device 500B determines whether the corresponding task has been handled. If the know-how information acquisition unit 560 determines that the corresponding task has not been handled ("NO" in step ST2610), the information processing device 500B proceeds to the process of step ST2601. If the know-how information acquisition unit 560 determines that the corresponding task has been handled ("YES" in step ST2610), the information processing device 500B proceeds to the process of step ST2611.

[0101] The information processing device 500B then executes a know-how input image output process (step ST2611). In the know-how input image output process, in the process of determining whether a corresponding task has been handled by the information processing device 500B, when an operation related to the corresponding task is instructed, the interactive information control unit 520B of the information processing device 500B outputs an interactive image including a know-how input area for accepting input of know-how information related to the person in charge.

[0102] The information processing device 500B then executes know-how input determination processing (step ST2612). In the know-how input determination processing, the know-how information acquisition unit 560 of the information processing device 500B determines whether know-how information has been input. If the know-how information acquisition unit 560 determines that know-how information has not been input within a certain period of time ("NO" in step ST2612), the information processing device 500B proceeds to termination determination processing (step ST2614). If the know-how information acquisition unit 560 determines that know-how information has been input ("YES" in step ST2612), the information processing device 500B proceeds to step ST2613.

[0103] The information processing device 500B then executes a know-how information acquisition process (step ST2613). In the know-how information acquisition process, the know-how information acquisition unit 560 of the information processing device 500B attaches metadata for each respondent to the know-how information acquired via the know-how input area and stores the information in a storage unit (not shown).

[0104] After executing the process of step ST2613, the information processing device 500B ends the series of processes shown in FIG.

[0105] An example of a conversational image using the sixth function will now be described. Figure 17 shows an icon 1601, a conversational image (operation area) 1602, an execute button (operation area) 1603, a cancel button (operation area) 1604, an image (solution display) 1605, a know-how input (operation area) 1606, a detailed request (operation area) 1607, a conversational image 1610, a conversational image (operation area) 1620, a conversational image (operation area) 1621, a bus schedule display button (operation area) 1622, a history details button (operation area) 1623, and a conversational image 1630. When the execute button 1603 is operated and the response is completed, an operation area such as a know-how input (operation area) 1606 is output. When an operation on the know-how input (operation area) 1606 is accepted, know-how information can be input.

[0106] [Seventh Function in Second Embodiment] A process example and an example operation image related to the seventh function of the information processing device 500C will be described. FIG. 18 is a flowchart showing an example of the seventh process in the information processing device according to the second embodiment of the present disclosure. FIG. 19 is a diagram for explaining the function of the seventh process in the information processing device according to the second embodiment of the present disclosure. The process shown in FIG. 18 is an information processing method performed by the information processing device 500B. For example, the information processing device 500B shown in FIG. 4 starts the process shown in FIG. 18 when it acquires current information. Here, a process example when the current information is traffic congestion information will be described.

[0107] The information processing device 500B then executes a process for determining whether there are multiple tasks (step ST2701). In the process for determining whether there are multiple tasks, the interactive information control unit 520B of the information processing device 500B ends the process shown in Fig. 18 if there are no multiple tasks to be handled simultaneously (step ST2701 "NO"). In the process for determining whether there are multiple tasks, the interactive information control unit 520B of the information processing device 500B ends the process shown in Fig. 18 if there are no multiple tasks to be handled simultaneously (step ST2701 "YES"). In the process for determining whether there are multiple tasks, the interactive information control unit 520B of the information processing device 500B proceeds to step ST2702.

[0108] Information processing device 500B then executes a process of outputting a task selection image for each corresponding task (step ST2702). In this process, interactive information control unit 520B of information processing device 500B outputs a new task selection image for each corresponding task.

[0109] The information processing device 500B then executes a task selection image selection determination process (step ST2703). In the task selection image selection determination process, the interactive information control unit 520B of the information processing device 500B determines whether a task selection image has been selected. If the interactive information control unit 520B determines that a task selection image has not been selected (step ST2703 "NO"), the interactive information control unit 520B repeats the determination. If the interactive information control unit 520B determines that a task selection image has been selected (step ST2703 "YES"), the process proceeds to step ST2704.

[0110] Information processing device 500B then executes a process of outputting an interactive image related to the corresponding task (step ST2704). In this process, interactive information control unit 520B of information processing device 500B outputs an interactive image related to the corresponding task.

[0111] The information processing device 500B then executes a determination as to whether there are multiple tasks (step ST2705). In the process of determining whether there are multiple tasks, if the interactive information control unit 520B of the information processing device 500B determines that there are multiple tasks ("YES" in step ST2705), the information processing device 500B proceeds to the process of ST2702.

[0112] If the information processing device 500B determines in step ST2705 that there are no multiple tasks, it ends the process shown in FIG.

[0113] An example of a conversational image using the seventh function will now be described. FIG. 19 shows a task selection image (operation area) 1701, a selection indicator 1702, a task selection image (operation area) 1711, and a response-required indicator 1712. FIG. 19 shows a case where there are multiple response tasks, such as an "accident traffic jam at intersection A" and a "01 vehicle sensor malfunction," and task selection images 1701 and 1711 are newly output for each response task. When a selection operation is accepted via the task selection image (operation area) 1701 and the task selection image (operation area) 1711, a conversational image of the task selection image (operation area) 1701 and the task selection image (operation area) 1711 corresponding to the selection operation can be selected and output. The selection indicator 1702 indicates that the response task "accident traffic jam at intersection A" is selected. The response-required indicator 1712 indicates that the response task is an unaddressed response task based on a status flag indicating the response status.

[0114] According to the above disclosure, the present disclosure can support a selection operation when an interactive image including operation regions related to a plurality of correspondence candidates is output.

[0115] This embodiment further discloses the following configuration: an information processing device including a conversational sentence receiving unit that receives a conversational sentence from a user, wherein the conversational information control unit outputs a conversational image by further using the conversational sentence received by the conversational sentence receiving unit. This configuration has the effect of providing an information processing device that can provide interactive support to a user (fleet manager) so that the user can respond appropriately to an event that requires response. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or fleet management system that has the same effect as the above by applying the configuration to the information processing method, information processing program, or fleet management system.

[0116] This embodiment further discloses the following configuration: an information processing device including a nomination receiving unit that receives nomination information for nominating the virtual responder via the conversational text receiving unit, and the conversational information control unit further outputs a conversational image including a conversational text by the virtual responder based on the nomination information. This configuration has the effect of providing an information processing device that enables a user (dispatch manager) to be provided with a conversational text by a virtual responder desired by the user in response to an event that has occurred. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or operational management system having the same effect as the above by applying the above configuration to the above information processing method, information processing program, or operational management system.

[0117] This embodiment further discloses the following configuration: an information processing device, wherein the conversational image including a conversational sentence by the virtual responder output by the conversational information control unit includes a plurality of the operation areas. This configuration provides an advantage of providing an information processing device that enables a selection from a plurality of operation candidates related to a response task by a virtual responder. Furthermore, the present disclosure provides an advantage of providing an information processing method, information processing program, or operation management system having the same effect as the above by applying the configuration to the information processing method, information processing program, or operation management system.

[0118] This embodiment further discloses the following configuration: an information processing device including a conversational statement receiving unit that receives a conversational statement from a user; the conversational information control unit further using the conversational statement received by the conversational statement receiving unit to output a conversational image; and the conversational image, including the conversational statement by the virtual responder, output by the conversational information control unit includes a plurality of the operation areas. This configuration has the effect of providing an information processing device that can provide interactive support to a user (fleet manager) so that the user can appropriately respond to an event that requires response. It also has the effect of providing an information processing device that can select from a plurality of operation candidates related to a response task by a virtual responder. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or fleet management system that has the same effect as the above by applying the above configuration to the above information processing method, information processing program, or fleet management system.

[0119] This embodiment further discloses the following configuration: an information processing device, wherein the conversational image including a conversation by the virtual responder output by the conversational information control unit includes a plurality of the operation areas. This configuration has the effect of providing an information processing device that enables a user (dispatch manager) to be provided with a conversation by a virtual responder of the user's choice in response to an event that has occurred. This has the effect of providing an information processing device that enables a selection from a plurality of operation candidates related to a response task by a virtual responder. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or operation management system having the same effect as the above by applying the above configuration to the above information processing method, information processing program, or operation management system.

[0120] This embodiment discloses the following configuration: an information processing device, wherein the conversational image including a conversational sentence by the virtual responder output by the conversational information control unit includes a plurality of the operation areas; and the information processing device comprises a decision support information generation unit that generates decision support information based on a response task for each operation area and an operation history related to the response task; and the conversational image output by the conversational information control unit includes the decision support information for each operation area. This configuration has the effect of providing an information processing device that can support a decision to select from a plurality of operation candidates. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or operation management system having the same effect as the above by applying the above configuration to the above information processing method, information processing program, or operation management system.

[0121] This embodiment discloses the following configuration: an information processing device including a decision support information generation unit that generates decision support information based on a corresponding task for each operation area and an operation history related to the corresponding task, and the conversational image output by the conversational information control unit includes the decision support information for each operation area. This configuration provides an advantage of being able to provide an information processing device that can support a decision to select from a plurality of operation candidates. Furthermore, the present disclosure provides an advantage of being able to provide an information processing method, information processing program, or traffic management system that has the same effect as the above by applying the configuration to the information processing method, information processing program, or traffic management system.

[0122] This embodiment discloses the following configuration: an information processing device including a decision support information generation unit that generates decision support information based on a corresponding task for each operation area and an operation history related to the corresponding task, and the conversational image output by the conversational information control unit includes the decision support information for each operation area. This configuration provides an advantage of being able to provide an information processing device that can support a decision to select from a plurality of operation candidates. Furthermore, the present disclosure provides an advantage of being able to provide an information processing method, information processing program, or traffic management system that has the same effect as the above by applying the configuration to the information processing method, information processing program, or traffic management system.

[0123] This embodiment discloses the following configuration: an information processing device, wherein the judgment support information is statistical information based on know-how information including metadata for each responder. This configuration provides an advantage of being able to provide an information processing device that enables support in selecting from a plurality of operation candidates based on statistical results of the know-how information. Furthermore, the present disclosure provides an advantage of being able to provide an information processing method, information processing program, or operation management system that has the same effect as the above by applying the configuration to the information processing method, information processing program, or operation management system.

[0124] This embodiment discloses the following configuration: an information processing device, wherein the judgment support information is a priority of an operation related to the operation area. This configuration provides an advantage of being able to provide an information processing device that enables support in selecting from a plurality of operation candidates using a priority based on know-how information. Furthermore, the present disclosure provides an advantage of being able to provide an information processing method, information processing program, or operation management system that has the same effect as the above by applying the configuration to the information processing method, information processing program, or operation management system.

[0125] This embodiment discloses the following configuration: an information processing device, wherein the judgment support information is selection reason information including reasons why the operation area will be selected. This configuration provides an advantage of being able to provide an information processing device that enables support for selection using selection reasons based on know-how information. Furthermore, the present disclosure provides an advantage of being able to provide an information processing method, information processing program, or operation management system with the same effects as those described above by applying the configuration to the information processing method, information processing program, or operation management system.

[0126] This embodiment discloses the following configuration: an information processing device, wherein the interactive information control unit outputs an interactive image including a know-how input area for accepting input of know-how information related to a responder when an operation related to the response task is instructed, and the information processing device includes a know-how information acquisition unit that stores the know-how information acquired via the know-how input area with metadata for each responder. This configuration has the effect of providing an information processing device that enables the accumulation of current response results in know-how information. This configuration also has the effect of enabling the accumulation of new know-how information, thereby enabling more appropriate response support to be provided to users. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or traffic management system having the same effect as the above by applying the above configuration to the above information processing method, information processing program, or traffic management system.

[0127] This embodiment discloses the following configuration: The interactive information control unit outputs a new task selection image for each response task when there are multiple response tasks to be handled simultaneously, and when a response task is selected via the task selection image, outputs the interactive image related to the selected response task. This configuration provides an advantage of providing an information processing device that enables output of an interactive image for each response task when there are multiple response tasks to be handled simultaneously. Furthermore, the present disclosure provides an advantage of providing an information processing method, information processing program, or traffic management system with the same effect as the above by applying the configuration to the information processing method, information processing program, or traffic management system.

[0128] Embodiment 3. In embodiment 3, a configuration is described that realizes a function in which operations on an interactive image and operations on a detailed information image are linked in addition to the functions of the configuration according to embodiment 1 or 2. In embodiment 3, duplicated descriptions of components according to embodiment 3 that are the same as the components according to embodiments 1 and 2 already described will be omitted as appropriate.

[0129] An example configuration of an information processing device according to a third embodiment of the present disclosure will be described. FIG. 20 is a diagram illustrating an example configuration of an information processing device according to the third embodiment of the present disclosure. The information processing device 500C has a function of linking a conversational image with a detailed information image. The information processing device 500C includes a current information acquisition unit 510, a conversational information control unit 520, a decision support information generation unit 521, a conversational sentence adjustment unit 522, a conversational sentence prediction unit 523, a statistical information output unit 524, a priority calculation unit 525, a supplemental information output unit 526, a corresponding operation signal output unit 530, a conversational sentence reception unit 540, a nomination reception unit 550, a know-how information acquisition unit 560, and a detailed information control unit 570.

[0130] The current information acquisition unit 510 acquires current information, which is information received at the current time, in the same manner as the current information acquisition unit 510 already described.

[0131] The conversation type information control unit 520 outputs voice data using the conversation sentence predicted by the conversation sentence prediction unit 523 .

[0132] The decision support information generating unit 521 generates decision support information based on the corresponding task for each operation area and the operation history related to the corresponding task, in the same manner as the decision support information generating unit 521 already described.

[0133] The conversation sentence adjustment unit 522 adjusts the conversation sentence of the user based on an operation by the user. In this case, the conversation-type information control unit outputs the conversation-type image including the conversation sentence adjusted by the conversation sentence adjustment unit.

[0134] The conversation sentence prediction unit 523 predicts candidate conversation sentences for the user. The conversation sentence prediction unit 523 predicts candidate conversation sentences for the user based on pre-stored feature information indicating characteristics of the user's responses, the current information, and the know-how information. In relation to this configuration, the conversation sentence reception unit 540 receives a conversation sentence selected from the candidate conversation sentences predicted by the conversation sentence prediction unit 523.

[0135] The statistical information output unit 524 outputs statistical information on operation candidates related to the operation area, similarly to the statistical information output unit 524 already described.

[0136] The priority calculation unit 525 calculates the priority of the operation candidate related to the corresponding task, similarly to the priority calculation unit 525 already described.

[0137] Similar to the supplemental information output unit 526 already described, the supplemental information output unit 526 outputs, for each operation related to an operation area, selection reason information including the reason why the operation area is likely to be selected, as judgment support information.

[0138] The corresponding operation signal output unit 530, like the corresponding operation signal output unit 530 already described, accepts an operation on the operation area and outputs a control signal instructing an operation related to the corresponding task.

[0139] The conversation sentence receiving unit 540 receives the conversation sentences of the user in the same manner as the conversation sentence receiving unit 540 already described.

[0140] The nomination receiving unit 550 receives nomination information for nominating the virtual person through the conversation sentence receiving unit 540, similar to the nomination receiving unit 550 already described.

[0141] The know-how information acquisition unit 560, like the know-how information acquisition unit 560 already described, outputs an interactive image including a know-how input area for accepting input of know-how information related to the responder when an operation related to the response task is instructed. The know-how information acquisition unit 560 stores the know-how information acquired via the know-how input area with metadata for each responder.

[0142] The interactive image output by the interactive information control unit 520 includes a detail request operation area that accepts an operation to request details of the corresponding task shown in the interactive image. When the detailed information control unit 570 accepts a detail request via the detail request operation area, it acquires the current information related to the corresponding task for which details are requested and outputs a detailed information image based on the current information. The detailed information control unit 570 outputs the detailed information image that includes a selection operation area that accepts a selection operation. With this configuration, the interactive information control unit 520 outputs the interactive image using the current information related to the selection operation area that was selected.

[0143] An example of processing of an information processing device according to embodiment 3 of the present disclosure will be described. Fig. 21 is a flowchart showing an example of processing of a conversational information control unit in the information processing device according to embodiment 3 of the present disclosure. Fig. 22 is a flowchart showing an example of processing of a detailed information control unit in the information processing device according to embodiment 3 of the present disclosure. Fig. 23 is a diagram showing an image of functions in the information processing device according to embodiment 3 of the present disclosure.

[0144] The process shown in Fig. 21 is an information processing method performed by an interactive information control unit 520C of the information processing device 500C. For example, the information processing device 500C shown in Fig. 20 starts the process shown in Fig. 21 in a state in which an operation control image during normal monitoring is being displayed via an input / output device.

[0145] The information processing device 500C then executes an individual detail request reception determination process (step ST3001). In the individual detail request reception determination process, the interactive information control unit 520C of the information processing device 500C determines whether an individual detail request has been received via an interactive image. If the interactive information control unit 520C determines that an individual detail request has not been received via an interactive image (step ST3001 "NO"), it repeats the process of step ST3001. If the interactive information control unit 520C determines that an individual detail request has been received via an interactive image (step ST3001 "YES"), it proceeds to the process of step ST3002.

[0146] Information processing device 500C then executes an individual detail request notification process (step ST3002). In the individual detail request notification process, interactive information control unit 520C of information processing device 500C notifies detailed information control unit 570 that an individual detail request has been made.

[0147] The information processing device 500C then executes an individual detail end request reception determination process (step ST3003). In the individual detail end request reception determination process, the interactive information control unit 520C of the information processing device 500C determines whether an individual detail end request has been received via the interactive image. If the interactive information control unit 520C determines that an individual detail end request has not been received via the interactive image (step ST3003 "NO"), it repeats the process of step ST3003. If the interactive information control unit 520C determines that an individual detail end request has been received via the interactive image (step ST3003 "YES"), it proceeds to the process of step ST3004.

[0148] The information processing device 500C then executes an individual detail end request notification process (step ST3004). When an individual detail end request is received in the individual detail end request notification process, the interactive information control unit 520C of the information processing device 500C notifies the detailed information control unit 570 of the individual detail end request.

[0149] When information processing device 500C issues an individual detail end request notification in the process of step ST3004, it then ends the series of processes in FIG.

[0150] The process shown in Fig. 22 is an information processing method performed by the detailed information control unit 570 of the information processing device 500C. For example, the information processing device 500C shown in Fig. 20 starts the process shown in Fig. 22 in a state in which an operation control image during normal monitoring is being displayed via an input / output device.

[0151] Next, information processing device 500C executes normal monitoring image output processing (step ST3011). In the normal monitoring image output processing, detailed information control unit 570 of information processing device 500C outputs a detailed information image that is preset for normal management to input / output device 300.

[0152] The information processing device 500C then executes an individual detail request determination process (step ST3012). In the individual detail request determination process, the detailed information control unit 570 of the information processing device 500C determines whether an individual detail request has been made from the interactive information control unit 520C. If the detailed information control unit 570 determines that an individual detail request has not been made from the interactive information control unit 520C (step ST3012 "NO"), it returns to the process of step ST3011. If the detailed information control unit 570 determines that an individual detail request has been made from the interactive information control unit 520C (step ST3012 "YES"), it proceeds to the process of step ST3013.

[0153] The information processing device 500C then executes an individual detailed image output process (step ST3013). In the individual detailed image output process, the detailed information control unit 570 of the information processing device 500C acquires current information from the current information acquisition unit 510, and outputs an individual detailed image using the current information related to the individual detailed request.

[0154] The information processing device 500C then executes an individual detail end determination process (step ST3014). In the individual detail end determination process, the detailed information control unit 570 of the information processing device 500C determines whether or not a notification of the end of the individual detail has been received from the interactive information control unit 520C. If the detailed information control unit 570 determines that a notification of the end of the individual detail has not been received from the interactive information control unit 520C ("NO" in step ST3014), it proceeds to the process of step ST3013. If the detailed information control unit 570 determines that a notification of the end of the individual detail has been received from the interactive information control unit 520C ("YES" in step ST3014), it terminates the process.

[0155] When the output of the individual detailed image is completed in the process of step ST3014, the information processing device 500C then terminates the series of processes related to FIG.

[0156] An overview of the functions of the third embodiment will be described. FIG. 23 shows a traffic management image 2000, a conversational image display area 2010, and a detailed information image 2020. The traffic management image 2000 is composed of a conversational image display area 2010 and a detailed information image 2020. The conversational image display area 2010 is an area that displays the conversational images described in the first and second embodiments. The detailed information image 2020 outputs a detailed information image related to the corresponding task displayed in the conversational image display area 2010 in response to an operation received via an operation area 2011 of the conversational image display area 2010. Furthermore, the conversational image display area 2010 outputs a conversational image related to the corresponding task in response to an operation received via an operation area 2021 of the detailed information image 2020.

[0157] [First Function in Third Embodiment] A process example and an example operation image related to the first function of the information processing device 500C will be described. FIG. 24 is a flowchart illustrating an example of the first process in the information processing device according to the third embodiment of the present disclosure. FIG. 25 is a first diagram illustrating a function achieved by the first process in the information processing device according to the third embodiment of the present disclosure. FIG. 26 is a second diagram illustrating a function achieved by the first process in the information processing device according to the third embodiment of the present disclosure. FIG. 27 is a third diagram illustrating a function achieved by the first process in the information processing device according to the third embodiment of the present disclosure. The process illustrated in FIG. 24 is an information processing method performed by the information processing device 500C. For example, the information processing device 500C illustrated in FIG. 20 starts the process illustrated in FIG. 24 in a state in which a traffic management image during normal monitoring is displayed via an input / output device.

[0158] The information processing device 500C then executes an individual detail request reception determination process (step ST3101). In the individual detail request reception determination process, the detailed information control unit 570 of the information processing device 500C determines whether an individual detail request has been received from the interactive information control unit 520C via an interactive image. If the detailed information control unit 570 has not received an individual detail request from the interactive information control unit 520C via an interactive image (step ST3101 "NO"), it proceeds to the process of step ST3104. If the detailed information control unit 570 has received an individual detail request from the interactive information control unit 520C via an interactive image (step ST3101 "YES"), it proceeds to the process of step ST3102.

[0159] Next, the information processing device 500C executes a process of acquiring current information related to the corresponding task for which individual detail information has been requested (step ST3102). In this process, the detailed information control unit 570 of the information processing device 500C acquires the current information from the information source 200.

[0160] Next, information processing device 500C executes a process of outputting a detailed information image based on the current information related to the individual detailed request (step ST3103). In this process, detailed information control unit 570 of information processing device 500C outputs a detailed information image based on the current information.

[0161] The information processing device 500C then proceeds to termination determination processing (step ST3104). In the termination determination processing, a control unit (not shown) of the information processing device 500C determines whether to terminate the processing of the information processing device 500C. The control unit (not shown) determines whether to terminate the processing of the information processing device 500C, for example, in accordance with an external termination command or an execution program. If the control unit (not shown) determines not to terminate the processing of the information processing device 500C (step ST3104 "NO"), the information processing device 500C proceeds to processing of step ST3101 and repeats processing from the processing of step ST3101. If the control unit (not shown) determines to terminate the processing of the information processing device 500C (step ST3104 "YES"), the information processing device 500C terminates processing.

[0162] A display example using the first function in embodiment 3 will be described. FIG. 25 shows a traffic management image 2100, a conversational image display area 2110, a conversational image 2111, a conversational image (operation area) 2120, a corresponding task-related image (operation area) 2121, a details button (operation area) 2122, a solution button (operation area) 2123, and a detailed information image (normal management state) 2140 in a normal management state. The detailed information image (normal management state) 2140 is an image showing detailed information related to a moving object. The detailed information image (normal management state) 2140 is an image including, for example, an image captured by an imaging device mounted on the moving object, the time of operation, the duration of operation, the location of operation, and the status of operation, as well as information identifying the moving object. FIG. 26 shows a state in which the detailed information image has been switched to a detailed information image related to a corresponding task in the traffic management image. A detailed information image (individual detailed status) 2150 relating to the corresponding task is displayed in a conversational image display area 2110, where a conversational image (operation area) 2120 and a details button (operation area) 2122 are displayed, and when an operation from the user is received via the details button (operation area) 2122, an image including detailed information relating to the corresponding task shown in the conversational image (operation area) 2120 is displayed. The detailed information is, for example, information identifying a moving object relating to the corresponding task and information indicating the status of the moving object. 27 shows a conversational image display area, which includes an icon 2160, a conversational image (operation area) 2161, a corresponding task-related image (operation area) 2162, a status level (high response level) 2163, a status level (medium response level) 2164, an in-vehicle status list display button (operation area) 2165, a solve button (operation area) 2166, an unsolved display 2167, a conversational image 2170, a mention (nomination information) 2171, a conversational image (operation area) 2180, a highlight button (operation area) 2181, a history detail button (operation area) 2182, a conversational image (operation area) 2190, a highlight button (operation area) 2191, and a history detail button (operation area) 2192. The operation management image 2100 includes a conversational image display area 2110 and a detailed information image (normal management status) 2140. The detailed information image 2140 is an image in the normal management state.25 , if the current information acquisition unit 510 acquires, as current information from a sensor mounted on the vehicle, information indicating that the stress of the vehicle occupants is increasing, the conversational information control unit 520C outputs a conversational image 2120 including a response task related image (operation area) 2121 related to the occupants based on the current information. When the conversational information control unit 520C accepts an operation via the response task related image (operation area) 2121, the detailed information control unit 570 acquires current information related to the response task in place of the current information acquired in the normal management state, and outputs a detailed information image 2151 showing the status of the occupants in each vehicle based on the current information. As a result, the detailed information image now shows detailed information related to the response task that was shown in the conversational image.

[0163] [Second Function in Third Embodiment] A process example and an example operation image related to the second function of the information processing device 500C will be described. FIG. 28 is a flowchart illustrating an example of the second process in the information processing device according to the third embodiment of the present disclosure. FIG. 29 is a first diagram illustrating a function based on the second process in the information processing device according to the third embodiment of the present disclosure. FIG. 30 is a second diagram illustrating a function based on the second process in the information processing device according to the third embodiment of the present disclosure. The process illustrated in FIG. 28 is an information processing method performed by the information processing device 500C. For example, the information processing device 500C illustrated in FIG. 20 starts the process illustrated in FIG. 28 in a state in which predicted conversation sentence 2240 ( FIG. 29 ) is being output during normal monitoring.

[0164] The information processing device 500C then executes a detailed information output determination process related to the individual detailed request (step ST3201). In the detailed information output determination process, the interactive information control unit 520 of the information processing device 500C determines whether detailed information related to the individual detailed request has been output. If the interactive information control unit 520 determines that detailed information related to the individual detailed request has not been output (step ST3201 "NO"), the information processing device 500C proceeds to the process of step ST3209. If the interactive information control unit 520 determines that detailed information related to the individual detailed request has been output (step ST3201 "YES"), the information processing device 500C proceeds to the process of step ST3202.

[0165] The information processing device 500C then executes a conversation sentence prediction process (step ST3202). In the conversation sentence prediction process, the conversation sentence prediction unit 523 of the information processing device 500C predicts candidate conversation sentences of the user by using current information related to the corresponding task. The conversation sentence prediction unit 523 predicts candidate conversation sentences of the user based on pre-stored feature information indicating features of the user's response, the current information, and the know-how information.

[0166] Information processing device 500C then executes conversation sentence candidate output processing (step ST3203). In the conversation sentence candidate output processing, conversation sentence prediction section 523 of information processing device 500C outputs predicted conversation sentence candidates.

[0167] The information processing device 500C then executes a conversation sentence candidate selection determination process (step ST3204). In the conversation sentence candidate selection determination process, the conversation sentence reception unit 540 of the information processing device 500C determines whether a conversation sentence candidate has been selected from the conversation sentence candidates. If the conversation sentence reception unit 540 determines that a conversation sentence candidate has not been selected within a certain period of time ("NO" in step ST3204), it proceeds to the process of step ST3206. If the conversation sentence reception unit 540 determines that a conversation sentence candidate has been selected ("YES" in step ST3204), it proceeds to the process of step ST3205.

[0168] Information processing device 500C then executes a conversation sentence output process (step ST3205). In the conversation sentence output process, conversation sentence receiving section 540 of information processing device 500C outputs a conversation sentence selected from conversation sentence candidates.

[0169] The information processing device 500C then executes a selection operation reception determination process for the detailed information image (step ST3206). In the selection operation reception determination process, the conversation sentence reception unit 540 of the information processing device 500C determines whether a selection operation for the detailed information image has been received. The conversation sentence reception unit 540 determines whether a conversation sentence selected from the conversation sentence candidates predicted by the conversation sentence prediction unit 523 has been received. If the conversation sentence reception unit 540 determines that a selection operation for the detailed information image has not been received within a certain period of time (step ST3206 "NO"), it proceeds to the process of step ST3204. If the conversation sentence reception unit 540 determines that a selection operation for the detailed information image has been received (step ST3206 "YES"), it proceeds to the process of step ST3207.

[0170] The information processing device 500C then executes a conversation sentence prediction process (step ST3207). In the conversation sentence prediction process, the conversation sentence prediction unit 523 of the information processing device 500C predicts conversation sentence candidates of the user based on a selection operation on the detailed information image, feature information indicating pre-stored features of the user's response, the current information, and the know-how information.

[0171] Information processing device 500C then executes conversation sentence candidate output processing (step ST3208). In the conversation sentence candidate output processing, conversation sentence prediction section 523 of information processing device 500C outputs predicted conversation sentence candidates.

[0172] The information processing device 500C then proceeds to termination determination processing (step ST3209). In the termination determination processing, a control unit (not shown) of the information processing device 500C determines whether to terminate the processing of the information processing device 500C. The control unit (not shown) determines whether to terminate the processing of the information processing device 500C, for example, in accordance with an external termination command or an execution program. If the control unit (not shown) determines not to terminate the processing of the information processing device 500C (step ST3209 "NO"), the information processing device 500C proceeds to processing of step ST3201 and repeats processing from the processing of step ST3201. If the control unit (not shown) determines to terminate the processing of the information processing device 500C (step ST3209 "YES"), the information processing device 500C terminates processing.

[0173] A display example using the second function in the third embodiment will be described. FIG. 29 shows a traffic management image 2200, a conversational image display area 2210, a conversational image 2211, a conversational image (operation area) 2220, a status level (high response level) 2221, a details request button (operation area) 2222, a solution notification button (operation area) 2223, a detailed information image (individual detailed status) 2230, and a predicted conversational sentence 2240. FIG. 30 shows a predicted conversational sentence (before a details request operation) 2241 and a predicted conversational sentence (after a details request operation) 2242. For example, in the detailed information image (individual detailed status) 2230 of the traffic management image 2200 shown in FIG. 29, when a detailed information image related to a corresponding task is first displayed, a predicted conversational sentence (before a details request operation) 2241 is displayed. Next, when one moving object is selected from among multiple moving objects in the detailed information image, a predicted conversational sentence (after a details request operation) 2242 is displayed in response to the selection operation. In this way, the predicted conversation sentence is configured to change in response to an operation on the detailed information image.

[0174] [Third Function in Third Embodiment] A process example and an example operation image related to the third function of the information processing device 500C will be described. FIG. 31 is a flowchart illustrating an example of the third process in the information processing device according to the third embodiment of the present disclosure. FIG. 32 is a first diagram illustrating a function based on the third process in the information processing device according to the third embodiment of the present disclosure. FIG. 33 is a second diagram illustrating a function based on the third process in the information processing device according to the third embodiment of the present disclosure. The process illustrated in FIG. 31 is an information processing method performed by the information processing device 500C. For example, the information processing device 500C illustrated in FIG. 20 starts the process illustrated in FIG. 31 while displaying a traffic management image.

[0175] The information processing device 500C then executes a detailed information output determination process for the individual detailed request (step ST3301). In this determination process, the conversation sentence prediction unit 523 of the information processing device 500C determines whether detailed information for the individual detailed request has been output. If the detailed information for the individual detailed request has not been output ("NO" in step ST3301), the conversation sentence prediction unit 523 causes the information processing device 500C to proceed to the process of step ST3309. If the detailed information for the individual detailed request has been output ("YES" in step ST3301), the conversation sentence prediction unit 523 causes the information processing device 500C to proceed to the process of step ST3302.

[0176] The information processing device 500C then executes a conversation sentence request determination process (step ST3302). In this process, the conversation sentence prediction unit 523 of the information processing device 500C determines whether a conversation sentence has been requested. If the conversation sentence prediction unit 523 determines that a conversation sentence has not been requested within a certain period of time ("NO" in step ST3302), it proceeds to the process of step ST3309. If the conversation sentence prediction unit 523 determines that a conversation sentence has been requested ("YES" in step ST3302), it proceeds to the process of step ST3303.

[0177] Information processing device 500C then executes a process of outputting a conversation sentence in response to the request (step ST3303). In this process, conversation sentence prediction unit 523 of information processing device 500C outputs the conversation sentence in response to the request to conversation-type information control unit 520.

[0178] The information processing device 500C then executes a process of outputting a conversational image including a conversational sentence and an adjustment request operation area (step ST3304). In this process, the conversational information control unit 520 of the information processing device 500C outputs the conversational image. The conversational information control unit 520 acquires the conversational sentence from the conversational sentence prediction unit 523 and outputs the conversational image including the conversational sentence and the adjustment request operation area. FIG. 33 shows an example of a conversational image including an adjustment request operation area. The conversational image of FIG. 33 includes a conversational image 2370, an icon 2380, a conversational image (operation area) 2381, a predicted conversational sentence 2382, a predicted conversational sentence 2383, an adjustment button (operation area) 2384, and an execute button (operation area) 2385. The adjustment button (operation area) 2384 corresponds to the adjustment request operation area.

[0179] The information processing device 500C then executes an operation reception determination process for the adjustment request operation area (step ST3305). In the operation reception determination process, the conversation sentence adjustment unit 522 of the information processing device 500C determines whether an operation for the adjustment request operation area has been received. If the conversation sentence adjustment unit 522 determines that no operation has been received within a certain period of time ("NO" in step ST3305), it proceeds to step ST3307. If the conversation sentence adjustment unit 522 determines that an operation has been received ("YES" in step ST3305), it proceeds to the process of step ST3306.

[0180] Information processing device 500C then executes a process of adjusting the conversation sentence (step ST3306). In this process, conversation sentence adjustment section 522 of information processing device 500C adjusts the conversation sentence of the user based on an operation by the user.

[0181] The information processing device 500C then executes a voice output determination process (step ST3307). In this process, the conversational information control unit 520C of the information processing device 500C acquires the adjusted conversational sentence from the conversational sentence adjustment unit 522 and determines whether to perform voice output. If the conversational information control unit 520C determines not to perform voice output ("NO" in step ST3307), it proceeds to the process of step ST3301. If the conversational information control unit 520C determines to perform voice output ("YES" in step ST3307), it proceeds to the process of step ST3308.

[0182] Information processing device 500C then executes a voice output process (step ST3308). In this process, conversational information control unit 520C of information processing device 500C outputs voice using conversational sentences.

[0183] The information processing device 500C then proceeds to termination determination processing (step ST3309). In the termination determination processing, a control unit (not shown) of the information processing device 500C determines whether to terminate the processing of the information processing device 500C. The control unit (not shown) determines whether to terminate the processing of the information processing device 500C, for example, in accordance with an external termination command or an execution program. If the control unit (not shown) determines not to terminate the processing of the information processing device 500C (step ST3309 "NO"), the information processing device 500C proceeds to processing of step ST3301 and repeats processing from the processing of step ST3301. If the control unit (not shown) determines to terminate the processing of the information processing device 500C (step ST3309 "YES"), the information processing device 500C terminates processing.

[0184] A display example using the third function in the third embodiment will be described. Figures 32 to 34 show display examples when providing support for response according to the situation. Figure 32 shows an example of an operation management image 2300, including a conversational image display area 2310, a conversational image 2311, a conversational image (operation area) 2320, a status level (high response level) 2321, a details request button (operation area) 2322, a solution notification button (operation area) 2323, a detailed information image (individual detailed status) 2330, a detailed information image for each moving object 2340, and a collective announcement button (operation area) 2341. Figure 33 shows a conversational image display area, which displays an icon 2380, a conversational image (operation area) 2381, a predicted conversational sentence 2382, a predicted conversational sentence 2383, an adjustment button (operation area) 2384, an execute button (operation area) 2385, and a conversational image 2390. The operation control image 2300 shown in Fig. 32 notifies a response task when an in-vehicle sensor detects an increase in passenger stress levels. In this case, when the user inputs a response request to make a broadcast to the vehicle, the information processing device 500C, as shown in Fig. 33, considers an automated voice guidance sentence (conversation sentence) and outputs it as a conversational image 2381 (predicted conversation sentence 2382, predicted conversation sentence 2383). The conversational image 2381 includes operation areas such as an adjustment button for adjusting the conversation sentence and an execution button for executing the broadcast, and the conversation sentence can be adjusted and output as voice by operating this operation area.

[0185] This embodiment discloses the following configuration: an information processing device including a conversation sentence prediction unit that predicts conversation sentence candidates for a user (dispatch manager) based on pre-stored feature information indicating characteristics of the user's (dispatch manager's) response, the current information, and the know-how information; and the conversation sentence reception unit that receives a conversation sentence selected from the conversation sentence candidates predicted by the conversation sentence prediction unit. This configuration advantageously provides an information processing device that enables a user (dispatch manager) to have a conversation with a virtual responder simply by selecting the conversation sentence. This configuration also advantageously enables a conversation without requiring the user (dispatch manager) to perform an input operation when a quick response is required. Furthermore, the present disclosure advantageously provides an information processing method, information processing program, or dispatch management system having the same advantageous effect as the above by applying the configuration to the above information processing method, information processing program, or dispatch management system.

[0186] This embodiment discloses the following configuration: an information processing device, wherein the conversational information control unit outputs voice data using the conversational sentence predicted by the conversational sentence prediction unit. This configuration advantageously provides an information processing device that enables a user (dispatch manager) to easily make announcements when responding to an emergency. This configuration also advantageously provides support for a response that takes into account the status of passengers, surrounding vehicles, and other conditions, regardless of the user's (dispatch manager's) experience. This configuration also advantageously enables a single user (dispatch manager) to simultaneously respond to multiple moving objects. Furthermore, the present disclosure advantageously provides an information processing method, information processing program, or traffic management system that achieves the same effect as the above by applying the configuration to the information processing method, information processing program, or traffic management system.

[0187] This embodiment discloses the following configuration: an information processing device including a conversation sentence adjustment unit that adjusts a user's conversation sentence based on an operation by the user, and the conversation-type information control unit that outputs the conversation-type image including the conversation sentence adjusted by the conversation sentence adjustment unit. This configuration has the effect of providing an information processing device that allows a user to adjust the user's conversation sentence presented by a virtual responder. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or traffic management system having the same effect as the above by applying the above configuration to the above information processing method, information processing program, or traffic management system.

[0188] This embodiment discloses the following configuration: an information processing device, wherein the conversational image output by the conversational information control unit includes a detail request operation area that accepts an operation to request details of a corresponding task shown in the conversational image, and a detailed information control unit that, when a detail request is accepted via the detail request operation area, acquires current information related to the corresponding task for which details are requested and outputs a detailed information image based on the current information. This configuration has the effect of providing an information processing device that links a conversational image with a detailed information image. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or traffic management system having the same effect as the above by applying the above configuration to the above information processing method, information processing program, or traffic management system.

[0189] This embodiment discloses the following configuration: an information processing device, wherein the detailed information control unit outputs the detailed information image including a selection operation area that accepts a selection operation, and the interactive information control unit outputs the interactive image using the current information related to the selection operation area that has been selected. This configuration has the effect of providing an information processing device that links an interactive image with a detailed information image. Furthermore, the present disclosure has the effect of providing an information processing method, information processing program, or traffic management system that has the same effect as the above by applying the above configuration to the above information processing method, information processing program, or traffic management system.

[0190] Here, a hardware configuration for realizing the functions of the present disclosure will be described. Fig. 34 is a diagram showing a first example of a hardware configuration for realizing the functions of the configuration of the present disclosure. Fig. 35 is a diagram showing a second example of a hardware configuration for realizing the functions of the configuration of the present disclosure. Information processing devices 500, 500A, 500B, and 500C of the present disclosure are each realized by hardware such as that shown in Fig. 34 or Fig. 36.

[0191] 34, each of the information processing devices 500, 500A, 500B, and 500C includes, for example, a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004. The processor 10001 and the memory 10002 are mounted on, for example, a computer. The memory 10002 stores programs for causing the computer to function as a current information acquisition unit 510, a conversational information control unit 520, a decision support information generation unit 521, a conversation sentence adjustment unit 522, a conversation sentence prediction unit 523, a statistical information output unit 524, a priority calculation unit 525, a supplemental information output unit 526, a corresponding operation signal output unit 530, a conversation sentence reception unit 540, a nomination reception unit 550, a know-how information acquisition unit 560, a detailed information control unit 570, and a control unit (not shown). The processor 10001 reads and executes the programs stored in the memory 10002 to realize the functions of a current information acquisition unit 510, a conversational information control unit 520, a decision support information generation unit 521, a conversation sentence adjustment unit 522, a conversation sentence prediction unit 523, a statistical information output unit 524, a priority calculation unit 525, a supplemental information output unit 526, a corresponding operation signal output unit 530, a conversation sentence reception unit 540, a nomination reception unit 550, a know-how information acquisition unit 560, a detailed information control unit 570, and a control unit (not shown). Furthermore, the memory 10002 or another memory (not shown) realizes a storage unit (not shown). Furthermore, the communication circuit 10004 realizes a communication unit (not shown).

[0192] The processor 10001 is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a microprocessor, a microcontroller, or a DSP (Digital Signal Processor). The memory 10002 may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory) or flash memory, or a magnetic disk such as a hard disk or flexible disk, or an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk. The processor 10001 and the memory 10002 or the communication circuit 10004 are connected in a state capable of transmitting data to each other. The processor 10001, memory 10002, and communication circuit 10004 are connected via an input / output interface 10003 so as to be capable of transmitting data to and from other hardware.

[0193] Alternatively, the functions of the current information acquisition unit 510, conversational information control unit 520, decision support information generation unit 521, conversation sentence adjustment unit 522, conversation sentence prediction unit 523, statistical information output unit 524, priority calculation unit 525, supplementary information output unit 526, corresponding operation signal output unit 530, conversation sentence reception unit 540, nomination reception unit 550, know-how information acquisition unit 560, detailed information control unit 570, and a control unit not shown in the figure in the information processing devices 500, 500A, 500B, and 500C may be realized by a dedicated processing circuit 20001, as shown in FIG. 35.

[0194] The processing circuit 20001 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), a SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration), etc. In addition, a storage unit (not shown) is realized by the memory 20002 or another memory (not shown). The memory 20002 may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory), or flash memory, or a magnetic disk such as a hard disk or flexible disk, or an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk. The communication circuit 20004 implements a communication unit (not shown). The processing circuit 20001 and the memory 20002 or the communication circuit 20004 are connected in a state where they can transmit data to each other. Furthermore, the processing circuit 20001, the memory 20002, and the communication circuit 20004 are connected in a state where they can transmit data to other hardware via the input / output interface 20003. Note that in the information processing devices 500, 500A, 500B, and 500C, the functions of the current information acquisition unit 510, the conversational information control unit 520, the decision support information generation unit 521, the conversation sentence adjustment unit 522, the conversation sentence prediction unit 523, the statistical information output unit 524, the priority calculation unit 525, the supplemental information output unit 526, the corresponding operation signal output unit 530, the conversation sentence reception unit 540, the nomination reception unit 550, the know-how information acquisition unit 560, the detailed information control unit 570, and a control unit (not shown) may be realized by separate processing circuits, or may be realized collectively by a processing circuit.

[0195] Alternatively, in the information processing devices 500, 500A, 500B, and 500C, the current information acquisition unit 510, the conversational information control unit 520, the decision support information generation unit 521, the conversational sentence adjustment unit 522, the conversational sentence prediction unit 523, the statistical information output unit 524, the priority calculation unit 525, the supplementary information output unit 526, the corresponding operation signal output unit 530, the conversational sentence reception unit 540, the nomination reception unit 550, the know-how information acquisition unit 560, the detailed information control unit 570, and some of the functions of a control unit not shown may be realized by the processor 10001 and the memory 10002, and the remaining functions may be realized by the processing circuit 20001.

[0196] It should be noted that, within the scope of this disclosure, the embodiments may be freely combined, any component of each embodiment may be modified, or any component of each embodiment may be omitted.

[0197] The present disclosure can support operations managers in taking appropriate action against events that require their attention, and is therefore suitable for use in, for example, operation management systems for mobile vehicles.

[0198] 10 Operation control system, 100 (100-1, ..., 100-n (n≧1)) Mobile body, 200 Information source, 300 Input / output device, 500, 500A, 500B, 500C Information processing device, 510 Current information acquisition unit, 520 Conversational information control unit, 521 Judgment support information generation unit, 522 Conversational sentence adjustment unit, 523 Conversational sentence prediction unit, 524 Statistical information output unit, 525 Priority calculation unit, 526 Supplementary information output unit, 530 Corresponding operation signal output unit, 540 Conversational sentence reception unit, 550 Nomination reception unit, 560 Know-how information acquisition unit, 570 Detailed information control unit, 1101 Image (icon), 1102 Image (conversational image (operation area)), 1103 Image (execute button (operation area)), 1104 Image (cancel button (operation area)), 1105 Image (response task related image (operation area)), 1106 Image (unresolved display), 1107 Image (conversational image (operation area)), 1108 Image (conversational image (operation area)), 1109 Image (bus schedule display button (operation area)), 1110 Image (history details button (operation area)), 1201 Image (icon), 1202 Image (conversational image (operation area)), 1203 Image (execute button (operation area)), 1204 Image (cancel button (operation area)), 1205 Image (unresolved display), 1206 Image (conversational image (operation area)), 1207 Image (mention (designation information)), 1208 Image (icon (virtual responder)), 1209 Image (conversational image (operation area)), 1210 Image (bus schedule display button (operation area)), 1211 Image (history details button (operation area)), 1212 Image (icon (virtual responder)), 1213 Image (conversational image (operation area)), 1214 Image (history detail button (operation area)), 1215 Image (conversational image (operation area)), 1216 Image (mention (designation information)), 1301 Image (icon), 1302 Image (conversational image (operation area)), 1303 Image (unresolved display), 1310 Image (operation area), 1311 Image (operation area (response operation candidate)), 1312 Image (operation area (response operation candidate)), 1313 Image (operation area (response operation candidate)), 1320 Image (selection support information), 1321 Image (statistical information), 1322 Image (statistical information), 1323 Image (statistical information), 1401 Image (icon),1402 Image (conversational image (operation area)), 1403 Image (unresolved display), 1410 Image (operation area), 1411 Image (operation area (corresponding operation candidate, selection support information)), 1412 Image (operation area (corresponding operation candidate, selection support information)), 1413 Image (operation area (corresponding operation candidate, selection support information)), 1501 Image (icon), 1502 Image (conversational image (operation area)), 1503 Image (unresolved display), 1510 Image (operation area), 1511 Image (operation area (corresponding operation candidate)), 1512 Image (operation area (corresponding operation candidate)), 1513 Image (operation area (corresponding operation candidate)), 1520 Image (selection support information), 1521 Image (supplementary information), 1522 Image (supplementary information), 1523 Image (supplementary information), 1601 Image (icon), 1602 Image (conversational image (operation area)), 1603 Image (execute button (operation area)), 1604 Image (cancel button (operation area)), 1605 Image (solution display), 1606 Image (know-how input (operation area)), 1607 Image (detailed request (operation area)), 1610 Image (conversational image), 1620 Image (conversational image (operation area)), 1621 Image (conversational image (operation area)), 1622 Image (bus schedule display button (operation area)), 1623 Image (history details button (operation area)), 1630 Image (conversational image), 1701 Image (task selection image (operation area)), 1702 Image (selected display), 1711 Image (task selection image (operation area)), 1712 Image (action required display), 2000 Image (traffic management image), 2010 Image (conversational image display area), 2011 Operation area, 2020 image (detailed information image), 2021 operation area, 2100 image (operation control image), 2110 image (conversational image display area), 2111 image (conversational image), 2120 image (conversational image (operation area)), 2121 image (corresponding task related image (operation area)), 2122 image (detail button (operation area)), 2123 image (solution button (operation area)), 2140 image (detailed information image (normal management state)), 2150 image (detailed information image (individual detailed state)), 2160 image (icon), 2161 image (conversational image (operation area)), 2162 image (corresponding task related image (operation area)), 2163 image (status level (high response level)),2164 Image (status level (medium response level)), 2165 Image (in-vehicle status list display button (operation area)), 2166 Image (solve button (operation area)), 2167 Image (unsolved display), 2170 Image (conversational image), 2171 Image (mention (designation information)), 2180 Image (conversational image (operation area)), 2181 Image (highlight button (operation area)), 2182 Image (history details button (operation area)), 2190 Image (conversational image (operation area)), 2191 Image (highlight button (operation area)), 2192 Image (history details button (operation area)), 2200 Image (operation control image), 2210 Image (conversational image display area), 2211 Image (conversational image), 2220 Image (conversational image (operation area)), 2221 Image (status level (high response level)), 2222 Image (detail request button (operation area)), 2223 Image (solution notification button (operation area)), 2230 Image (detailed information image (individual detailed status)), 2240 Image (predicted conversation text), 2241 Image (predicted conversation text (before detail request operation)), 2242 Image (predicted conversation text (after detail request operation)), 2300 Image (traffic control image), 2310 Image (conversational image display area), 2311 Image (conversational image), 2320 Image (conversational image (operation area)), 2321 Image (status level (response level high)), 2322 Image (detail request button (operation area)), 2323 Image (solution notification button (operation area)), 2330 Image (detailed information image (individual detailed status)), 2370 Image (conversational image), 2380 Image (icon), 2381 Image (conversational image (operation area)), 2382 Image (predicted conversation sentence), 2383 Image (predicted conversation sentence), 2384 Image (adjustment button (operation area)), 2385 Image (execution button (operation area)), 2390 Image (conversational image), 10001 Processor, 10002 Memory, 10003 Input / output interface, 10004 Communication circuit, 20001 Processing circuit, 20002 Memory, 20003 Input / output interface, 20004 Communication circuit.

Claims

1. An information processing device comprising: a current information acquisition unit that acquires current information, which is information received at the current time; a conversational information control unit that outputs a conversational image including an operation area and conversational text related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of a mobile object; and a response operation signal output unit that receives an operation on the operation area and outputs a control signal that commands an operation related to the response task.

2. An information processing device according to claim 1, further comprising a conversational sentence receiving unit that receives conversational sentences from a user, wherein the conversational information control unit outputs a conversational image by further using the conversational sentences received by the conversational sentence receiving unit.

3. An information processing device as described in claim 2, further comprising a nomination reception unit that receives nomination information for nominating the virtual respondent via the conversational text reception unit, and the conversational information control unit further outputs a conversational image including a conversational text by the virtual respondent based on the nomination information.

4. The information processing device according to claim 1, wherein the interactive image including the conversation by the virtual person output by the interactive information control unit includes a plurality of the operation areas.

5. The information processing device according to claim 2, wherein the interactive image including the conversational text by the virtual person output by the interactive information control unit includes a plurality of the operation areas.

6. The information processing device according to claim 3, wherein the interactive image including the conversational text by the virtual person output by the interactive information control unit includes a plurality of the operation areas.

7. An information processing device as described in claim 4, further comprising a decision support information generation unit that generates decision support information based on corresponding tasks for each operation area and operation history related to the corresponding tasks, and the interactive image output by the interactive information control unit includes the decision support information for each operation area.

8. An information processing device according to claim 5, further comprising a decision support information generation unit that generates decision support information based on a corresponding task for each operation area and an operation history related to the corresponding task, and the interactive image output by the interactive information control unit includes the decision support information for each operation area.

9. An information processing device as described in claim 6, further comprising a decision support information generation unit that generates decision support information based on a corresponding task for each operation area and an operation history related to the corresponding task, and the interactive image output by the interactive information control unit includes the decision support information for each operation area.

10. The information processing device according to any one of claims 7 to 9, wherein the decision support information is statistical information based on know-how information including metadata for each responder.

11. The information processing device according to any one of claims 7 to 9, wherein the decision support information is a priority of an operation related to the operation area.

12. An information processing device according to any one of claims 7 to 9, wherein the decision support information is selection reason information including a reason why the operation area is likely to be selected.

13. An information processing device according to any one of claims 1 to 12, wherein the interactive information control unit outputs an interactive image including a know-how input area for accepting input of know-how information related to the responder when an operation related to the response task is commanded, and further comprises a know-how information acquisition unit that stores the know-how information acquired via the know-how input area with metadata for each responder attached.

14. An information processing device according to any one of claims 1 to 12, wherein the interactive information control unit outputs a new task selection image for each corresponding task when there are multiple corresponding tasks to be handled simultaneously, and when a corresponding task is selected via the task selection image, outputs the interactive image related to the selected corresponding task.

15. An information processing device as described in any one of claims 2 to 3, claims 5, 6, 8, and 9, comprising a conversation sentence prediction unit that predicts candidate conversation sentences for a user based on pre-stored feature information indicating characteristics of the user's response, the current information, and the know-how information, and the conversation sentence acceptance unit accepts a conversation sentence selected from the candidate conversation sentences predicted by the conversation sentence prediction unit.

16. The information processing device according to claim 15, wherein the conversational information control unit outputs voice data using the conversation sentence predicted by the conversation sentence prediction unit.

17. An information processing device as described in claim 15 or claim 16, further comprising a conversation sentence adjustment unit that adjusts the user's conversation sentence based on an operation by the user, and the conversational information control unit outputs the conversational image including the conversation sentence adjusted by the conversation sentence adjustment unit.

18. An information processing device as described in any one of claims 1 to 17, wherein the conversational image output by the conversational information control unit includes a detail request operation area that accepts an operation to request details of the corresponding task shown in the conversational image, and is equipped with a detailed information control unit that, when a detailed request is accepted via the detail request operation area, acquires the current information related to the corresponding task for which details are requested and outputs a detailed information image based on the current information.

19. An information processing device as described in claim 18, wherein the detailed information control unit outputs the detailed information image including a selection operation area that accepts a selection operation, and the interactive information control unit outputs the interactive image using the current information related to the selection operation area that has been selected.

20. An information processing method using an information processing device, wherein a current information acquisition unit of the information processing device acquires current information, which is information received at the current time; an interactive information control unit of the information processing device outputs an interactive image including a conversational text and an operation area related to a response task by a virtual responder generated based on the current information and know-how information for each responder in the past related to the operation of a mobile object; and a response operation signal output unit of the information processing device accepts an operation on the operation area and outputs a control signal instructing an operation related to the response task.

21. A traffic management system equipped with an information processing device that communicates with a mobile unit-mounted device mounted on each mobile unit, wherein the information processing device comprises: a current information acquisition unit that acquires current information, which is information received at the current time; a conversational information control unit that outputs a conversational image including an operation area and conversational text related to a response task by a virtual responder generated based on the current information and know-how information for each past responder related to the operation of the mobile unit; and a response operation signal output unit that receives an operation on the operation area and outputs a control signal to the mobile unit-mounted device to command an operation related to the response task.

Images