Information provision device, information provision method, and information provision program

Abstract

To provide a technique for enabling a candidate of a remote operator (candidate operator) to receive a remote operation request without anxiety.SOLUTION: An information provision device includes a notification device. The notification device notifies one or a plurality of candidate operators being candidates of a remote operator of presentation information which indicates contents of a request before deciding the remote operator who is to receive the remote operation request from a mobile body.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present disclosure relates to an information providing apparatus, an information providing method, and an information providing program.

Background Art

[0002] Patent Document 1 discloses a vehicle driving system including a remote driving management device. The remote driving management device determines a driver who performs remote driving of a vehicle by referring to registration data of a remote driver in response to a remote driving request, and requests the determined remote driver to perform remote driving.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] According to the technique described in Patent Document 1, after a remote driver who performs remote driving based on a remote driving request from a certain vehicle is determined by the remote driving management device, the request for the remote driving is notified to the remote driver. As a result, the remote driver who receives the request may feel anxious about the possibility of accepting an unintended request.

[0005] The present disclosure has been made in view of the above problems, and an object thereof is to provide a technique that enables a candidate for a remote operator (candidate operator) to accept a request for remote operation with confidence.

Means for Solving the Problems

[0006] The information providing apparatus according to the present disclosure includes a notification device. The notification device is configured to notify one or a plurality of candidate operators, who are candidates for the remote operator, of presentation information indicating the content of the request before the remote operator who accepts the request from the mobile body is determined.

[0007] The information providing method according to the present disclosure is a method for a computer to provide information. The information providing method includes obtaining presentation information indicating the content of a request for remote operation from a mobile body, and before the remote operator who accepts the request is determined, notifying the obtained presentation information to one or a plurality of candidate operators, who are candidates for the remote operator, via a notification device.

[0008] The information providing program according to the present disclosure is executed by a computer. The information providing program causes the computer to obtain presentation information indicating the content of a request for remote operation from a mobile body, and before the remote operator who accepts the request is determined, notify the obtained presentation information to one or a plurality of candidate operators, who are candidates for the remote operator, via a notification device.

Advantages of the Invention

[0009] According to the present disclosure, before the remote operator is determined, presentation information indicating the content of the request for remote operation is notified to the candidate operators. As a result, the candidate operators can be assured of making a decision on whether to accept the request for remote operation.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0011] Embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0012] 1. Remote operation system FIG. 1 is a schematic diagram showing a configuration example of a remote operation system 1 to which an "information providing device" according to an embodiment is applied. The remote operation system 1 is a system for remotely operating a moving body 10. Remote operation is a concept including remote driving. The remote operation system 1 includes a moving body 10, a remote operation device 20, a management device 30, a service provider system 40, a display device 50, and a mobile terminal 60.

[0013] The moving body 10 is an object of remote operation. The remote operation device 20 is a device used when a remote operator 2 remotely operates the moving body 10. That is, the moving body 10 is configured to be remotely operable by the remote operation device 20. The remote operation device 20 and the management device 30 are installed in a remote operation management center 3 for managing the remote operation of the moving body 10. More specifically, a plurality of remote operation devices 20 are arranged in the remote operation management center 3. The moving body 10, the remote operation device 20, and the management device 30 can communicate with each other via a communication network. Also, each of the moving body 10 and the management device 30 can communicate with a service provider system (or simply a provider system) 40 via a communication network.

[0014] The management device 30 receives a remote operation request from the mobile body 10 via the operator system 40. In response to this request, the management device 30 assigns (determines) a certain remote operator 2 from among a plurality of candidate operators 4 to the mobile body 10 that is the target of the remote operation. The management device 30 manages the assignment relationship between the mobile body 10 and the remote operator 2. Further, the management device 30 provides the information on the assignment relationship to the mobile body 10 and the remote operation device 20. Based on the information on the assignment relationship, the mobile body 10 and the remote operation device 20 establish communication. After the communication is established, the mobile body 10 and the remote operation device 20 may communicate directly without going through the management device 30.

[0015] The remote operation management center 3 includes a waiting place 5 as a facility attached to the remote operation device 20. The waiting place 5 is used by one or a plurality of candidate operators 4 who wait to receive a remote operation request.

[0016] Each of the candidate operators 4 has the qualification to perform the remote operation of one or a plurality of types of mobile bodies 10. The candidate operator 4 determined as the remote operator 2 moves to the location where the designated remote operation device 20 is located and performs the remote operation of the designated mobile body 10 according to the content of the designated remote operation service.

[0017] 1-1. Types of Mobile Bodies and Types of Remote Operation Services In the example of the remote operation system 1 shown in FIG. 1, there are a plurality of types of mobile bodies 10 that are the targets of remote operation. Specifically, for example, various types of mobile bodies listed as follows can be the targets of the remote operation. The various types of mobile bodies are, for example, passenger cars, trucks, small or large MaaS (Mobility as a Service) vehicles, buses, forklifts, carts, small ships, large cruisers, golf course carts, small personal mobilities, electric wheelchairs, amusement park rides (including attractions), drones, power shovels, and bulldozers.

[0018] Also, in the example of the remote operation system 1, there are multiple types of remote operation services provided by the remote operation management center 3. Specifically, various types of services listed as follows may correspond to the remote operation service. The various types of services include, for example, autonomous driving backup, driving / parking on behalf of private cars, substitute driving for taxis / trucks, distribution of shared cars, home delivery, transportation of goods, loading / unloading of factory forklifts, departure and arrival of ships, movement of personal mobility, operation on behalf of amusement park attractions, and landing of drones. Additionally, autonomous driving backup means, for example, retreating and driving an autonomous driving vehicle in a remote operation when the autonomous driving vehicle has fallen into a situation where autonomous driving is difficult (e.g., stopping due to an obstacle or stacking of autonomous driving vehicles).

[0019] 1-2. Example of Remote Operation Device FIG. 2 is a block diagram showing a configuration example of the remote operation device 20 shown in FIG. 1. For example, the remote operation device 20 may be configured as a remote cockpit capable of corresponding to various types of moving bodies 10. Alternatively, for example, the remote operation device 20 may be configured as a remote cockpit having a dedicated remote operation member for a specific type of moving body 10.

[0020] The remote operation device 20 includes a communication device 21, an output device 22, an input device 23, and a control device 24.

[0021] The communication device 21 communicates with the moving body 10 and the management device 30. The output device 22 outputs various information. For example, the output device 22 includes a display 25. The display 25 presents various information to the remote operator 2 by displaying various information. Also, the output device 22 includes a speaker 26. The speaker 26 outputs, for example, the sound detected by the microphone of the moving body 10 or outputs various information transmitted from the management device 30 by voice.

[0022] The input device 23 receives the input from the remote operator 2. For example, the input device 23 includes a remote operation member that is operated when the remote operator 2 remotely operates the moving body 10. Examples of the remote operation member include a handle (steering wheel), an accelerator pedal, a brake pedal, a direction indicator, a joystick, a cross key, a switch, and the like. The remote operation member may be a touch panel. The input device 23 may include a keyboard, a mouse, a touch panel, etc. other than the remote operation member.

[0023] The control device 24 controls the remote operation device 20. The control device 24 includes one or more processors 27 (hereinafter simply referred to as the processor 27) and one or more storage devices 28 (hereinafter simply referred to as the storage device 28). The processor 27 executes various processes. The storage device 28 stores various information. Examples of the processor 27 include one of a general-purpose processor, a dedicated processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), and an integrated circuit, or a combination thereof. The processor 27 can also be referred to as circuitry or processing circuitry. Circuitry is hardware programmed to implement the described functions, or hardware that executes the functions. This also applies to the processors 33, 42, 52, and 63 described later. Examples of the storage device 28 include one of a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), and an SSD (Solid State Drive), or a combination thereof. This also applies to the storage devices 34, 43, 53, and 64 described later.

[0024] The remote operation program PROG1 is a computer program executed by the processor 27. The functions of the control device 24 may be realized by the cooperation of the processor 27 that executes the remote operation program PROG1 and the storage device 28. The remote operation program PROG1 is stored in the storage device 28. Alternatively, the remote operation program PROG1 may be recorded on a computer-readable recording medium.

[0025] The control device 24 communicates with the mobile body 10 via the communication device 21. The control device 24 receives the mobile body information MOV transmitted from the mobile body 10. The mobile body 10 is equipped with various sensors including a camera. The camera captures the surroundings of the mobile body 10 and acquires a video (image) showing the situation around the mobile body 10. The mobile body information MOV is information obtained by various sensors and includes the video obtained by the camera. The control device 24 presents the mobile body information MOV to the remote operator 2 by displaying the mobile body information MOV including the video on the display 25. The remote operator 2 can recognize the state of the mobile body 10 and the surrounding situation based on the mobile body information MOV displayed on the display 25.

[0026] The remote operator 2 operates the remote operation member of the input device 23. The operation amount of the remote operation member is detected by a sensor installed on the remote operation member. The control device 24 generates remote operation information OPE reflecting the operation amount of the remote operation member by the remote operator 2. Then, the control device 24 transmits the remote operation information OPE to the mobile body 10 via the communication device 21.

[0027] As a computer program executed by the processor 27, the storage device 28 further stores an information providing program PROG3 (see Section 1-5 described later). Alternatively, the information providing program PROG3 may be recorded on a computer-readable recording medium for use in the remote operation device 20.

[0028] When the processor 27 executes the information providing program PROG3, the remote control device 20 including the output device 22 (the display 25 and the speaker 26), which is an example of the "notification device" according to the present disclosure, functions as the "information providing device" according to the present disclosure. In this case, it can be said that the remote control device 20 is integrated with the information providing device.

[0029] 1-3. Example of the management device FIG. 3 is a block diagram showing a configuration example of the management device 30 shown in FIG. 1. The management device 30 manages the remote control system 1. The management device is, for example, the management server on the cloud. The management server may be composed of a plurality of servers that perform distributed processing.

[0030] The management device 30 includes a communication device 31 and a control device 32. The communication device 31 communicates with the mobile body 10, the remote control device 20, and the operator system 40.

[0031] The control device 32 controls the management device 30. The control device 32 includes one or more processors 33 (hereinafter simply referred to as the processor 33) and one or more storage devices 34 (hereinafter simply referred to as the storage device 34). The processor 33 executes various processes. The storage device 34 stores various information. The various information includes management information MNG, the details of which will be described later as appropriate.

[0032] The management program PROG2 is a computer program executed by the processor 33. The functions of the control device 32 may be realized by the cooperation of the processor 33 that executes the management program PROG2 and the storage device 34. The management program PROG2 is stored in the storage device 34. Alternatively, the management program PROG2 may be recorded on a computer-readable recording medium.

[0033] The control device 32 communicates with the mobile body 10, the remote control device 20, and the operator system 40 via the communication device 31. The control device 32 receives the mobile body information MOV transmitted from the mobile body 10. Then, the control device 32 transmits the received mobile body information MOV to the remote control device 20. Also, the control device 32 receives the remote control information OPE transmitted from the remote control device 20. Then, the control device 32 transmits the received remote control information OPE to the mobile body 10.

[0034] In addition, the control device 32 communicates with the operator system 40 via the communication device 31. The control device 32 receives the request information REQ (to be described later) transmitted from the operator system 40. The control device 32 determines the remote control device 20 to be used for the remote control related to the received request information REQ, and determines the remote operator 2 who operates the determined remote control device 20. The process executed by the control device 32 to determine the remote operator 2 includes a process of selecting one or a plurality of candidate operators 4 who are candidates for the remote operator 2. Also, the control device 32 generates the presentation information PST (to be described later) based on the received request information REQ. Details of the generated presentation information PST will be described later in Section 3.

[0035] In addition, the control device 32 generates progress information PRG indicating the progress status of the remote control after receiving the request for the remote control. Then, the control device 32 transmits the generated progress information PRG to the operator system 40 that transmitted the request information REQ. Details of the progress information PRG will be described later in Section 2-2.

[0036] 1-4. Service Provider System FIG. 1 illustrates a plurality of service provider systems 40. Each individual service provider system 40 is a server of a service provider that provides one or more types of remote operation services for one or more types of moving bodies 10. Each service provider system 40 includes a communication device 41, one or more processors 42 (hereinafter simply referred to as processor 42), and one or more storage devices 43 (hereinafter simply referred to as storage device 43). The storage device 43 stores information MI of each moving body 10 that receives remote operation services from the service provider. The information MI of each moving body 10 includes, for example, the ID (Identification) number of the moving body 10, the type (category or vehicle type, etc.), and color information.

[0037] Each service provider system 40 receives a remote operation request from the moving body 10. The request from the moving body 10 includes, for example, the information MI of the moving body 10, the position information of the moving body 10, and information indicating the type of remote operation service requested by the moving body 10. In response to the received request, the service provider system 40 generates request information REQ. The request information REQ is information indicating the specific content of the request when requesting a remote operation based on the request from the moving body 10 to the remote operation management center 3. The service provider system 40 transmits the generated request information REQ to the management device 30. A specific example of the request information REQ will be described later in Section 2-1. Also, the service provider system 40 receives progress information PRG from the management device 30.

[0038] 1-5. Display Device and Mobile Terminal One or more display devices 50 are installed at the waiting location 5. Also, at least one of the one or more candidate operators 4 waiting at the waiting location 5 holds a mobile terminal 60. Each of the display device 50 and the mobile terminal 60 is communicable with the management device 30 via a communication network. Each of the display device 50 and the mobile terminal 60 is configured to receive the presentation information PST described later from the management device 30 and notify the received presentation information PST to the one or more candidate operators 4. Thus, each of the display device 50 and the mobile terminal 60 corresponds to an example of the "information providing device" according to the present disclosure.

[0039] Specifically, the display device 50 includes a display 51, one or more processors 52 (hereinafter simply referred to as the processor 52), and one or more storage devices 53 (hereinafter simply referred to as the storage device 53). The processor 52 executes various processes related to the control of the display 51. The storage device 53 stores various information.

[0040] The information providing program PROG3 is a computer program executed by the processor 52. The functions of the display device 50 may be realized by the cooperation of the processor 52 and the storage device 53 that execute the information providing program PROG3. The information providing program PROG3 is stored in the storage device 53. Alternatively, the information providing program PROG3 may be recorded on a computer-readable recording medium.

[0041] The mobile terminal 60 is, for example, a smartphone or a tablet terminal. The mobile terminal 60 includes a display 61, a speaker 62, one or more processors 63 (hereinafter simply referred to as the processor 63), and one or more storage devices 64 (hereinafter simply referred to as the storage device 64). The display 61 is, for example, a touch panel. The processor 63 executes various processes related to the control of the display 51 and the speaker 62. The storage device 64 stores various information.

[0042] Similar to the display device 50, the functions of the mobile terminal 60 may be realized by the cooperation of the processor 63 and the storage device 64 that execute the information providing program PROG3. The information providing program PROG3 is stored in the storage device 64. Alternatively, the information providing program PROG3 may be recorded on a computer-readable recording medium.

[0043] In addition, the "notification device" according to the present disclosure is a device that notifies information by at least one of display and sound, for example, at least one of a display and a speaker. The displays 51 and 61, and the speaker 62 correspond to examples of the "notification device". That is, in the example of the display device 50, the notification of the presentation information PST is performed by the display of the presentation information PST on the display 51. Also, in the example of the mobile terminal 60, the notification of the presentation information PST is performed by the display of the presentation information PST using the display 61. Alternatively, the notification of the presentation information PST may be performed by voice notification of the presentation information PST using the speaker 62 together with or instead of the display.

[0044] 2. Communication between the management device (remote operation management center) and the service provider system As described above, each service provider system 40 transmits the request information REQ to the management device 30, and the management device 30 transmits the progress information PRG to the service provider system 40 that transmitted the request information REQ. The formats of the request information REQ and the progress information PRG transmitted in this way are standardized between the management device 30 and each service provider system 40.

[0045] 2-1. Request information REQ from the service provider system The following are various specific examples of the request information REQ indicating the content of the remote operation request.

[0046] (Urgency) The request information REQ may include information on the "urgency of remote operation" at the time of the request. The urgency indicates the degree of need for a rapid start of the remote operation. The urgency is specified by levels in a number of steps (e.g., three steps or five steps) pre-specified by the remote operation management center 3. Situations where a rapid start of the remote operation is required correspond to, for example, a situation where it is necessary to rapidly move the moving body 10, or a situation where it is necessary to rush the moving body 10 to reach the target point. The following is an example of the urgency setting. That is, in an example where an automatic driving backup is requested as a remote operation service, due to reasons such as the automatic driving vehicle having stopped on the road, it is necessary to rapidly move the moving body 10. Therefore, the urgency is set to "high". Also, in an example where the distribution of a shared car is requested as a remote operation service, it is necessary to deliver the shared car to the customer by the specified time. Therefore, the urgency is set to "medium". Also, in an example where the return of a rental car is requested as a remote operation service, what is required is to return the used rental car to the business office (waiting location), and there is no great need to rush. Therefore, the urgency is set to "low".

[0047] (Status of the moving body) Also, the request information REQ may include information indicating the "status of the moving body 10" at the time of the request. This information is necessary for the remote operator 2 when starting the requested remote operation. For example, the information indicating the status of the moving body 10 is character information such as "parked in the garage" or "the automatic driving vehicle has stopped in the middle of the road". Alternatively, the information indicating the status of the moving body 10 may include, together with the character information, one or both of the image information of the moving body 10 and the surrounding information of the moving body 10 at the time of the request. More specifically, the image information is, for example, an image (including video) of a camera mounted on the moving body 10.

[0048] (Type of the moving body, and type of the remote operation service) Further, the request information REQ may include information indicating the type of the moving body 10 that is the target of the requested remote operation. An example of the type of the moving body 10 is as already described. Also, the request information REQ may include information indicating the type of the requested remote operation service. An example of the type of the remote operation service is as already described.

[0049] (Completion condition) Further, the request information REQ may include information indicating the completion condition of the requested remote operation. In other words, the completion condition is the condition for ending the remote operation. For example, the completion condition is "moving the moving body 10 to the goal point" or "picking up a person or an object during the movement by the remote operation".

[0050] (Location information) Further, the request information REQ may include location information, that is, information indicating the positions of various locations such as the start point, the goal point, and the passing points in the movement of the moving body 10 by the remote operation service.

[0051] (Accompanying information) Further, the request information REQ may include accompanying information. In a remote operation service that requires picking up a person or an object, the accompanying information is, for example, information about the person or object to be picked up (for example, name and image).

[0052] 2-2. Progress information PRG to the service provider system The progress information PRG is information indicating the progress status of the remote operation after the request start. The progress information PRG may include current status information indicating the current state of the mobile body 10 after the request start. For example, the current status information may include "the remote operation has not yet started", "the selection of the remote operator 2 is in progress", and "the remote operation is in progress". These current status information can be obtained, for example, based on the history information of the processing executed by the processor 33. Further, the current status information may include information of the remote operator 2 (for example, ID number, proficiency, and evaluation score) who is performing the remote operation together with "the remote operation is in progress". The information of the remote operator 2 is obtained in advance and included in the management information MNG.

[0053] Also, the progress information PRG may include the current position information of the mobile body 10 after the request start. The current position information can be obtained from the mobile body information MOV.

[0054] Furthermore, the progress information PRG may include the following accompanying information. For example, in a remote operation service related to the transportation of people or objects, the accompanying information may include information indicating the presence or absence of pickup of people or objects, information of the picked-up people or objects (such as an image indicating the people or objects), and information indicating the presence or absence of completion of transportation. These accompanying information can be obtained from the mobile body information MOV.

[0055] The service provider can appropriately grasp the progress status of the remote operation by receiving the progress information PRG from the management device 30 (remote operation management center 3).

[0056] 3. Information provision to candidate operators (prompt information PST) As described above, the management device 30 (control device 32) generates the presentation information PST based on the request information REQ. Then, in order to present the generated presentation information PST to one or more candidate operators 4 for the remote operation related to the request information REQ, the management device 30 transmits the presentation information PST to an information providing device (such as the display device 50). The information providing device that has acquired the presentation information PST notifies one or more candidate operators 4 of the presentation information PST by displaying the presentation information PST on a notification device (such as the display 51) (see, for example, FIGS. 4 or 5 described later).

[0057] In the present embodiment, the above-mentioned notification of the presentation information PST is executed for one or more candidate operators 4 before the remote operator 2 who accepts the request for the remote operation related to the request information REQ is determined.

[0058] 3-1. Examples of Information Providing Devices to be Transmitted In the example of the remote operation system 1 shown in FIG. 1, the "information providing device" to which the presentation information PST is to be transmitted is at least one of the display device 50 at the waiting location 5, the mobile terminal 60, and the remote operation device 20.

[0059] Specifically, in the example where one or more candidate operators 4 are waiting at the waiting location 5 as shown in FIG. 1, the management device 30 may transmit the presentation information PST to each of the display device 50 and the mobile terminal 60. Alternatively, the management device 30 may transmit it only to either the display device 50 or the mobile terminal 60. Further, the management device 30 may transmit the presentation information PST not only to one or both of the display device 50 and the mobile terminal 60, but also to the remote operation device 20 that is scheduled to be operated by the remote operator 2 to perform the remote operation related to the request information REQ. That is, the target of the notification of the presentation information PST by the "information providing device" may include the remote operator 2 who starts the remote operation after a certain candidate operator 4 is determined as the remote operator 2.

[0060] In an example of a remote operation system having a dedicated remote operation device 20 for a certain candidate operator 4, the transmission of the presentation information PST before the remote operator 2 is determined may be executed as follows. That is, when the candidate operator 4 is waiting at a location with the dedicated remote operation device 20 (for example, a remote cockpit), the management device 30 may transmit the presentation information PST to the remote operation device 20 that functions as an "information providing device". Additionally, the "location with the remote operation device 20" mentioned here may include not only the remote operation management center 3, but also locations outside the remote operation management center 3.

[0061] 3-2. Specific Example of Presentation Information PST The presentation information PST may be the same as the request information REQ. Alternatively, in order to make it easier for the remote operator 2 to understand and perform remote operations, the presentation information PST may include information processed or added based on the management information MNG of the management device 30 together with the request information REQ as follows. The management information MNG used here includes various information obtained in advance based on the moving body information MOV, etc. The various information mentioned here is, for example, the surrounding information of the area where the remote operation is performed, the performance information of past remote operations, and the characteristic information of the moving body 10. The surrounding information mentioned here includes, for example, information indicating points that the remote operator 2 should pay attention to during remote operations (for example, sunken road locations and locations under road construction). The performance information of past remote operations includes, for example, information collected by the management device 30 from the moving body information MOV during the movement of the moving body 10 by past remote operations (for example, during the driving of a vehicle). The characteristic information of the moving body 10 is, for example, information indicating the operating characteristics of each type of moving body 10.

[0062] Here, an example of the presentation information PST that partially shares the request information REQ is described. That is, for example, regarding the urgency, the type of the moving body 10, the type of the remote operation service, the state of the moving body 10, the completion condition, and the accompanying information, the presentation information PST is the same as the request information REQ.

[0063] In addition, the presentation information PST may include, as additional information PST1 not included in the request information REQ, for example, information on necessary qualifications. The mobile body 10 to be remotely operated includes mobile bodies (e.g., automobiles and ships) that require a dedicated driving qualification. The information on necessary qualifications is qualification information such as the driving qualification required of the remote operator 2 for remote operation (see, for example, FIG. 5).

[0064] Also, as another example of the additional information PST1, the presentation information PST may include information on the difficulty level D of remote operation. The difficulty level D is obtained, for example, from the management information MNG (see step S106 described later).

[0065] Furthermore, the presentation information PST may include, as processed information PST2 obtained by processing based on the request information REQ, for example, information on a movement route. The information on the movement route is, for example, information on the movement route itself (e.g., the driving route of a vehicle), information on intermediate passing points, and information on points to be noted.

[0066] The information on the movement route is generated based on the location information included in the request information REQ and, for example, the above-mentioned various types of information (peripheral information of the area where remote operation is performed, past remote operation performance information, characteristics information of the mobile body 10, etc.). Specifically, as the information on the movement route, the management device 30 calculates an optimal movement route of the mobile body 10 by remote operation based on the location information and the various types of information. A specific example of the information on the movement route will be described later with reference to FIG. 4.

[0067] FIG. 4 is a diagram showing a first display example of the presentation information PST. The presentation information PST shown in FIG. 4 is displayed on a "notification device" such as the display 51. In the first display example, each piece of information constituting the presentation information PST corresponding to one remote operation request is clearly displayed in separate display areas.

[0068] Specifically, character information indicating a high degree of urgency is displayed using large characters. Also, character information (automatic driving backup) indicating the type of remote operation service is displayed. Further, a combination of character information (MaaS vehicle), which is an example of information indicating the type of the mobile body (mobility) 10, and an icon is displayed along with the name, color, and identification number of the MaaS vehicle as accompanying information.

[0069] Also, in the first display example, a combination of character information (stopped due to an obstacle, waiting for route recovery), which is an example of information indicating the state (current state) of the MaaS vehicle at the time of request, and image information IMG1 is displayed. The image information IMG1 is an in-vehicle camera image. In the image information IMG1, the obstacles to be avoided included in the in-vehicle camera image are marked by augmented reality (AR) technology.

[0070] Also, in the first display example, a combination of character information (stop at the specified goal position at the specified angle), which is an example of information indicating the completion condition, and image information IMG2 is displayed. In this image information IMG2, goal information (for example, a goal frame indicating the goal position) is superimposed on the same in-vehicle camera image as that of the image information IMG1 by AR technology. In this example, detailed goal information including not only the specification of the goal position but also the angle of the MaaS vehicle when stopping at the goal position is shown as the completion condition. And the goal information is displayed in an easy-to-understand manner through vision using AR superimposed display.

[0071] In the first display example, two pieces of image information IMG3 and IMG4, which are examples of information indicating a driving route (moving route) for avoiding obstacles, are displayed. The image information IMG3 is a top view showing the driving route, that is, two-dimensional map information. The image information IMG4 is three-dimensional map information in which the driving route is superimposed on the same in-vehicle camera image as that of the image information IMG1 by AR technology. Through these pieces of image information IMG3 and IMG4, the obstacle avoidance route is clearly displayed visually. Note that the information on the driving route may be notified together with voice information output by the speaker 62 or the like.

[0072] Also, in the first display example, numerical information (for example, 1.0), which is an example of information indicating the difficulty level D of remote operation, is displayed. Alternatively, the difficulty level D may be displayed by character information such as "easy", "normal", or "difficult".

[0073] Furthermore, in the first display example, accompanying information using a combination of character information and the image information IMG5 and IMG6 is presented. The character information is, for example, the name of a person or object to be picked up. The image information IMG5 and IMG6 are, for example, images related to the person or object to be picked up. Note that, for example, image information indicating points to be noted when avoiding obstacles is basically the information on the driving route, but may also be included in this accompanying information.

[0074] FIG. 5 is a diagram showing a second display example of the presentation information PST. The presentation information PST shown in FIG. 5 is displayed on a "notification device" such as the display 51. In the second display example, five pieces of presentation information PST corresponding to five requests for remote operations that have not yet been determined by the remote operator 2 are organized as a list and displayed in an easy-to-understand manner. Each piece of presentation information PST includes accompanying information together with information indicating a service (type of remote operation service), mobility (type of moving body), required qualifications, current status, and completion conditions. The content of each piece of information is as shown in FIG. 5. Additionally, when displaying the presentation information PST based on a newly received request, the presentation information PST to be the target of the display may be displayed in a manner that is easily distinguishable from the presentation information PST corresponding to other requests. For example, a frame surrounding the presentation information PST to be the target of the new display may be superimposed, or a color different from the background color of other display areas may be used as the background color of the display area of the presentation information PST. Also, in this list, the presentation information PST may be displayed from top to bottom in descending order of the urgency of the remote operation.

[0075] 3-3. Customization Examples of Presentation Information PST Furthermore, the presentation information PST may be modified (customized) as follows by each individual candidate operator 4.

[0076] For example, the presentation information PST may be generated to be different according to the proficiency of the candidate operator 4 for the remote operation. Specifically, for example, for a candidate operator 4 with low experience, the management device 30 may generate the presentation information PST to include a lot of accompanying information (e.g., points to note and advice). On the other hand, for a senior candidate operator 4, the management device 30 may generate the presentation information PST not to include accompanying information that is obvious to seniors. Note that the information on the proficiency of the candidate operator 4 for the remote operation can be obtained, for example, based on the above-described past remote operation performance information included in the management information MNG.

[0077] Further, for example, when requesting a candidate operator 4 specialized for a specific remote operation service to perform a remote operation related to the specific remote operation service, the management device 30 may generate presentation information PST so as to have content specialized for the specific remote operation service.

[0078] 4. Processing by the Management Device FIG. 6 is a flowchart showing an example of processing executed by the management device 30 for providing a remote operation service. The processing of this flowchart is executed during the operation of the remote operation system 1.

[0079] Steps S100 and S102: In step S100, the management device 30 (processor 33) waits for a request for a remote operation service from the service provider system 40. While there is no request for a remote operation service (step S102; No), the management device 30 maintains a waiting state. On the other hand, when a request for a remote operation service is received during the waiting (step S102; Yes), the management device 30 continues to wait for other requests for remote operation services and executes the processing from step S104 in parallel.

[0080] Step S104: In step S104, the management device 30 receives request information REQ from the service provider system 40. As already described, the request information REQ includes information such as the type of remote operation service and the degree of urgency.

[0081] Step S106: Next, in step S106, the management device 30 reads and updates the management information MNG stored in the storage device 34. Specifically, for example, the management information MNG includes various information (type of remote operation service, urgency, etc.) included in the request information REQ, the above-described difficulty D, the response priority of the request, information on the candidate operator 4 (e.g., past operation results, possessed qualifications, and availability information), and information on the remote operation device 20 (e.g., information indicating the suitable mobile body 10 and availability information). The response priority is specified based on, for example, the type of remote operation service, urgency, and difficulty D.

[0082] In step S106, the management device 30 calculates (sets) the difficulty D of the remote operation related to the current request information REQ received in step S104 by the following method. Then, the management device 30 updates the response priority of each remote operation request currently included in the management information MNG in consideration of the calculated difficulty D.

[0083] (Method for calculating difficulty D) The above difficulty level D can be calculated as follows based on various information included in the request information REQ transmitted from the operator system 40. That is, in this example, the difficulty level D is obtained by multiplying a predetermined basic value (for example, 1.0) by coefficients Ki (i = 1 to n) corresponding to various information (for example, urgency, type of remote operation service, type of the mobile body 10, completion condition, movement route, and presence or absence of a specified time). That is, each coefficient Ki indicates the difficulty level Di in individual information units such as urgency. For example, each coefficient Ki is set to a reference value (for example, 1.0) when the difficulty level Di is standard. And each coefficient Ki is set to a value smaller than the reference value (for example, 0.8) when the difficulty level Di is lower than the standard difficulty level, while it is set to a value larger than the reference value (for example, 1.5) when the difficulty level Di is higher than the standard difficulty level. Such a relationship between each coefficient Ki and the difficulty level Di of individual information such as urgency is determined in advance and stored in the storage device 34. The management device 30 acquires each coefficient Ki corresponding to the various information included in the current request information REQ from the above relationship. For example, when the urgency included in the current request information REQ is "high", the management device 30 acquires the coefficient K1 of urgency corresponding to the "high" urgency from the above relationship.

[0084] Also, each coefficient Ki of the difficulty level D calculated as described above may be corrected (optimized) based on, for example, the evaluation result of the difficulty level by the remote operator 2 who actually performed the remote operation. Specifically, each time the remote operation ends, the management device 30 acquires, via the remote operation device 20, the evaluation result (for example, easy, normal, or difficult) of the difficulty level of the current remote operation from the remote operator 2. The management device 30 stores the acquired evaluation result in the storage device 34 in association with the difficulty level (set difficulty level) D set during the remote operation in step S106. Thereby, the relationship between the evaluation result and the set difficulty level D is accumulated. Then, the management device 30 determines the deviation of the evaluation result from the set difficulty level D based on the accumulated information, and when the deviation is recognized, executes a process of statistically optimizing each coefficient Ki so that the deviation becomes smaller.

[0085] Furthermore, each coefficient Ki of difficulty level D may be similarly corrected (optimized) based on, for example, at least one of "time required for remote operation" and "number of occurrences of remote operation troubles", instead of or together with the evaluation result of the remote operator 2. Specifically, in the example of using the time required for remote operation, each time the remote operation ends, the management device 30 stores the actual time required for the remote operation in the storage device 34 in association with the assumed value of the time required for the remote operation. Thereby, the relationship between the actual time required and the assumed value is accumulated. Then, based on the accumulated information, the management device 30 determines whether the actual time required is too long compared to the assumed value. If the actual time required is too long, the management device 30 executes a process of statistically optimizing each coefficient Ki so that the time difference becomes shorter. Similarly, in the example of using the number of occurrences of remote operation troubles, each time the remote operation ends, the management device 30 stores the number of occurrences of troubles in the storage device 34. Thereby, the number of occurrences of troubles is accumulated. Then, based on the accumulated information, the management device 30 determines whether the number of occurrences of troubles is too large. If the number of occurrences of troubles is too large, the management device 30 executes a process of statistically optimizing each coefficient Ki so that the number of occurrences of troubles becomes smaller.

[0086] Step S108: Next, in step S108, the management device 30 selects the remote operation device 20 to be used for the remote operation related to the current request information REQ. Specifically, the management device 30 selects the remote operation device 20 based on, for example, the information included in the management information MNG (for example, the type of remote operation service and the corresponding priority).

[0087] Steps S110 and S112: Next, in step S110, the management device 30 executes a process of checking whether there is any availability in the selected remote operation device 20. As a result, if there is no availability (step S110; No), the process proceeds to step S112. In step S112, the management device 30 updates the management information MNG so that the selected remote operation device 20 is in a waiting state for availability. Thereafter, the processes of steps S108 and S110 are repeatedly executed.

[0088] Step S114: On the other hand, if there is an available remote operation device 20 selected (step S110; Yes), the process proceeds to step S114. In step S114, the management device 30 selects a candidate operator 4 for the remote operation related to the current request information REQ. Specifically, the management device 30 selects the candidate operator 4 based on, for example, the information (such as the type of remote operation service and the corresponding priority) included in the management information MNG.

[0089] Steps S116 and S118: Next, in step S116, the management device 30 executes a process of checking whether there is an available slot for the selected candidate operator 4. As a result, if there is no available slot (step S116; No), the process proceeds to step S118. In step S118, the management device 30 updates the management information MNG so that the selected candidate operator 4 is in a waiting state. Thereafter, the processes of steps S114 and S116 are repeatedly executed.

[0090] Step S120: On the other hand, if there is an available slot for the selected candidate operator 4 (step S116; Yes), the process proceeds to step S120. In step S120, the management device 30 generates the presentation information PST by the method already described.

[0091] Step S122: Next, in step S122, the management device 30 notifies the selected candidate operator 4 of the generated presentation information PST. In an example where the candidate operator 4 is waiting at the waiting location 5, the presentation information PST is notified via the display device 50. In this example, the presentation information PST may include information for identifying the candidate operator 4 to be notified. Also, when the candidate operator 4 has a mobile terminal 60, the presentation information PST may be notified via the display device 50.

[0092] (Example of processing on the information providing device side) More specifically, in step S122, the management device 30 transmits the presentation information PST to an "information providing device" such as the display device 50 in order to notify the candidate operator 4 of the presentation information PST. The information providing device acquires (receives) the presentation information PST. Then, the information providing device notifies the candidate operator 4 of the acquired presentation information PST by displaying it on the display or the like. Thus, according to the flowchart shown in FIG. 6, the information providing device acquires the presentation information PST before the remote operator 2 who performs the current remote operation is determined in step S126 described later, and notifies the candidate operator 4 of the presentation information PST before the determination.

[0093] (Notification examples varying according to the degree of urgency) In addition, in step S122, the management device 30 may transmit the presentation information PST with an instruction to display the presentation information PST in different manners according to the degree of urgency included in the presentation information PST. Alternatively, the management device 30 may transmit the presentation information PST with an instruction to notify the presentation information PST with different sounds according to the degree of urgency. Alternatively, the management device 30 may transmit the presentation information PST with both of these instructions.

[0094] The information providing device that has received the above instructions notifies the presentation information PST with at least one of different displays and sounds according to the degree of urgency. For example, when the presentation information PST is displayed as shown in FIG. 5, the information providing device may display the presentation information PST in a manner that is easier to distinguish a request for a remote operation having a degree of urgency equal to or higher than a predetermined level from other requests. Also, for example, when notifying a request for a remote operation having a degree of urgency equal to or higher than a predetermined level, the information providing device may notify the presentation information PST with a sound that attracts the attention of the candidate operator 4 as compared with when notifying other requests. This also applies to the transmission of the presentation information PST by the process of step S126 described later.

[0095] Step S124: Next, in step S124, the management device 30 executes a process of confirming with the candidate operator 4 whether it can respond to the current remote operation request. The candidate operator 4 operates a predetermined device such as the mobile terminal 60, for example, and responds to the management device 30 regarding whether to accept the request.

[0096] According to the processes of steps S122 and S124, the candidate operator 4 can obtain an opportunity to check the presented information PST notified before the decision of the remote operator 2 and determine whether to accept the current remote operation request. Additionally, the candidate operator 4 can also reject the acceptance of the request.

[0097] If the candidate operator 4 is not capable of responding (step S124; No), the process returns to step S114. That is, another candidate operator 4 is selected. On the other hand, if the candidate operator 4 is capable of responding (step S124; Yes), the process proceeds to step S126.

[0098] Step S126: In step S126, the management device 30 executes a process of determining the currently selected candidate operator 4 as the remote operator 2 who will perform the remote operation related to the current request. Then, the management device 30 transmits the presented information PST to the remote operation device 20 that is planned to be used by the determined remote operator 2. The presented information PST transmitted to the remote operation device 20 is displayed using, for example, the display 25. Alternatively, the presented information PST may be notified by voice from the speaker 26 instead of or together with the display on the display 25.

[0099] Step S128: Next, in step S128, the management device 30 executes a process of determining whether the determined remote operator 2 has completed the preparation to start the current remote operation. For example, when the determined remote operator 2 operates the switch of the remote operation device 20 to be used this time and gives a response indicating that the preparation is complete, the management device 30 determines that the preparation is complete.

[0100] Step S130: When the preparation of the remote operator 2 is completed (Step S128; Yes), the management device 30 starts the remote operation by the remote operator 2 (Step S130). Specifically, the management device 30 starts generating the remote operation information OPE of the remote operation device 20 by the remote operator 2 and transmitting the generated remote operation information OPE to the moving body 10.

[0101] Steps S132 and S134: Next, in Step S132, the management device 30 determines whether the current remote operation has ended. In other words, the management device 30 determines whether the above completion condition is satisfied. As a result, if the remote operation has not ended (Step S132; No), the process proceeds to Step S134. In Step S134, the management device 30 updates the management information MNG as necessary. For example, the management device 30 updates the information indicating the state (current state) of the moving body 10 during the execution of the remote operation.

[0102] On the other hand, if the remote operation has ended (Step S132; Yes), the process returns to Step S100.

[0103] 5. Effects As described above, according to the "information providing device" according to the present embodiment, before the remote operator 2 who accepts the remote operation request from the moving body 10 is determined, the presentation information PST indicating the content of the request is notified to one or more candidate operators 4. As a result, the candidate operator 4 can accept the remote operation request with confidence.

[0104] More specifically, by notifying the presentation information PST before the remote operator 2 is determined, it is possible to give the candidate operator 4 an opportunity to determine whether to accept the request based on the presentation information PST. Further, for example, if the information notified before the remote operator 2 is determined is only a request notification that simply asks to accept the request, there is insufficient material for the candidate operator 4 to determine whether to accept the request. As a result, for example, the candidate operator 4 may be required to determine whether to accept the request while feeling anxious about the possibility of accepting a request that is not originally intended in order to obtain an opportunity for remote operation. On the other hand, the presentation information PST according to the present embodiment is information that specifically shows the content of the remote operation request. Therefore, the candidate operator 4 can make a judgment on whether to accept the request with confidence.

[0105] Further, in the example of the remote operation system 1 shown in FIG. 1, the remote operation targets a plurality of types of moving bodies 10. Therefore, if due consideration is not given to the request for remote operation to the candidate operator 4, the candidate operator 4 may feel great anxiety about the possibility of accepting a request for remote operation of a type of moving body 10 that is not intended. Also, the more types of moving bodies 10 there are, the higher the anxiety of the candidate operator 4 can become. In this regard, the presentation information PST according to the present embodiment includes "information indicating the type of the moving body 10". Thereby, even when performing a remote operation task targeting a plurality of types of moving bodies 10, the candidate operator 4 can make a judgment on whether to accept the request with more confidence.

[0106] Also, in the example of the remote operation system 1 shown in FIG. 1, there are multiple types of remote operation services provided. Therefore, if appropriate consideration is not given to the request for remote operation to the candidate operator 4, the candidate operator 4 may feel great unease about the possibility of accepting a request for a type of remote operation service that is not intended. Also, the more types of remote operation services there are, the higher the unease of the candidate operator 4 can become. Regarding this point, the presentation information PST according to the present embodiment includes "information indicating the type of remote operation service". Thereby, even when performing remote operation work for multiple types of moving bodies 10, the candidate operator 4 can more confidently determine whether to accept the request.

[0107] In addition, according to an example in which the presentation information PST includes both information indicating the type of the moving body 10 and information indicating the type of the remote operation service, the "information providing device" can present to the candidate operator 4 very clearly what kind of remote operation is required for what kind of remote operation service according to the type of the requested moving body 10 and the type of the remote operation service.

[0108] Also, the presentation information PST according to the present embodiment includes "information indicating the state of the moving body 10 at the time of the request", "information on the urgency of the remote operation", "information on the qualifications required for the remote operator 2", "information on the completion conditions of the remote operation", and "information on the difficulty level of the remote operation". By including at least one of such various types of information in the presentation information PST, it is possible to clearly present to the candidate operator 4 what kind of remote operation is required.

[0109] Also, in the present embodiment, the presentation information PST is notified with at least one of different displays and sounds according to the urgency. Thereby, for example, when the candidate operator 4 is exposed to a plurality of presentation information PSTs at the same time, the candidate operator 4 can make a judgment to give priority to accepting requests with a higher urgency. Also, the awareness of the candidate operator 4 regarding accepting requests with a higher urgency can be enhanced.

[0110] Also, in the present embodiment, the presentation information PST is also notified to the remote operation device 20 that is scheduled to be operated by the remote operator 2 in order to perform a remote operation based on a request. The presentation information PST is information that is useful not only for determining whether the candidate operator 4 accepts the request, but also when performing a remote operation after accepting the request. For this reason, the candidate operator 4 determined as the remote operator 2 can, for example, move from the waiting location 5, sit in the remote cockpit (remote operation device 20), and then promptly start the remote operation while checking the presentation information PST.

[0111] Also, the content of the presentation information PST required by the candidate operator 4 may vary depending on the proficiency level of the candidate operator 4. Therefore, in the present embodiment, the presentation information PST includes different contents according to the proficiency level of the candidate operator 4 with respect to the remote operation. Thereby, it becomes possible to more accurately notify the presentation information PST suitable for each individual candidate operator 4.

[0112] Also, in the present embodiment, the "information providing device" is, for example, the display device 50 arranged at the waiting location 5. Thereby, before being determined as the remote operator 2, the presentation information PST can be notified to the one or more candidate operators 4 waiting at the waiting location 5. Also, the "information providing device" is, for example, the mobile terminal 60 possessed by the candidate operator 4 waiting. Thereby, before being determined as the remote operator 2, the presentation information PST can be notified to the candidate operator 4 waiting.

[0113] 6. Other various configuration examples of the remote operation system In the remote operation system 1, the type of the moving body 10 that is the target of the remote operation may be one.

[0114] Also, the type of the remote operation service provided for one or more types of moving bodies 10 may be one.

[0115] Further, the remote operation system may not include the service provider system 40. In an example of a remote operation system that does not include the service provider system 40, the request information REQ may be directly transmitted from the mobile body 10 to the management device 30.

[0116] Also, in the example of the flowchart shown in FIG. 6, the management device 30 selects one candidate operator 4 and notifies the selected candidate operator 4 of the presentation information PST (see steps S114 and S122). Then, when the candidate operator 4 does not accept the remote operation request, the next candidate operator 4 is selected (see steps S124 and S114). Instead of this example, the management device 30 may simultaneously notify a plurality of candidate operators 4 of one presentation information PST. And when a plurality of candidate operators 4 wish to accept the request, the management device 30 may execute a process of determining one candidate operator 4 from among the plurality of applicants as the remote operator 2 based on, for example, the management information MNG.

Explanation of Reference Numerals

[0117] 1 Remote operation system, 2 Remote operator, 3 Remote operation management center, 4 Candidate operator, 5 Waiting location, 10 Mobile body, 20 Remote operation device (information providing device), 25, 51, 61 Display (notification device), 26, 62 Speaker (notification device), 30 Management device, 40 Service provider system, 50 Display device (information providing device), 60 Mobile terminal (information providing device), MNG Management information, MOV Mobile body information, OPE Remote operation information, PRG Progress information, PST Presentation information, REQ Request information

Claims

1. A notification device configured to notify one or more candidate operators, who are candidates for the remote operator, of presentation information indicating the content of the request before a remote operator who accepts a request for remote operation from a mobile body is determined. An information providing device.

2. The information providing device according to claim 1, wherein there are a plurality of types of the mobile body, and the presentation information includes information indicating the type of the mobile body. An information providing device.

3. The information providing device according to claim 1 or 2, wherein the remote operation is provided as a plurality of types of remote operation services, and the presentation information includes information indicating the type of the remote operation service. An information providing device.

4. The information providing device according to claim 1, wherein the presentation information includes information indicating the state of the mobile body at the time of the request. An information providing device.

5. The information providing device according to claim 1, wherein the presentation information includes information on the urgency of the remote operation. An information providing device.

6. The information providing device according to claim 5, wherein the notification device notifies the presentation information with at least one of different displays and sounds according to the urgency. An information providing device.

7. The information providing device according to claim 1, wherein the presentation information includes information on the qualifications required for the remote operator for the remote operation. An information providing device.

8. The information providing device according to claim 1, wherein the presentation information includes information on the completion conditions of the remote operation. An information providing device.

9. The information providing device according to claim 1, wherein the presentation information includes information on the difficulty level of the remote operation. An information providing device.

10. The information providing device according to claim 1, wherein the notification device includes at least one of a display and a speaker of a remote operation device to be operated by the remote operator to perform the remote operation based on the request. An information providing device.

11. The information providing device according to claim 1, wherein the presentation information includes different contents according to the proficiency levels of the one or more candidate operators with respect to the remote operation. An information providing device.

12. The information providing device according to claim 1, wherein the information providing device is arranged at the waiting place of the one or more candidate operators. An information providing device.

13. The information providing device according to claim 1, wherein the information providing device is a mobile terminal possessed by the one or more candidate operators. An information providing device.

14. An information providing method for a computer to provide information, comprising: obtaining presentation information indicating the content of a request for remote operation from a moving body; before a remote operator who accepts the request is determined, notifying the obtained presentation information to one or more candidate operators who are candidates for the remote operator via a notification device; including the information providing method.

15. An information providing program executed by a computer, comprising: obtaining presentation information indicating the content of a request for remote operation from a moving body; before a remote operator who accepts the request is determined, notifying the obtained presentation information to one or more candidate operators who are candidates for the remote operator via a notification device; causing the computer to execute the information providing program.

Images