Remote service management method and management device

Abstract

To achieve smooth operation of a remote service when a plurality of operators provide the remote service of mobile objects including remote operations.SOLUTION: A method for managing a remote service for mobile objects is provided. The method includes a step of assigning a service business to at least one operator among a plurality of operators engaged in the remote service when a start trigger of the service business to an object for which the remote service is provided is output. The service business includes a first business that affects the travel efficiency of the object of the remote service and a second business that does not affect the travel efficiency. In the step of assigning the service business, if a start trigger of the first business for the object of the remote service is output, when there is an operator already engaged in the second business for the object of the remote service, the first business is assigned to the operator.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to a method and apparatus for managing remote services for mobile objects. [Background technology]

[0002] JP 2018-142265 A discloses a method for managing remote services for autonomous vehicles. In this conventional method, when it is determined that remote operation of an autonomous vehicle is necessary, a standby operator is selected from among multiple operators, and remote operation is assigned to the selected operator. Therefore, according to this conventional method, it is possible to efficiently operate remote services for multiple autonomous vehicles with a small number of operators.

[0003] In addition to JP 2018-142265 A, JP 2021-144732 A can be exemplified as documents showing the technical state of the technical field related to the present disclosure. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-142265 A [Patent Document 2] Patent Publication No. 2021-144732 Summary of the Invention [Problem to be solved by the invention]

[0005] An operator who remotely controls a moving object, including an autonomous vehicle, obtains information about the moving object during remote control and grasps the surroundings of the moving object and the contents of the remote control task required of the operator. The information about the moving object includes sensor information, such as camera images obtained by a camera mounted on the moving object. This sensor information is typically visualized and output to a display. Outputting the sensor information to a display is expected to help the operator quickly grasp the surroundings of the moving object.

[0006] However, it is inevitable that the time required for an operator waiting for remote control to grasp the surrounding situation, etc., will be longer than that required for a driver sitting in the driver's seat of the mobile body, because while a driver is expected to always be aware of the surrounding situation of the mobile body he or she is riding in, it is realistically difficult to expect an operator waiting for remote control to grasp the surrounding situation to the same extent as a driver does.

[0007] It is undesirable to require an operator waiting to remotely control the vehicle to grasp the surrounding situation to the same extent as a driver does, since this leads to a decrease in the amount of work that the operator can handle per unit time and an increase in labor costs. In addition, when one operator is selected from among multiple operators and assigned to remote control, it is virtually impossible for each operator to grasp information about the vehicle that requires remote control before it is determined that remote control is necessary.

[0008] One object of the present disclosure is to provide a technology for realizing smooth operation of remote services for mobile objects, including remote operation, when the remote services are provided by multiple operators. [Means for solving the problem]

[0009] A first aspect of the present disclosure is a method for managing remote services for a mobile object, comprising the following features. The method includes a step of allocating the service job to at least one operator among a plurality of operators engaged in the remote service when a start trigger for the service job for the remote service provision target is output. The service operations include a first operation that affects the driving efficiency of the object to be provided, and a second operation that does not affect the driving efficiency. The step of allocating the service task includes: When a start trigger for the first task for the object to be provided is output, determining whether an operator already engaged in the second task for the object to be provided is included in the plurality of operators; When it is determined that an operator already engaged in the second task for the provision target is included in the plurality of operators, appointing the operator already engaged in the second task for the provision target to an operator in charge of the first task for the provision target; Includes.

[0010] A second aspect of the present disclosure is an apparatus for managing remote services for a mobile object, the apparatus having the following features. The apparatus includes a processor for managing the remote service. The processor, When a start trigger for a service operation for a target for providing the remote service is output, a process of allocating the service operation to at least one operator among a plurality of operators engaged in the remote service is performed. The service operations include a first operation that affects the driving efficiency of the object to be provided, and a second operation that does not affect the driving efficiency. In the process of allocating the service task, the processor When a start trigger for the first task for the provision target is output, a process of determining whether an operator already engaged in the second task for the provision target is included in the plurality of operators; When it is determined that an operator already engaged in the second task for the provision target is included in the plurality of operators, a process of appointing the operator already engaged in the second task for the provision target to an operator in charge of the first task for the provision target; The present invention is configured to: Effect of the Invention

[0011] According to the present disclosure, when a start trigger for a first task for a remote service target is output, if there is an operator already engaged in a second task for the remote service target, the first task is assigned to the operator. This makes it possible to reduce the time required for the operator to grasp the surrounding situation of the remote service target. Therefore, when a remote service is provided by multiple operators, this is expected to contribute to the smooth operation of the remote service. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a conceptual diagram illustrating a remote service. [Diagram 2] FIG. 11 is a diagram showing an example of an image output from a display of a terminal operated by an operator. [Diagram 3] FIG. 11 is a diagram showing another example of an image output from the display of the terminal operated by the operator. [Figure 4] FIG. 13 is a diagram for explaining an example of an image that is displayed on a display when a first task for a vehicle is assigned, in association with two types of states of an operator before this assignment is made. [Diagram 5] 2 is a block diagram showing an example of a functional configuration of a processor of a management server particularly related to the first embodiment. FIG. [Figure 6] 10 is a flowchart showing the flow of processing by a management server (processor) that is particularly related to the first embodiment. [Figure 7] FIG. 11 is a diagram showing yet another example of an image output from the display of the terminal operated by the operator. [Figure 8] FIG. 13 is a block diagram showing an example of a functional configuration of a processor of a management server that is particularly related to a second embodiment. [Figure 9] 13 is a flowchart showing a flow of processing by a management server (processor) that is particularly related to a second embodiment. [Figure 10] FIG. 13 is a block diagram showing an example of a functional configuration of a processor of a management server that is particularly related to a third embodiment. [Figure 11] 13 is a flowchart showing a flow of processing by a management server (processor) that is particularly related to a third embodiment. [Figure 12] FIG. 13 is a block diagram showing an example of the functional configuration of a processor of a management server that is particularly related to the fourth embodiment. [Figure 13] 13 is a flowchart showing the flow of processing by a management server (processor) that is particularly related to the fourth embodiment. [Figure 14] FIG. 13 is a block diagram showing an example of the functional configuration of a processor of a management server that is particularly related to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, a remote service management method and a management device according to an embodiment of the present disclosure will be described with reference to the drawings. The management method according to the embodiment is realized by computer processing performed in the management device according to the embodiment. In addition, in each drawing, the same or corresponding parts are given the same reference numerals, and the description thereof will be simplified or omitted.

[0014] 1. First embodiment First, a first embodiment of the present disclosure will be described with reference to FIGS.

[0015] 1-1. Overview 1-1-1.Remote service Fig. 1 is a conceptual diagram for explaining a remote service, which illustrates a management server MS, a plurality of vehicles VH, and a plurality of operators OP.

[0016] The management server MS is an example of a management device according to the first embodiment. The management server MS manages remote services. The management server MS is typically managed by a provider of the remote services. The management server MS communicates with a plurality of vehicles VH and a plurality of operators OP.

[0017] Each of the multiple vehicles VH is an example of a moving body according to the first embodiment. Each of the multiple vehicles VH is a target for providing remote services. Some or all of the multiple vehicles VH may be vehicles owned by a remote service provider, or may be vehicles owned by a corporation or individual that has entered into a remote service provision contract with the provider. The total number of the multiple vehicles VH is M (M≧2). Hereinafter, for ease of explanation, any one of the multiple vehicles VH will be referred to as "vehicle VHm". The configuration of vehicle VHm is not particularly limited, but it is desirable for the vehicle VHm to have a configuration capable of autonomous driving.

[0018] Each of the multiple operators OP performs a service business SB for a target of remote service provision. The multiple operators OP may be employees of a business providing remote services, or may be employees of a corporation or individuals who have concluded a contract for outsourcing with the business. The total number of the multiple operators OP is N (N≧2). Hereinafter, for convenience of explanation, any one of the multiple operators OP will be referred to as "operator OPn".

[0019] 1-1-2.Service operations The service tasks SB performed by the operator OPn include a first task SB1 and a second task SB2. These tasks can be distinguished, for example, based on whether or not the execution of the task affects the driving efficiency of the vehicle VHm. For example, the first task SB1 is a service task SB that affects the driving efficiency, and the second task SB2 is a service task SB that does not affect the driving efficiency. The "driving efficiency" here is, for example, the ratio of the result to the execution amount of the service task SB performed by the operator OPn, and an example of this result is the time at which the vehicle VHm arrives at the destination.

[0020] An example of the first business SB1 is an operation business. The operation business includes a driving business, a command business, and an assistance business. The driving business is a business of operating devices (e.g., the steering wheel, pedals, shift lever, turn signals, etc. of the vehicle VHm) that are directly or indirectly related to the traveling of the vehicle VHm while monitoring images of the surroundings of the vehicle VHm acquired from a camera mounted on the vehicle VHm (hereinafter, also referred to as an "on-board camera").

[0021] The instruction work is not a work aimed at operating devices related to the traveling of the vehicle VHm. However, in the instruction work, information related to the traveling of the vehicle VHm is generated and provided to the vehicle VHm. For example, consider a case where there is a fallen object in front of the vehicle VHm and the operator OPn is required to make a decision on how the vehicle VHm should travel. In this case, the instruction work includes the work of the operator OPn who recognizes the fallen object and generates instruction information such as "follow the road" or "avoid obstacles and proceed." In addition, consider a case where it is difficult for the vehicle VHm to recognize a traffic signal due to backlighting or the like and the operator OPn is required to recognize the traffic signal. In this case, the instruction work also includes the work of the operator OPn who recognizes the traffic signal and generates recognition information such as "the traffic signal is green."

[0022] Like the instruction task, in the support task, information related to the traveling of the vehicle VHm is provided to the vehicle VHm. Unlike the instruction task, in the support task, information is generated by the operator OPn (human) taking into consideration the driving experience and driving knowledge, and is provided to the vehicle VHm. For example, consider a case where a vehicle VHm that plans to turn right at an intersection without traffic lights encounters an oncoming vehicle that also plans to turn right at this intersection, and the operator OPn is required to make a decision on when to make the right turn. In this case, the task of the driver of the oncoming vehicle or the operator OPn who recognizes the driver's gesture to generate support information such as "the oncoming vehicle is about to start, so give priority to the oncoming vehicle's right turn" or "the driver of the oncoming vehicle is yielding, so you may turn right first" is included in the support task.

[0023] An example of the second task SB2 is a monitoring task. The monitoring task includes a task of monitoring images of the surroundings of the vehicle VHm acquired from an on-board camera to check the safety of driving the vehicle VHm. The on-board camera may include a camera that acquires images of the interior of the vehicle VHm. In this case, the monitoring task includes a task of monitoring images of the interior of the vehicle VHm acquired from the on-board camera to check the status of an occupant (e.g., the driver) of the vehicle VHm. Note that the various images acquired from the on-board camera are typically videos, but may also be still images.

[0024] The surveillance work may include a task of monitoring visualized images of surrounding objects obtained from a recognition sensor other than an on-board camera (e.g., a LiDAR mounted on the vehicle VHm). The surveillance work may include a task of indirectly confirming the safety of traveling of the vehicle VHm by monitoring images of traffic flow obtained from a camera attached to a road structure (e.g., a traffic signal installed at an intersection) or visualized images of traffic flow obtained from a recognition sensor other than a camera (e.g., an infrared sensor). Hereinafter, the cameras and recognition sensors attached to road structures are collectively referred to as "infrastructure sensors."

[0025] The monitoring task may include a task of monitoring driving information of the vehicle VHm acquired from a status sensor (e.g., an acceleration sensor, a steering angle sensor) mounted on the vehicle VHm. The monitoring task may include a task of listening to sound information of the vehicle VHm (e.g., sounds outside the vehicle, conversations between occupants) acquired from a microphone (e.g., a microphone outside or inside the vehicle) mounted on the vehicle VHm.

[0026] Images of the on-board camera, recognition sensor, etc. monitored by the operator OP in the first and second tasks SB1 and SB2 are output from a display DPn of a terminal operated by the operator OPn. Fig. 2 is a diagram showing an example of an image IMG1 output from a display DP1 of a terminal operated by the operator OP1. In the example shown in Fig. 2, the image IMG1 includes an image IM_CF1. The image IM_CF1 is an image of the center front of the vehicle VH1 captured by the on-board camera of the vehicle VH1.

[0027] In addition, image IM_LF1 is superimposed on the left portion of image IM_CF1, and image IM_RF1 is superimposed on the right portion of image IM_CF1. Image IM_LF1 is an image of the left front of vehicle VH1 acquired by the vehicle-mounted camera of vehicle VH1, and image IM_RF1 is an image of the right front of vehicle VH1 acquired by the vehicle-mounted camera of vehicle VH1. In addition, image IM_CR1 is superimposed on a part of the upper part of image IM_CF1. Image IM_CR1 is an image of the central rear of vehicle VH1 acquired by the vehicle-mounted camera of vehicle VH1.

[0028] The image IMG1 shown in Fig. 2 corresponds to an example of an image output from the display DP1 when the operator OP1 performs the first task SB1. Note that the image IMG1 may include an image of the surroundings of the vehicle VH1 other than the image shown in Fig. 2 (for example, an image of the side of the vehicle VH1). The display DP1 may be composed of two or more displays. In this case, the images IM_LF1, IM_RF1, and IM_CR1 may be output from a display other than the display on which the image IM_CF1 is output.

[0029] Fig. 3 is a diagram showing another example of image IMG1 output from the display DP1 of the terminal operated by the operator OP1. The image IMG1 shown in Fig. 3 corresponds to an example of an image output from the display DP1 when the operator OP1 performs a second task SB2. In the example shown in Fig. 3, the display area of ​​the display DP1 is divided into four, and images IM_CF1 to IM_CF4 are output in each area. The images IM_CF2 to IM_CF4 are images of the center front of the vehicles VH2 to VH4 captured by the on-board cameras of these vehicles.

[0030] As can be seen from Fig. 3, the second task SB2 includes a task of monitoring surrounding images of two or more vehicles VH and simultaneously checking the driving safety of these vehicles VH. The reason for this is that the operator OPn in charge of the first task SB1 of the vehicle VHm is expected to concentrate on this first task SB1 or is prohibited from engaging in service tasks SB other than this first task SB1, whereas there are fewer such constraints in the second task SB2. Note that the example shown in Fig. 3 is just one example, and during the second task SB2 by the operator OPn, only information about one vehicle (i.e., information about the vehicle VHm) may be output from the display DPn.

[0031] 1-1-3. Service Business SB Start Trigger A service job SB by an operator OPn is started with the output of a trigger. Examples of output sources of the start trigger TRG of the service job SB include the vehicle VHm, the operator OPn, the management server MS, and an arbitrary predictor. Below, these output sources and output examples of the start trigger TRG in these output sources will be described.

[0032] The vehicle VHm recognizes objects included in the surrounding image of the vehicle VHm. The vehicle VHm also detects the motion of the recognized object. For example, if it is difficult to recognize an object included in the surrounding image, the vehicle VHm requests the management server MS to recognize the object. At this time, the start trigger TRG is output. In another example, if the object is recognized but an unnatural motion of the object is detected, the vehicle VHm requests the management server MS to check the state of the object. At this time, the start trigger TRG is also output.

[0033] The vehicle VHm may recognize the state of the occupant (driver) contained in the interior image of the vehicle VHm. Then, when an abnormal state of the driver is recognized, the vehicle VHm may request the management server MS to confirm this abnormal state. At this time, the start trigger TRG is also output. The vehicle VHm may detect the movement of an object around the vehicle VHm based on information from a recognition sensor other than the on-board camera. Then, when an unnatural movement of the object is detected, the vehicle VHm may request the management server MS to confirm the state of the object. At this time, the start trigger TRG is also output.

[0034] An operator OPn waiting for a service job SB starts a second job SB2 for the vehicle VHm at any timing. An example of the arbitrary timing is the timing when the operator OPn starts a service job SB. Another example of the arbitrary timing is the timing when the first job SB1 for the vehicle VHm by the operator OPn is completed. In such a case, the operator OPn requests the management server MS for the second job SB2. At this time, a start trigger TRG is output.

[0035] While engaged in the second task SB2, the operator OPn monitors the surrounding image of at least one vehicle output from the display DPn. The operator OPn may also monitor information other than the surrounding image (for example, an interior image, recognition sensor information, a traffic flow image, and driving information). The operator OPn can further listen to information (i.e., sound information) about at least one vehicle output from a speaker. Then, when the operator OPn determines that the first task SB1 is necessary for a certain vehicle during the second task SB2, the operator OPn makes a request for this service task SB to the management server MS. At this time, a start trigger TRG is output.

[0036] The output of the start trigger TRG can be detected by the management server MS. For example, when the vehicle VHm is the output source, the start trigger TRG is detected by the management server MS receiving a request signal for a service job SB from the vehicle VHm. When the operator OPn engaged in the second job SB2 is the output source, the start trigger TRG is detected by the management server MS receiving a request signal for a first job SB1 from the operator OPn.

[0037] The management server MS can appropriately acquire images (e.g., surrounding images, interior images) from the vehicle VHm's onboard camera. Therefore, when the vehicle VHm is provided with an object recognition function and a driver state recognition function, the management server MS can recognize objects included in the surrounding images of the vehicle VHm, detect the motion of the recognized objects, and recognize the state of the driver of the vehicle VHm. The management server MS can also appropriately acquire information other than the images from the onboard camera (e.g., recognition sensor information, traffic flow images, driving information, sound information). Therefore, when the management server MS is provided with a function for determining the start of a service job SB, the management server MS can actively output a start trigger TRG.

[0038] The management server MS may output a start trigger TRG of the second task SB2 for the vehicle VHm every time a predetermined time elapses while the vehicle VHm is in operation. The management server MS may also output a start trigger TRG of the second task SB2 for the vehicle VHm every time the accumulated mileage of the vehicle VHm reaches a dividing line while the vehicle VHm is in operation. The management server MS may also output a start trigger TRG of the first task SB1 to check the operation of various devices of the vehicle VHm (for example, check whether the lights are on) when the operation of the vehicle VHm starts or stops. The management server MS may further output a start trigger TRG of the second task SB2 to check various conditions of the vehicle VHm (check tire pressure, oil, battery, mileage, appearance) when the operation of the vehicle VHm starts or stops.

[0039] The arbitrary predictor is formed, for example, inside the management server MS. The arbitrary predictor may be formed outside the management server MS. The arbitrary predictor predicts the occurrence of a service job SB for the vehicle VHm by machine learning using the provision history (time period and location) of the service job SB. The arbitrary predictor may predict the occurrence of a service job SB at a point focused on by an infrastructure sensor by machine learning using the provision history of the service job SB. The point focused on by the infrastructure sensor is set, for example, from the detection range of the infrastructure sensor and map information. When the occurrence of a service job SB is predicted, the arbitrary predictor formed inside the management server MS outputs a start trigger TRG. The arbitrary predictor formed outside the management server MS transmits a signal equivalent to the start trigger TRG to the management server MS.

[0040] For ease of explanation, the start trigger TRG of the first task SB1 for the vehicle VHm will also be referred to as the "start trigger TRG_SB1," and the start trigger TRG of the second task SB2 for the vehicle VHm will also be referred to as the "start trigger TRG_SB2."

[0041] 1-2. Features of the first embodiment When a start trigger TRG for a service job SB for a vehicle VHm is output, the management server MS selects an operator OPn to which this service job SB is assigned from among a plurality of operators OP. For ease of explanation, the operator OPn to which the service job SB is assigned is also referred to as "operator OP_SB" below. In addition, the operator OPn to which the first job SB1 is assigned is also referred to as "operator OP_SB1," and the operator OPn to which the second job SB2 is assigned is also referred to as "operator OP_SB2."

[0042] Here, consider a display DPn that a candidate for operator OP_SB1 is monitoring when a start trigger TRG_SB1 for vehicle VHm is output. Assumed candidates for operator OP_SB1 are an operator OPn waiting to engage in a service job SB and an operator OPn (i.e., operator OP_SB2) engaged in a second job SB2. The former is an operator OPn in a state where he / she can accept the first job SB1 performed in response to the start trigger TRG_SB1 as a new service job SB. The latter is an operator OPn in a state where he / she can switch from the second job SB2 in which he / she is currently engaged to the first job SB1 performed in response to the start trigger TRG_SB1.

[0043] "CASE1" shown in Fig. 4 is an example of an image IMGn output from the display DPn when a first task SB1 for a vehicle VH3 is assigned to an operator OPn waiting to be engaged in a service task SB. "CASE2" shown in Fig. 4 is an example of an image IMG1 output from the display DPn when a first task SB1 for a vehicle VH3 is assigned to an operator OPn engaged in a second task SB2 for the vehicle VH3.

[0044] Comparing "CASE1" and "CASE2", the latter is expected to grasp the surrounding conditions of the vehicle VH3 earlier than the former. The reason is that before the first task SB1 for the vehicle VH3 is assigned, the operator OPn is already engaged in the second task SB2 for the vehicle VH3, so it does not take time to grasp the surrounding conditions of the vehicle VH3.

[0045] Based on this viewpoint, in the first embodiment, when a start trigger TRG_SB1 of a first task SB1 for a vehicle VHm is output, it is determined whether or not there is an operator OPn already engaged in a second task SB2 for the vehicle VHm. Then, when it is determined that there is an operator OPn already engaged in a second task SB2 for the vehicle VHm, the first task SB1 is preferentially assigned to this operator OPn. It is expected that such preferential assignment will contribute to smooth operation of remote services.

[0046] The management method and management device according to the first embodiment will be described in detail below.

[0047] 1-3. Remote service management device 1-3-1. Configuration example Fig. 5 is a block diagram showing an example of a functional configuration of the processor 10 of the management server MS that is particularly related to the first embodiment. In the example shown in Fig. 5, the processor 10 includes a state information acquisition unit 11, a first trigger output determination unit 12, an allocation method setting unit 13, a first task allocation unit 14, and a first task assignment unit 15. The functions of these blocks are realized by the processor 10 executing a remote service program.

[0048] The status information acquisition unit 11 acquires information on the current status of multiple vehicles VH and multiple operators OP. The information on the current status of multiple vehicles VH includes, for example, information on the operating status and information on the provision status of a service job SB. The operating status is divided into a state in which the drive source (e.g., an electric motor, an engine) of the vehicle VHm is operating and a state in which it is not. The provision status is divided into a state in which a service job SB is being provided and a state in which it is not. When a service job SB is being provided to the vehicle VHm, information on the type of service job SB being provided (i.e., a first job SB1 and a second job SB2) is added to the provision status information.

[0049] Information on the current status of multiple operators OP includes information on their engagement status in service business SB. The engagement status is divided into a state of waiting to engage in service business SB and a state of being engaged in service business SB. When an operator OPn is engaged in a service business SB, information on the type of service business SB in which the operator is engaged (i.e., the first business SB1 and the second business SB2) is added to the information on the current status. When an operator OPn is engaged in a service business SB, unique information (e.g., ID information) of the object of provision of this service business SB (hereinafter also referred to as "vehicle VH_SB") is added to the information on the engagement status. As can be understood from the explanation of FIG. 3, the total number of objects of provision of the second business SB2 (hereinafter also referred to as "vehicle VH_SB2") is at least 1.

[0050] The state information acquisition unit 11 transmits the information relating to the current state that it has acquired to the allocation method setting unit 13 and the first task allocation unit 14 .

[0051] The first trigger output determination unit 12 determines whether or not a start trigger TRG_SB1 for the vehicle VHm has been output. As already described, the output sources of the start trigger TRG include the vehicle VHm, the operator OPn, the management server MS, and any predictor. When the output of the start trigger TRG_SB1 is detected, the first trigger output determination unit 12 transmits to the allocation setting unit 13 unique information (e.g., ID information) of the vehicle that output the start trigger TRG_SB1 (hereinafter also referred to as "vehicle VH_TRG_SB1").

[0052] The allocation method setting unit 13 sets an allocation method of the first task SB1 for the vehicle VH_TRG_SB1 based on information on the current states of the multiple vehicles VH received from the state information acquisition unit 11 and unique information of the vehicle VH_TRG_SB1 received from the first trigger output determination unit 12. Specifically, the allocation method setting unit 13 determines whether or not the vehicle VH_TRG_SB1 is included in the current provision target of the second task SB2 (i.e., the vehicle VH_SB2). This determination is made by comparing the unique information of the vehicle VH_TRG_SB1 with that of the vehicle VH_SB2.

[0053] If it is determined that the vehicle VH_TRG_SB1 is included in the vehicle VH_SB2, the allocation method is set to "priority allocation". If it is determined that the vehicle VH_TRG_SB1 is not included in the vehicle VH_SB2, the allocation method is set to "normal allocation". The allocation method setting unit 13 transmits information on the set allocation method and unique information of the vehicle VH_TRG_SB1 to the first task allocation unit 14.

[0054] The first task allocation unit 14 selects an operator OPn to be in charge of the first task SB1 for the vehicle VH_TRG_SB1 based on information regarding the current status of multiple operators OP received from the status information acquisition unit 11, information on the allocation method received from the allocation method setting unit 13, and unique information of the vehicle VH_TRG_SB1.

[0055] Consider a case where "priority allocation" is set as the allocation method. In this case, an operator OP_SB2 who is already engaged in the second task SB2 for the vehicle VH_TRG_SB1 is identified based on information about the current states of multiple operators OP and unique information about the vehicle VH_TRG_SB1. This identified operator OP_SB2 is selected as the operator OP_SB1 in charge of the first task SB1 for the vehicle VH_TRG_SB1.

[0056] Consider a case where "normal allocation" is set as the allocation method. In this case, for example, based on information on the current states of the multiple operators OP, multiple operators OP who are waiting for the service job SB are set as candidates for the operator OP_SB1. Then, an operator in charge of the first job SB1 for the vehicle VH_TRG_SB1 is selected from among these candidates.

[0057] In addition, when "normal allocation" is set, a publicly known method can be applied to the selection method of the operator OP_SB1. For example, according to a publicly known method, the candidates for the operator OP_SB1 may be narrowed down based on the length of waiting time (operation rate) of the service job SB by the candidates, the proficiency (number of experiences) of the service job SB, etc.

[0058] The first task provision unit 15 transmits information required to start the first task SB1 for the vehicle VH_TRG_SB1 to the terminal operated by the operator OP_SB1 selected by the first task allocation unit 14. An example of the information required to start the first task SB1 is an image of the surroundings of the vehicle VH_TRG_SB1.

[0059] The first task setting unit 15 also transmits information to this terminal notifying that the second task SB2 for the vehicle VH_TRG_SB1 has been shifted to the first task SB1 for this vehicle VH_TRG_SB1. The first task setting unit 15 further transmits information to this terminal to enable the operation of devices related to the running of the vehicle VH_TRG_SB1 (e.g., steering wheel, pedals, shift lever, blinker, etc.).

[0060] Furthermore, when the operator OP_SB1 is selected by the first service allocation unit 14, the first service provision unit 15 updates information about the current state of this operator OP_SB1. Specifically, information about the type of service service SB being performed is updated. Furthermore, when the first service SB1 by the operator OP_SB1 is started, the first service provision unit 15 updates information about the current state of the multiple vehicles VH. Specifically, information about the type of service service SB being provided is updated.

[0061] 1-3-2. Processing example 6 is a flowchart showing a flow of processing by the management server MS (processor 10) that is particularly related to the first embodiment. The routine shown in FIG. 6 is executed repeatedly at a predetermined control period, for example.

[0062] 6, first, it is determined whether or not the start trigger TRG_SB1 has been output (step S11). For example, when the processor 10 receives a predetermined signal from the output source of the start trigger TRG, it is determined that the start trigger TRG_SB1 has been output. When the determination result of step S11 is negative, the current process is terminated.

[0063] If the determination result in step S11 is positive, information on the current states of the vehicles VH and the operators OP is acquired (step S12). The information on the current states is stored, for example, in a database of the management server MS, and the processor 10 acquires the latest information therefrom.

[0064] Following the processing of step S12, it is determined whether or not the vehicle that output the start trigger TRG_SB1 (i.e., the vehicle VH_TRG_SB1) is included in the current target of provision of the second service SB2 (i.e., the vehicle VH_SB2) (step S13). The determination in step S13 is performed, for example, by comparing the unique information of the vehicle VH_TRG_SB1 with that of the vehicle VH_SB2.

[0065] If the determination result in step S13 is positive, the first task SB1 for the vehicle VH_TRG_SB1 is assigned to the operator OP_SB2 engaged in the second task SB2 for the vehicle VH_TRG_SB1 (step S14). On the other hand, if the determination result in step S13 is negative, the first task SB1 is assigned according to a known method (step S15). In step S15, for example, a plurality of operators OP waiting for the service task SB are set as candidates for the operator OP_SB1, and one operator is selected from among these candidates. Then, the first task SB1 for the vehicle VH_TRG_SB1 is assigned to the selected operator.

[0066] Following the processing of step S14 or S15, an execution command for the first task SB1 for the vehicle VH_TRG_SB1 is sent to the computer of the selected operator (step S16). This execution command includes information required to start the first task SB1, information notifying the transition to the first task SB1, and information enabling the operation of devices related to the traveling of the vehicle VH_TRG_SB1.

[0067] 1-4.Effects According to the first embodiment described above, when a start trigger TRG_SB1 for a vehicle VHm is output, if there is an operator OPn already engaged in a second task SB2 for the vehicle VH_TRG_SB1, the first task SB1 for the vehicle VH_TRG_SB1 is assigned to this operator OPn. This makes it possible to reduce the time required for this operator OP to grasp the surrounding conditions of the vehicle VH_TRG_SB1. This is expected to contribute to the smooth operation of remote services.

[0068] 2. Second embodiment Next, a second embodiment of the present disclosure will be described with reference to Figures 7 to 9. Note that descriptions that overlap with the description of the first embodiment will be omitted as appropriate.

[0069] 2-1. Features of the second embodiment FIG. 7 is a diagram showing another example of image IMG1 output from display DP1 of a terminal operated by operator OP1. Image IMG1 shown in FIG. 7 corresponds to an example of an image output from display DP1 when operator OP1 performs a second task SB2. In the example shown in FIG. 7, the display area of ​​display DP1 is divided into four. Up to this point, it is the same as the example shown in FIG. 3. In the example shown in FIG. 7, images IM_IS1 to IS4 are output in each area of ​​display DP1. Images IM_IS1 to IS4 are images acquired by four infrastructure sensors, respectively.

[0070] In the second embodiment, a case is considered where the second task SB2 of monitoring the image of the traffic flow acquired from the infrastructure sensor is mainly performed. The management server MS and an arbitrary predictor are assumed as the output source of the start trigger TRG of the second task SB2 of monitoring the image of the traffic flow. Since the installation positions of the infrastructure sensors are known, it is also conceivable that an operator OPn waiting for the service task SB selects a specific infrastructure sensor, and the start trigger TRG of the second task SB2 is output by this operator OPn.

[0071] The start trigger TRG (i.e., start trigger TRG_SB1) of the first task SB1 for the vehicle VHm described in the first embodiment may be output while the operator OPn is engaged in the second task SB2 of monitoring an image of a traffic flow. The output source of this start trigger TRG_SB1 is assumed to be the vehicle VHm, the management server MS, and any predictor. Note that, when the operator OPn is engaged in the second task SB2 of monitoring an image of the surroundings of the vehicle VHm acquired from the vehicle-mounted camera of the vehicle VHm, this operator OPn may be the output source of the start trigger TRG_SB1, but this case is not considered in the second embodiment.

[0072] When an operator OPn is engaged in the second task SB2 of monitoring the surrounding image of the vehicle VHm, information on the target of the second task SB2 (i.e., the vehicle VH_SB2) can be acquired from information on the current states of the multiple operators OP. In the first embodiment, based on the information on the vehicle VH_SB2, it was determined whether or not there is an operator OPn already engaged in the second task SB2 for the vehicle VH_TRG_SB1.

[0073] However, when an operator OPn is engaged in the second task SB2 of monitoring an image of an infrastructure sensor, it is considered that the operator OPn is performing the second task SB2 without recognizing at what position in the image the image of the vehicle VH_SB2 exists. Moreover, in the first embodiment, the position at which the image of the vehicle VH_SB2 exists in the image of the infrastructure sensor is not specified. Therefore, with the inquiry method based on the first embodiment, it is difficult to specify information on the provision target (i.e., the vehicle VH_SB2) of the second task SB2 based on the image of the infrastructure sensor.

[0074] If coordinate information indicating where in the image of the vehicle VH_SB2 is located within the image of the infrastructure sensor is calculated in advance, and this coordinate information is added to information relating to the current states of the multiple operators OP (more specifically, information on the engagement state), it is possible to identify information about the vehicle VH_SB2. However, it is also assumed that the coordinate information is not calculated in advance intentionally. Examples of reasons for this include reducing the processing load for calculating the coordinate information, suppressing an increase in the communication load associated with the constant transmission of information relating to the current states of the multiple operators OP, and refraining from the constant transmission of information relating to the current states of the multiple vehicles VH before the output of the start trigger TRG from the perspective of privacy protection.

[0075] If the coordinate information is not calculated in advance intentionally, the information of the vehicle VH_SB2 cannot be identified. Therefore, in the second embodiment, when a start trigger TRG_SB1 for the vehicle VHm is output, an inquiry is made about an operator OPn already engaged in the second task SB2 based on an image from an infrastructure sensor, using a combination of information different from the combination of information used when setting the allocation method described in the first embodiment.

[0076] In the first inquiry method of the second embodiment, it is determined whether or not vehicle VH_SB2 is being monitored by a second service SB2 based on an image of an infrastructure sensor based on unique information of vehicle VH_TRG_SB1, unique information of vehicle VH_SB2, and coordinate information of vehicle VH_TRG_SB1 within an image of an infrastructure sensor.

[0077] In the second inquiry method of the second embodiment, the above-mentioned determination is performed based on the unique information of the vehicle VH_TRG_SB1, the position information and orientation information of the vehicle VH_TRG_SB1, and the position information and angle of view information of the infrastructure sensor (camera). That is, in the second inquiry method, the position information and orientation information of the vehicle VH_TRG_SB1, and the position information and angle of view information of the infrastructure sensor (camera) are added to the unique information of the vehicle VH_TRG_SB1 used when setting the allocation method described in the first embodiment. The former information is acquired, for example, from a GPS sensor mounted on the vehicle VH_TRG_SB1. The latter information is previously set or registered.

[0078] In the second inquiry method, the vehicle VH_TRG_SB1 may communicate with an infrastructure sensor (camera), and confirmation information as to whether or not the vehicle VH_TRG_SB1 is included in the range of the angle of view of the infrastructure sensor may be further added. In the second inquiry method, color information of the body of the vehicle VH_TRG_SB1 may also be collated with color information of an object recognized in an image of the infrastructure sensor (camera) as an auxiliary method. In the case of an infrastructure sensor (infrared sensor), infrared rays may be emitted from an on-board device in a predetermined light emission pattern from the vehicle VH_TRG_SB1, thereby generating confirmation information as to whether or not the vehicle VH_TRG_SB1 is included in the recognition range of the infrastructure sensor. In the case where the vehicle VH_TRG_SB1 has a LiDAR, the light emitted from the LiDAR may be used instead of emitting infrared rays.

[0079] In the third query method of the second embodiment, the same additional information as in the second query method is used. However, unlike the second query method, the third query method is premised on the existence of a server that manages the location information and angle of view information of the infrastructure sensor (camera) separate from the management server MS. In this case, it is considered that the management server MS requests this information from the server that manages the information of the infrastructure sensor. Then, when the information of the infrastructure sensor is provided in response to this request, the above-mentioned determination is made by a method similar to that of the second query method.

[0080] In the second and third inquiry methods, an infrastructure sensor that communicates with the vehicle VH_TRG_SB1 may generate confirmation information as to whether the vehicle VH_TRG_SB1 is included in the range of the angle of view of the infrastructure sensor. In this case, the confirmation information is provided to the management server MS from the infrastructure sensor, not from the vehicle VH_TRG_SB1.

[0081] The management method and management device according to the second embodiment will be described in detail below.

[0082] 2-2. Remote service management device 2-2-1. Configuration example Fig. 8 is a block diagram showing a configuration example of a management server MS particularly related to the second embodiment. In the example shown in Fig. 8, the management server MS includes a processor 20 and a remote service DB (database) 21.

[0083] The processor 20 includes the function units 11 to 15 described in FIG. 5 and a second task inquiry unit 22. In the second embodiment, information on the current states of a plurality of operators OP is transmitted from the state information acquisition unit 11 to the second task inquiry unit 22. The second task inquiry unit 22 determines whether or not there is an operator OPn engaged in a second task SB2 for the vehicle VH_TRG_SB1, based on the information on the current states and information stored in the remote service DB 21. The second task inquiry unit 22 also transmits the determination result to the allocation method setting unit 13.

[0084] In the second embodiment, the allocation method is set by the allocation method setting unit 13 based on the determination result received from the second task inquiry unit 22. Specifically, if the determination result is positive, "priority allocation" is set as the allocation method. If the determination result is negative, "normal allocation" is set as the allocation method.

[0085] The remote service DB21 stores information about the current states of the multiple vehicles VH and the multiple operators OP. The information in the remote service DB21 is updated periodically. Past information in the remote service DB21 is also stored in the remote service DB21 for a certain period of time. When coordinate information of the vehicle VH_TRG_SB1 in the image of the infrastructure sensor is calculated, this coordinate information is stored in the remote service DB21 as part of information about the current states of the multiple operators OP.

[0086] When the position information and direction information of the vehicle VH_TRG_SB1 are acquired, the vehicle information is stored as part of the information regarding the current states of the multiple vehicles VH in the remote service DB 21. When confirmation information regarding whether the vehicle VH_TRG_SB1 is included in the range of the angle of view of the infrastructure sensor is generated, the confirmation information is stored in the remote service DB 21 as part of the information regarding the current states of the multiple vehicles VH.

[0087] When the location information of the infrastructure sensor and the like is set or registered in advance, the infrastructure sensor information is stored in the remote service DB 21. When the location information of the infrastructure sensor and the like is provided from a server that manages the information of the infrastructure sensor, the infrastructure sensor information is also stored in the remote service DB 21.

[0088] 2-2-2. Processing example 9 is a flowchart showing the flow of processing by the management server MS (processor 20) that is particularly related to the second embodiment. The routine shown in FIG 9 is executed repeatedly at a predetermined control period, for example.

[0089] The basic flow of the routine shown in Fig. 9 is the same as that described in Fig. 6. The difference between these routines is that the process of step S21 is performed instead of the process of step S12. That is, in the routine shown in Fig. 9, in step S21, information required for the above-mentioned first to third inquiry methods is acquired as "inquiry information." Furthermore, in the routine shown in Fig. 9, it is determined whether or not the vehicle VH_TRG_SB1 is included in the vehicle VH_SB2 based on this inquiry information (step S13).

[0090] 2-3.Effects According to the second embodiment described above, when a start trigger TRG_SB1 for a vehicle VHm is output, if there is an operator OPn performing a second task SB2 for the vehicle VH_TRG_SB1 based on a traffic flow image acquired from an infrastructure sensor, the first task SB1 for the vehicle VH_TRG_SB1 can be assigned to this operator OPn. Therefore, it is possible to obtain the same effect as that obtained by the first embodiment.

[0091] 3. Third embodiment Next, a third embodiment of the present disclosure will be described with reference to Figures 10 to 11. Note that descriptions that overlap with the descriptions of the first and second embodiments will be omitted as appropriate.

[0092] 3-1. Features of the third embodiment In the first and second embodiments, when there is an operator OPn already engaged in the second task SB2 for the vehicle VH_TRG_SB1, a process is performed to assign the first task SB1 for the vehicle VH_TRG_SB1 to this operator OPn. That is, a process is performed to have the operator OPn engaged in the second task SB2 for the vehicle VH_TRG_SB1 take charge of the second task SB2 for this vehicle. Therefore, when this process is performed, the second task SB2 for the vehicle VH_TRG_SB1 by the operator OPn is completed.

[0093] Here, consider the case where the total number of vehicles (i.e., vehicles VH_SB2) to which the operator OPn was provided the second service SB2 before this allocation was made is two or more. In other words, consider the case where the operator OPn was concurrently in charge of the second service SB2 for two or more vehicles VH_SB2 before this allocation was made. In this case, one of the two or more vehicles VH_SB2 corresponds to the vehicle VH_TRG_SB1. Therefore, when the first service SB1 for the vehicle VH_TRG_SB1 is started, the second service SB2 for the remaining vehicles VH_SB2 that were the targets of the second service SB2 provided to this vehicle VH_TRG_SB1 will end.

[0094] Therefore, in the third embodiment, when an operator OPn who has been engaged in the second task SB2 for two or more vehicles VH_SB2 including a vehicle VH_TRG_SB1 is selected as an operator in charge of the first task SB1 for this vehicle VH_TRG_SB1, a start trigger TRG for the second task SB2 for the remaining vehicles VH_SB2 is output. When this start trigger TRG is output, the second task SB2 is assigned to the vehicle (hereinafter also referred to as "vehicle VH_TRG_SB2") that has output this start trigger TRG. Therefore, according to the third embodiment, it is possible to continue the second task SB2 for the remaining vehicles VH_SB2 while starting the first task SB1 for the vehicle VH_TRG_SB1.

[0095] 3-2. Remote service management device 3-2-1. Configuration example Fig. 10 is a block diagram showing an example of a functional configuration of the processor 30 of the management server MS particularly related to the third embodiment. In the example shown in Fig. 10, the processor 30 includes the function units 11 to 15 described in Fig. 5, a second trigger output unit 31, a second trigger output determination unit 32, a second task allocation unit 33, and a second task assignment unit 34. In the third embodiment, information on the current states of a plurality of operators OP is transmitted from the state information acquisition unit 11 to the second task allocation unit 33.

[0096] The second trigger output unit 31 outputs a start trigger TRG_SB2 for the vehicle VHm. In the third embodiment, information on the current states of multiple operators OP is transmitted from the state information acquisition unit 11 to the second trigger output unit 31. In the third embodiment, the first task assignment unit 15 also transmits to the second trigger output unit 31 information on the operator OP_SB1 selected by the first task assignment unit 14 and information on the vehicle VH_TRG_SB1 in charge of this operator OP_SB1.

[0097] When the second trigger output unit 31 receives information from the first task assignment unit 15, it refers to the unique information (e.g., ID information) of the operator OP_SB1 selected by the first task assignment unit 14, and extracts information on the current state of this operator OP_SB1 from the information on the current states of multiple operators OP. Then, based on the extracted information on the current state (specifically, information on the engagement state in the service task SB), the second trigger output unit 31 determines whether the engagement state of the operator OP_SB1 immediately before the selection by the first task assignment unit 14 was concurrently handling the second task SB2 for two or more vehicles VH_SB2.

[0098] Then, when it is determined that the engagement state of the operator OP_SB1 immediately before the selection by the first task allocation unit 14 was concurrently handling the second task SB2 for two or more vehicles VH_SB2, the second trigger output unit 31 identifies the remaining vehicles VH_SB2 to which the second task SB2 was provided together with the vehicle VH_TRG_SB1. The remaining vehicles VH_SB2 are identified, for example, based on information received from the first task assignment unit 15 (specifically, unique information of the vehicle VH_TRG_SB1) and information on the current status of the multiple operators OP (specifically, information on the current status of the operator OPn selected by the first task allocation unit 14). The second trigger output unit 31 outputs a start trigger TRG of the second task SB2 for the identified remaining vehicles VH_SB2.

[0099] The second trigger output determination unit 32 determines whether or not a start trigger TRG_SB2 for the vehicle VHm has been output. As already described, the output sources of the start trigger TRG include the vehicle VHm, the operator OPn, the management server MS, and any predictor. In particular, in the third embodiment, a start trigger TRG for the second task SB2 for the remaining vehicle VH_SB2 that was previously serving as the vehicle VH_TRG_SB1 may be output. When the output of the start trigger TRG_SB2 is detected, the second trigger output determination unit 32 transmits to the second task allocation unit 33 unique information (e.g., ID information) of the vehicle that has output the start trigger TRG_SB2 (i.e., the vehicle VH_TRG_SB2).

[0100] The second task allocation unit 33 selects an operator OPn to which the second task SB2 for the vehicle VH_TRG_SB2 is assigned based on information regarding the current status of multiple operators OP received from the status information acquisition unit 11 and the unique information of the vehicle VH_TRG_SB2 received from the second trigger output determination unit 32.

[0101] The second task SB2 is assigned, for example, by the "normal assignment" used in the assignment of the first task SB1. In this case, based on information on the current states of the multiple operators OP, multiple operators OP waiting for the service task SB are set as candidates for the operator OP_SB2. Then, an operator to be assigned the second task SB2 for the vehicle VH_TRG_SB2 is selected from among these candidates. The unique information of the vehicle VH_TRG_SB2 may or may not be used in the assignment of the second task SB2. For example, when candidates for the operator OP_SB2 are narrowed down based on the proficiency of the service task SB, the unique information of the vehicle VH_TRG_SB2 is used to calculate the proficiency.

[0102] The second task assignment unit 34 transmits information necessary for starting the second task SB2 for the vehicle VH_TRG_SB2 to a terminal operated by the operator OP_SB2 selected by the second task allocation unit 33. An example of the information necessary for starting the second task SB2 is an image of the surroundings of the vehicle VH_TRG_SB2. When the operator OP_SB2 is selected by the second task assignment unit 33, the second task assignment unit 34 updates information about the current states of the multiple operators OP. When the second task SB2 is started by this operator OP_SB2, the second task assignment unit 34 updates information about the current states of the multiple vehicles VH.

[0103] 3-2-2. Processing example 11 is a flowchart showing the flow of processing by the management server MS (processor 30) that is particularly related to the third embodiment. The routine shown in FIG. 11 is executed following the processing of step S16 in FIG.

[0104] In the routine shown in Fig. 11, first, it is determined whether or not an operator OPn (i.e., operator OP_SB1) in charge of a first task SB1 for a vehicle VH_TRG_SB1 was concurrently in charge of a second task SB2 for two or more vehicles VH_SB2 immediately before starting the first task SB1 (step S31). The determination in step S31 is made, for example, based on information about the operator OPn in charge of the first task SB1 for a vehicle VH_TRG_SB1, information about this vehicle VH_TRG_SB1, and information about the operator OPn's engagement in a service task SB. If the determination result in step S31 is negative, the current process ends.

[0105] If the determination result in step S31 is positive, a start trigger TRG (that is, a start trigger TRG_SB2) is output for the remaining vehicles VH_SB2 that were the targets of the second service SB2 together with the vehicle VH_TRG_SB1 (step S32).

[0106] Effects According to the third embodiment described above, when an operator OPn concurrently performs the second task SB2 for two or more vehicles VH_SB2, when the first task SB1 for the vehicle VH_TRG_SB1 is assigned to this operator OPn, a start trigger TRG for the second task SB2 for the remaining vehicles VH_SB2 that the operator OPn concurrently performed as well as the vehicle VH_TRG_SB1 can be output. Therefore, while starting the first task SB1 for the vehicle VH_TRG_SB1, it is possible to smoothly hand over the second task SB2 for the remaining vehicles VH_SB2 to another operator.

[0107] 4. Fourth embodiment Next, a fourth embodiment of the present disclosure will be described with reference to Figures 12 and 13. Note that descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate.

[0108] 4-1. Features of the fourth embodiment In the first and second embodiments, when there is an operator OPn already engaged in the second task SB2 for the vehicle VH_TRG_SB1, a process is performed in which the first task SB1 for the vehicle VH_TRG_SB1 is assigned to this operator OPn. In other words, in the first and second embodiments, when there is even one operator OPn already engaged in the second task SB2 for the vehicle VH_TRG_SB1, the first task SB1 for the vehicle VH_TRG_SB1 is assigned to this operator OPn.

[0109] However, as can be understood from the definition of the second task SB2, the total number of operators already engaged in the second task SB2 for the vehicle VH_TRG_SB1 may be two or more. In this case, the issue is which operator to assign the first task SB1 for the vehicle VH_TRG_SB1 to. Therefore, in the fourth embodiment, in such a case, one operator is selected to assign the first task SB1 for the vehicle VH_TRG_SB1.

[0110] Although the method of selecting an operator is not particularly limited, it is desirable to narrow down the candidates for the operator OP_SB1 based on a certain selection criterion. An example of this selection criterion will be described later. By selecting an operator, when the total number of operators OPn engaged in the second task SB2 for the vehicle VH_TRG_SB1 is two or more, it becomes possible to reliably assign the first task SB1 for the vehicle VH_TRG_SB1 to one operator.

[0111] 4-2. Remote service management device 4-2-1. Configuration example Fig. 12 is a block diagram showing an example of a functional configuration of the processor 40 of the management server MS particularly related to the fourth embodiment. In the example shown in Fig. 12, the processor 40 includes the function units 11 to 15 described in Fig. 5 and an operator selection unit 41.

[0112] In the fourth embodiment, the first task allocation unit 14 selects an operator OPn who will be in charge of the first task SB1 for the vehicle VH_TRG_SB1. Up to this point, it is the same as the first embodiment. In the fourth embodiment, if the total number of operators who will be in charge of the second task SB2 for the vehicle VH_TRG_SB1 is two or more, the first task allocation unit 14 selects these operators as final candidates for the operator OP_SB1. The final candidates for the operator OP_SB1 are transmitted to the operator selection unit 41.

[0113] The operator selection unit 41 selects one operator from among the final candidates for the operator OP_SB1 received from the first task allocation unit 14. A first example of a selection criterion is the output source of the start trigger TRG_SB1. If the final candidate for the operator OP_SB1 corresponds to the output source of the start trigger TRG_SB1, this final candidate is highly likely to understand the cause, reason, etc. of starting the first task SB1 for the vehicle VH_TRG_SB1. Therefore, in the first example, if the final candidate for the operator OP_SB1 is the output source of the start trigger TRG_SB1, this final candidate is selected as the operator OP_SB1.

[0114] A second example of the selection criterion is the duration of the second task SB2 for the vehicle VH_TRG_SB1. It is expected that the longer the duration of the second task SB2 for the vehicle VH_TRG_SB1, the higher the degree of understanding of the surrounding conditions of the vehicle VH_TRG_SB1. Therefore, in the second example, the final candidate who has performed the second task SB2 for the vehicle VH_TRG_SB1 for the longest period of time is selected as the operator OP_SB1.

[0115] A third example of the selection criteria is the type of image in which the final candidate for operator OP_SB1 recognizes the vehicle VH_TRG_SB1. The image monitored by the operator OP_SB1 in the first task SB1 is an image of the surroundings of the vehicle VH_TRG_SB1. Therefore, the final candidate who monitors the image of the surroundings of the vehicle VH_TRG_SB1 is expected to grasp the surrounding conditions of the vehicle VH_TRG_SB1 in a short time compared to the final candidate who monitors the image of the infrastructure sensor including the image of the vehicle VH_TRG_SB1. Therefore, in the third example, the final candidate who operates the terminal that outputs the image of the surroundings of the vehicle VH_TRG_SB1 on the display is selected as the operator OP_SB1.

[0116] The fourth example of the selection criteria is the opposite of the third example. The final candidate who monitors the images from the infrastructure sensor is expected to grasp the surrounding environment of the vehicle VH_TRG_SB1 in a short time because the final candidate who monitors the images from the infrastructure sensor grasps the entire surrounding environment of the vehicle VH_TRG_SB1. Therefore, in the fourth example, the final candidate who operates the terminal that outputs the images from the infrastructure sensor on the display is selected as the operator OP_SB1.

[0117] A fifth example of the selection criteria is the communication band used by the final candidate at the time of selection. If there is a difference in merit between communication bands, it is expected that the final candidate using a better communication band will be able to grasp the surrounding situation of the vehicle VH_TRG_SB1 in a shorter time. Therefore, in the fifth example, the final candidate using the best communication band is selected as the operator OP_SB1. The communication band can be evaluated based on the communication speed, communication delay time, and communication delay time fluctuation between the terminal operated by the final candidate and the management server MS.

[0118] A sixth example of the selection criterion is the object to be gazed upon in the first task SB1. The object to be gazed upon in the first task SB1 is an object that caused the first task SB1 to be started for the vehicle VH_TRG_SB1. If information regarding the object to be gazed upon is also output when the start trigger TRG is output, the final candidate who has been monitoring the surrounding image of the vehicle VH_TRG_SB1 including the image of the object to be gazed upon, or the image of the infrastructure sensor including the image of the object to be gazed upon, is expected to grasp the cause, reason, etc. of starting the first task SB1 for the vehicle VH_TRG_SB1 in a short time. Therefore, in the sixth example, the final candidate who operates the terminal that outputs the surrounding image of the vehicle VH_TRG_SB1 including the image of the object to be gazed upon, or the image of the infrastructure sensor including the image of the object to be gazed upon, on the display, is selected as the operator OP_SB1.

[0119] The operator selection unit 41 transmits information on the final candidate selected as the operator OP_SB1 to the first task assignment unit 15.

[0120] 4-2-2. Processing example 13 is a flowchart showing a flow of processing by the management server MS (processor 40) that is particularly related to the fourth embodiment. The routine shown in FIG 13 is executed repeatedly at a predetermined control period, for example.

[0121] The basic flow of the routine shown in Fig. 13 is the same as that explained in Fig. 6. The difference between these routines is that a process is added that is performed when the determination result in step S13 is positive. That is, in the routine shown in Fig. 13, when the determination result in step S13 is positive, the processes in steps S41 and S42 are performed.

[0122] In the process of step S41, it is determined whether the total number of operators (i.e., operators OP_SB2) in charge of the second task SB2 for the vehicle VH_TRG_SB1 is 2 or more. If the result of the determination in step S41 is negative, that is, if the total number of operators in charge of the second task SB2 for the vehicle VH_TRG_SB1 is 1, the process of step S16 is performed.

[0123] If the determination result of step S41 is positive, processing of step S42 is performed. In the processing of step S42, the operator in charge of the second task SB2 for the vehicle VH_TRG_SB1 (i.e., the operator OP_SB2) is set as the final candidates for the operator OP_SB1, and one person is selected from the final candidates. As already explained, the selection method is not particularly limited. When the final candidates are narrowed down using the selection criteria, it is desirable to appropriately combine the first to sixth examples described above. The selected one operator OP_SB2 is assigned the first task SB1 for the vehicle VH_TRG_SB1.

[0124] Effects According to the fourth embodiment described above, when the total number of operators OPn engaged in the second task SB2 for the vehicle VH_TRG_SB1 is two or more, it is possible to reliably assign the first task SB1 for the vehicle VH_TRG_SB1 to one operator.

[0125] 5. Fifth embodiment Finally, a fifth embodiment of the present disclosure will be described with reference to Fig. 14. Note that descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate.

[0126] 5-1. Features of the fifth embodiment In the first and second embodiments, when there is an operator OPn already engaged in the second task SB2 for the vehicle VH_TRG_SB1, a process is performed to assign the first task SB1 for the vehicle VH_TRG_SB1 to this operator OPn. Therefore, when this process is performed, the second task SB2 for the vehicle VH_TRG_SB1 by the operator OPn ends, and instead the first task SB1 for the vehicle VH_TRG_SB1 starts.

[0127] With the transition of the series of service operations SB, the images output from the display DPn are switched. The problem here is that the images output from the display DPn in the second operation SB2 for the object of the series of service operations SB (i.e., the vehicle VH_SB) are expected to be different from those output from the display DPn in the first operation SB1 for the vehicle VH_SB.

[0128] Therefore, in the fifth embodiment, when a series of service jobs SB transition, the sensor conditions before and after switching of the image output from the display DPn are compared. Then, based on the difference between these sensor conditions, the image output from the display DPn is adjusted when the first job SB1 starts. By performing such processing, it is possible to realize a smooth transition of a series of service jobs SB.

[0129] 5-2. Remote service management device Fig. 14 is a block diagram showing a configuration example of a management server MS particularly related to the fifth embodiment. In the example shown in Fig. 14, the management server MS includes a processor 50 and a remote service DB 21. The processor 50 includes the first task assignment unit 15 shown in Fig. 5. In the example shown in Fig. 14, the first task assignment unit 15 includes a sensor condition setting unit 51, a sensor condition comparison unit 52, a sensor condition adjustment unit 53, and a task information generation unit 54. These functional units correspond to a configuration example particularly related to the fifth embodiment.

[0130] When the operator OP_SB1 is selected by the first task allocation unit 14 (see FIG. 5), the sensor condition setting unit 51 sets sensor conditions necessary for executing the first task SB1 for the vehicle VH_TRG_SB1. Examples of the sensor conditions include the number of sensors, the sensor orientation (a combination of a direction such as forward, backward, right, left, and a direction with a field angle such as 360 degrees, wide angle, narrow angle), the type of sensor (camera, LiDAR, etc.), and the sensor parameters (camera parameters such as brightness, contrast, and aperture, and a frame rate, etc.).

[0131] The sensor condition is set based on, for example, information on the task in the first task SB1 for the vehicle VH_TRG_SB1 and / or information on the gaze target in the first task SB1. For example, when the task in the first task SB1 is to determine whether the vehicle VH_TRG_SB1 can start, the sensor condition is set to output an image in front of the vehicle VH_TRG_SB1 (e.g., images of the center front, left front, and right front). In another example, when the task in the first task SB1 is to determine whether the vehicle VH_TRG_SB1 can turn right at an intersection, the sensor condition is set to output an image to the right (e.g., images of the right side and right rear) in addition to an image in front of the vehicle VH_TRG_SB1.

[0132] When the task in the first task SB1 is to determine whether the vehicle VH_TRG_SB1 can make a left turn at an intersection, and the target of attention is a two-wheeled vehicle approaching the vehicle VH_TRG_SB1 from the left rear of the vehicle VH_TRG_SB1, a sensor condition is set to output an image in front of the vehicle VH_TRG_SB1 (for example, images of the center front and left front).When the vehicle is a ride-sharing vehicle such as a bus, and the tasks in the first task SB1 are to determine whether the vehicle can depart after users of the ride-sharing service get on and off, and to check the safety of users at the boarding and alighting entrance, a sensor condition is set to output an image in front of the vehicle VH_TRG_SB1 (for example, images of the center front, left front and right front) and an image of the interior of the vehicle VH_TRG_SB1.

[0133] Consider a case where the total number of images that can be output from the display DPn is restricted due to reasons such as an upper limit on the communication bandwidth. In this case, the sensor conditions may be set in advance. For example, consider a case where the vehicle is a ride-sharing vehicle and the above-mentioned two types of tasks (determining whether to depart and checking the safety of the boarding and alighting entrance) are tasks in the first business SB1. In this case, the pre-set sensor conditions are assumed to be to output an image in front of the vehicle VH_TRG_SB1 (for example, an image of the center front) and an image of the interior of the vehicle VH_TRG_SB1.

[0134] Even if there is a restriction on the total number of images that can be output from the display DPn, the pre-set sensor conditions may be changed when the above-mentioned task and / or gaze target information is input to the sensor condition setting unit 51. For example, in the case where the above-mentioned vehicle is a ride-sharing vehicle, consider a case where a user who has missed the ride-sharing vehicle is about to open the boarding / alighting door on the side of the vehicle body. In this case, with the output of the start trigger TRG_SB1 that sets the gaze target as this user, the pre-set sensor conditions may be changed to sensor conditions that output an image in front of the vehicle VH_TRG_SB1 (for example, an image of the center front) and an image of the side of the vehicle VH_TRG_SB1.

[0135] It is not possible to accept all requests to change the pre-set sensor conditions. Therefore, when a request for change is received, it is desirable to determine to what extent the request for change should be accepted according to a certain criterion. Examples of such a criterion include the following: Criterion 1: Prioritize the image of the sensor that recognizes the image of the gaze target. Criterion 2: Accept images from sensors that match predefined sensor conditions Criterion 3: Accept the requested sensor condition rather than the predefined sensor condition. Criterion 4: Accept pre-defined sensor conditions over requested changes

[0136] The sensor condition comparison unit 52 compares the sensor conditions set by the sensor condition setting unit 51 with the current sensor conditions. The current sensor conditions are the sensor conditions in the second task SB2 for the vehicle VH_TRG_SB1, and include the number of sensors, the sensor orientation, the sensor type, the sensor parameters, etc., described above. In the fifth embodiment, information on the current sensor conditions is stored in the remote service DB 21.

[0137] The sensor condition comparison unit 52 extracts information on the current sensor condition from the remote service DB 21 by, for example, referring to the unique information of the operator OP_SB1 selected by the first task allocation unit 14. Then, the sensor condition comparison unit 52 transmits to the sensor condition adjustment unit 53 information on the difference between the extracted current sensor condition and the sensor condition set by the sensor condition setting unit 51.

[0138] The sensor condition adjustment unit 53 sets the sensor conditions for performing the first task SB1 for the vehicle VH_TRG_SB1 based on the difference information received from the sensor condition comparison unit 52. For example, consider a case where the second task SB2 for the vehicle VH_TRG_SB1 before the transition of the service task SB is the second task SB2 for only the vehicle VH_TRG_SB1. In this case, it is assumed that the sensor conditions of the number of sensors and the sensor orientation are the same as the sensor conditions set by the sensor condition setting unit 51. Therefore, adjustments are made to the sensor types and sensor parameters.

[0139] As another example, consider the case where the second task SB2 for the vehicle VH_TRG_SB1 before the transition of the service task SB is based on an image of an infrastructure sensor. In this case, all of the sensor conditions, such as the number of sensors, the sensor orientation, the sensor type, and the sensor parameters, are changed. In another example, the sensor conditions are changed to output an image of the surroundings of the vehicle VH_TRG_SB1 from the display DPn while continuing to output an image of the infrastructure sensor.

[0140] The task information generation unit 54 generates task information including the sensor conditions after adjustment by the sensor condition adjustment unit 53. This task information may include information for enabling operation of devices related to the traveling of the vehicle VH_TRG_SB1 (e.g., steering wheel, pedals, shift lever, blinker, etc.). The task information generation unit 54 transmits the generated task information to a terminal operated by the operator OP_SB1 selected by the first task allocation unit 14.

[0141] Effects According to the fifth embodiment described above, it is possible to realize a smooth transition of a series of service operations SB. In addition, since the sensor conditions are adjusted based on the information on the difference in the sensor conditions, it is possible to reduce the processing load on the management server MS (processor 50) associated with the transition of a series of service operations SB. [Explanation of symbols]

[0142] 10,20,30,40,50 processors 11 Status information acquisition unit 12 First trigger output determination section 13 Allocation method setting section 14 1st Business Allocation Division 15 First Business Granting Department 21 Remote Service DB 22 2nd Business Inquiry Department 31 Second trigger output section 32 Second trigger output judgment section 33 2nd Task Allocation Division 34 2nd Business Granting Department 41 Operator Selection Department 51 Sensor condition setting section 52 Sensor condition comparison section 53 Sensor condition adjustment section 54 Business information generation department DP1, DP2 displays MS Management Server OP1,OP2 Operator VH1, VH2 vehicles SB Service Business SB1 1st business SB2 2nd business TRG Start trigger

Claims

1. 1. A method for managing remote services for a mobile object, comprising: a step of allocating the service task to at least one operator among a plurality of operators engaged in the remote service when a start trigger for the service task for the remote service provision target is output; The service operation includes a first operation that affects the driving efficiency of the object to be provided and a second operation that does not affect the driving efficiency, The step of allocating a service task comprises: When a start trigger for the first task for the provision target is output, determining whether an operator already engaged in the second task for the provision target is included in the plurality of operators; When it is determined that an operator already engaged in the second task for the provision target is included in the plurality of operators, appointing the operator already engaged in the second task for the provision target to an operator in charge of the first task for the provision target; 23. A method for managing a remote service, comprising:

2. 2. The method of claim 1 , The second task includes a task of monitoring traffic flow based on images from an infrastructure sensor; The step of determining whether an operator already engaged in the second task for the provision target is included in the plurality of operators includes a step of determining whether an operator already engaged in a monitoring task of an image of the infrastructure sensor including an image of the provision target is included in the plurality of operators.

23. A method for managing a remote service comprising:

3. 3. The method according to claim 1 or 2, When an operator who has already been engaged in the second task for the provision target is appointed as an operator in charge of the first task for the provision target, a step of determining whether or not the second task for a provision target other than the provision target was included in the second task in which the operator was engaged immediately before the appointment; outputting a start trigger for the second operation for the different provision target when it is determined that the second operation for the different provision target is included; 4. The method of claim 3, further comprising:

4. 3. The method according to claim 1 or 2, The step of allocating a service task comprises: When it is determined that an operator already engaged in the second task for the provision target is included in the plurality of operators, before allocating the operator already engaged in the second task for the provision target to an operator in charge of the first task for the provision target, determining whether or not a total number of operators already engaged in the second task for the provision target is two or more; When it is determined that the total number of operators is two or more, selecting an operator to be in charge of the first task for the provision target from among the two or more operators who have already been engaged in the second task for the provision target; Further includes 23. A method for managing a remote service comprising:

5. 3. The method according to claim 1 or 2, A method for managing remote services, further comprising a step of changing, when an operator who was already engaged in the second task for the object to be provided is appointed as an operator in charge of the first task for the object to be provided, the output conditions of information output from a display monitored by the operator to output conditions for engaging in the first task for the object to be provided.

6. An apparatus for managing remote services for a mobile object, comprising: a processor for managing the remote service; The processor, When a start trigger for a service operation for a target of the remote service is output, a process of allocating the service operation to at least one operator among a plurality of operators engaged in the remote service is performed; The service operation includes a first operation that affects the driving efficiency of the object to be provided and a second operation that does not affect the driving efficiency, In the process of allocating the service task, the processor a process of determining whether an operator already engaged in the second task for the provision target is included in the plurality of operators when a start trigger for the first task for the provision target is output; When it is determined that an operator already engaged in the second task for the provision target is included in the plurality of operators, a process of appointing the operator already engaged in the second task for the provision target to an operator in charge of the first task for the provision target; A remote service management device configured to perform the above.

7. 7. The apparatus of claim 6, The second task includes a task of monitoring traffic flow based on images from an infrastructure sensor; In the process of determining whether an operator already engaged in the second task for the provision target is included in the plurality of operators, the processor and determining whether an operator already engaged in monitoring an image of the infrastructure sensor including the image to be provided is included in the plurality of operators. A remote service management device comprising:

8. 8. An apparatus according to claim 6 or 7, comprising: The processor further comprises: When an operator who has already been engaged in the second task for the provision target is appointed as an operator in charge of the first task for the provision target, a process of determining whether or not the second task for a provision target other than the provision target was included in the second task in which the operator was engaged immediately before the appointment; When it is determined that the second operation for a provision target other than the provision target is included, a process of outputting a start trigger for the second operation for the other provision target; A remote service management device configured to perform the above.

9. 8. An apparatus according to claim 6 or 7, comprising: In the process of allocating the service task, the processor further When it is determined that an operator already engaged in the second task for the provision target is included in the plurality of operators, a process of determining whether or not a total number of operators already engaged in the second task for the provision target is two or more before allocating the operator already engaged in the second task for the provision target to an operator in charge of the first task for the provision target; When it is determined that the total number of operators is two or more, a process of selecting an operator to be in charge of the first task for the provision target from among the two or more operators who have already been engaged in the second task for the provision target; A remote service management device configured to perform the above.

10. 8. An apparatus according to claim 6 or 7, comprising: The processor further comprises: A remote service management device characterized in that, when an operator who is already engaged in the second task for the object of service is appointed as an operator in charge of the first task for the object of service, the device is configured to perform a process of changing the output conditions of information output from the display monitored by the operator to output conditions for engaging in the first task for the object of service.

Images