Information processing method, information processing device, and program

Abstract

To provide an information processing method capable of dealing with dirt or damage inside a moving object at the right time.SOLUTION: In an information processing method, a computer performs the steps of: acquiring a sensing result of the inside of a mobile object 300; executing a series of recognition processing to recognize at least one of the internal dirt and damage inside the mobile object 300 based on the sensing result; determining processing timing to deal with at least one of the internal dirt and damage of the mobile object 300 according to the results of recognition processing; and outputting a notification for moving the mobile object to the processing area according to the processing timing.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to an information processing method for information relating to a moving object. [Background technology]

[0002] Conventionally, a technique for managing the operation of a mobile object is known (Patent Document 1).

[0003] Also, a technique has been disclosed relating to a moving body equipped with a robot that automatically cleans the inside of the moving body (Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-54537 A [Patent Document 2] JP 2002-166379 A Summary of the Invention [Problem to be solved by the invention]

[0005] When managing the operation of a moving body, if there is any dirt or damage inside the moving body, it is desirable to deal with the dirt or damage in a timely manner.

[0006] Therefore, an object of the present disclosure is to provide an information processing method, an information processing device, and a program that can deal with stains or damage to the inside of a moving object at an appropriate time. [Means for solving the problem]

[0007] An information processing method according to one embodiment of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, executing a recognition process to recognize at least one of the recognized degrees of dirt and damage to the interior of the moving body based on the sensing results, determining a timing to deal with the recognized at least one of the recognized dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of at least one of the recognized dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputting a notification to move the moving body to a treatment site in accordance with the timing to deal with the recognized dirt and damage, further changing the threshold according to (i) the recognized type of dirt or damage to the interior of the moving body, or (ii) the cost of dealing with the recognized dirt or damage to the interior of the moving body included in the result of the recognition process, and determining the timing to deal with the recognized dirt or damage to be earlier than a predetermined timing when the comparison result indicates that the recognized degree of at least one of the recognized dirt and damage to the interior of the moving body exceeds the changed threshold.

[0008] In addition, an information processing method according to one embodiment of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, executing a recognition process to recognize at least one of dirt and damage to the interior of the moving body based on the sensing results, determining a timing to deal with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputting a notification to move the moving body to a treatment site in accordance with the timing to deal with the recognition, wherein the execution recognizes at least one of the dirt and damage at each of a plurality of locations inside the moving body, and the determination determines the timing to deal with the recognition to be earlier than a predetermined timing when the number of locations corresponding to the recognized degrees exceeding the threshold at each of the plurality of locations included in the result of the recognition process is equal to or greater than a predetermined number.

[0009] In addition, an information processing method according to one embodiment of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, performing a recognition process to recognize at least one of the dirt and damage to the interior of the moving body based on the sensing results, determining a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the degree of the recognized at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputting a notification to move the moving body to a treatment site in accordance with the timing for dealing with the recognition, and the information processing method further changes the threshold according to a time period.

[0010] In addition, an information processing method according to one embodiment of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, performing a recognition process to recognize at least one of the dirt and damage to the interior of the moving body based on the sensing results, determining a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the degree of the recognized at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputting a notification to move the moving body to a treatment site in accordance with the timing for dealing with the recognition, and the information processing method further changes the threshold according to the demand situation of the moving body.

[0011] In addition, an information processing method according to one embodiment of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, performing a recognition process to recognize at least one of the dirt and damage inside the moving body based on the sensing results, determining a timing to deal with the recognized at least one of the dirt and damage inside the moving body based on a comparison result of comparing the recognized degree of at least one of the dirt and damage inside the moving body included in the result of the recognition process with a threshold, and outputting a notification to move the moving body to a treatment site in accordance with the timing to deal with the response, the timing to deal with the response being a cleaning timing for cleaning the moving body, and the cleaning timing is determined according to whether the type of dirt inside the moving body recognized included in the result of the recognition process is dirt that worsens over time.

[0012] In addition, an information processing method according to one embodiment of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, performing a recognition process to recognize at least one of dirt and damage to the interior of the moving body based on the sensing results, determining a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the degree of the recognized at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputting a notification to move the moving body to a treatment site in accordance with the timing for dealing with the dirt or damage to the interior of the moving body, and the determination of the timing for dealing with the dirt or damage to the interior of the moving body is further based on the characteristics of passengers who are scheduled to board the vehicle regarding the dirt or damage to the interior of the moving body.

[0013] An information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body; a recognition processing execution unit that executes a recognition processing to recognize at least one of the recognized degrees of dirt and damage to the interior of the moving body based on the sensing results; and a response timing determination unit that determines a response timing for addressing at least one of the recognized dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of at least one of the recognized dirt and damage to the interior of the moving body included in the recognition processing with a threshold, and outputs a notification to move the moving body to a response site in accordance with the response timing, wherein the response timing determination unit further changes the threshold according to (i) the recognized type of dirt or damage to the interior of the moving body, or (ii) the cost of addressing the recognized dirt or damage to the interior of the moving body included in the result of the recognition processing, and the response timing determination unit determines the response timing to be earlier than a predetermined timing when the comparison result indicates that the recognized degree of at least one of the recognized degrees of dirt and damage to the interior of the moving body exceeds the changed threshold.

[0014] In addition, an information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body, a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving body based on the sensing results, and a response timing determination unit that determines a response timing for dealing with the recognized at least one of the dirt and damage inside the moving body based on a comparison result of comparing the recognized degree of at least one of the dirt and damage inside the moving body included in the recognition processing with a threshold, and outputs a notification to move the moving body to a response site in accordance with the response timing, wherein the recognition processing execution unit recognizes at least one of the dirt and damage at each of a plurality of locations inside the moving body, and the response timing determination unit determines the response timing to be earlier than a predetermined timing when the number of locations corresponding to the recognized degrees exceeding the threshold at each of the plurality of locations included in the recognition processing result is equal to or greater than a predetermined number.

[0015] In addition, an information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body, a recognition processing execution unit that executes a recognition processing to recognize at least one of the recognized dirt and damage to the interior of the moving body based on the sensing results, and a response timing determination unit that determines a response timing for responding to the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of the at least one of the dirt and damage to the interior of the moving body included in the result of the recognition processing with a threshold, and outputs a notification to move the moving body to a response site in accordance with the response timing, and the response timing determination unit further changes the threshold according to a time period.

[0016] In addition, an information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body, a recognition processing execution unit that executes a recognition processing to recognize at least one of the recognized dirt and damage to the interior of the moving body based on the sensing results, and a response timing determination unit that determines a response timing for responding to the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of the at least one of the dirt and damage to the interior of the moving body included in the result of the recognition processing with a threshold, and outputs a notification to move the moving body to a response site in accordance with the response timing, and the response timing determination unit further changes the threshold according to the demand situation of the moving body.

[0017] In addition, an information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body, a recognition processing execution unit that executes a recognition processing to recognize at least one of the recognized dirt and damage inside the moving body based on the sensing results, and a response timing determination unit that determines a response timing for addressing the recognized at least one of the dirt and damage inside the moving body based on a comparison result of comparing the recognized degree of at least one of the dirt and damage inside the moving body included in the result of the recognition processing with a threshold value, and outputs a notification to move the moving body to a response site in accordance with the response timing, wherein the response timing is a cleaning timing for cleaning the moving body, and the response timing determination unit determines the cleaning timing according to whether the type of recognized dirt inside the moving body included in the result of the recognition processing is dirt that worsens over time.

[0018] In addition, an information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body, a recognition processing execution unit that executes a recognition processing to recognize at least one of the dirt and damage inside the moving body based on the sensing results, and a response timing determination unit that determines a response timing for dealing with the recognized at least one of the dirt and damage inside the moving body based on a comparison result of comparing the recognized degree of the at least one of the dirt and damage inside the moving body included in the recognition processing with a threshold value, and outputs a notification to move the moving body to a response site in accordance with the response timing, and the response timing determination unit further determines the response timing according to the characteristics of passengers who are scheduled to board the vehicle regarding the dirt or damage inside the moving body.

[0019] A program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, in which the computer acquires sensing results for the interior of a moving body, executes a recognition process to recognize at least one of the recognized degrees of dirt and damage to the interior of the moving body based on the sensing results, determines a timing for dealing with the recognized at least one of the recognized dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of at least one of the recognized dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputs a notification for moving the moving body to a treatment site in accordance with the timing for dealing with the recognized dirt and damage to the interior of the moving body, in which the determination further changes the threshold according to (i) the recognized type of dirt or damage to the interior of the moving body, or (ii) the cost of dealing with the recognized dirt or damage to the interior of the moving body included in the result of the recognition process, and in which the determination determines the timing for dealing with the recognized dirt or damage to the interior of the moving body to be earlier than a predetermined timing when the comparison result indicates that the recognized degree of at least one of the recognized dirt and damage to the interior of the moving body exceeds the changed threshold.

[0020] Furthermore, a program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, the first process being a process in which the computer acquires sensing results for the interior of a moving body, executes a recognition process to recognize at least one of the recognized degrees of dirt and damage to the interior of the moving body based on the sensing results, determines a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputs a notification to move the moving body to a treatment site in accordance with the timing for dealing with the recognized degree of dirt and damage, the execution recognizing at least one of the dirt and damage at each of a plurality of locations inside the moving body, and the determination determining the timing for dealing with the reaction to be earlier than a predetermined timing when the number of locations corresponding to a degree exceeding the threshold among the recognized degrees at each of the plurality of locations included in the result of the recognition process is equal to or greater than a predetermined number.

[0021] Furthermore, a program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, in which the computer acquires sensing results for the interior of a moving body, executes a recognition process for recognizing at least one of the dirt and damage to the interior of the moving body based on the sensing results, determines a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of the at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputs a notification to move the moving body to a treatment site in accordance with the timing for dealing with the recognition, and the first process further changes the threshold according to a time period.

[0022] Furthermore, a program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, in which the computer acquires sensing results for the interior of a moving body, executes a recognition process for recognizing at least one of the dirt and damage to the interior of the moving body based on the sensing results, determines a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the recognized degree of the at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputs a notification to move the moving body to a treatment site in accordance with the timing for dealing with the recognition, and the first process further changes the threshold according to the demand situation of the moving body.

[0023] Moreover, a program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, the first process being a process in which the computer acquires sensing results for the interior of a moving body, executes a recognition process for recognizing at least one of the dirt and damage inside the moving body based on the sensing results, determines a timing for dealing with the recognized at least one of the dirt and damage inside the moving body based on a comparison result of comparing the recognized degree of at least one of the dirt and damage inside the moving body included in the result of the recognition process with a threshold, and outputs a notification for moving the moving body to a treatment site in accordance with the timing for dealing with the recognized at least one of the dirt and damage inside the moving body, wherein the timing for dealing with the cleaning is a timing for cleaning the moving body, and the determination determines the cleaning timing based on whether the type of dirt inside the moving body recognized included in the result of the recognition process is dirt that worsens over time.

[0024] Furthermore, a program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, in which the computer acquires sensing results for the interior of a moving body, executes a recognition process for recognizing at least one of the dirt and damage to the interior of the moving body based on the sensing results, determines a timing for dealing with the recognized at least one of the dirt and damage to the interior of the moving body based on a comparison result of comparing the degree of the recognized at least one of the dirt and damage to the interior of the moving body included in the result of the recognition process with a threshold, and outputs a notification for moving the moving body to a treatment site in accordance with the timing for dealing with the recognition, and the determination further determines the timing for dealing with the dirt or damage to the interior of the moving body based on the characteristics of passengers who are scheduled to board the vehicle regarding the dirt or damage to the interior of the moving body. Effect of the Invention

[0025] According to an information processing method, an information processing device, and a program according to an aspect of the present disclosure, dirt or damage to the inside of a moving object can be dealt with at an appropriate time. [Brief description of the drawings]

[0026] [Figure 1] FIG. 1 is a block diagram showing a configuration of an information processing system according to an embodiment. [Figure 2A] FIG. 2A is a schematic diagram showing an example of the interior of a moving object according to an embodiment. [Figure 2B] FIG. 2B is a schematic diagram illustrating an example of the interior of the moving body according to the embodiment. [Figure 2C] FIG. 2C is a schematic diagram illustrating an example of the interior of the moving object according to the embodiment. [Diagram 3] FIG. 3 is a schematic diagram illustrating an example of a table stored in the recognition process execution unit according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an example of a specific example of the proportion of the range of soiling or damage in a predetermined area inside a moving object according to an embodiment. [Diagram 5]FIG. 5 is a sequence diagram of the first moving object control process according to the embodiment. [Figure 6] FIG. 6 is a flowchart of the first handling timing decision process according to the embodiment. [Figure 7] FIG. 7 is a sequence diagram of a response timing setting input process according to the embodiment. [Figure 8] FIG. 8 is a sequence diagram of the second moving object control process according to the embodiment. [Figure 9] FIG. 9 is a sequence diagram of a third moving object control process according to another embodiment. [Figure 10] FIG. 10 is a flowchart of a second handling timing decision process according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] (How one aspect of the present invention was achieved) In general, in an autonomous mobile body, since there is no driver, the state of dirt or damage inside the mobile body tends to be less noticeable than in a mobile body with a driver. For this reason, when an autonomous mobile body is provided to a user, it is difficult to deal with dirt or damage inside the mobile body at an appropriate time. For example, if the mobile body is operated to frequently deal with dirt or damage inside the mobile body, the frequency with which the user feels uncomfortable can be reduced, but the utilization efficiency of the mobile body will decrease. Conversely, for example, if the mobile body is operated not frequently dealt with dirt or damage inside the mobile body, the frequency with which the user feels uncomfortable can be reduced, but the utilization efficiency of the mobile body will increase.

[0028] In view of such problems, the inventors have conducted extensive research and repeated experiments, and as a result, have come up with an information processing method, an information processing device, and a program according to an embodiment of the present disclosure, which are capable of dealing with stains or damage to the inside of a moving object at an appropriate time.

[0029] An information processing method according to one aspect of the present disclosure includes a computer acquiring sensing results for the interior of a moving body, performing a recognition process to recognize at least one of dirt and damage to the interior of the moving body based on the sensing results, determining an action timing for dealing with the at least one of the dirt and damage to the interior of the moving body according to the result of the recognition process, and outputting a notification to move the moving body to a treatment site according to the action timing.

[0030] According to the above information processing method, the timing of countermeasures for countering at least one of the dirt and damage inside the mobile body is determined from the sensing result of the inside of the mobile body, and a notification for moving the mobile body to a countermeasure site is output according to the determined countermeasure timing. Therefore, the dirt or damage inside the mobile body can be countered at an appropriate timing. In other words, the dirt or damage can be efficiently countered, and the utilization efficiency of the mobile body can be improved.

[0031] The timing of the countermeasure may be the time when the recognition process is executed. This allows for prompt countermeasures to be taken when at least one of the internal stains and damage of the moving object is recognized.

[0032] The timing to take action may be a time point a predetermined time after the time point at which the recognition process is executed, and the predetermined time may be determined according to the result of the recognition process, thereby making it possible to determine the timing to take action according to the recognition result of the stain or damage inside the moving body.

[0033] Furthermore, the notification may be output when the moving object has no passengers or cargo after the arrival of the timing to respond, thereby making it possible to prevent the moving object from being moved to a response site while the moving object is transporting passengers or cargo.

[0034] The timing of the countermeasure may be determined according to the degree of dirt or damage inside the moving body recognized as a result of the recognition process. In this way, the timing of the countermeasure can be determined according to the degree of dirt or damage inside the moving body.

[0035] The timing of the countermeasure may be determined according to the type of the stain or damage inside the moving body recognized as a result of the recognition process. In this way, the timing of the countermeasure can be determined according to the type of the stain or damage inside the moving body.

[0036] The timing of the countermeasure may be determined according to the cost of countermeasures against the stain or damage inside the moving body recognized as a result of the recognition process. In this way, the countermeasure timing can be determined according to the cost of countermeasures against the stain or damage inside the moving body.

[0037] The countermeasure timing may be a timing for cleaning the moving body, and the cleaning timing may be determined according to whether the type of the dirt inside the moving body recognized as a result of the recognition process is dirt that worsens over time. This makes it possible to determine the cleaning timing depending on whether the dirt inside the moving body is dirt that worsens over time.

[0038] In addition, the result of the recognition process may be displayed, a screen for inputting a response timing setting may be displayed, the input response timing setting may be stored, and the stored response timing setting may be used to determine the response timing. In this way, the response timing can be determined based on the response timing setting set by a user who uses the information processing method.

[0039] The notification may be a request for the mobile object to move, whereby the mobile object can be moved to a treatment site according to a treatment timing.

[0040] The notification may be a recommendation to an owner or manager of the mobile body to take measures inside the mobile body, so that the owner or manager of the mobile body can know the recommendation to take measures inside the mobile body.

[0041] Furthermore, the timing of the countermeasure may be determined according to the characteristics of the passengers who are planning to board the vehicle with respect to stains or damages to the inside of the vehicle. In this way, the timing of the countermeasure can be determined according to the passengers who are planning to board the vehicle.

[0042] Also, information indicating whether a device provided in the moving body for taking measures against the stain or damage inside the moving body has been operated may be acquired, and the timing of the action may be determined according to whether the device has been operated. In this way, the timing of the action can be determined according to whether the action against the stain or damage inside the moving body has been taken.

[0043] An information processing device according to one embodiment of the present disclosure includes an acquisition unit that acquires sensing results for the interior of a moving body, a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage to the interior of the moving body based on the sensing results, and a response timing determination unit that determines a response timing for addressing at least one of the dirt and damage to the interior of the moving body according to a result of the recognition processing, and outputs a notification to move the moving body to a response site according to the response timing.

[0044] According to the information processing device, the timing of action to take against at least one of the dirt and damage inside the mobile body is determined from the sensing result of the inside of the mobile body, and a notification for moving the mobile body to a treatment site is output according to the determined timing of action. Therefore, the dirt or damage inside the mobile body can be dealt with at an appropriate timing.

[0045] A program according to one embodiment of the present disclosure is a program for causing a computer to execute a first process, the first process being a process in which the computer acquires sensing results for the interior of a moving body, executes a recognition process to recognize at least one of dirt and damage to the interior of the moving body based on the sensing results, determines an action timing for dealing with the at least one of the dirt and damage to the interior of the moving body according to the result of the recognition process, and outputs a notification to move the moving body to a treatment site according to the action timing.

[0046] According to the program, the timing for dealing with at least one of the dirt and damage inside the mobile body is determined from the sensing result of the inside of the mobile body, and a notification for moving the mobile body to a treatment site is output according to the determined timing for dealing with the dirt or damage inside the mobile body. Therefore, the dirt or damage inside the mobile body can be dealt with at an appropriate time.

[0047] Hereinafter, specific examples of an information processing method, an information processing device, and a program according to one aspect of the present disclosure will be described with reference to the drawings. Each of the embodiments shown here shows one specific example of the present disclosure. Therefore, the numerical values, shapes, components, arrangement and connection of the components, steps (processes), and order of steps shown in the following embodiments are merely examples and do not limit the present disclosure. In addition, each figure is a schematic diagram and is not necessarily a precise illustration.

[0048] In addition, a comprehensive or specific aspect of the present disclosure may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a system, a method, an integrated circuit, a computer program, and a recording medium.

[0049] (Embodiment) An information processing system according to an embodiment will be described below. This information processing system is a system for managing the operation of a vehicle that transports passengers or cargo.

[0050] Here, as an example, the mobile body is described as an autonomous vehicle used in a ride-sharing service, but the mobile body does not necessarily have to be limited to an autonomous vehicle used in a ride-sharing service as long as it is a mobile body capable of transporting passengers or cargo. In addition, it does not matter whether the mobile body has a driver or a seat.

[0051] [1. Information processing system configuration] FIG. 1 is a block diagram showing a configuration of an information processing system 1 according to an embodiment.

[0052] As shown in FIG. 1, the information processing system 1 includes a mobile object control server 100, a servicer server 200, and one or more mobile objects 300.

[0053] The moving body 300 is an autonomous vehicle used in a ride-sharing service, and transports passengers or cargo. In Fig. 1, the moving body 300 is illustrated as if it were one unit, but the number of moving bodies 300 is not necessarily limited to one unit, and may be multiple units.

[0054] The moving body 300 includes a control unit 30, a sensing unit 31, a steering unit 32, and a communication unit 33. The moving body 300 may further include, for example, a device that takes measures against stains or damage to the inside of the moving body 300. For example, the measures include cleaning or repair, and the device that takes measures includes a dust collector, a self-propelled vacuum cleaner, a sterilization device, a deodorization device, a repair device, etc.

[0055] The sensing unit 31 senses the inside of the moving body 300 and outputs sensing information indicating the sensing result. The sensing unit 31 may include, for example, an imaging device such as a digital video camera or a digital still camera, capture an image of a seat inside the moving body 300, and output the captured image as sensing information. The sensing unit 31 may also include, for example, an odor sensor, sense an odor in the internal space of the moving body 300, and output information indicating the sensed odor as sensing information. The sensing unit 31 may also include, for example, an infrared sensor, measure the surface temperature of a seat inside the moving body 300, and output the measured surface temperature as sensing information. The sensing unit 31 may also include, for example, a sound collecting microphone, collect sound inside the moving body 300, and output the collected sound as sensing information.

[0056] The control unit 32 controls the moving body 300. The control unit 32 may be realized, for example, by dedicated hardware, or may be realized, for example, by including a processor and a memory and having the processor execute a program stored in the memory.

[0057] The communication unit 33 communicates with other devices that can communicate with it. The other devices include the mobile control server 100. The communication unit 33 may be provided with, for example, a wireless communication device and communicate with other devices wirelessly.

[0058] The control unit 30 controls the sensing unit 31, the control unit 32, and the communication unit 33. The control unit 30 may be realized, for example, by dedicated hardware, or may be realized, for example, by including a processor and a memory and having the processor execute a program stored in the memory.

[0059] The mobile object control server 100 is a server used by a control company that controls the mobile object 300 .

[0060] The mobile object control server 100 includes a control unit 10, a display unit 11, an operation unit 12, a communication unit 13, a mobile object management unit 14, a mobile object management DB 15, an acquisition unit 40, a recognition process execution unit 50, a response timing determination unit 60, a response timing setting unit 70, and a response timing setting DB 80. The mobile object control server 100 may be, for example, a computer including a processor and a memory, and realize various functions by the processor executing a program stored in the memory.

[0061] The communication unit 13 communicates with other devices that can communicate with it. The other devices include the mobile object 300 and the servicer server 200. The communication unit 13 may include, for example, a wireless communication device and communicate with the other devices wirelessly.

[0062] The display unit 11 displays images to a user who uses the mobile object control server 100. The display unit 11 may include a display device such as a liquid crystal display, and may display images on the display device.

[0063] The operation unit 12 accepts operations from a user who uses the mobile object control server 100. The operation unit 12 may include input devices such as a keyboard, a mouse, a touch panel, etc., and may accept operations performed by the user using the input devices.

[0064] The mobile object management DB 15 is a database that stores information on the state of interior dirt or damage of the mobile object 300 .

[0065] The mobile entity management unit 14 manages the information stored in the mobile entity management DB 15 .

[0066] The countermeasure timing setting DB80 is a database that stores information related to the setting of the timing to take measures against the stain or damage inside the moving body 300 (hereinafter, also referred to as "countermeasure timing setting"). The countermeasure timing setting DB80 may store, as the countermeasure timing setting, information indicating the time to clean the inside of the moving body 300 or information indicating the cycle to clean the inside of the moving body 300. For example, the information indicating the time to clean may be information indicating "clean at 12:00 and 24:00 every day", and the information indicating the cycle to clean may be information indicating "clean every 4 hours after the start of the service". The countermeasure timing setting DB80 may store, for example, different countermeasure timing settings for busy seasons and off-seasons. In this case, the countermeasure timing setting DB80 may further store information indicating the busy season. For example, the information indicating the busy season may be information indicating the time and location of an event such as a soccer game, a baseball game, or a concert. The countermeasure timing setting DB80 may also store different countermeasure timing settings according to weather conditions. For example, the weather conditions may be rainy, sunny, extremely hot, extremely cold, etc. In this case, the response timing setting DB 80 may further store information indicating the weather information.

[0067] The response timing setting unit 70 manages the information stored in the response timing setting DB 80 .

[0068] The acquisition unit 40 acquires a sensing result for the inside of the moving body 300. More specifically, the acquisition unit 40 acquires sensing information output from the sensing unit 31 of the moving body 300 as a sensing result for the inside of the moving body 300. That is, the acquisition unit 40 acquires the sensing information transmitted from the communication unit 33 of the moving body 300 and received by the communication unit 13 of the mobile body control server 100.

[0069] The recognition process execution unit 50 executes recognition process to recognize at least one of dirt and damage inside the moving body 300 based on the sensing result of the inside of the moving body 300 acquired by the acquisition unit 40 .

[0070] For example, when the sensing information is an image of the inside of the moving body 300, the recognition process execution unit 50 may perform image processing on the image to detect the dirt or damage inside the moving body 300. In this case, the recognition process execution unit 50 may detect the dirt or damage inside the moving body 300 by detecting the difference between the images before and after the passenger gets on the vehicle and performing image recognition processing on the detected difference. In this case, the recognition process execution unit 50 may, for example, perform image recognition processing on the image to identify the passenger's behavior while on the vehicle and calculate the type of dirt or damage inside the moving body 300 based on the identified behavior. For example, when the recognition process execution unit 50 identifies that the passenger has been eating snacks, it may calculate that the dirt or damage inside the moving body 300 is spilled snacks. For example, when the recognition process execution unit 50 identifies that the passenger has been drinking a drink, it may calculate that the dirt or damage inside the moving body 300 is spilled drink. Also, for example, when the recognition process executing unit 50 determines that the passenger was blowing his nose, it may calculate that the stain inside the moving object 300 is a tissue.

[0071] Figure 2A is a schematic diagram showing an example of the appearance of the inside of moving body 300 when the type of internal stain or damage of moving body 300 is "spilled sweets", Figure 2B is a schematic diagram showing an example of the appearance of the inside of moving body 300 when the type of internal stain or damage of moving body 300 is "spilled drinks", and Figure 2C is a schematic diagram showing an example of the appearance of the inside of moving body 300 when the type of internal stain or damage of moving body 300 is "plastic bottle".

[0072] For example, when the sensing information is information indicating an odor in the internal space of the moving object 300, the recognition process executing section 50 may detect the pollution of the air inside the moving object 300 based on the information indicating the odor.

[0073] For example, when the sensing information is the surface temperature inside the moving object 300, the recognition process executing unit 50 may detect wetness inside the moving object 300 based on the surface temperature inside the moving object 300. For example, wetness of a sheet may be detected.

[0074] The recognition processing execution unit 50 may, for example, calculate the degree of dirt or damage to the inside of the moving object 300 in the recognition processing.

[0075] The recognition process execution unit 50 may, for example, identify the number of pieces of dirt or damage inside the moving body 300, and calculate the degree of dirt or damage based on the identified number of pieces of dirt or damage. In this case, the recognition process execution unit 50 may, for example, calculate the degree of dirt or damage as "small" when the number of pieces of dirt or damage is relatively small, calculate the degree of dirt or damage as "medium" when the number of pieces of dirt or damage is relatively medium, and calculate the degree of dirt or damage as "large" when the number of pieces of dirt or damage is relatively large. For example, the recognition process execution unit 50 may calculate the degree of dirt or damage as "small" when the number of pieces of dirt or damage is three or less, calculate the degree of dirt or damage as "medium" when the number of pieces of dirt or damage is four or more and six or less, and calculate the degree of dirt or damage as "large" when the number of pieces of dirt or damage is seven or more. Here, the number of pieces of dirt or damage may be the number of pieces of dirt or damage throughout the entire interior of the moving body 300, the number of pieces of dirt or damage at a specific location within the interior of the moving body 300, or the number of pieces of dirt or damage per unit area (i.e., the density).

[0076] The recognition process execution unit 50 may, for example, determine the time that has elapsed since the inside of the moving body 300 was soiled or damaged, and calculate the degree of the soiling or damage based on the determined elapsed time. For example, if the soiling or damage to the inside of the moving body 300 is due to a spilled drink, the longer the time that has elapsed since the drink was spilled, the greater the time or cost for cleaning the spilled drink. For this reason, the recognition process execution unit 50 may, for example, calculate that the greater the degree of soiling or damage, the longer the time that has elapsed since the inside of the moving body 300 was soiled or damaged. The recognition processing execution unit 50 may, for example, calculate the degree of soiling or damage to be "small" if less than one hour has elapsed since the interior of the moving body 300 was soiled or damaged, calculate the degree of soiling or damage to be "medium" if the time that has elapsed since the interior of the moving body 300 was soiled or damaged is one hour or more but less than three hours, and calculate the degree of soiling or damage to be "large" if three hours or more have elapsed since the interior of the moving body 300 was soiled or damaged.

[0077] The recognition process execution unit 50 may, for example, identify the type of soiling or damage inside the moving body 300, and calculate the degree of soiling or damage based on the number of the identified types of soiling or damage. In this case, the recognition process execution unit 50 may, for example, calculate the degree of soiling or damage to be "small" when the number of types of soiling or damage is one, calculate the degree of soiling or damage to be "medium" when the number of types of soiling or damage is two, and calculate the degree of soiling or damage to be "large" when the number of types of soiling or damage is three.

[0078] The recognition process execution unit 50 may, for example, identify the type of dirt or damage inside the moving body 300, identify a countermeasure corresponding to the identified type of dirt or damage, and calculate the degree of dirt or damage based on the identified countermeasure. In this case, the recognition process execution unit 50 may, for example, calculate the degree of dirt or damage as "small" when the number of countermeasures is one, calculate the degree of dirt or damage as "medium" when the number of countermeasures is two, and calculate the degree of dirt or damage as "large" when the number of countermeasures is three. In this case, the recognition process execution unit 50 may, for example, store a table in which the type of dirt or damage is associated with the countermeasure, and identify the countermeasure corresponding to the identified type of dirt or damage by referring to the stored table.

[0079] FIG. 3 is a schematic diagram showing an example of a table stored in the recognition process execution unit 50. As shown in FIG.

[0080] The recognition processing execution unit 50 may, for example, identify the type of dirt or damage inside the moving body 300, identify the cost of dealing with the dirt or damage according to the identified type of dirt or damage, and calculate the degree of dirt or damage based on the identified cost of dealing. For example, the cost of dealing is the time or fee for dealing. In this case, the recognition processing execution unit 50 may, for example, calculate the degree of dirt or damage as "small" when the cost of dealing is less than 10 minutes, calculate the degree of dirt or damage as "medium" when the cost of dealing is 10 minutes or more but less than 1 hour, and calculate the degree of dirt or damage as "large" when the cost of dealing is 1 hour or more. In this case, the recognition processing execution unit 50 may, for example, store a table in which the type of dirt or damage is associated with the time or fee for dealing, and may specify the method of dealing from the type of dirt or damage specified by referring to the stored table. An example of the table to be stored may be the table illustrated in FIG. 3. The response time and response fee may be preset values, or may be values ​​calculated from past history, or may be values ​​obtained from an external company or the like.

[0081] The recognition processing execution unit 50 may, for example, identify the proportion of the range of the soiling or damage in a predetermined area inside the mobile body 300, and calculate the degree of the soiling or damage based on the identified proportion of the range of the soiling or damage. In this case, the recognition processing execution unit 50 may, for example, calculate the degree of the soiling or damage to be "small" when the proportion of the range of the soiling or damage is less than 10%, calculate the degree of the soiling or damage to be "medium" when the proportion of the range of the soiling or damage is 10% or more and less than 30%, and calculate the degree of the soiling or damage to be "large" when the proportion of the range of the soiling or damage is 30% or more.

[0082] FIG. 4 is a schematic diagram showing an example of a specific example of the proportion of the extent of the soiling or damage in a predetermined area inside the moving body 300. In FIG.

[0083] Here, the stains or damage may be concentrated in one location inside the moving body 300, or may be distributed over multiple locations. Therefore, the recognition process execution unit 50 may determine a usable range in a predetermined area inside the moving body 300 from the location of the stain or damage, and calculate the degree of staining according to the proportion of the determined usable range. As an example of the usable range in a predetermined area inside the moving body 300, for example, an area within a predetermined range from each location of the stain or damage may be set as an unusable area, and an area in the predetermined area other than the unusable area may be set as a usable range.

[0084] The recognition process execution unit 50 may calculate the degree of soiling or damage by combining the above-mentioned calculations of the degree of soiling or damage.

[0085] The recognition process execution unit 50 may calculate the degree of soiling or damage for each location inside the moving body 300, for example.

[0086] The recognition process executing unit 50 may calculate the overall degree of damage or breakage of the interior of the moving body 300 according to the degree of damage or breakage at each location inside the moving body 300, for example. The recognition process executing unit 50 may, for example, digitize the degree of damage or breakage at each location inside the moving body 300, and calculate the sum of these as the overall degree of damage or breakage of the interior of the moving body 300. The recognition process executing unit 50 may, for example, calculate the maximum value of the degree of damage or breakage at each location inside the moving body 300 as the overall degree of damage or breakage of the interior of the moving body 300. The recognition process executing unit 50 may, for example, digitize the degree of damage or breakage at each location inside the moving body 300, and calculate the maximum value of the sum of the values ​​for each part inside the moving body 300 as the overall degree of damage or breakage of the interior of the moving body 300. For example, the part in question is a seat, a floor, a window, etc. In addition, the recognition processing execution unit 50 may, for example, digitize the degree of damage or soiling at each location inside the moving body 300 and calculate the average of these as the degree of damage or soiling of the inside of the moving body 300 as a whole.

[0087] The recognition process execution unit 50 may detect, for example, stains or damage to the exterior of the moving body 300 based on information acquired by a device external to the moving body 300. For example, the information is an image captured by a surveillance camera installed in a hangar that stores the moving body 300, an image captured by an on-board camera of a moving body other than the moving body 300, or the like.

[0088] The response timing determination unit 60 determines response timing for dealing with at least one of the stains and damages inside the moving body 300, according to the result of the recognition process executed by the recognition process execution unit 50. Here, the response timing determination unit 60 may further determine the response timing using a response timing setting stored in the response timing setting DB 80.

[0089] The countermeasure timing determination unit 60 may determine the countermeasure timing according to the degree of the dirt or damage inside the moving body 300 recognized as a result of the recognition process by the recognition process execution unit 50, for example. The countermeasure timing determination unit 60 may determine the countermeasure timing so that the greater the degree of the dirt or damage inside the moving body 300, the earlier the countermeasure timing. For example, when the degree of the dirt or damage inside the moving body 300 exceeds a threshold, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the countermeasure timing is earlier than the preset countermeasure timing, and when the degree of the dirt or damage inside the moving body 300 does not exceed the threshold, the countermeasure timing is the same as the preset countermeasure timing. The preset countermeasure timing is the timing for taking measures against the dirt or damage inside the moving body 300, which is indicated by the countermeasure timing setting stored in the countermeasure timing setting DB80. This makes it possible to prevent the operating rate of the moving body 300 from being lowered more than necessary by taking measures even if the degree of the dirt or damage is small. In this case, if the stain or damage inside the moving body 300 is of a type that increases the time or cost of cleaning over time, the threshold value may be made smaller. For example, the stain is a spilled drink, and the damage is frayed fibers of a sheet. This can suppress the increase in the time or cost required to deal with the stain or damage. In addition, in this case, the action timing determination unit 60 may further change the value of the threshold value depending on the location of the stain or damage inside the moving body 300. For example, the location is a seat or a floor, and the seat is less susceptible to liquids such as drinks than a floor. This can make it possible to deal with the stain or damage less quickly when the stain or damage is of a type that increases the time or cost of cleaning over time, when the stain or damage is of a spilled drink, and the location is made of a material that does not absorb liquids such as drinks, than when the location is made of a material that absorbs liquids such as drinks.In addition, when the degree of damage or soiling at each location inside the moving body 300 is calculated as a result of the recognition process by the recognition process execution unit 50, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the timing is earlier than the preset countermeasure timing when the threshold is exceeded at at least one location. In addition, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the timing is earlier than the preset countermeasure timing when a predetermined number of locations exceed the threshold. This is because, when only some locations inside the moving body 300 are soiled or damaged, services can be provided without causing strong discomfort to passengers, and this can be utilized to reduce the number of times countermeasures against the soiling or damage. As a more specific example, when the location where the threshold is exceeded is a seat, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the timing is earlier than the preset countermeasure timing when the number of seats exceeding the threshold is two or more. Furthermore, the countermeasure timing determination unit 60 may determine a seat available for passengers based on the position of a seat whose degree of damage or stain exceeds a threshold, and when there is no available seat, determine the countermeasure timing so that the timing is earlier than the preset countermeasure timing. The countermeasure timing determination unit 60 may change the threshold value according to the current time period. In this case, the countermeasure timing determination unit 60 may set the threshold value lower in the off-season and set the threshold value higher in the busy season. This reduces the discomfort of passengers caused by the provision of a stained or damaged moving body 300 even in the off-season, and suppresses a decrease in the operating rate of the moving body 300 even in the busy season. The countermeasure timing determination unit 60 may determine the countermeasure timing so that the timing is after the end of the service if a service is being provided, even if the degree of damage or stain inside the moving body 300 exceeds the threshold. This prevents the countermeasure from being taken against the stain or stain during the service. Furthermore, the countermeasure timing determination unit 60 may determine the countermeasure content for damage or soiling depending on the time period.In this case, the countermeasure timing determination unit 60 may determine the countermeasure content so that, for example, in the off-season, the countermeasure content is limited to the countermeasure content that requires a relatively short time, and in the busy season, the countermeasure content is not limited. For example, the countermeasure content that requires a relatively short time is garbage removal and vacuuming. The countermeasure timing determination unit 60 may change the threshold value according to the demand situation of the mobile body 300. In this case, the countermeasure timing determination unit 60 may set the threshold value to be low when the demand situation is high, and set the threshold value to be high when the demand situation is low. For example, the high demand situation is rainy weather, extremely hot days, extremely cold days, and the time period when an event (concert, soccer, baseball, etc.) is held. The countermeasure timing determination unit 60 may determine the countermeasure timing so that, for example, the greater the degree of dirt or damage inside the mobile body 300, the shorter the time until the next countermeasure timing indicated by the preset countermeasure timing. Thereby, the greater the degree of dirt or damage, the earlier the countermeasure timing, and conversely, the smaller the degree of dirt or damage, the later the countermeasure timing. As a more specific example, the response timing determination unit 60 may determine the response timing so that, when the degree of dirt or damage is "small," the time until the next response timing is shortened by 15 minutes, when the degree of dirt or damage is "medium," the time until the next response timing is shortened by 30 minutes, and when the degree of dirt or damage is "large," the time until the next response timing is shortened by one hour. In this case, for example, when the time until the next response timing is two hours and the degree of dirt or damage is recognized as "medium" as a result of the recognition process by the recognition process execution unit 50, the response timing determination unit 60 determines the response timing to be one hour and 30 minutes later.

[0090] The countermeasure timing determination unit 60 may determine the countermeasure timing according to the type of dirt or damage inside the moving body 300 recognized as a result of the recognition process by the recognition process execution unit 50, for example. For example, when there are multiple types of dirt or damage inside the moving body 300, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the multiple types of dirt or damage can be dealt with at a countermeasure site that can deal with them. This can prevent the moving body 300 from having to be moved to another countermeasure site because all of the measures for the moving body 300 are not completed at one countermeasure site. In addition, when the countermeasure timing is the cleaning timing for cleaning the moving body 300, the countermeasure timing determination unit 60 may determine the cleaning timing according to whether the type of dirt inside the moving body 300 recognized as a result of the recognition process by the recognition process execution unit 50 is dirt that worsens over time. For example, dirt that worsens over time is spilled drinks, and damage that worsens over time is frayed fibers of a sheet, etc.

[0091] The countermeasure timing determination unit 60 may determine the countermeasure timing according to the countermeasure cost for countermeasures against the stain or damage inside the moving body 300 recognized as a result of the recognition process by the recognition process execution unit 50. In this way, for example, when the countermeasure cost is the countermeasure time, the period for temporarily suspending the service for the countermeasure is known, and therefore the countermeasure timing can be determined in accordance with the operation status of the entire service including other moving bodies 300. For example, when the countermeasure cost is the countermeasure time, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the countermeasure timing becomes earlier as the countermeasure time becomes longer when the current time is in the off-season. Also, the countermeasure timing determination unit 60 may determine the countermeasure timing so that the countermeasure timing becomes earlier as the countermeasure time becomes shorter when the current time is in the busy season.

[0092] The response timing determination unit 60 may determine the response timing depending on whether the internal dirt or damage of the moving body 300 recognized as a result of the recognition processing by the recognition processing execution unit 50 is specific dirt or damage.

[0093] For example, when the stain or damage is a specific stain or damage, the countermeasure timing determination unit 60 may determine the countermeasure timing to be earlier than a predetermined countermeasure timing. This allows prioritizing countermeasures to the stain or damage without taking in new passengers in the case of stain or damage that is likely to cause discomfort to passengers. In particular, when the specific stain or damage is vomit, for example, the countermeasure timing determination unit 60 may determine that the countermeasure timing is the time when the recognition process is executed. The fact that the stain or damage is vomit can be detected, for example, by an image of the interior of the moving body 300 and / or the smell of the interior space of the moving body 300.

[0094] When the countermeasure timing is the timing to clean the moving body 300, the countermeasure timing determination unit 60 may determine the cleaning timing to perform cleaning at least once in a preset cleaning period, or at least once before the number of rides with passengers reaches a preset number, or at least once before the total service time with passengers reaches a preset time, or at least once before the number of charging or refueling reaches a preset number, or at least once before the travel distance reaches a preset distance, or at least once before the travel time reaches a preset time. In this way, it is possible to deal with dirt or damage that is difficult to detect with a sensor. For example, dirt that is difficult to detect with a sensor is invisible dust, and dirt that is difficult to detect with a sensor is tears on the back of the seat outside the sensing range.

[0095] The countermeasure timing determination unit 60 may determine, for example, the timing to temporarily stop the service of the moving body 300 due to charging as the countermeasure timing. This can suppress a decrease in the availability rate of the moving body 300. In this case, the countermeasure timing determination unit 60 may search for a place where both the countermeasure for the stain or damage and the charging can be performed. Alternatively, in this case, the countermeasure timing determination unit 60 may output a signal to the charging station to dispatch a staff member to deal with the stain or damage. Alternatively, in this case, the countermeasure timing determination unit 60 may output a signal to the charging station to have a staff member to deal with the stain or damage board the charging station while moving toward the charging station. Here, as another example of a case where the service of the moving body 300 is temporarily stopped, a case where maintenance of the moving body 300 is performed, etc., may be considered.

[0096] In the case where there are a plurality of moving bodies 300, the countermeasure timing determination unit 60 may determine the countermeasure timing for one moving body 300 in accordance with a comparison between the degree of dirt or damage of the one moving body 300 and the degree of dirt or damage of the other moving bodies 300. This can reduce the possibility that the number of moving bodies 300 providing services will be insufficient due to the plurality of moving bodies 300 simultaneously dealing with dirt or damage. In this case, the countermeasure timing determination unit 60 may determine the countermeasure timing for each moving body 300 from the viewpoint of efficiently using the plurality of moving bodies 300. As a more specific example, the countermeasure timing determination unit 60 may determine the countermeasure timing for each moving body 300 such that the countermeasure timing for a moving body 300 having a greater degree of dirt or damage is earlier. As another more specific example, the response timing determination unit 60 may determine the response timing of each moving body 300 by giving priority to the moving body 300 that takes the shortest time to temporarily stop the service. For example, the moving body 300 that takes the shortest time to temporarily stop the service is the moving body 300 that is likely to require charging. As another more specific example, the response timing determination unit 60 may determine the response timing of each moving body 300 by giving priority to the moving body 300 that has other moving bodies 300 that can be arranged nearby. As another more specific example, the response timing determination unit 60 may determine the response timing of each moving body 300 by giving priority to the moving body 300 in an area with low demand based on the past history. As another more specific example, the response timing determination unit 60 may determine the response timing of each moving body 300 by giving priority to the moving body 300 that takes the shortest time to temporarily stop the service. Even if the degree of damage or stain on one moving body 300 is relatively greater than the degrees of damage or stain on other moving bodies 300, if the degree is not absolutely greater, the countermeasure timing decision unit 60 does not need to advance the countermeasure timing for the one moving body 300. This makes it possible to prevent the number of countermeasures for one moving body 300 from becoming more than necessary.The countermeasure timing determination unit 60 may determine the countermeasure timing according to the characteristics of the passengers who plan to board the vehicle with respect to soiling or damage to the inside of the vehicle 300, for example.

[0097] The countermeasure timing determination unit 60 may determine the countermeasure timing according to whether or not a device provided in the moving body 300 for taking measures against stains or damage to the inside of the moving body 300 has been operated.

[0098] When the response timing determination unit 60 determines the response timing, it outputs a notification to move the mobile body 300 to a response site according to the determined response timing. The response timing determination unit 60 may output, for example, a movement request to the mobile body 300 as the notification. The response timing determination unit 60 may also output, for example, a recommendation to the owner or manager of the mobile body 300 to deal with the inside of the mobile body 300 as the notification. The response timing determination unit 60 may also output the notification when there are no passengers or cargo in the mobile body 300 after the response timing arrives.

[0099] For example, when a mobile body 300 equipped with a sterilization device or a deodorization device finishes its service, the response timing determination unit 60 may output an instruction to the mobile body 300 to operate the sterilization device or the deodorization device to sterilize or deodorize the inside of the mobile body 300.

[0100] The control unit 10 controls the display unit 11, the operation unit 12, the communication unit 13, the mobile object management unit 14, the acquisition unit 40, the recognition process execution unit 50, the response timing determination unit 60, and the response timing setting unit .

[0101] The servicer server 200 is a server used by a service company that provides the mobile unit 300 .

[0102] The servicer server 200 includes a control unit 20, a display unit 21, an operation unit 22, a communication unit 23, and a handling timing setting UI generation unit 90. The servicer server 200 may be, for example, a computer including a processor and a memory, and realize various functions by the processor executing a program stored in the memory.

[0103] The communication unit 23 communicates with other devices that are communicable with the communication unit 23. The other devices include the mobile object control server 100. The communication unit 23 may include, for example, a wireless communication device and communicate with the other devices wirelessly.

[0104] The display unit 21 displays an image to a user who uses the servicer server 200. When the handling timing setting UI generating unit 90 generates a handling timing setting user interface described below, the display unit 21 displays the handling timing setting user interface. The display unit 21 may include a display device such as a liquid crystal display, and may display an image on the display device.

[0105] The operation unit 22 receives operations from a user who uses the servicer server 200. The operation unit 22 may include input devices such as a keyboard, a mouse, a touch panel, etc., and may receive operations performed by the user using the input devices.

[0106] The response timing setting UI generation unit 90 generates a response timing setting user interface that displays information that is useful when a user using the servicer server 200 inputs a response timing setting, or when a user using the servicer server 200 inputs a movement request to move the mobile body 300 to a response site where the internal dirt or damage of the mobile body 300 is addressed.

[0107] The countermeasure timing setting user interface may, for example, display the result of the recognition process by the recognition process execution unit 50, and may display a screen on which the user using the servicer server 200 inputs a countermeasure timing setting or a movement request. When the sensing information is an image of the inside of the mobile body 300, for example, the countermeasure timing setting user interface may display an image in which the dirt or damage inside the mobile body 300 can be visually confirmed. This allows the user using the servicer server 200 to check the state of the dirt or damage inside the mobile body 300 and input a countermeasure timing setting or a movement request. In this case, the countermeasure timing setting user interface may display not only the latest image, but also one or more images captured in the past. The countermeasure timing setting user interface may, for example, also display the location of a countermeasure site that can deal with the dirt or damage inside the mobile body 300, or an estimate of the movement time to the countermeasure site. The countermeasure timing setting user interface may, for example, also display information on the busy season and the off-season, and the current time. The countermeasure timing setting user interface may, for example, also display past cleaning history.

[0108] In the case where there are a plurality of mobile bodies 300, the countermeasure timing setting user interface may display, for example, sensing information of one mobile body 300 that is the target of the countermeasure timing setting or the movement request, as well as sensing information of the other mobile bodies 300. This allows a user using the servicer server 200 to input a countermeasure timing setting or a movement request for one mobile body 300 from the viewpoint of efficiently using the plurality of mobile bodies 300. Furthermore, in the case where there are a plurality of mobile bodies 300, the countermeasure timing setting user interface may also display, for example, the status of each mobile body 300. For example, the status may be in service, waiting, cleaning, charging, etc. In this way, a user using the servicer server 200 can input a countermeasure timing setting or a movement request for one mobile body 300 from the viewpoint of efficiently using the plurality of mobile bodies 300.

[0109] [2. Operation of information processing system] The operation of the information processing system 1 having the above configuration will be described below.

[0110] As an example, the information processing system 1 performs a first moving object control process, a response timing setting input process, and a second moving object control process.

[0111] First, the first mobile object control process will be described with reference to the drawings.

[0112] The first mobile object control process is a process in which the mobile object control server 100 controls the mobile object 300 in accordance with the result of sensing inside the mobile object 300.

[0113] FIG. 5 is a sequence diagram of the first mobile object control process.

[0114] In the moving object 300, the sensing unit 31 senses the inside of the moving object 300 and outputs sensing information indicating the sensing result. Then, the communication unit 33 transmits the sensing information output from the sensing unit 31 to the moving object control server 100 (step S10).

[0115] When the sensing information is transmitted, the communication unit 13 receives the sensing information in the mobile object control server 100. When the sensing information is received, the mobile object control server 100 starts a first action timing determination process (step S20).

[0116] FIG. 6 is a flowchart of the first action timing decision process.

[0117] When the first action timing determination process is started, the acquisition unit 40 acquires the sensing information received by the communication unit 13 as a sensing result for the inside of the moving object 300 (step S21).

[0118] When the sensing result is acquired, the recognition process execution unit 50 executes a recognition process for recognizing at least one of dirt and damage inside the moving object 300 based on the acquired sensing result (step S22).

[0119] When the recognition process is executed, the countermeasure timing determination unit 60 checks whether the degree of dirt or damage inside the moving object 300, which is indicated by the result of the executed recognition process, is equal to or greater than a threshold value (step S23).

[0120] In the process of step S23, if the degree of the stain or damage inside the moving body 300 is not equal to or greater than the threshold (step S23: No), the countermeasure timing determination unit 60 checks whether the stain or damage inside the moving body 300 is specific stain or damage (step S24). For example, the specific stain is vomit, and the specific damage is a hole in a seat.

[0121] In the process of step S23, if the degree of the internal dirt or damage of the moving object 300 is equal to or greater than the threshold (step S23: Yes), or in the process of step S24, if the internal dirt or damage of the moving object 300 is specific dirt or damage (step S24: Yes), the response timing determination unit 60 determines the response timing so as to shorten the time until the moving object 300 is moved to a response site (step S25). The response site is a response site that can deal with the internal dirt or damage of the moving object 300, as indicated by the response timing setting stored in the response timing setting DB 80.

[0122] In the processing of step S24, if the internal dirt or damage of the moving body 300 is not specific dirt or damage (step S24: No), the response timing determination unit 60 determines the response timing so as not to change the time until the moving to the above-mentioned response site (step S26).

[0123] When the process of step S25 is completed and when the process of step S26 is completed, the response timing decision unit 60 waits until the determined response timing arrives (step S27: No is repeated). When the determined response timing arrives (step S27: Yes), the response timing decision unit 60 outputs a movement request to move the mobile object 300 to a response site (step S28).

[0124] When the process of step S28 ends, the mobile control server 100 ends the first action timing determination process.

[0125] Returning to FIG. 5, the first mobile control process will be further described.

[0126] When the first response timing determination process (step S20) is completed in the mobile object control server 100, the communication unit 13 transmits to the mobile object 300 a movement request output from the response timing determination unit 60 to move the mobile object 300 to a response site (step S29).

[0127] When the movement request is transmitted, the communication unit 33 receives the movement request in the moving body 300. Then, the control unit 32 moves the moving body 300 to the treatment site in accordance with the movement request (step S30).

[0128] When a mobile object 300 equipped with a sterilization device or a deodorization device finishes its service, the response timing determination unit 60 in the mobile object control server 100 outputs an instruction (hereinafter also referred to as a "sterilization / deodorization instruction") to the mobile object 300 to operate the sterilization device or the deodorization device to sterilize or deodorize the inside of the mobile object 300. Then, the communication unit 13 transmits the sterilization / deodorization instruction to the mobile object 300.

[0129] When the sterilization / deodorization instruction is transmitted, the communication unit 33 receives the sterilization / deodorization instruction in the mobile object 300. Then, the sterilization device or deodorization device provided in the mobile object 300 sterilizes or deodorizes the inside of the mobile object 300 (Step S50).

[0130] Next, the response timing setting input process will be described with reference to the drawings.

[0131] The response timing setting input process is a process in which the mobile control server 100 updates the response timing setting.

[0132] FIG. 7 is a sequence diagram of the response timing setting input process.

[0133] In the moving object 300, the sensing unit 31 senses the inside of the moving object 300 and outputs sensing information indicating the sensing result. Then, the communication unit 33 transmits the sensing information output from the sensing unit 31 to the moving object control server 100 (step S110).

[0134] When the sensing information is transmitted, the communication unit 13 in the mobile object control server 100 receives the sensing information. When the sensing information is received, the acquisition unit 40 acquires the sensing information received by the communication unit 13 as a sensing result for the inside of the mobile object 300. When the sensing result is acquired, the recognition process execution unit 50 executes recognition process for recognizing at least one of dirt and damage inside the mobile object 300 based on the acquired sensing result (step S120).

[0135] When the recognition process is executed, the communication unit 33 transmits the result of the recognition process to the servicer server 200 (step S130).

[0136] When the result of the recognition process is transmitted, the communication unit 23 in the servicer server 200 receives the result of the recognition process. When the result of the recognition process is received, the action timing setting UI generation unit 90 generates a action timing setting user interface that displays the result of the recognition process. Then, the display unit 21 displays the generated action timing setting user interface, that is, displays the result of the recognition process (step S140).

[0137] When the user, having confirmed the displayed result of the recognition process, operates the operation unit 22 to input a response timing setting, the operation unit 22 accepts the response timing setting (step S150).

[0138] When the response timing setting is accepted, the communication unit 23 transmits the accepted response timing setting to the mobile object control server 100 (step S160).

[0139] When the response timing setting is transmitted, the communication unit 13 receives the response timing setting in the mobile control server 100. Then, the response timing setting unit 70 stores the received response timing setting in the response timing setting DB (step S170), thereby updating the response timing setting.

[0140] Next, the second mobile object control process will be described with reference to the drawings.

[0141] The second moving object control process is a process in which the moving object control server 100 controls the moving object 300 in response to a movement request for the moving object 300 from a user.

[0142] FIG. 8 is a sequence diagram of the second mobile object control process.

[0143] 8, the processes of steps S210 to S240 are respectively the same as the processes of steps S110 to S140 in the response timing setting input process. Also, the processes of steps S275 to S290 are respectively the same as the processes of steps S30 to S50 in the first mobile object control process. For this reason, detailed explanations of the processes of steps S210 to S240 and steps S275 to S290 have already been explained, so they will be omitted here, and the explanation will focus on the processes of steps S250 to S270.

[0144] After the processing of step S240 is completed, when the user checks the displayed results of the recognition processing and inputs a movement request to move the mobile object 300 to a treatment site into the operation unit 22, the operation unit 22 accepts the movement request (step S250).

[0145] When the movement request is accepted, the communication unit 23 transmits the movement request to the mobile object control server 100 (step S260).

[0146] When the movement request is transmitted, in the mobile object control server 100, the communication unit 13 receives the transmitted movement request, and transmits the received movement request to the mobile object 300 (step S270).

[0147] When the process of step S270 ends, the information processing system 1 proceeds to the process of step S275.

[0148] [3. Consideration] As described above, according to the information processing system 1, the timing of action to deal with at least one of the stains and damages inside the mobile body 300 is determined from the sensing result of the inside of the mobile body 300, and a notification for moving the mobile body 300 to a treatment site is output according to the determined timing of action. Therefore, the stains or damages inside the mobile body 300 can be dealt with at an appropriate timing.

[0149] (Other embodiments) Although the information processing system according to one or more aspects of the present disclosure has been described based on the embodiment, the present disclosure is not limited to this embodiment. As long as it does not deviate from the spirit of the present disclosure, various modifications conceived by a person skilled in the art to this embodiment and forms constructed by combining components in different embodiments may also be included within the scope of one or more aspects of the present disclosure.

[0150] (1) In the embodiment, the information processing system 1 has been described as being configured to perform a first mobile object control process, as an example. However, the information processing system 1 may be configured to perform a third mobile object control process, instead of the first mobile object control process.

[0151] The third mobile object control process will be described below with reference to the drawings.

[0152] The third mobile object control process is a process in which the mobile object control server 100 notifies the owner or manager of the mobile object 300 of a recommendation for dealing with the interior of the mobile object 300 based on the sensing results of the interior of the mobile object 300.

[0153] FIG. 9 is a sequence diagram of the third mobile object control process.

[0154] 9, the process of step S310 and the process of steps S340 to S350 are respectively similar to the process of step S10 and the process of steps S40 to S50 in the first mobile object control process according to the embodiment. Therefore, since the process of step S310 and the process of steps S340 to S350 have already been explained, detailed explanations thereof will be omitted here, and the explanation will focus on the process of steps S320 to S328.

[0155] In the process of step S310, when the sensing information is transmitted from the moving object 300, the communication unit 13 receives the sensing information in the moving object control server 100. When the sensing information is received, the moving object control server 100 starts a second action timing determination process (step S320).

[0156] FIG. 10 is a flowchart of the second action timing decision process.

[0157] 10, the processes of steps S321 to S327 are similar to the processes of steps S21 to S27 in the first handling timing decision process according to the embodiment, respectively. Therefore, since the processes of steps S321 to S327 have already been explained, detailed explanations thereof will be omitted here, and the explanation will focus on the processes of steps S329 to S330.

[0158] In the process of step S327, when the determined action timing arrives (step S327: Yes), the action timing determination unit 60 outputs a recommendation for action to be taken inside the moving object 300 to the owner or manager of the moving object 300 (step S328).

[0159] When the process of step S328 ends, the mobile control server 100 ends the second action timing determination process.

[0160] Returning to FIG. 9, the second mobile object control process will be further described.

[0161] When the second response timing determination process (step S320) is completed in the mobile control server 100, the communication unit 13 transmits the recommendation for internal response of the mobile unit 300 to the owner or manager of the mobile unit 300 output from the response timing determination unit 60 to the service server 200 (step S329).

[0162] When the recommendation for measures to be taken inside the mobile object 300 is transmitted, the communication unit 23 in the servicer server 200 receives the recommendation for measures to be taken inside the mobile object 300. Then, the display unit 21 displays the received recommendation for measures to be taken inside the mobile object 300 (step S330).

[0163] (2) In the embodiment, the information processing system 1 has been described as including two servers, the mobile object control server 100 and the servicer server 200, as an example. However, the information processing system 1 is not necessarily limited to the example including the mobile object control server 100 and the servicer server 200, as long as the information processing system 1 can realize functions similar to those realized by the mobile object control server 100 and the servicer server 200. The information processing system 1 may be configured to include, for example, one server that can realize functions similar to those realized by the mobile object control server 100 and the servicer server 200. In addition, for example, the information processing system 1 may be configured to include three or more servers that can realize functions similar to those realized by the mobile object control server 100 and the servicer server 200 by operating in cooperation with each other.

[0164] (3) In the embodiment, the information processing system 1 has been described as having a configuration in which the mobile object control server 100 executes the recognition process and determines the timing of the response, as an example. However, the information processing system 1 does not necessarily need to be limited to a configuration in which the mobile object control server 100 executes the recognition process and determines the timing of the response, as long as the information processing system 1 can execute the recognition process and determine the timing of the response. The information processing system 1 may be, for example, a configuration in which the mobile object 300 executes part or all of the recognition process, or a configuration in which the mobile object 300 executes part or all of the process of determining the timing of the response.

[0165] (4) Some or all of the components of the mobile object control server 100, the servicer server 200, and the mobile object 300 may be configured from a single system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically, is a computer system including a microprocessor, a ROM (Read Only Memory), a RAM (Random Access Memory), etc. A computer program is stored in the ROM. The system LSI achieves its functions when the microprocessor operates in accordance with the computer program.

[0166] Although the term "system LSI" is used here, it may be called IC, LSI, super LSI, or ultra LSI depending on the level of integration. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. It is also possible to use a field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI.

[0167] Furthermore, if an integrated circuit technology that can replace LSI appears due to the progress of semiconductor technology or a different derived technology, it is natural that such technology may be used to integrate the functional blocks. The application of biotechnology, etc. is also a possibility.

[0168] (5) One aspect of the present disclosure may be not only such an information processing system, but also an information processing method having steps corresponding to characteristic components included in the information processing system. Also, one aspect of the present disclosure may be a computer program that causes a computer to execute each of the characteristic steps included in the information processing method. Also, one aspect of the present disclosure may be a computer-readable non-transitory recording medium on which such a computer program is recorded.

[0169] (6) In the embodiments, each component may be realized by a dedicated hardware or by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. [Industrial Applicability]

[0170] The present disclosure is widely applicable to systems that operate mobile objects. [Explanation of symbols]

[0171] 1. Information Processing Systems 10, 20, 30 Control section 11, 21 Display section 12, 22 Operation section 13, 23, 33 Communications Department 14 Mobile Management Department 15 Mobile management DB 31 Sensing section 32 Control Unit 40 Acquisition Department 50 Recognition processing execution unit 60 Response timing decision unit 70 Response timing setting section 80 Response timing setting DB 90 Response timing setting UI generation section 100 Mobile control server 200 Service Server 300 Mobile

Claims

1. An information processing method, comprising: Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; outputting a notification for moving the mobile object to a treatment site in accordance with the treatment timing; The determination further includes changing the threshold value according to (i) the type of the recognized dirt or damage inside the moving object, or (ii) the recognized cost of dealing with the dirt or damage inside the moving object, which are included in the result of the recognition process; The determination includes determining that the timing to take action is earlier than a predetermined timing when the comparison result indicates that the recognized degree of at least one of the dirt and damage inside the moving object exceeds the changed threshold value. Information processing methods.

2. An information processing method, comprising: Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; outputting a notification for moving the mobile object to a treatment site in accordance with the treatment timing; The implementation recognizes at least one of soiling and damage at each of a plurality of locations within the vehicle; The determination includes determining that the timing of the response is earlier than a predetermined timing when a number of locations corresponding to the degree exceeding the threshold value among the degrees recognized in each of the plurality of locations included in the result of the recognition processing is equal to or greater than a predetermined number. Information processing methods.

3. An information processing method, comprising: Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; outputting a notification for moving the mobile object to a treatment site in accordance with the treatment timing; The information processing method further comprises: The threshold value is changed depending on a time period. Information processing methods.

4. An information processing method, comprising: Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; outputting a notification for moving the mobile object to a treatment site in accordance with the treatment timing; The information processing method further comprises: changing the threshold value according to a demand situation of the mobile object; Information processing methods.

5. An information processing method, comprising: Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; outputting a notification for moving the mobile object to a treatment site in accordance with the treatment timing; the countermeasure timing is a cleaning timing for cleaning the moving body, determining the cleaning timing according to whether the recognized type of dirt inside the moving object, which is included in the result of the recognition process, is dirt that worsens over time; Information processing methods.

6. An information processing method, comprising: Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; outputting a notification for moving the mobile object to a treatment site in accordance with the treatment timing; The timing of the action is further determined according to the characteristics of the passengers who are scheduled to board the vehicle with respect to the dirt or damage to the inside of the vehicle. Information processing methods.

7. The timing of the response is the time when the recognition process is executed. The information processing method according to any one of claims 1 to 6.

8. the timing of the response is a predetermined time after the recognition process is executed, The predetermined time is determined according to the result of the recognition process, thereby determining the timing of the action. The information processing method according to any one of claims 1 to 6.

9. After the timing for taking action arrives, if there are no passengers or cargo in the moving object, the notification is output. The information processing method according to any one of claims 1 to 8.

10. and determining, when the comparison result indicates that the recognized degree of at least one of the dirt and damage inside the moving object does not exceed the changed threshold, the timing to take action is determined to be the predetermined timing. The information processing method according to claim 1 .

11. If the time period is a busy period, the change is to change the threshold value to a higher value. The information processing method according to claim 3.

12. If the time period is an off-season, the modification changes the threshold value to a lower value. The information processing method according to claim 3.

13. In the determination, when the degree of the comparison result is recognized and exceeds the threshold value, and when the mobile object is providing a service, a timing after the service ends is determined as the timing to take the action. The information processing method according to any one of claims 1 to 6.

14. When the demand condition is high, the modification changes the threshold value to be lower. The information processing method according to claim 4.

15. Displaying the results of the recognition process; Display the screen for inputting the action timing settings, storing the inputted response timing setting; The timing of the response is determined using the stored response timing setting. The information processing method according to any one of claims 1 to 6.

16. The notification is a movement request to the moving object. The information processing method according to any one of claims 1 to 6.

17. The notification is a recommendation to an owner or manager of the mobile unit to take measures within the mobile unit. The information processing method according to any one of claims 1 to 6.

18. Acquire information indicating whether a device for taking measures against internal contamination or damage of the moving body, which is provided in the moving body, has been operated; Furthermore, the timing of the countermeasure is determined according to whether the device has been operated or not. The information processing method according to any one of claims 1 to 6.

19. An information processing device, an acquisition unit that acquires a sensing result for the inside of the moving object; a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving object based on the sensing result; a countermeasure timing determination unit that determines a countermeasure timing for dealing with at least one of the recognized internal stains and damages of the moving body based on a comparison result of the recognition process, the comparison result being obtained by comparing the recognized degree of at least one of the internal stains and damages of the moving body with a threshold value, and outputs a notification for moving the moving body to a countermeasure site in accordance with the countermeasure timing; The countermeasure timing determination unit further changes the threshold value according to (i) the type of the recognized internal dirt or damage of the moving body, or (ii) the recognized cost of dealing with the recognized internal dirt or damage of the moving body, which are included in the result of the recognition process; the countermeasure timing determination unit determines the countermeasure timing to be earlier than a predetermined timing when the comparison result indicates that at least one of the recognized degrees of dirt and damage inside the moving body exceeds the changed threshold value; Information processing device.

20. A program for causing a computer to execute a first process, The first process includes: The computer, Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; a process of outputting a notification for moving the moving object to a treatment site in accordance with the treatment timing; The determination further includes changing the threshold value according to (i) the type of the recognized dirt or damage inside the moving object, or (ii) the recognized cost of dealing with the dirt or damage inside the moving object, which are included in the result of the recognition process; The determination includes determining that the timing to take action is earlier than a predetermined timing when the comparison result indicates that the recognized degree of at least one of the dirt and damage inside the moving object exceeds the changed threshold value. program.

21. An information processing device, an acquisition unit that acquires a sensing result for the inside of the moving object; a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving object based on the sensing result; a countermeasure timing determination unit that determines a countermeasure timing for dealing with at least one of the recognized internal stains and damages of the moving body based on a comparison result of the recognition process, the comparison result being obtained by comparing the recognized degree of at least one of the internal stains and damages of the moving body with a threshold value, and outputs a notification for moving the moving body to a countermeasure site in accordance with the countermeasure timing; the recognition processing execution unit recognizes at least one of dirt and damage in each of a plurality of locations inside the moving object; the response timing determination unit determines the response timing to be earlier than a predetermined timing when a number of locations corresponding to a degree exceeding the threshold value among the degrees recognized in each of the plurality of locations included in the result of the recognition processing is equal to or greater than a predetermined number; Information processing device.

22. A program for causing a computer to execute a first process, The first process includes: The computer, Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; a process of outputting a notification for moving the moving object to a treatment site in accordance with the treatment timing; The implementation recognizes at least one of soiling and damage at each of a plurality of locations within the vehicle; The determination includes determining that the timing of the response is earlier than a predetermined timing when a number of locations corresponding to the degree exceeding the threshold value among the degrees recognized in each of the plurality of locations included in the result of the recognition processing is equal to or greater than a predetermined number. program.

23. An information processing device, an acquisition unit that acquires a sensing result for the inside of the moving object; a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving object based on the sensing result; a countermeasure timing determination unit that determines a countermeasure timing for dealing with at least one of the recognized internal stains and damages of the moving body based on a comparison result of the recognition process, the comparison result being obtained by comparing the recognized degree of at least one of the internal stains and damages of the moving body with a threshold value, and outputs a notification for moving the moving body to a countermeasure site in accordance with the countermeasure timing; The response timing determination unit further The threshold value is changed depending on a time period. Information processing device.

24. A program for causing a computer to execute a first process, The first process includes: The computer, Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; a process of outputting a notification for moving the moving object to a treatment site in accordance with the treatment timing; The first process further includes: The threshold value is changed depending on a time period. program.

25. An information processing device, an acquisition unit that acquires a sensing result for the inside of the moving object; a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving object based on the sensing result; a countermeasure timing determination unit that determines a countermeasure timing for dealing with at least one of the recognized internal stains and damages of the moving body based on a comparison result of the recognition process, the comparison result being obtained by comparing the recognized degree of at least one of the internal stains and damages of the moving body with a threshold value, and outputs a notification for moving the moving body to a countermeasure site in accordance with the countermeasure timing; The response timing determination unit further changing the threshold value according to a demand situation of the mobile object; Information processing device.

26. A program for causing a computer to execute a first process, The first process includes: The computer, Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; a process of outputting a notification for moving the moving object to a treatment site in accordance with the treatment timing; The first process further includes: changing the threshold value according to a demand situation of the mobile object; program.

27. An information processing device, an acquisition unit that acquires a sensing result for the inside of the moving object; a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving object based on the sensing result; a countermeasure timing determination unit that determines a countermeasure timing for dealing with at least one of the recognized internal stains and damages of the moving body based on a comparison result of the recognition process, the comparison result being obtained by comparing the recognized degree of at least one of the internal stains and damages of the moving body with a threshold value, and outputs a notification for moving the moving body to a countermeasure site in accordance with the countermeasure timing; the countermeasure timing is a cleaning timing for cleaning the moving body, the countermeasure timing determination unit determines the cleaning timing according to whether or not the type of recognized dirt on the inside of the moving object, which is included in the result of the recognition process, is dirt that worsens over time. Information processing device.

28. A program for causing a computer to execute a first process, The first process includes: The computer, Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; a process of outputting a notification for moving the moving object to a treatment site in accordance with the treatment timing; the countermeasure timing is a cleaning timing for cleaning the moving body, The determination includes determining the cleaning timing according to whether or not the type of dirt inside the moving object recognized as a result of the recognition process is dirt that worsens over time. program.

29. An information processing device, an acquisition unit that acquires a sensing result for the inside of the moving object; a recognition processing execution unit that executes a recognition processing to recognize at least one of dirt and damage inside the moving object based on the sensing result; a countermeasure timing determination unit that determines a countermeasure timing for dealing with at least one of the recognized internal stains and damages of the moving body based on a comparison result of the recognition process, the comparison result being obtained by comparing the recognized degree of at least one of the internal stains and damages of the moving body with a threshold value, and outputs a notification for moving the moving body to a countermeasure site in accordance with the countermeasure timing; The countermeasure timing determination unit further determines the countermeasure timing according to the characteristics of the passengers who are scheduled to board the vehicle with respect to the dirt or damage to the inside of the vehicle. Information processing device.

30. A program for causing a computer to execute a first process, The first process includes: The computer, Obtaining sensing results for the inside of the moving object; Executing a recognition process to recognize at least one of dirt and damage inside the moving object based on the sensing result; determining a timing for dealing with at least one of the recognized internal dirt and damage of the moving body based on a comparison result of the comparison between the recognized degree of at least one of the recognized internal dirt and damage of the moving body, which is included in the result of the recognition process, and a threshold value; a process of outputting a notification for moving the moving object to a treatment site in accordance with the treatment timing; The timing of the action is further determined according to the characteristics of the passengers who are scheduled to board the vehicle with respect to the dirt or damage to the inside of the vehicle. program.

Images