Information processing device, information processing method, and program

Abstract

To support quick and appropriate determinations on abnormalities.SOLUTION: An information processing device 2A capable of communicating with a management server 1 includes a control unit. The control unit executes operations including acquiring sensor information from sensors provided in a vehicle 2, and when an abnormality in the vehicle is detected from the sensor information, notifying the management server 1 of contents of the abnormality.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, there is known an invention that notifies a remote operation device and secures a remote operator when an abnormal state in which manual driving by an occupant (driver) is difficult is detected (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above background art, only an abnormal state of the driver is detected.

[0005] In view of such circumstances, an object of the present disclosure is to assist rapid and appropriate determination of an abnormality.

Means for Solving the Problems

[0006] An information processing apparatus according to an embodiment of the present disclosure is an information processing apparatus capable of communicating with a management server, including a control unit, and the control unit acquires sensor information from sensors provided in a vehicle, when detecting an abnormality inside the vehicle from the sensor information, notifies the management server of the content of the abnormality, and executes operations including the above.

[0007] An information processing method according to an embodiment of the present disclosure is An information processing method using an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, When an abnormality is detected inside the vehicle from the sensor information, the details of the abnormality are notified to the management server. Includes.

[0008] A program according to one embodiment of this disclosure is A computer acting as an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, When an abnormality is detected inside the vehicle from the sensor information, the details of the abnormality are notified to the management server. Perform an action that includes this. [Effects of the Invention]

[0009] According to one embodiment of this disclosure, the aim is to support administrators in making quick and appropriate decisions regarding anomalies. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram of the information processing system of this embodiment. [Figure 2] This is a block diagram showing the configuration of the management server. [Figure 3] This is a block diagram showing the vehicle configuration. [Figure 4] This is a sequence diagram illustrating the operation of an information processing system. [Figure 5] This diagram shows the data structure of the anomaly-related information database. [Modes for carrying out the invention]

[0011] Figure 1 is a schematic diagram of the information processing system S of this embodiment. The information processing system S includes a management server 1 and a vehicle 2. The management server 1 can communicate with the vehicle 2 via a network NW. The network NW includes, for example, a mobile communication network, the Internet, or a fixed communication network.

[0012] In Figure 1, for the sake of simplicity, one management server 1 and one vehicle 2 are shown. However, the number of management servers 1 and vehicles 2 is not limited to this. For example, the processing performed by management server 1 may be performed by multiple management servers 1 located in a distributed manner. Management server 1 may be able to communicate with multiple vehicles 2.

[0013] The outline of the processing performed by the information processing unit of this embodiment is described below. The control unit 21 of the information processing unit 2A performs operations including acquiring sensor information from a sensor 24 installed in the vehicle 2, and, when it detects an abnormality inside the vehicle from the sensor information, notifying the management server 1 of the details of the abnormality. With this configuration, the information processing unit 2A can quickly notify the administrator who performs remote monitoring, etc., of any abnormality inside the vehicle. Thus, the information processing unit 2A can support the administrator in making quick and appropriate decisions regarding abnormalities. Furthermore, the information processing unit 2A can support the administrator in smoothly handling escalations.

[0014] Management Server 1 may be a server that supports the provision of services by the operator. Management Server 1 may be installed in a control center, a flight management center, a remote monitoring center, a business management center, a facility dedicated to the operator, or a shared facility including a data center. Management Server 1 may also be called a center server. As an alternative, Management Server 1 may be installed in a vehicle 2.

[0015] Vehicle 2 includes any type of automobile such as, for example, a gasoline vehicle, a diesel vehicle, an HEV, a PHEV, a BEV, or an FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. The operation of vehicle 2 may be automated at any level. The level of automation is, for example, any one of levels 1 to 5 in the SAE level classification. "SAE" is an abbreviation for Society of Automotive Engineers. Vehicle 2 may be a vehicle dedicated to MaaS. "MaaS" is an abbreviation for Mobility as a Service. As an alternative, vehicle 2 may be driven by a driver.

[0016] In FIG. 2, the internal configuration of the management server 1 is described in detail.

[0017] The management server 1 includes a control unit 11, a communication unit 12, a storage unit 13, and a display unit 14. Each component of the management server 1 is communicably connected to each other via, for example, a dedicated line.

[0018] The control unit 11 includes, for example, one or more general-purpose processors including a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The control unit 11 may include one or more dedicated processors specialized for specific processing. Instead of including a processor, the control unit 11 may include one or more dedicated circuits. The dedicated circuit may be, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 11 may include an ECU (Electronic Control Unit). The control unit 11 transmits and receives any information via the communication unit 12.

[0019] The communication unit 12 includes a communication module compatible with one or more wired or wireless LAN (Local Area Network) standards for connecting to a network. The communication unit 12 may include a module compatible with one or more mobile communication standards, including LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation). The communication unit 12 may include a communication module, etc., compatible with one or more short-range communication standards or specifications, including Bluetooth®, AirDrop®, IrDA, ZigBee®, Felica®, or RFID. The communication unit 12 transmits and receives arbitrary information via the network.

[0020] The storage unit 13 includes, but is not limited to, semiconductor memory, magnetic memory, optical memory, or a combination of at least two of these. Semiconductor memory is, for example, RAM or ROM. RAM is, for example, SRAM or DRAM. ROM is, for example, EEPROM. The storage unit 13 may function as, for example, main memory, auxiliary memory, or cache memory. The storage unit 13 may store information resulting from analysis or processing by the control unit 11. The storage unit 13 may store various information related to the operation or control of the management server 1. The storage unit 13 may store system programs, application programs, and embedded software. The storage unit 13 may be located outside the management server 1 and accessible from the management server 1. The storage unit 13 includes an abnormality-related information database.

[0021] The display unit 14 is, for example, a display. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electroluminescence. Instead of being provided on the management server 1, the display unit 14 may be connected to the management server 1 as an external output device. Any connection method can be used, for example, USB, HDMI (registered trademark), or Bluetooth (registered trademark). "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0022] Figure 3 provides a detailed explanation of the internal configuration of vehicle 2.

[0023] In this example, vehicle 2 is equipped with an information processing device 2A. Alternatively, the information processing device 2A may be located outside vehicle 2.

[0024] The information processing device 2A includes a control unit 21, a communication unit 22, a storage unit 23, a sensor 24, a display unit 25, an input unit 26, and an output unit 27. Each component of the information processing device 2A is connected to each other so as to be able to communicate, for example, via a dedicated line.

[0025] The description of the hardware configuration of the control unit 21, communication unit 22, storage unit 23, and display unit 25 may be the same as the description of the hardware configuration of the control unit 11, communication unit 12, storage unit 13, and display unit 14. The description is omitted here.

[0026] In this embodiment, vehicle 2 is operated autonomously. The storage unit 23 of vehicle 2 stores ADK (Autonomous Driving Kit) software for autonomous driving and conductor software.

[0027] Sensor 24 is installed in vehicle 2. Sensor 24 includes a camera image sensor and captures images. The images may be still images or moving images. Sensor 24 may generate images and record the generated images in storage unit 23. Sensor 24 may include a camera to assist in the remote operation of vehicle 2 and a surveillance camera for the conductor.

[0028] Sensor 24 may be a door sensor that detects whether or not a person is caught in the door of vehicle 2. Sensor 24 may also be a millimeter-wave sensor.

[0029] The display unit 25 may be a digital signage display. The display unit 25 may be a touch panel.

[0030] The input unit 26 is, for example, a microphone, physical keys, capacitive keys, a pointing device, or a touchscreen integrated with a display. The input unit 26 accepts operations to input information used for the operation of the vehicle 2. Instead of being installed in the vehicle 2, the input unit 26 may be connected to the vehicle 2 as an external input device. Any connection method can be used, for example, USB, HDMI®, or Bluetooth®.

[0031] The output unit 27 includes one or more output interfaces that output information and notify the user. For example, the output interfaces included in the output unit 27 may be speakers that output information as sound, but are not limited to these. For example, the output unit 27 may be any broadcasting equipment.

[0032] As an additional example, vehicle 2 may include a communication device for communication between passengers and the operator of management server 1. Vehicle 2 may further include various buttons for bus operation.

[0033] The processes performed by the information processing system S of this embodiment will be described in detail below, as shown in Figure 4. Here, as an example, one or more vehicles 2 are operated as an autonomous bus. A management server 1 located at the center monitors one or more vehicles 2. The number of vehicles to be monitored can be set arbitrarily.

[0034] In step S1, the control unit 21 of the information processing device 2A acquires sensor information (in this case, captured images) from the in-vehicle camera acting as the sensor 24, and analyzes the captured images. Based on the analysis results, the control unit 21 detects an abnormality within the vehicle 2.

[0035] In step S2, the control unit 21 determines whether the detected anomaly is related to a suspicious object. If the answer in step S2 is No, the control unit 21 executes step S11, which will be described later.

[0036] If the answer in step S2 is Yes, the control unit 21 determines in step S3 whether it can determine the contents of the suspicious object (e.g., explosives, liquids, etc.). If the answer in step S3 is Yes, the control unit 21 executes step S5, which will be described later.

[0037] If the answer in step S3 is No, the control unit 21 adjusts at least one of the camera orientation, field of view, and zoom level (magnification or reduction) in step S4 to capture a magnified image of the suspicious object.

[0038] In step S5, the control unit 21 determines the size of the suspicious object. Here, as an example, the control unit 21 determines whether the size is "large" or not. If the answer in step S5 is Yes, the control unit 21 sets the urgency level to "high" in step S6.

[0039] The level of urgency can be set arbitrarily. For example, the level of urgency is set to "high" when it concerns human life and safety. The level of urgency is set to "medium" when it concerns the operation or the sense of security of passengers. The level of urgency is set to "low" when it concerns making requests.

[0040] If the answer in step S5 is No, the control unit 21 determines in step S7 whether the size of the suspicious object is "medium". If the answer in step S7 is Yes, the control unit 21 sets the urgency level to "medium" in step S8.

[0041] If the answer in step S7 is No, the control unit 21 determines in step S9 whether the size of the suspicious object is "small". If the answer in step S9 is Yes, the control unit 21 sets the urgency level to "low" in step S10. If the answer in step S9 is No, the control unit 21 executes step S11.

[0042] In step S11, the control unit 21 determines whether the abnormality detected in step S1 is related to the passengers of vehicle 2.

[0043] If the result in step S11 is No, the control unit 21 executes step S19, which will be described later.

[0044] If the answer in step S11 is Yes, then in step S12, the control unit 21 analyzes the passenger's condition using sensor information obtained from the sensor 24. The passenger's condition includes, for example, at least one of the following pieces of information: ·age ·sex ·posture ·behavior • Vital signs (e.g., pulse, blood pressure, respiratory rate)

[0045] Age or gender may be determined from the passenger's commuter pass information. Vital signs may be determined from sensors worn by the passenger, provided that the passenger has given their consent.

[0046] In step S13, the control unit 21 determines whether the abnormality is a passenger emergency. A passenger emergency includes, for example, any of the following: • A passenger has collapsed. A passenger is caught in the door. • Passenger hyperventilation

[0047] If the answer in step S13 is Yes, the control unit 21 sets the urgency level to "High" in step S14.

[0048] If the result in step S13 is No, the control unit 21 determines in step S15 whether the abnormality is an operational disruption. An operational disruption includes, for example, any of the following: • The train cannot depart because passengers are not seated. • Passengers are having trouble with each other.

[0049] If the answer in step S15 is Yes, the control unit 21 sets the urgency level to "Medium" in step S16.

[0050] If the answer in step S15 is No, the control unit 21 determines in step S17 whether the abnormality is an inquiry from a passenger. For example, if the control unit 21 detects that a passenger has waved their hand two or more times, it may determine that the abnormality is an inquiry from a passenger. If the answer in step S17 is Yes, the control unit 21 sets the urgency level to "Low" in step S18. If the answer in step S17 is No, the control unit 21 executes step S19, which will be described later.

[0051] As shown in Figure 5, the control unit 21 stores abnormality-related information associated with each vehicle in the storage unit 23 at any given time. The abnormality-related information includes, for example, at least one of the following pieces of information: • Details of the abnormality ·Urgency level • Condition inside the vehicle (e.g., size of suspicious object) • Passenger status • Overall image • Enlarged image

[0052] In step S19, the control unit 21 notifies the management server 1 of the abnormality-related information. This notification is also called escalation. The management server 1 stores the abnormality-related information in the storage unit 13.

[0053] In step S20, the management server 1 receives abnormality-related information. When the management server 1 receives multiple abnormality-related information from multiple vehicles 2, it may notify the remote monitor of the abnormality-related information according to the level of urgency. The notification may be, for example, displayed via the display unit 14, or output as audio via the speaker.

[0054] As an alternative, the processes from step S2 to step S10 and the processes from step S11 to step S18 may be performed in the reverse order. For steps S13, S15, and S17, the order in which each step is performed can be arbitrarily set.

[0055] As described above, according to this embodiment, the control unit 21 of the information processing device 2A performs operations including acquiring sensor information from the sensor 24 installed in the vehicle 2, and, when it detects an abnormality inside the vehicle from the sensor information, notifying the management server 1 of the details of the abnormality. With this configuration, the information processing device 2A can quickly notify the administrator who performs remote monitoring, etc., of any abnormality inside the vehicle. Thus, the information processing device 2A can support the administrator in making quick and appropriate decisions regarding abnormalities. Furthermore, the information processing device 2A can support the administrator in smoothly handling escalations.

[0056] Furthermore, according to this embodiment, the content of the anomaly relates to at least one of the following: a suspicious object, an emergency situation for a passenger, disruption of operations, and an inquiry from a passenger. In addition, according to this embodiment, the sensor 24 includes at least one of an image sensor, a door sensor, and a millimeter-wave sensor. With this configuration, the information processing device 2A can detect various anomalies.

[0057] Furthermore, according to this embodiment, the sensor 24 includes a camera, and the operation of the control unit 21 includes, when it determines that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, adjusting at least one of the camera's orientation, field of view, and zoom level to capture a magnified image of the suspicious object and notifying the management server 1 of the magnified image. With this configuration, the information processing device 2A can further support the administrator's decision-making.

[0058] Furthermore, according to this embodiment, the operation of the control unit 21 includes, when it determines that the nature of the abnormality is related to a passenger, analyzing the passenger's condition and notifying the management server 1 of the passenger's condition. The passenger's condition includes at least one of the passenger's age, gender, posture, behavior, pulse rate, blood pressure, and respiratory rate. This configuration allows the information processing device 2A to further support the administrator's decision-making.

[0059] Furthermore, according to this embodiment, the urgency level is determined from at least one of the size of the suspicious object and the passenger's condition, and the urgency level is notified to the management server 1. With this configuration, the information processing device 2A can further support the administrator's decision-making.

[0060] While this disclosure is described based on drawings and embodiments, it should be noted that those skilled in the art may make various modifications and alterations based on this disclosure. Furthermore, changes are permitted as long as they do not depart from the spirit of this disclosure. For example, the functions included in each means or step can be rearranged in a logically consistent manner, and multiple means or steps can be combined into one or divided.

[0061] For example, in the above embodiment, a program that performs all or part of the functions or processing of the information processing device 2A can be recorded on a computer-readable recording medium. The computer-readable recording medium includes non-temporary computer-readable media, such as a magnetic recording device, optical disc, magneto-optical recording medium, or semiconductor memory. The program can be distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD (Digital Versatile Disc) or CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. Alternatively, the program can be distributed by storing it in the storage of any server and transmitting the program from any server to another computer. The program can also be provided as a program product. This disclosure can also be implemented as a processor-executable program.

[0062] A computer, for example, stores a program recorded on a portable storage medium or a program transferred from a server in its main memory. Then, the computer reads the program stored in the main memory with its processor and executes the processing according to the read program. The computer may also read a program directly from a portable storage medium and execute the processing according to the program. The computer may also execute the processing according to the received program sequentially each time a program is transferred to it from a server. Processing may also be performed by a so-called ASP-type service, which does not transfer programs from the server to the computer, but realizes its function only through execution instructions and result acquisition. "ASP" is an abbreviation for application service provider. A program includes information used for processing by an electronic computer that is equivalent to a program. For example, data that is not a direct instruction to the computer but has the nature of defining the computer's processing falls under "equivalent to a program".

[0063] Some embodiments of the present disclosure are described below. However, it should be noted that the embodiments of the present disclosure are not limited to these. [Note 1] An information processing device capable of communicating with a management server, including a control unit, the control unit is Acquiring sensor information from sensors installed on the vehicle, When an abnormality is detected inside the vehicle from the sensor information, the details of the abnormality are notified to the management server. An information processing device that performs operations including those mentioned above. [Note 2] In the information processing device described in Appendix 1, The information processing device is such that the content of the aforementioned anomaly relates to at least one of the following: a suspicious object, an emergency situation of a passenger, disruption of operations, and an inquiry from a passenger. [Note 3] In the information processing device described in Appendix 1 or 2, The sensor is an information processing device that includes at least one of an image sensor, a door sensor, and a millimeter-wave sensor. [Note 4] In the information processing device described in any one of the appendices 1 to 3, The aforementioned sensor includes a camera, The aforementioned operation is, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, Information processing device, including [Note 5] In the information processing device described in any one of the appendices 1 to 4, the operation is: If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, Information processing device, including [Note 6] In the information processing device described in Appendix 5, An information processing device in which the passenger's condition includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate. [Note 7] In the information processing device described in Appendix 2, the above operation is: This includes determining the degree of urgency based on at least one of the size of the suspicious object and the condition of the passenger, and notifying the management server of the degree of urgency. Information processing device. [Note 8] A vehicle equipped with the information processing device described in Appendix 1. [Note 9] An information processing method using an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, When an abnormality is detected inside the vehicle from the sensor information, the details of the abnormality are notified to the management server. Information processing methods, including those mentioned above. [Note 10] In the information processing method described in Appendix 9, A method for processing information relating to at least one of the following abnormalities: a suspicious object, a passenger's emergency condition, a disruption to operations, and an inquiry from a passenger. [Note 11] In the information processing method described in Appendix 9 or 10, The sensor is an information processing method comprising at least one of an image sensor, a door sensor, and a millimeter-wave sensor. [Note 12] In the information processing method described in any one of the appendices 9 to 11, The aforementioned sensor includes a camera, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, Information processing methods, including those mentioned above. [Note 13] In the information processing method described in any one of the appendices 9 to 12, If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, Information processing methods, including those mentioned above. [Note 14] In the information processing method described in Appendix 13, Information processing method for determining the passenger's condition, which includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate. [Note 15] A computer acting as an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, When an abnormality is detected inside the vehicle from the sensor information, the details of the abnormality are notified to the management server. A program that performs an action that includes the following: [Note 16] In the program described in Appendix 15, The program is related to at least one of the following abnormalities: a suspicious object, a passenger emergency, a disruption to operations, and a passenger inquiry. [Note 17] In the program described in Appendix 15 or 16, The program includes at least one of the following sensors: an image sensor, a door sensor, and a millimeter-wave sensor. [Note 18] In the program described in any one of the appendices 15 to 17, The aforementioned sensor includes a camera, The aforementioned operation is, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, A program that includes this. [Note 19] In the program described in any one of the appendices 15 to 18, the above operation is: If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, A program that includes this. [Note 20] In the program described in Appendix 19, The passenger's condition is a program that includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate. [Explanation of Symbols]

[0064] S Information Processing System

Claims

1. An information processing device capable of communicating with a management server, including a control unit, the control unit is Acquiring sensor information from sensors installed on the vehicle, The sensor information is used to detect abnormalities inside the vehicle, To determine whether the nature of the abnormality is related to a suspicious object, If it is determined that the nature of the abnormality is related to a suspicious object, the size of the suspicious object is determined, and the level of urgency is set according to that size. To determine whether the nature of the abnormality is related to the passenger, If it is determined that the nature of the abnormality is related to a passenger, the urgency level will be set according to whether the nature of the abnormality is a passenger emergency, a disruption to operations, or an inquiry from a passenger. The management server is notified of the details of the abnormality and the degree of urgency, and other abnormality-related information. An information processing device that performs operations including those mentioned above.

2. In the information processing apparatus according to claim 1, The sensor is an information processing device that includes at least one of an image sensor, a door sensor, and a millimeter-wave sensor.

3. In the information processing apparatus according to claim 1, The aforementioned sensor includes a camera, The aforementioned operation is, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, Information processing device, including

4. In the information processing apparatus according to claim 1, the operation is: If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, Information processing device, including

5. In the information processing apparatus according to claim 4, An information processing device that determines the passenger's condition, including at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate.

6. A vehicle equipped with the information processing device described in claim 1.

7. An information processing method using an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, The sensor information is used to detect abnormalities inside the vehicle, To determine whether the nature of the abnormality is related to a suspicious object, If it is determined that the nature of the abnormality is related to a suspicious object, the size of the suspicious object is determined, and the level of urgency is set according to that size. To determine whether the nature of the abnormality is related to the passenger, If it is determined that the nature of the abnormality is related to a passenger, the urgency level will be set according to whether the nature of the abnormality is a passenger emergency, a disruption to operations, or an inquiry from a passenger. The management server is notified of the details of the abnormality and the degree of urgency, and other abnormality-related information. Information processing methods, including those mentioned above.

8. In the information processing method described in claim 7, The sensor includes at least one of an image sensor, a door sensor, and a millimeter-wave sensor, and is an information processing method.

9. In the information processing method described in claim 7, The aforementioned sensor includes a camera, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, Information processing methods, including those mentioned above.

10. In the information processing method described in claim 7, If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, Information processing methods, including those mentioned above.

11. In the information processing method described in claim 10, Information processing method for determining the passenger's condition, which includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate.

12. A computer acting as an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, The sensor information is used to detect abnormalities inside the vehicle, To determine whether the nature of the abnormality is related to a suspicious object, If it is determined that the nature of the abnormality is related to a suspicious object, the size of the suspicious object is determined, and the level of urgency is set according to that size. To determine whether the nature of the abnormality is related to the passenger, If it is determined that the nature of the abnormality is related to a passenger, the urgency level will be set according to whether the nature of the abnormality is a passenger emergency, a disruption to operations, or an inquiry from a passenger. The management server is notified of the details of the abnormality and the degree of urgency, and other abnormality-related information. A program that performs an action that includes the following:

13. In the program described in claim 12, The program includes at least one of the following sensors: an image sensor, a door sensor, and a millimeter-wave sensor.

14. In the program described in claim 12, The aforementioned sensor includes a camera, The aforementioned operation is, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, A program that includes this.

15. In the program according to claim 12, the operation is: If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, A program that includes this.

16. In the program described in claim 15, The passenger's condition is a program that includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate.

Images