Information processing device, information processing method, and program

Abstract

To make it easy for a surveillant to know which of a plurality of images to look at.SOLUTION: An information processing device 1 capable of communicating with a plurality of vehicles 2 performing automatic driving includes a control unit. The control unit executes operations including: receiving a notification, from each of the plurality of vehicles 2, of contents of an abnormality, an interior image of the vehicle, and the number of people in the vehicle; determining the load of an automatic driving process and the number of people in the vehicle for each of the plurality of vehicles 2 to prioritize the plurality of vehicles 2 based on determination results; and highlighting and displaying the contents of the abnormality of a vehicle with the largest priority and the interior image of the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, a technique is known in which one of a plurality of images is displayed in a main screen area and the other images are displayed in a sub-screen area, and when a slide operation in a first direction in the main screen area is detected, the sub-screen area is hidden and the main screen area is displayed as a single screen in a display area including the hidden area (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-106321 Summary of the Invention [Problem to be solved by the invention]

[0004] In the background art described above, the person watching the screen is not informed which of the multiple images they should look at.

[0005] The present disclosure has been made in view of the above circumstances, and aims to make it easier for the observer to know which of a plurality of images to look at. [Means for solving the problem]

[0006] An information processing device according to an embodiment of the present disclosure includes: An information processing device capable of communicating with a plurality of vehicles performing automatic driving, the information processing device including a control unit, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; Perform an action including:

[0007] An information processing method according to an embodiment of the present disclosure includes: An information processing method by an information processing device capable of communicating with a plurality of vehicles performing automatic driving, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; Includes.

[0008] A program according to an embodiment of the present disclosure includes: A computer as an information processing device that can communicate with multiple autonomously driving vehicles, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; The operation includes: [Effects of the Invention]

[0009] According to an embodiment of the present disclosure, it is possible to make it easier for the observer to know which of the multiple images to look at. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram of an information processing system according to an embodiment of the present invention. [Figure 2]FIG. 1 is a block diagram showing a configuration of an information processing device. [Figure 3] FIG. 1 is a block diagram showing the configuration of a vehicle. [Figure 4] FIG. 2 is a sequence diagram showing the operation of the information processing system. [Figure 5] FIG. 2 is a diagram showing the data structure of a vehicle information DB (database). [Figure 6] FIG. DETAILED DESCRIPTION OF THE INVENTION

[0011] 1 is a schematic diagram of an information processing system S according to this embodiment. The information processing system S includes an information processing device 1 and a vehicle 2. The information processing device 1 is capable of communicating with the vehicle 2 via a network NW. The network NW includes, for example, a mobile communication network, the Internet, or a fixed communication network.

[0012] For ease of explanation, FIG. 1 illustrates one information processing device 1 and one vehicle 2. However, the number of information processing devices 1 and vehicles 2 is not limited to this. For example, the processing performed by the information processing device 1 may be executed by multiple information processing devices 1 that are distributed. The information processing device 1 may be capable of communicating with multiple vehicles 2.

[0013] An overview of the processing executed by the information processing device 1 of this embodiment will be described. The operation of the control unit 11 of the information processing device 1 includes receiving notifications of the details of the abnormality, an interior image, and the number of people inside each of the multiple vehicles from each of the multiple vehicles; determining the load of the autonomous driving process and the number of people inside each of the multiple vehicles and prioritizing the multiple vehicles based on the determination results; and highlighting and displaying the details of the abnormality and the interior image of the vehicle assigned the highest priority. With this configuration, the information processing device 1 can easily identify which of the multiple images a monitor at a control center or the like should look at when multiple vehicles simultaneously experience abnormalities. The information processing device 1 can thus automatically identify the vehicle that should be prioritized, thereby supporting smooth decision-making by the monitor and smooth processing of abnormality notifications.

[0014] The information processing device 1 may be a server that supports the provision of services by a business operator. The information processing device 1 may be installed, for example, in a facility dedicated to the business operator or in a shared facility including a data center. As an alternative example, the information processing device 1 may be mounted on a vehicle 2. The information processing device 1 may be referred to as a center server.

[0015] Vehicle 2 may be any type of automobile, such as a gasoline vehicle, a diesel vehicle, an HEV, a PHEV, a BEV, or an FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. The operation of vehicle 2 may be automated at any level. The level of automation may be, for example, any of levels 1 to 5 in the SAE classification. "SAE" is an abbreviation for Society of Automotive Engineers. Vehicle 2 may be a dedicated MaaS vehicle. "MaaS" is an abbreviation for Mobility as a Service. Alternatively, vehicle 2 may be driven by a driver.

[0016] The internal configuration of the information processing device 1 will be described in detail with reference to FIG.

[0017] The information processing device 1 includes a control unit 11, a communication unit 12, a storage unit 13, and a display unit 14. The components of the information processing device 1 are connected to each other via, for example, a dedicated line so that they can communicate with each other.

[0018] The control unit 11 includes, for example, one or more general-purpose processors including a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The control unit 11 may include one or more dedicated processors specialized for specific processing. Instead of including a processor, the control unit 11 may include one or more dedicated circuits. The dedicated circuits may be, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 11 may include an ECU (Electronic Control Unit). The control unit 11 transmits and receives any information via the communication unit 12.

[0019] The communication unit 12 includes a communication module compatible with one or more wired or wireless LAN (Local Area Network) standards for connecting to a network. The communication unit 12 may include a module compatible with one or more mobile communication standards including LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation). The communication unit 12 may include a communication module compatible with one or more short-range communication standards or specifications including Bluetooth (registered trademark), AirDrop (registered trademark), IrDA, ZigBee (registered trademark), FeliCa (registered trademark), or RFID. The communication unit 12 transmits and receives any information via the network.

[0020] The memory unit 13 includes, for example, semiconductor memory, magnetic memory, optical memory, or a combination of at least two of these, but is not limited to these. The semiconductor memory is, for example, RAM or ROM. The RAM is, for example, SRAM or DRAM. The ROM is, for example, EEPROM. The memory unit 13 may function, for example, as a main memory device, an auxiliary memory device, or a cache memory. The memory unit 13 may store information resulting from analysis or processing by the control unit 11. The memory unit 13 may store various information related to the operation or control of the information processing device 1. The memory unit 13 may store system programs, application programs, embedded software, etc. The memory unit 13 may be provided outside the information processing device 1 and may be accessed by the information processing device 1. The memory unit 13 includes a vehicle information DB.

[0021] The display unit 14 is, for example, a display. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electroluminescence. The display unit 14 may be connected to the information processing device 1 as an external output device instead of being provided in the information processing device 1. Any connection method may be used, for example, USB, HDMI (registered trademark), or Bluetooth (registered trademark). "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0022] The internal configuration of the vehicle 2 will be explained in detail in FIG.

[0023] The vehicle 2 includes a control unit 21, a communication unit 22, a storage unit 23, an imaging unit 24, a display unit 25, an input unit 26, and an output unit 27. The components of the vehicle 2 are connected to each other so that they can communicate with each other, for example, via a dedicated line.

[0024] The description of the hardware configuration of the control unit 21, the communication unit 22, the storage unit 23, and the display unit 25 may be the same as the description of the hardware configuration of the control unit 11, the communication unit 12, the storage unit 13, and the display unit 14. The description here will be omitted.

[0025] The vehicle 2 of this embodiment is driven automatically. The storage unit 23 of the vehicle 2 stores ADK (Autonomous Driving Kit) software for the automatic driving and conductor software.

[0026] The imaging unit 24 includes a camera and captures images. The images may be either still images or videos. The imaging unit 24 may generate images and record the generated images in the storage unit 23. The imaging unit 24 may include a camera that supports remote operation of the vehicle 2 and a surveillance camera for the conductor.

[0027] The display unit 25 may be a signage or a touch panel.

[0028] The input unit 26 is, for example, a microphone, physical keys, capacitance keys, a pointing device, or a touch screen that is integrated with a display. The input unit 26 accepts an operation to input information used for the operation of the vehicle 2. The input unit 26 may be connected to the vehicle 2 as an external input device instead of being provided in the vehicle 2. Any connection method may be used, for example, USB, HDMI (registered trademark), or Bluetooth (registered trademark).

[0029] The output unit 27 includes one or more output interfaces that output information to notify the user. For example, the output interface included in the output unit 27 may be a speaker that outputs information as sound, but is not limited to this. For example, the output unit 27 may be any broadcasting device.

[0030] The vehicle 2 may further include a sensor. The vehicle 2 may further include a communication device for communication between passengers and an operator of the information processing device 1. The vehicle 2 may further include various buttons for operating the bus.

[0031] Hereinafter, as shown in FIG. 4, the processing executed by the information processing system S of this embodiment will be described in detail. Here, as an example, multiple vehicles 2 are operated as autonomous driving buses. An information processing device 1 provided in a control center monitors the multiple vehicles 2. Here, as an example, a total of nine vehicles, namely, vehicle 2A, vehicle 2B, vehicle 2C, vehicle 2D, vehicle 2E, vehicle 2F, vehicle 2G, vehicle 2H, and vehicle 2I, are monitored on the monitoring screen of the display unit 14. As shown in FIG. 6A described later, the remote monitoring screen is divided into nine screens. In-vehicle images of vehicle 2A, vehicle 2B, vehicle 2C, vehicle 2D, vehicle 2E, vehicle 2F, vehicle 2G, vehicle 2H, and vehicle 2I are displayed on screens 2a, 2b, 2c, 2d, 2e, 2f, 2g, 2h, and 2i, respectively.

[0032] The nine vehicles are collectively referred to as vehicle 2. The number of vehicles to be monitored can be set arbitrarily.

[0033] In step S1, the control unit 21 of the vehicle 2 detects and analyzes the situation inside the vehicle using the imaging unit 24 or a sensor. The control unit 21 detects an abnormality by image analysis or the like. The abnormality includes at least one of the following: - The presence of a passenger near the door (for example, a passenger leaning against the door and preventing it from opening) Dangerous behavior while driving Disputes between passengers

[0034] In step S2, the control unit 21 determines whether or not the conductor of the vehicle 2 is able to respond to the abnormality. Whether or not the conductor is able to respond may be determined based on the conductor's judgment.

[0035] If the answer is Yes in step S2, the conductor responds to the abnormality in step S3.

[0036] If the result of step S2 is No, the control unit 21 notifies the information processing device 1 in step S4 of the details of the abnormality, the vehicle interior image, the screen number of the screen displaying the vehicle interior image that needs to be confirmed on the remote monitoring screen of the display unit 14, and the number of people in the vehicle. The notification is also called escalation. As an additional example, at least one of the following requests may be notified: - Requesting passengers near the doors to be careful Request arbitration between passengers

[0037] As an alternative, the control unit 21 may transmit the vehicle interior images to the information processing device 1 periodically or irregularly, regardless of whether an abnormality is detected or not.

[0038] Here, as an example, a situation will be described in which all nine vehicles notify the information processing device 1 of an abnormality. The number of vehicles to notify of an abnormality is arbitrary. As shown in FIG. 5, the control unit 11 stores, in association with each vehicle, the content of the abnormality, the screen number of the screen that needs to be confirmed, and the number of people in the vehicle. As an additional example, the control unit 11 may store, in association with each vehicle, the latitude and longitude of each vehicle, the level of autonomous driving, the load of autonomous driving processing (corresponding to "ADK load" in FIG. 6), and the ADK provider. Information indicating the load of autonomous driving processing may be received from each vehicle, the information processing device 1, etc.

[0039] In step S5 of FIG. 4, the control unit 11 determines the load of the automatic driving process and the number of people in the vehicle for each vehicle.

[0040] In step S6, the control unit 11 assigns a priority to each vehicle based on the determination result. For example, the control unit 11 may assign a higher priority to a vehicle with a heavy load on the automatic driving processing. As an additional or alternative example, the control unit 11 may assign a higher priority to a vehicle with a large number of passengers on board. Here, as an example, a situation is described in which the highest priority is assigned to vehicle 2E. As an additional example, the control unit 11 may assign a higher priority to a vehicle with a large number of emergency stop records. The emergency stop record may be, for example, the average number of emergency stops per 10 kilometers of driving history.

[0041] In step S7, as shown in B of FIG. 6, the control unit 11 divides the interior image of the vehicle 2E assigned the highest priority into nine screens (i.e., screens 2e1, 2e2, 2e3, 2e4, 2e5, 2e6, 2e7, 2e8, and 2e9) and displays them on the display unit 14. Each of the nine screens displays a plurality of interior images captured from a plurality of different positions inside the vehicle 2E. Furthermore, the control unit 11 checks the screen number notified from the vehicle 2E. Here, as an example, the notified screen number is 2e6. The control unit 11 highlights and displays the content of the abnormality and the interior image in screen number 2e6. For example, the control unit 11 may thicken the text indicating the content of the abnormality and the frame of the screen displaying the interior image, or change the color of the text and the frame to red, etc. Additionally or alternatively, the control unit 11 may enlarge or flash the screen corresponding to screen number 2e6.

[0042] In step S8, the control unit 11 may compare the notified current abnormality with past cases. Step S8 is optional.

[0043] In step S9, the control unit 11 determines whether the notified current abnormality is "new" or "known" (existing). Step S9 is optional. For example, when comparing the notified current abnormality with past cases, the control unit 11 determines that the notified current abnormality is "known" if all three items, namely the abnormality content, screen number, and time period, are the same. The control unit 11 may determine that the notified current abnormality is "new" if even one of the three items is different.

[0044] If the answer is Yes in step S9, in step S10, the control unit 11 searches the past archives in the memory unit 13 for the response content taken in the corresponding past case at that time. In step S11, the control unit 11 may display the content of the current abnormality and the response content taken at that time on the remote monitoring screen of the display unit 14.

[0045] If the answer is No in step S9, the control unit 11 does not execute steps S10 and S11.

[0046] As described above, according to this embodiment, the operation of the control unit 11 includes receiving notifications of the details of the abnormality, interior images, and the number of people inside each of the multiple vehicles from each of the multiple vehicles; determining the load of the autonomous driving process and the number of people inside each of the multiple vehicles and prioritizing the multiple vehicles based on the determination results; and highlighting and displaying the details of the abnormality and the interior images of the vehicle assigned the highest priority. With this configuration, the information processing device 1 makes it easy for a monitor at a control center or the like to see which of the multiple images to look at, even if an abnormality occurs in multiple vehicles at the same time in a situation where the monitor must monitor multiple vehicles simultaneously. Therefore, the information processing device 1 can automatically clarify the target vehicle that should be prioritized, thereby supporting smooth decision-making by the monitor and smooth processing of abnormality notifications.

[0047] Furthermore, according to this embodiment, the operation of the control unit 11 includes receiving, from the vehicle assigned the highest priority, a plurality of interior images captured from a plurality of different positions within the vehicle, receiving the screen number of a screen that displays an interior image that needs to be confirmed on the remote monitoring screen among the plurality of interior images, and displaying an image that highlights the interior image corresponding to the screen number. With this configuration, the information processing device 1 can easily determine where an abnormality exists within the vehicle, further supporting smooth judgment by the monitor and smooth processing of abnormality notification.

[0048] Furthermore, according to this embodiment, the operation includes prioritizing multiple vehicles based on their emergency stop history in addition to the determination result. This configuration allows the information processing device 1 to prioritize vehicles that are more likely to make an emergency stop, thereby reducing the possibility of an emergency stop and the impact on passengers standing inside the vehicle.

[0049] Furthermore, according to this embodiment, the operation includes comparing the notified current abnormality with past cases, determining whether the abnormality is new or known from the comparison result, and, if it is determined that the current abnormality is known, displaying the response content that was taken in the corresponding past case.With this configuration, the information processing device 1 supports the monitor in smoothly processing abnormality notifications by referring to past cases.

[0050] According to this embodiment, the operation of the information processing device 1 supports smooth handling of various abnormalities, including at least one of the following: the presence of a passenger near a door, a dangerous act while the train is moving, and a fight between passengers.

[0051] Furthermore, according to this embodiment, the operation includes assigning a higher priority to vehicles with a heavy load on the automatic driving process or to vehicles with a large number of passengers. Especially when driving on city roads, there are many obstacles, which increases the load on the automatic driving process, and therefore, many abnormalities occur. Furthermore, when an abnormality occurs, it takes longer for passengers to get on and off vehicles with many passengers. Therefore, by configuring the information processing device 1 to assign the above priorities, the information processing device 1 can reduce the impact of abnormalities on operation.

[0052] According to this embodiment, the display of the vehicle interior image in an emphasized manner includes enlarging the screen by thickening the frame of the screen displaying the vehicle interior image. With this configuration, the information processing device 1 makes it easier for the observer to know which image to look at.

[0053] Although the present disclosure will be described based on various drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Other modifications are possible within the scope of the present disclosure. For example, the functions included in each means or step may be rearranged so as not to cause logical inconsistencies, and multiple means or steps may be combined or divided into one.

[0054] For example, in the above-described embodiment, a program for executing all or part of the functions or processes of the information processing device 1 can be recorded on a computer-readable recording medium. Computer-readable recording media include non-transitory computer-readable media, such as magnetic recording devices, optical discs, magneto-optical recording media, or semiconductor memories. The program can be distributed, for example, by selling, transferring, or lending a portable recording medium, such as a DVD (Digital Versatile Disc) or CD-ROM (Compact Disc Read Only Memory), on which the program is recorded. The program can also be distributed by storing the program in the storage of a server and transmitting the program from the server to another computer. The program can also be provided as a program product. The present disclosure can also be realized as a program executable by a processor.

[0055] A computer temporarily stores a program recorded on a portable recording medium or transferred from a server in its main storage device. The computer then reads the program stored in the main storage device using a processor and executes processing in accordance with the read program. The computer may also read the program directly from a portable recording medium and execute processing in accordance with the program. The computer may also execute processing in accordance with the received program each time a program is transferred from a server to the computer. Processing may also be executed through a so-called ASP-type service that achieves its functions simply by issuing execution instructions and obtaining results, without transferring the program from the server to the computer. "ASP" is an abbreviation for application service provider. Programs include information used for processing by a computer that is equivalent to a program. For example, data that does not directly instruct a computer but has properties that define computer processing falls under the category of "equivalent to a program."

[0056] Some embodiments of the present disclosure will be described below as examples, however, it should be noted that the embodiments of the present disclosure are not limited to these examples. [Appendix 1] An information processing device capable of communicating with a plurality of vehicles performing automatic driving, the information processing device including a control unit, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; An information processing device that performs operations including: [Appendix 2] In the information processing device according to Supplementary Note 1, the operation is receiving, from the highest-priority vehicle, a plurality of interior images captured from a plurality of different positions within the vehicle; receiving a screen number of a screen that displays an in-vehicle image that needs to be confirmed on a remote monitoring screen from among the plurality of in-vehicle images; highlighting and displaying the vehicle interior image corresponding to the screen number; An information processing device comprising: [Appendix 3] In the information processing device according to Supplementary Note 1 or 2, the operation is and assigning the priorities based on the emergency stop records of each of the plurality of vehicles in addition to the determination results. [Appendix 4] In the information processing device according to any one of Supplementary Notes 1 to 3, the operation is Comparing the reported abnormality with past cases, determining whether the anomaly is novel or known from the comparison results; If it is determined that the current abnormality is known, displaying the details of the measures taken in the corresponding past cases; An information processing device comprising: [Appendix 5] In the information processing device according to any one of Supplementary Notes 1 to 4, The information processing device, wherein the abnormality includes at least one of the presence of a passenger near a door, a dangerous act while the train is moving, and a fight between passengers. [Appendix 6] In the information processing device according to any one of Supplementary Notes 1 to 5, the operation is An information processing device that includes assigning a high priority to vehicles with a heavy load on the automatic driving processing or vehicles with a large number of passengers. [Appendix 7] In the information processing device according to any one of Supplementary Notes 1 to 6, the operation is The information processing device, wherein displaying the vehicle interior image in an emphasized manner includes thickening a frame of a screen displaying the vehicle interior image and enlarging the screen. [Appendix 8] An information processing method by an information processing device capable of communicating with a plurality of vehicles performing automatic driving, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; An information processing method, including: [Appendix 9] 10. The information processing method according to claim 8, receiving, from the highest-priority vehicle, a plurality of interior images captured from a plurality of different positions within the vehicle; receiving a screen number of a screen that displays an in-vehicle image that needs to be confirmed on a remote monitoring screen from among the plurality of in-vehicle images; highlighting and displaying the vehicle interior image corresponding to the screen number; An information processing method, including: [Appendix 10] In the information processing method according to Supplementary Note 8 or 9, An information processing method including assigning the priorities based on the emergency stop records of each of the plurality of vehicles in addition to the determination result. [Appendix 11] In the information processing method according to any one of Supplementary Notes 8 to 10, Comparing the reported abnormality with past cases, determining whether the anomaly is novel or known from the comparison results; If it is determined that the current abnormality is known, displaying the details of the measures taken in the corresponding past cases; An information processing method, including: [Appendix 12] In the information processing method according to any one of Supplementary Notes 8 to 11, The information processing method, wherein the abnormality includes at least one of the presence of a passenger near the door, a dangerous act while the train is moving, and a fight between passengers. [Appendix 13] In the information processing method according to any one of Supplementary Notes 8 to 12, An information processing method including assigning a high priority to a vehicle with a heavy load on the automatic driving processing or a vehicle with a large number of passengers. [Appendix 14] In the information processing method according to any one of Supplementary Notes 8 to 13, The information processing method, wherein displaying the vehicle interior image in an emphasized manner includes thickening a frame of a screen displaying the vehicle interior image and enlarging the screen. [Appendix 15] A computer as an information processing device that can communicate with multiple autonomously driving vehicles, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; A program that causes an operation including [Appendix 16] In the program according to Supplementary Note 15, the operation receiving, from the highest-priority vehicle, a plurality of interior images captured from a plurality of different positions within the vehicle; receiving a screen number of a screen that displays an in-vehicle image that needs to be confirmed on a remote monitoring screen from among the plurality of in-vehicle images; highlighting and displaying the vehicle interior image corresponding to the screen number; Including, the program. [Appendix 17] In the program according to Supplementary Note 15 or 16, the operation The program includes assigning the priorities based on the emergency stop records of each of the plurality of vehicles in addition to the determination result. [Appendix 18] In the program according to any one of Supplementary Notes 15 to 17, the operation is Comparing the reported abnormality with past cases, determining whether the anomaly is novel or known from the comparison results; If it is determined that the current abnormality is known, displaying the details of the measures taken in the corresponding past cases; Including, the program. [Appendix 19] 19. The program according to any one of Supplementary Notes 15 to 18, The program, wherein the abnormality includes at least one of the presence of a passenger near the door, a dangerous act while the train is moving, and a fight between passengers. [Appendix 20] 20. The program according to any one of Supplementary Notes 15 to 19, wherein the operation The program includes assigning a high priority to a vehicle with a heavy load on the automatic driving processing or a vehicle with a large number of passengers. [Explanation of symbols]

[0057] S Information Processing System

Claims

1. An information processing device capable of communicating with a plurality of vehicles performing automatic driving, the information processing device including a control unit, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; An information processing device that performs operations including:

2. 2. The information processing apparatus according to claim 1, wherein the operation is: receiving, from the highest-priority vehicle, a plurality of interior images captured from a plurality of different positions within the vehicle; receiving a screen number of a screen that displays an in-vehicle image that needs to be confirmed on a remote monitoring screen from among the plurality of in-vehicle images; highlighting and displaying the vehicle interior image corresponding to the screen number; An information processing device comprising:

3. 2. The information processing apparatus according to claim 1, wherein the operation is: and assigning the priorities based on the emergency stop records of each of the plurality of vehicles in addition to the determination results.

4. 2. The information processing apparatus according to claim 1, wherein the operation is Comparing the reported abnormality with past cases, determining whether the anomaly is novel or known from the comparison results; If it is determined that the current abnormality is known, displaying the details of the measures taken in the corresponding past cases; An information processing device comprising:

5. 2. The information processing device according to claim 1, The information processing device, wherein the content of the abnormality includes at least one of the presence of a passenger near a door, a dangerous act while the train is moving, and a fight between passengers.

6. 2. The information processing apparatus according to claim 1, wherein the operation is: An information processing device that includes assigning a high priority to vehicles with a heavy load on the automatic driving processing or vehicles with a large number of passengers.

7. 2. The information processing apparatus according to claim 1, wherein the operation is: The information processing device, wherein displaying the vehicle interior image in an emphasized manner includes thickening a frame of a screen displaying the vehicle interior image and enlarging the screen.

8. An information processing method by an information processing device capable of communicating with a plurality of vehicles performing automatic driving, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; An information processing method, including:

9. 9. The information processing method according to claim 8, receiving, from the highest-priority vehicle, a plurality of interior images captured from a plurality of different positions within the vehicle; receiving a screen number of a screen that displays an in-vehicle image that needs to be confirmed on a remote monitoring screen from among the plurality of in-vehicle images; highlighting and displaying the vehicle interior image corresponding to the screen number; An information processing method, including:

10. 9. The information processing method according to claim 8, An information processing method including assigning the priorities based on the emergency stop records of each of the plurality of vehicles in addition to the determination result.

11. 9. The information processing method according to claim 8, Comparing the reported abnormality with past cases, determining whether the anomaly is novel or known from the comparison results; If it is determined that the current abnormality is known, displaying the details of the measures taken in the corresponding past cases; An information processing method, including:

12. 9. The information processing method according to claim 8, The information processing method, wherein the abnormality includes at least one of the presence of a passenger near a door, a dangerous act while the train is moving, and a fight between passengers.

13. 9. The information processing method according to claim 8, An information processing method including assigning a high priority to a vehicle with a heavy load on the automatic driving processing or a vehicle with a large number of passengers.

14. 9. The information processing method according to claim 8, The information processing method, wherein displaying the vehicle interior image in an emphasized manner includes thickening a frame of a screen displaying the vehicle interior image and enlarging the screen.

15. A computer as an information processing device that can communicate with multiple autonomously driving vehicles, receiving a notification of the content of the abnormality, an image of the interior of the vehicle, and the number of people inside the vehicle from each of the plurality of vehicles; Determining the load of the automatic driving process and the number of people inside the vehicle for each of the plurality of vehicles, and prioritizing the plurality of vehicles based on the determination result; highlighting and displaying the details of the abnormality of the vehicle assigned the highest priority and an image of the interior of the vehicle; A program that causes an operation including

16. 16. The program according to claim 15, wherein the operation is: receiving, from the highest-priority vehicle, a plurality of interior images captured from a plurality of different positions within the vehicle; receiving a screen number of a screen that displays an in-vehicle image that needs to be confirmed on a remote monitoring screen from among the plurality of in-vehicle images; highlighting and displaying the vehicle interior image corresponding to the screen number; Including, the program.

17. 16. The program according to claim 15, wherein the operation is: The program includes assigning the priorities based on the emergency stop records of each of the plurality of vehicles in addition to the determination result.

18. 16. The program according to claim 15, wherein the operation Comparing the reported abnormality with past cases, determining whether the anomaly is novel or known from the comparison results; If it is determined that the current abnormality is known, displaying the details of the measures taken in the corresponding past cases; Including, the program.

19. 16. The program according to claim 15, The program, wherein the abnormality includes at least one of the presence of a passenger near a door, a dangerous act while the train is moving, and a fight between passengers.

20. 16. The program according to claim 15, wherein the operation is: The program includes assigning a high priority to a vehicle with a heavy load on the automatic driving processing or a vehicle with a large number of passengers.

Images