Information processor and maas provision method

Abstract

To reduce in-car announcements reminding passengers to refrain from unnecessary movement within the vehicle.SOLUTION: A control unit of an information processor acquires the number of standing passengers within a vehicle. The control unit of the information processor determines whether to execute detection processing for passengers moving within the vehicle, based on analysis of moving images captured inside the vehicle, according to the number of standing passengers. When the detection processing detects a standing passenger moving within the vehicle, the control unit of the information processor outputs announcement information for making in-car announcements to remind passengers to refrain from movement within the vehicle.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and a MaaS providing method. [Background technology]

[0002] Patent Document 1 discloses a monitoring system. In the monitoring system, photographed images of each of the passenger compartments of a plurality of moving bodies are acquired. In the monitoring system, the amount of movement of passengers in each of the passenger compartments of the plurality of moving bodies is acquired based on the acquired photographed images. In the monitoring system, a priority indicating the degree of necessity for monitoring passengers is calculated based on the acquired amount of movement. Then, in the monitoring system, a display target on a display device that sequentially switches and displays the passenger compartments of each of the plurality of moving bodies at a display switching period is determined based on the priority. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-94724 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to suppress in-vehicle announcements to warn passengers about moving around inside the vehicle when it is not necessary. [Means for solving the problem]

[0005] The information processing device according to the present disclosure includes: Obtaining the number of standing passengers in the vehicle; determining whether or not to execute a process of detecting passengers moving inside the vehicle by analyzing a moving image captured inside the vehicle according to the number of standing passengers; When a standing passenger moving inside the vehicle is detected in the detection process, announcement information is output to make an announcement inside the vehicle to alert passengers about their movement inside the vehicle. The controller is configured to: [Effects of the Invention]

[0006] The present disclosure makes it possible to suppress in-vehicle announcements warning passengers about unnecessary movement within the vehicle. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a monitoring system. [Figure 2] FIG. 2 is a diagram showing an example of a moving image inside a vehicle captured by an in-vehicle camera. [Figure 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of the in-vehicle device. [Figure 4] FIG. 4 is a flowchart of the first process. [Figure 5] FIG. 5 is a flowchart of the second process. DETAILED DESCRIPTION OF THE INVENTION

[0008] There are cases where passengers in a vehicle fall while moving around inside the vehicle. Therefore, when passenger movement is detected inside the vehicle, an announcement may be made inside the vehicle to warn passengers about movement inside the vehicle. Here, we consider a case where passenger movement inside the vehicle is detected by analyzing video images captured by a camera installed inside the vehicle.

[0009] When there are many standing passengers in a vehicle (hereinafter sometimes referred to as "standing passengers"), the distance between the standing passengers is shorter than when there are few standing passengers. Therefore, when there are many standing passengers, the camera installed in the vehicle is more likely to capture video images in which standing passengers overlap each other than when there are few standing passengers. In this case, because the standing passengers overlap in the video images, it becomes difficult to distinguish the outlines of two different standing passengers captured during video analysis.

[0010] Therefore, in video analysis, two different standing passengers may be recognized as the same person. In this case, the position of one standing passenger may be recognized as the position of two standing passengers who are the same person in the captured video. In this case, if the position of the other standing passenger is recognized as the position of the two standing passengers who are the same person in the next frame, the positions of the two standing passengers who are the same person will be recognized as having moved from the position of one standing passenger to the position of the other standing passenger. This may result in the standing passengers being mistakenly recognized as moving. In this way, when there are a large number of standing passengers, there is a higher possibility that the movement of standing passengers in the vehicle will be erroneously detected compared to when there are few standing passengers.

[0011] Furthermore, compared to when there are few standing passengers, when there are many standing passengers, the space for movement within the vehicle is smaller, and movement within the vehicle is therefore restricted. Therefore, even if the movement of a standing passenger is detected when there are many standing passengers, it is expected that the detection is more likely to be a false detection than when there are few standing passengers.

[0012] Therefore, a control unit of an information processing device according to the present disclosure acquires the number of standing passengers in the vehicle. The control unit of the information processing device determines whether to execute a detection process to detect passengers moving within the vehicle by analyzing video images captured inside the vehicle, depending on the number of standing passengers. Then, when the control unit detects standing passengers moving within the vehicle in the detection process, it outputs announcement information to make an in-vehicle announcement to warn passengers about movement within the vehicle.

[0013] As described above, the information processing device determines whether to execute the detection process depending on the number of standing passengers. This suppresses the execution of the detection process in situations where there is a possibility that standing passengers may be erroneously detected as moving. Furthermore, the execution of the detection process is suppressed in situations where movement within the vehicle is suppressed. Therefore, it is possible to suppress the output of announcement information in these situations. As a result, it is possible to suppress in-vehicle announcements to warn passengers about movement within the vehicle by passengers in unnecessary situations.

[0014] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc. described in each embodiment are not intended to limit the technical scope of the disclosure to those configurations.

[0015] <Embodiment> A monitoring system 1 in this embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a diagram showing a schematic configuration of the monitoring system 1. The monitoring system 1 is configured to include an in-vehicle device 100, an in-vehicle camera 200, and an acceleration sensor 300. In the monitoring system 1, the in-vehicle device 100, the in-vehicle camera 200, and the acceleration sensor 300 are interconnected via an in-vehicle network.

[0016] (In-car camera) The in-vehicle camera 200 is a camera installed inside the vehicle 10. The vehicle 10 is a vehicle that can accommodate multiple passengers. Furthermore, passengers can stand inside the vehicle 10. In this embodiment, the vehicle 10 is a bus. However, the vehicle 10 may be a vehicle other than a bus as long as it can accommodate multiple passengers and allow passengers to stand inside the vehicle. The vehicle 10 may be, for example, a train car.

[0017] In-vehicle camera 200 captures images of the interior of vehicle 10. In-vehicle camera 200 is installed on the top of vehicle 10. In-vehicle camera 200 overlooks the passengers in vehicle 10. This allows in-vehicle camera 200 to capture images of the entire interior of vehicle 10. In-vehicle camera 200 transmits the captured video images to in-vehicle device 100 in real time via the in-vehicle network.

[0018] The acceleration sensor 300 is a sensor that detects acceleration. The acceleration sensor 300 transmits the detected acceleration to the in-vehicle device 100 in real time via an in-vehicle network. This allows the in-vehicle device 100 to grasp the acceleration of the vehicle 10.

[0019] (In-vehicle device) The in-vehicle device 100 is a device mounted on the vehicle 10. The in-vehicle device 100 outputs various pieces of information to passengers of the vehicle 10 (displaying information on a display, outputting audio, etc.). There is a possibility that a passenger of the vehicle 10 may fall over while moving inside the vehicle 10. Therefore, when a passenger of the vehicle 10 is moving inside the vehicle, the in-vehicle device 100 makes an in-vehicle announcement to alert the passenger of the vehicle 10 regarding movement inside the vehicle.

[0020] The in-vehicle device 100 performs a process (hereinafter, sometimes referred to as a "detection process") to detect the movement of passengers inside the vehicle 10 by analyzing the moving images captured by the in-vehicle camera 200. Specifically, in the detection process, the in-vehicle device 100 identifies the outline of the passenger captured in the moving images and identifies the position of the passenger. Then, in the detection process, the in-vehicle device 100 detects the movement of the passenger inside the vehicle 10 by determining whether the position of the identified passenger is moving.

[0021] At this time, when there are many passengers standing inside vehicle 10 (hereinafter sometimes referred to as "standing passengers"), the distance between the standing passengers is shorter than when there are few standing passengers. Therefore, when there are many standing passengers, moving images of standing passengers overlapping each other are more likely to be captured by the camera installed inside the vehicle than when there are few standing passengers.

[0022] Fig. 2 is a diagram showing an example of a moving image of the interior of vehicle 10 captured by in-vehicle camera 200. In the moving image shown in Fig. 2, standing passenger 30A is positioned in front of standing passenger 30B, and the two passengers 30A and 30B overlap. In this case, because standing passenger 30A and standing passenger 30B overlap in the moving image, it is difficult for in-vehicle device 100 to distinguish the contours of standing passenger 30A and standing passenger 30B when analyzing the moving image.

[0023] Therefore, in the video analysis, the in-vehicle device 100 may recognize the standing passenger 30A and the standing passenger 30B as the same person. In the example shown in Fig. 2, the in-vehicle device 100 first recognizes the standing passenger 30A as the standing passenger 30A and the standing passenger 30B who are the same person. Then, in the next frame, the in-vehicle device 100 recognizes the standing passenger 30B as the standing passenger 30A and the standing passenger 30B who are the same person.

[0024] That is, the positions of the standing passengers 30A and 30B, who are the same person, are first recognized as the position of the standing passenger 30A (the position of the shaded area on the left side of FIG. 2). In this frame, the vehicle-mounted device 100 recognizes the position of the standing passenger 30A as the position of the standing passenger 30B (the position of the shaded area on the right side of FIG. 2). As a result, the vehicle-mounted device 100 recognizes that the standing passengers 30A and 30B, who are the same person, are moving from the position of the standing passenger 30A to the position of the standing passenger 30B before and after the frame. In this way, when there are many standing passengers, there is a higher possibility that the standing passengers will be erroneously detected as moving compared to when there are few standing passengers.

[0025] Furthermore, compared to when there are few standing passengers, when there are many standing passengers, there is less space to move around inside the vehicle 10, which reduces movement inside the vehicle. Therefore, even if the movement of a standing passenger is detected when there are many standing passengers, there is a higher possibility that the detection is a false detection than when there are few standing passengers.

[0026] Therefore, the in-vehicle device 100 acquires the number of standing passengers in the vehicle 10 (hereinafter, may be referred to as the "number of standing passengers"). The in-vehicle device 100 determines whether to execute the detection process depending on the number of standing passengers. Then, when the in-vehicle device 100 detects standing passengers moving inside the vehicle in the detection process, it makes an in-vehicle announcement to call attention to movement inside the vehicle. The method by which the in-vehicle device 100 determines whether to execute the detection process and the method by which the in-vehicle announcement is made will be described in detail later.

[0027] The in-vehicle device 100 includes a computer having a processor 110, a main memory 120, an auxiliary memory 130, and a communication interface (communication I / F) 140. The processor 110 is, for example, a central processing unit (CPU) or a digital signal processor (DSP). The main memory 120 is, for example, a random access memory (RAM). The auxiliary memory 130 is, for example, a read-only memory (ROM). The auxiliary memory 130 is, for example, a hard disk drive (HDD) or a disc recording medium such as a CD-ROM, a DVD disc, or a Blu-ray disc. The auxiliary memory 130 may also be a removable medium (portable storage medium). Examples of removable media include a USB memory or an SD card. The communication I / F 140 is, for example, a local area network (LAN) interface board. The speaker 150 is a speaker provided inside the vehicle 10.

[0028] In the in-vehicle device 100, the auxiliary storage unit 130 stores an operating system (OS), various programs, various information tables, and the like. In addition, in the in-vehicle device 100, the processor 110 loads the programs stored in the auxiliary storage unit 130 into the main storage unit 120 and executes them, thereby realizing various functions as described below. However, some or all of the functions of the in-vehicle device 100 may be realized by hardware circuits such as ASICs or FPGAs. Note that the in-vehicle device 100 does not necessarily have to be realized by a single physical configuration, and may be configured by multiple computers that cooperate with each other.

[0029] (Functional configuration) Next, the functional configuration of the in-vehicle device 100 that constitutes the monitoring system 1 according to this embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram that schematically shows an example of the functional configuration of the in-vehicle device 100.

[0030] The in-vehicle device 100 includes a control unit 101, a communication unit 102, and an output unit 103. The control unit 101 has a function of performing arithmetic processing for controlling the in-vehicle device 100. The control unit 101 can be realized by a processor 110 in the in-vehicle device 100. The communication unit 102 has a function of connecting the in-vehicle device 100 to an in-vehicle network. , can be realized by a communication I / F 140 in the in-vehicle device 100. The output unit 103 has a function of outputting sound into the vehicle 10. The output unit 103 can be realized by a speaker 150 in the in-vehicle device 100. Note that the output unit 103 may have a function of displaying images, etc. on a display provided in the vehicle 10.

[0031] The control unit 101 receives video images of the interior of the vehicle 10 from the in-vehicle camera 200 via the communication unit 102. The control unit 101 acquires the number of standing passengers in the vehicle 10 by analyzing the video images of the interior of the vehicle 10. Specifically, the control unit 101 identifies the positions of characteristic points (e.g., heads) of passengers in the vehicle 10 as the positions of the passengers through video analysis. Then, the control unit 101 identifies passengers located in an area where standing passengers are allowed as standing passengers, and counts the number of standing passengers.

[0032] Furthermore, the control unit 101 monitors the position of the identified standing passenger. Then, the control unit 101 executes the detection process by referring to the position of the standing passenger. Specifically, in the detection process, if the position of the standing passenger has moved by a predetermined distance or more within a predetermined time, the control unit 101 determines that the standing passenger is moving within the vehicle 10. In other words, in the detection process, if the head of the standing passenger has moved by a predetermined distance or more within a predetermined time, the control unit 101 determines that the standing passenger is moving within the vehicle 10.

[0033] On the other hand, as described above, when the number of standing passengers in vehicle 10 is large, the likelihood of false detection of the movement of standing passengers increases compared to when the number of standing passengers is small. Furthermore, when the number of standing passengers is large, even if the movement of standing passengers is detected, the likelihood of the detection being false is higher than when the number of standing passengers is small. Therefore, control unit 101 determines whether the number of standing passengers is equal to or greater than a first threshold. Here, the first threshold is a value determined according to the density of passengers in vehicle 10. The first threshold is determined by multiplying a predetermined density by the area of ​​the boarding section of vehicle 10. The predetermined density is determined as a density at which in-vehicle camera 200 is expected to capture video images of standing passengers overlapping each other, and is determined as a density at which the movement of standing passengers in the vehicle is expected to be suppressed.

[0034] The control unit 101 acquires the acceleration of the vehicle 10 from the acceleration sensor 300 via the communication unit 102. The control unit 101 acquires the horizontal acceleration of the vehicle 10 (hereinafter, may be referred to as "horizontal acceleration") as the acceleration of the vehicle 10. Here, when the horizontal acceleration of the vehicle 10 is large, a standing passenger may stagger or his / her upper body may sway more than when the horizontal acceleration of the vehicle 10 is small. Therefore, even though the standing passenger is not moving inside the vehicle, the head of the standing passenger may move a predetermined distance or more within a predetermined time. Therefore, when the horizontal acceleration is an acceleration that causes the standing passenger to stagger or his / her upper body to sway, there is a higher possibility that the standing passenger will be erroneously detected as moving inside the vehicle than when the horizontal acceleration is not large.

[0035] Therefore, the control unit 101 determines to prohibit the execution of the detection process when the number of standing passengers is equal to or greater than a first threshold and the horizontal acceleration is equal to or greater than a predetermined value. Here, the predetermined value is set to an acceleration that is expected to cause standing passengers to stumble or their upper bodies to sway in the vehicle 10. Furthermore, even if the number of standing passengers is equal to or greater than the first threshold, there may be passengers moving around inside the vehicle. Therefore, the control unit 101 determines to execute the detection process when the number of standing passengers is equal to or greater than the first threshold and the horizontal acceleration is less than a predetermined value. Furthermore, the control unit 101 determines to execute the detection process when the number of standing passengers is less than the first threshold.

[0036] The control unit 101 may determine to prohibit the execution of the detection process when the number of standing passengers exceeds a first threshold and the horizontal acceleration exceeds a predetermined value. The control unit 101 determines to execute the detection process when the number of standing passengers exceeds a first threshold and the horizontal acceleration is less than a predetermined value. At this time, the control unit 101 determines to execute the detection process when the number of standing passengers is less than the first threshold. In this case, the control unit 101 may make either a decision as to whether to execute the detection process when the number of standing passengers is equal to the first threshold or when the horizontal acceleration is equal to a predetermined value.

[0037] When the control unit 101 determines to execute the detection process, it starts the detection process. When the control unit 101 detects a standing passenger moving inside the vehicle during the detection process, the control unit 101 makes an in-vehicle announcement (hereinafter, sometimes simply referred to as an "in-vehicle announcement") via the output unit 103 to call attention to the movement inside the vehicle.

[0038] Here, the greater the number of standing passengers, the higher the possibility of false detection in the detection process. Therefore, when the control unit 101 detects the movement of standing passengers inside the vehicle in the detection process, it makes different in-vehicle announcements depending on the number of standing passengers, depending on whether the possibility of false detection is high or low.

[0039] Specifically, when the number of standing passengers is equal to or greater than the second threshold, the control unit 101 outputs behavior caution information for making an announcement to urge passengers to be careful about the behavior of the vehicle. The announcement to urge passengers to be careful about the behavior of the vehicle is, for example, an announcement about the swaying of the vehicle 10 while it is moving. Furthermore, when the number of standing passengers is less than the second threshold, the control unit 101 outputs safety behavior information for making an announcement to urge passengers to take a predetermined behavior for safety. An example of the predetermined behavior is sitting in a seat. Another example of the predetermined behavior is holding onto a strap. Note that the predetermined behavior may also be remaining standing in the current position without moving within the vehicle. Note that the second threshold may be the same value as the first threshold, or may be a value smaller than the first threshold.

[0040] In this way, the control unit 101 outputs either the behavior caution information or the safe behavior information depending on the number of standing passengers. Here, the content of the in-car announcement based on the output of the safe behavior information provides a more direct warning to standing passengers regarding their movement within the car than the content of the in-car announcement based on the behavior caution information. In this way, an indirect warning is issued when there is a high possibility that the detection in the detection process is a false positive, and a direct warning is issued when there is a low possibility that the detection in the detection process is a false positive. This prevents a direct warning in-car announcement from being issued when the detection in the detection process is a false positive, thereby preventing passengers from feeling uncomfortable.

[0041] (First process) The first process executed by the control unit 101 in the in-vehicle device 100 in the monitoring system 1 will be described with reference to Fig. 4. Fig. 4 is a flowchart of the first process. The first process is a process for determining whether or not to execute the detection process. The first process is repeatedly executed at predetermined intervals. Furthermore, the first process is executed when the vehicle 10 is traveling.

[0042] In the first process, first, in S101, the number of standing passengers in the vehicle 10 is acquired. Next, in S102, it is determined whether the number of standing passengers is equal to or greater than a first threshold. If a negative determination is made in S102, it can be assumed that there is a lower possibility that movement within the vehicle will be erroneously detected in the detection process compared to if a positive determination is made. Therefore, in S106, it is determined that the detection process is to be executed. Then, the first process is temporarily terminated.

[0043] If a negative determination is made in S102, the horizontal acceleration is acquired from the acceleration sensor 300 in S103. Next, in S104, if the acquired horizontal acceleration is equal to or greater than a predetermined value, It is determined whether or not there is any movement within the vehicle. If a negative determination is made in S104, the number of standing passengers is equal to or greater than the first threshold value, and the horizontal acceleration is less than a predetermined value. Therefore, although there is a higher possibility that movement within the vehicle will be erroneously detected in the detection process than when a negative determination is made in S102, there is a lower possibility that movement within the vehicle will be erroneously detected in the detection process than when a positive determination is made in S104. Therefore, in S106, it is decided to execute the detection process. Then, the first process is temporarily terminated.

[0044] If a positive determination is made in S104, the number of standing passengers is equal to or greater than the first threshold value, and the horizontal acceleration is equal to or greater than a predetermined value. Therefore, it is assumed that there is a higher possibility of erroneous detection in the detection process than if a negative determination is made. Therefore, in S105, it is determined that execution of the determination process is prohibited. Then, the first process is temporarily terminated.

[0045] (Second process) Next, the second process executed by the control unit 101 in the in-vehicle device 100 in the monitoring system 1 will be described with reference to Fig. 5. Fig. 5 is a flowchart of the second process. The second process is a process of executing a detection process and outputting behavior caution information or safe behavior information when a standing passenger is detected moving inside the vehicle 10. The second process starts when it is determined in S106 of the first process that the detection process is to be executed.

[0046] In the second process, first, in S201, a detection process is executed by video image analysis. Next, in S202, it is determined whether movement within the vehicle has been detected in the detection process. Specifically, in the detection process, it is determined whether the positions of standing passengers have moved a predetermined distance or more within a predetermined time. Next, in S203, it is determined whether the number of standing passengers is equal to or greater than a second threshold. If a positive determination is made in S203, behavior caution information is output in S204. That is, in S204, behavior caution information is output instead of safe behavior information. Then, the second process is terminated. On the other hand, if a negative determination is made in S203, safe behavior information is output in S205. That is, in S205, safe behavior information is output instead of behavior caution information. Then, the second process is terminated.

[0047] As described above, the monitoring system 1 determines whether to execute the detection process depending on the number of standing passengers. This suppresses the execution of the detection process in situations where there is a high possibility that standing passengers will be erroneously detected as moving. Furthermore, the execution of the detection process is suppressed in situations where movement within the vehicle 10 is suppressed. Therefore, in-vehicle announcements can be suppressed in these situations. In this way, it is possible to suppress in-vehicle announcements to warn passengers about movement within the vehicle 10 by passengers in unnecessary situations.

[0048] (Variation 1) In this embodiment, the in-vehicle device 100 determines to execute the detection process when the number of standing passengers is equal to or greater than a first threshold and the horizontal acceleration is less than a predetermined value. On the other hand, in this modified example, the in-vehicle device 100 determines to prohibit the execution of the detection process when the number of standing passengers is equal to or greater than the first threshold. In other words, the in-vehicle device 100 determines to prohibit the execution of the detection process when the number of standing passengers is equal to or greater than the first threshold, and determines to execute the detection process when the number of standing passengers is less than the first threshold.

[0049] As a result, regardless of the horizontal acceleration, there is a high possibility that standing passengers will be erroneously detected as moving, and in situations where movement within the vehicle 10 is suppressed, the detection process is not executed. Even in this way, it is possible to suppress in-vehicle announcements to warn passengers about movement within the vehicle 10 by passengers in unnecessary situations. In this modified example, the detection process is not executed when the number of standing passengers is equal to or greater than the first threshold, and therefore the second threshold is set to the first threshold. is set to a value smaller than

[0050] (Variation 2) As described above, the greater the number of standing passengers, the greater the possibility of false detection in the detection process. Therefore, the greater the number of standing passengers, the greater the possibility of unnecessary in-vehicle announcements being made. Furthermore, if behavior caution information or safe behavior information is output every time in-vehicle movement is detected in the detection process, the in-vehicle announcement will be made every time even if in-vehicle movement is falsely detected. Therefore, it is expected that passengers in the vehicle 10 will feel uncomfortable if in-vehicle announcements are made multiple times even when in-vehicle movement is not occurring. Furthermore, even if behavior caution information or safe behavior information is not output every time in-vehicle movement is detected in the detection process, passengers in the vehicle 10 will be able to understand that they are being warned about in-vehicle movement if these information is announced a certain number of times.

[0051] Therefore, when the number of standing passengers exceeds a third threshold that is equal to or less than the first threshold, the in-vehicle device 100 limits the number of times that the behavior caution information or the safe behavior information is output within a predetermined period. Here, the third threshold may be the same as or different from the second threshold.

[0052] In this case, the number of passengers in vehicle 10 does not change while vehicle 10 is traveling between bus stops. Therefore, it is assumed that making a predetermined number of in-vehicle announcements while vehicle 10 is traveling between bus stops is sufficient. Therefore, the predetermined period is set as the period during which vehicle 10 travels between bus stops. Furthermore, the predetermined period may be, for example, a period determined by a predetermined length of time. In this manner, unnecessary in-vehicle announcements to call attention can be suppressed in situations where there is a high possibility of erroneous detection in the detection process.

[0053] (Variation 3) The monitoring system 1 can be used in various situations. The monitoring system 1 may be used to provide MaaS (Mobility as a Service), which is a service that utilizes mobility.

[0054] <Other embodiments> The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate within the scope of the present disclosure. Furthermore, the processes and means described in the present disclosure may be freely combined and implemented as long as no technical contradiction occurs.

[0055] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.

[0056] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include any type of medium suitable for storing electronic instructions, such as a magnetic disk (e.g., a floppy disk or a hard disk drive (HDD)), an optical disk (e.g., a CD-ROM, a DVD disk, or a Blu-ray disk), a read-only memory (ROM), a random-access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, or an optical card. [Explanation of symbols]

[0057] 1. Surveillance system 10. Vehicle 30. Standing passengers 100...In-vehicle equipment 101 Control unit 102··Communications Department 103 Output section 200··In-car camera 300··Accelerometer

Claims

1. Obtaining the number of standing passengers in the vehicle; determining whether or not to execute a process of detecting passengers moving inside the vehicle by analyzing a moving image captured inside the vehicle according to the number of standing passengers; When a standing passenger moving inside the vehicle is detected in the detection process, announcement information is output to make an announcement inside the vehicle to alert passengers about their movement inside the vehicle. a control unit configured to perform Information processing device.

2. The determination of whether or not to execute the detection process is determining to prohibit execution of the detection process when the number of standing passengers exceeds a first threshold; determining to execute the detection process when the number of standing passengers is less than the first threshold value; Including, The information processing device according to claim 1 .

3. The control unit obtaining a horizontal acceleration of the vehicle; and further configured to perform The determination of whether or not to execute the detection process is determining to prohibit execution of the detection process when the number of standing passengers exceeds a first threshold value and the acceleration exceeds a predetermined value; determining to execute the detection process when the number of standing passengers exceeds the first threshold value and the acceleration is less than the predetermined value; determining to execute the detection process when the number of standing passengers is less than the first threshold value; Including, The information processing device according to claim 1 .

4. The announcement information to be output is a first announcement to call attention to a behavior of the vehicle when the number of standing passengers exceeds a second threshold that is equal to or less than the first threshold; If the number of standing passengers is less than the second threshold, a second announcement is made to encourage predetermined safety behavior.

4. The information processing device according to claim 2 or 3.

5. acquiring the announcement information includes limiting the number of times the announcement information is output within a predetermined period when the number of standing passengers exceeds a third threshold value that is equal to or less than the first threshold value; 4. The information processing device according to claim 2 or 3.

6. Using the information processing device according to claim 1, MaaS (Mobility as a Service) provision method.

Images