Information processing device, information processing method, and notification system

Abstract

The present invention allows a confirming person to perform confirmation work satisfactorily.　On the basis of information from a sensor, the movement of the confirming person, who confirms whether a subject for confirmation is left in a predetermined space, is acquired. At the timing of the start of confirmation, the initial value of a waiting time before notification of uncompleted confirmation is issued is set to a timer. The remaining value of the waiting time in the timer is adjusted on the basis of the movement of the confirming person. When the remaining value of the waiting time in the timer becomes zero without a confirmation button being pressed and operated, the confirming person is notified from the notification unit that the confirmation is not completed. In a state in which the confirmation is being performed by the confirming person, the notification of uncompleted confirmation is suppressed, allowing the confirming person to perform the confirmation work satisfactorily.

Description

Information processing device, information processing method, and notification system

[0001] The present technology relates to an information processing device, an information processing method, and a notification system, and more particularly to an information processing device or the like that allows a checker to perform a check task in a satisfactory manner.

[0002] In recent years, there have been many accidents involving children being left behind on school buses (shuttle buses) for kindergartens, nurseries, etc. This would not have happened if the school bus driver or the accompanying nursery school teacher had done a thorough check. However, in reality, it is believed that this occurs due to incomplete work, carelessness, or other factors, or a combination of these.

[0003] In light of this situation, efforts are being made to prevent young children from being left behind. The Ministry of Land, Infrastructure, Transport and Tourism published the "Guidelines for Safety Devices to Help Prevent Children from Being Left Behind on Shuttle Buses" in December 2022. In addition, the Cabinet Office has compiled emergency measures to prevent recurrence, including making it mandatory to install safety devices on buses serving kindergartens, nurseries, and other schools nationwide from April 2023.

[0004] In response to this trend, many equipment manufacturers are offering devices that comply with the guidelines. These devices can be broadly divided into the following two types. The first type is a type that installs an "alight confirmation button," in which the driver completes the interior check by pressing the alight confirmation button at the rear of the bus after the power of the school bus has been shut off. The second type is a type that installs a "sensor," for example, a camera, to detect whether any children have been left behind inside the bus.

[0005] For example, Patent Documents 1 and 2 disclose examples of the second embodiment. According to these examples, a camera captures images of the interior of the vehicle, and if a child remains in the vehicle after the child exits, the driver is notified. However, there are concerns that the camera's operational performance may be impaired to a certain extent in blind spots or in dark surroundings. Furthermore, because the system relies entirely on the camera, there are concerns that it may be significantly vulnerable to unexpected events such as camera failure, temporary malfunction, or the child intentionally avoiding detection.

[0006] In fact, the first method, i.e., driver-initiated exit confirmation, is a superior method. First, it is extremely inexpensive to implement. Second, it essentially provides a highly flexible exit confirmation method that utilizes human intelligence.

[0007] However, in the first mode, if the exit confirmation button is not pressed within a predetermined time, a notification sound, such as an alarm sound, buzzer sound, warning message sound, etc., may be emitted. The issuance of a notification sound can be a significant psychological burden for the driver or the children exiting the vehicle.

[0008] Therefore, for example, there is a concern that the driver may be so concerned about the notification sound that they neglect to check. Also, for example, the driver may be so concerned about the children getting off the bus that they fail to ensure their safety. Furthermore, in an environment where the notification sound is avoided, such as a quiet residential area where the driver is concerned about the notification sound being emitted, and the driver wants to turn off the notification sound for some reason, the driver may intentionally stop the notification sound from being emitted and then neglect to resume operation.

[0009] In order to avoid the psychological pressure on the driver and the children caused by the notification sound as described above, it is possible to set a long waiting time before the notification sound is emitted. In that case, if the waiting time is set longer than necessary, for example, when the bus is stopped, there is a possibility that the driver will leave the school bus without checking whether the children have got off due to an emergency.

[0010] JP 2020-003967 A JP 2023-009057 A

[0011] An object of the present technology is to enable the checker to perform the check work well.

[0012] The concept of this technology is an information processing device that includes a control unit that controls the following processes: a process of acquiring the movements of a checker who checks whether there are any items remaining to be checked in a specified space based on information from a sensor; a process of setting an initial value for the waiting time until a notification that the check is incomplete in a timer at the timing of starting the check; a process of adjusting the remaining value of the waiting time in the timer based on the movements of the checker; and a process of having a notification unit notify the checker that the check is incomplete when the remaining value of the waiting time in the timer becomes 0 without the check button being pressed.

[0013] In this technology, the control unit controls the acquisition process, the setting process, the adjustment process, and the notification process. In the acquisition process, the movement of a person checking whether a check target remains in a predetermined space is acquired based on information from a sensor.

[0014] For example, the information from the sensor may include periodically detected information on the position of the inspector. In this case, for example, the information from the sensor may further include periodically detected information on the speed of the inspector. By including periodically detected information on the position of the inspector and periodically detected information on the speed of the inspector in the information from the sensor, it becomes possible to easily obtain the movement of the inspector based on the information from the sensor.

[0015] Furthermore, for example, in the acquisition process, information from the sensor may be subjected to tracking processing before use. By performing tracking processing on the information from the sensor in this manner, it is possible to improve the noise resistance of the information from the sensor.

[0016] Furthermore, for example, the sensor may be a millimeter wave radar, which provides information including the location (distance, direction) of the inspector and the speed of the inspector, making it possible to easily obtain the movement of the inspector.

[0017] In the setting process, an initial value of the waiting time until a notification that the confirmation is incomplete is set in the timer at the timing of starting the confirmation. For example, if the predetermined space is the interior space of a school bus for a kindergarten, nursery school, etc., the timing of starting the confirmation may be the timing when the power source (engine, motor, etc.) is stopped.

[0018] In the adjustment process, the remaining waiting time value on the timer is adjusted based on the checker's movement. For example, in the adjustment process, if the checker's movement is such that there is a possibility that the checker will delay pressing the confirmation button, the remaining waiting time value on the timer may be adjusted to increase. This makes it possible to appropriately adjust the waiting time until a notification that the check is not completed is sent.

[0019] In this case, for example, a movement that may delay the checker's pressing of the confirmation button may be a movement away from the confirmation button. Also, in this case, for example, a movement that may delay the checker's pressing of the confirmation button may be a movement to stop at a predetermined position. Also, in this case, for example, a movement that may delay the checker's pressing of the confirmation button may be a movement to proceed along a path toward a location different from the path toward the confirmation button.

[0020] Furthermore, for example, the adjustment process may adjust the remaining value of the waiting time on the timer depending on the location of the person checking. This makes it possible to more appropriately adjust the waiting time until a notification that the check is incomplete depending on the location of the person checking. In this case, for example, the remaining value of the waiting time on the timer may be adjusted depending on the distance from the checker to the confirmation button. In this case, for example, the remaining value of the waiting time on the timer may be adjusted depending on which of multiple areas into which a predetermined space is divided the checker is located.

[0021] Furthermore, for example, the adjustment process may adjust the remaining value of the waiting time in the timer in accordance with the characteristic movements of the checker, thereby making it possible to more appropriately adjust the waiting time until the check is notified of incompleteness in accordance with the characteristic movements of the checker.

[0022] In the notification process, when the remaining waiting time value on the timer reaches 0 without the confirmation button being pressed, the notification unit notifies the person making the confirmation that the confirmation is incomplete. In this case, the notification from the notification unit is made by emitting a notification sound (an alarm sound, a buzzer sound, a warning message sound, etc.), for example.

[0023] In this way, this technology adjusts the remaining waiting time value on the timer based on the checker's movements, and while the checker is checking, notifications that the check is incomplete can be suppressed, allowing the checker to perform the check work smoothly.

[0024] In addition, in the present technology, for example, the control unit may further control a process of outputting a warning message when the checker's movement is unexpected, thereby making it possible to make the checker aware that the movement is unexpected and to encourage the checker to make the expected movement.

[0025] Furthermore, in the setting process of the present technology, for example, an initial value of the waiting time according to the brightness of a predetermined space may be set in the timer. As a result, for example, if the predetermined space is dark and it is difficult for the checker to perform the check work, the initial value of the waiting time set in the timer is increased, allowing the checker to perform the check work slowly and calmly.

[0026] Furthermore, in the present technology, for example, the adjustment process may be configured to adjust the remaining value of the waiting time in the timer according to the brightness of the specified space. As a result, for example, if the specified space is dark and it is difficult for the checker to perform the check, the increase rate when adjusting the remaining value of the waiting time in the timer is increased, making it possible to perform a more appropriate adjustment.

[0027] In addition, in the present technology, for example, the predetermined space may be the interior space of a school bus, the object of confirmation may be a child, and the person confirming the child's disembarkation may be a driver or a nursery teacher. In this case, while the driver or nursery teacher is confirming the child's disembarkation, it is possible to prevent a notification that the confirmation is incomplete, thereby enabling the driver or nursery teacher to smoothly perform the confirmation work.

[0028] In this case, for example, the confirmation button may be located at the rear of the interior of the school bus, and the sensor may be located at the rear of the interior of the school bus alongside the confirmation button. By locating the sensor at the rear of the interior of the school bus alongside the confirmation button in this way, it becomes possible for the sensor to simply and easily obtain information on the distance from the confirmation button to the person making the confirmation, for example.

[0029] Another concept of the present technology is an information processing method having the steps of: acquiring the movements of a checker who checks whether any items to be checked remain in a specified space based on information from a sensor; setting an initial value of the waiting time until notifying that the check is incomplete in a timer at the timing of starting the check; adjusting the remaining value of the waiting time in the timer based on the movements of the checker; and notifying the checker that the check is incomplete when the remaining value of the waiting time in the timer becomes 0 without the check button being pressed.

[0030] Another concept of the present technology is a notification system that includes a sensor, a confirmation button, a timer, a notification unit, and a control unit, wherein the control unit controls a process of acquiring the movements of a checker who checks whether any items to be checked remain in a specified space based on information from the sensor, a process of setting an initial value of the waiting time until a notification that the check is incomplete in the timer at the timing of starting the check, a process of adjusting the remaining value of the waiting time in the timer based on the movement of the checker, and a process of having the notification unit notify the checker that the check is incomplete when the remaining value of the waiting time in the timer becomes 0 without the confirmation button being pressed.

[0031] 1 is a diagram schematically illustrating a school bus (shuttle bus) for a kindergarten, nursery school (daycare center), etc. equipped with a notification system according to the present technology. FIG. 2 is a block diagram illustrating an example configuration of the notification system. FIG. 3 is a schematic functional block diagram of a millimeter-wave radar. FIG. 4 is an explanatory diagram for outlining an example of a mechanism for object detection using a chirp signal. FIG. 4 is a diagram schematically illustrating an example of millimeter-wave radars arranged in an array. FIG. 5 is a block diagram illustrating an example configuration of a chirp signal generating unit. FIG. 6 is a block diagram illustrating an example configuration of a signal processing unit. FIG. 7 is a diagram illustrating an example of sensing information of the millimeter-wave radar, i.e., information related to the position (distance and direction) and speed of an object (target). FIG. 8 is a diagram illustrating an example of sensing information of the millimeter-wave radar (a state in which the driver has started moving). FIG. 9 is a diagram illustrating an example of sensing information of the millimeter-wave radar (a state in which the driver is approaching the millimeter-wave radar). FIG. 10 is a diagram illustrating an example of sensing information of the millimeter-wave radar (a state in which the driver is reversing (backing up) toward the front of the school bus). FIG. 11 is a flowchart illustrating an example of a procedure for notification processing in the notification system. FIG. 12 is a flowchart illustrating an example of a process for adjusting a waiting time of a timer. FIG. 13 is a flowchart illustrating another example of a process for adjusting a waiting time of a timer. FIG. 14 is a block diagram illustrating another example configuration of the notification system. Fig. 10 is a flowchart showing another example of the procedure of the notification process in the notification system.Fig. 11 is a block diagram showing an example of the hardware configuration of a computer.

[0032] The following describes modes for carrying out the invention (hereinafter referred to as "embodiments"). The description will be given in the following order: 1. Embodiment 1-1. Example of a school bus 1-2. Example of a configuration of a notification system 1-2-1. Detailed description of millimeter-wave radar 1-2-2. Detection of driver movement 1-2-3. Example of a notification processing procedure in the notification system 1-2-4. Example of a process for adjusting the timer waiting time 1-3. Other example configurations of the notification system 1-4. Processing by software 2. Modified examples

[0033] 1. Embodiments "1-1. Example of School Bus" FIG. 1 schematically shows a school bus (shuttle bus) 10 for a kindergarten, nursery school (daycare center), or the like, equipped with a notification system according to the present technology. The school bus 10 has a vehicle body 11, an entrance / exit (boarding / exiting door) 12, a driver's seat 13, and seats 14 for children and nursery teachers. The seats 13 and 14 constitute interior objects of the school bus 10. The seat 13 is provided in the front portion of the interior of the school bus 10. A plurality of seats 14 are provided from the front to the rear of the interior of the school bus 10.

[0034] A disembarking confirmation button 101 and a millimeter wave radar 102, which constitute the notification system 100, are disposed at the rear of the interior of the school bus 10. After the power source (engine or motor) of the school bus 10 is stopped, the driver stands up from the seat 13 and walks toward the rear to check that children have disembarked, and the driver presses the button 101 after completing the check.

[0035] If the driver does not press the exit confirmation button 101 before the remaining waiting time value on a timer (not shown) reaches 0, the notification unit notifies the driver that the confirmation is incomplete under the control of a control unit (not shown). This notification is made, for example, by having the notification unit output a notification sound (such as an alarm sound, buzzer sound, or warning message sound). Here, the timer, notification unit, and control unit also constitute the notification system 100.

[0036] The timer starts counting down when driver confirmation begins, for example, when the power of the school bus 10 is stopped, and an initial value for the waiting time until the control unit notifies that confirmation is incomplete is set. The timing for starting driver confirmation is not limited to when the power of the school bus 10 is stopped, but may also be when the school bus 10 enters the grounds of a kindergarten or nursery school from outside and stops, or when the door of the entrance / exit 12 is opened. In the following explanation, it is assumed that the timing for starting driver confirmation is when the power of the school bus 10 is stopped.

[0037] The notification that the above-mentioned confirmation is incomplete is not limited to the output of a notification sound, but may also be made by turning on or blinking a light, or by vibrating a mobile device (e.g., a smartphone or a smartwatch) held by the driver, etc. In the following description, the notification is made by outputting a notification sound.

[0038] The millimeter-wave radar 102 constitutes a sensor that outputs information for acquiring the driver's movements. As will be described later, the millimeter-wave radar 102 periodically detects information about the driver's position and speed. Note that the sensor that outputs information for acquiring the driver's movements is not limited to the millimeter-wave radar 102, and a camera, a LiDAR (Light Detection and Ranging), an ultrasonic sensor, or the like may also be used. In the following description, the millimeter-wave radar 102 is used as the sensor.

[0039] The millimeter-wave radar 102 is arranged next to the alighting confirmation button 101 at the rear of the interior of the school bus 10. By arranging the millimeter-wave radar 102 next to the alighting confirmation button 101 in this way, it becomes possible for the millimeter-wave radar 102 to simply and easily obtain information on the distance, direction, and speed to the driver from the alighting confirmation button 101. Note that the millimeter-wave radar 102 does not necessarily have to be arranged at the rear of the interior of the school bus 10.

[0040] The driver constitutes the checker. Note that the checker is not limited to the driver. For example, it could be a nursery school teacher who rides on the school bus 10. In the following explanation, the checker will be described as the driver. Furthermore, the children constitute the check target.

[0041] In this embodiment, the control unit acquires the driver's movements based on information from the millimeter-wave radar 102, and adjusts the remaining waiting time value in the timer based on the driver's movements. This makes it possible to prevent the driver from being notified that the check is incomplete while the driver is checking, thereby preventing psychological pressure from being placed on the driver and allowing the driver to perform the check work smoothly.

[0042] 1-2. Example of the configuration of the notification system Fig. 2 shows an example of the configuration of the notification system 100. The notification system 100 has an alighting confirmation button 101, a millimeter wave radar 102, a timer 103, a control unit 104, a sound signal generating unit 105, and a speaker 106. Here, the sound signal generating unit 105 and the speaker 106 constitute a notification unit.

[0043] As described above, after the power source (engine or motor) of the school bus 10 is stopped, the driver stands up from the seat 13 and walks backward to check whether the children have disembarked, and then presses the disembarkation confirmation button 101 after completing the check. As described above, the millimeter-wave radar 102 periodically detects information on the driver's position and speed as information for obtaining the driver's movements.

[0044] "1-2-1. Detailed Description of Millimeter-Wave Radar" The millimeter-wave radar 102 will now be described in detail. The millimeter-wave radar 102 is a radar that uses millimeter waves. The short wavelength of the millimeter-wave signal allows the antenna of the millimeter-wave radar 102 to be miniaturized. Therefore, the mounting size of the millimeter-wave radar 102 is compact, measuring approximately a few centimeters. Known millimeter-wave bands used by the millimeter-wave radar 102 include, for example, bands of 24.05 GHz to 24.25 GHz, 57 GHz to 64 GHz, 76 GHz to 77 GHz, and 77 GHz to 81 GHz. In the 60 GHz and 79 GHz millimeter-wave bands, a relatively wide frequency band of several GHz can be used, thereby providing high distance resolution.

[0045] 3 shows a schematic functional block diagram of the millimeter-wave radar 102. The millimeter-wave radar 102 includes a chirp signal generator 201, an amplifier 202, a transmitting antenna 203, a receiving antenna 204, an amplifier 205, a mixer 206, an amplifier 207, a low-pass filter (LPF) 208, an AD converter 209, and a signal processor 210.

[0046] The chirp signal generator 201 generates and outputs a chirp signal, which is a signal format commonly used in recent millimeter-wave radars. This chirp signal is a signal whose frequency changes linearly over time. In millimeter-wave radars, methods such as the Frequency Modulated Continuous Wave (FMCW) method and the Fast Chirp Modulation (FCM) method are widely used to sweep the frequency of the chirp signal.

[0047] The chirp signal output from the chirp signal generating unit 201 is separated by a splitter or the like, and one part of the signal is amplified by an amplifier 202 and then transmitted as a transmission signal from a transmitting antenna 203. The other part of the signal separated from the chirp signal output from the chirp signal generating unit 201 is supplied to a mixer 206.

[0048] A transmission signal (chirp signal) transmitted from the transmitting antenna 203 is reflected by an object (target) and returned as a reflected signal, which is received as a received signal by the receiving antenna 204. The reflected signal received by the receiving antenna 204 is amplified by an amplifier 205 and then supplied to a mixer 206. It is desirable to use a low-noise amplifier as the amplifier 205, for example.

[0049] The mixer 206 mixes the transmission signal (chirp signal) output from the chirp signal generating unit 201 with the received signal (chirp signal reflected by an object and returned) received by the receiving antenna 204, and obtains a beat signal which is the frequency difference between these two signals.

[0050] The beat signal obtained by mixer 206 is amplified by amplifier 207, has unnecessary noise components (for example, high-frequency components) removed by low-pass filter 208, is converted from an analog signal to a digital signal by AD converter 209, and is then supplied to signal processing unit 210. Signal processing unit 210 performs various signal analyses on the beat signal converted into a digital signal, and calculates the distance to an object (target), the speed of the object (target), the direction (azimuth) in which the object (target) is located, etc.

[0051] Fig. 4 is an explanatory diagram outlining an example of an object detection mechanism using a chirp signal, showing an example of a typical chirp signal used in the FCM system. In Fig. 4, the horizontal axis represents time and the vertical axis represents frequency. In the FCM system, the frequency is linearly changed from a low frequency to a high frequency (up-chirp), and this is periodically transmitted.

[0052] The principle of radar ranging will be outlined below with reference to Figure 4, taking the FCM method as an example. A transmission signal (chirp signal) sent from the radar's transmitting antenna hits an object (target), and the reflected signal is received by the receiving antenna as a received signal. Millimeter-wave radar can measure the distance from the radar to the object (target) by measuring the time it takes for the signal to travel back and forth (delay time).

[0053] Specifically, the beat signal obtained by mixing the transmitted signal and the received signal is converted from an analog signal to a digital signal by an A / D converter, and then the beat frequency is detected by FFT (Fast Fourier Transform), and the distance to the object (target) is calculated based on this beat frequency.

[0054] For example, if the frequency change per unit time of the chirp signal is Br, the speed of light is c, and the frequency of the detected beat signal is fb, the distance r from the radar to the object (target) can be calculated using the following equation (1): r = cfb / 2Br (1)

[0055] Furthermore, millimeter-wave radars that use the FCM method can measure the relative speed between the radar and a target by detecting the phase difference between multiple chirp signals. In this case, the positive or negative value of the detected phase difference determines the positive or negative speed, and thus it can be determined whether the object (target) is approaching or moving away from the radar.

[0056] For example, when the wavelength of the carrier frequency of the chirp signal is λ, the repetition period of the chirp signal is Tc, and the phase difference is ω, the relative velocity v between the radar and the target can be calculated by the following equation (2): v = λω / 4πTc (2)

[0057] Furthermore, millimeter-wave radar can calculate the direction of an incoming signal by receiving it using an antenna array. For example, when the phase difference of the beat signal generated between the arrays is ω and the antenna spacing is d, the direction θ of the incoming signal can be calculated using the following equation (3). Note that the antenna spacing d in an antenna array is usually set to a value between λ / 2 and λ. θ = sin -1 (λω / 2πd) ...(3)

[0058] Figure 5 shows a schematic diagram of an example of an array-shaped millimeter-wave radar. In Figure 5, parts corresponding to those in Figure 3 are designated by the same reference numerals. In this example, a plurality of components (hereinafter referred to as "receiving units" for convenience) are provided, each of which includes a receiving antenna 204, an amplifier 205, a mixer 206, an amplifier 207, a low-pass filter 208, and an AD converter 209, all of which are designated by reference numeral 250. In a millimeter-wave radar having an independent receiving unit 250 for each receiving antenna 204, the direction of an arriving wave can be calculated by digital signal processing, including FFT, after A / D conversion.

[0059] Such a receiving configuration with multiple receiving antennas is called multiple input. Similarly, a transmitting configuration with multiple transmitting antennas is called multiple output. Furthermore, a transmitting and receiving configuration that combines such multiple receiving antennas with multiple transmitting antennas is called multiple input multiple output (MIMO). MIMO makes it possible to virtually increase the aperture length of the antenna, thereby improving the azimuth estimation accuracy of the millimeter-wave radar. MIMO radar may be applied to the present technology.

[0060] In an array of millimeter-wave radars as shown in Fig. 5, the signal processing unit 210 uses the reception results of each receiving unit 250 to detect an object (target). Note that in the example shown in Fig. 5, the configuration of the parts involved in generating and transmitting a transmission signal, i.e., the chart signal generating unit 201, amplifier 202, and transmitting antenna 203 shown in Fig. 3, are not shown. Therefore, although not explicitly shown in Fig. 5, the mixer 206 of each receiving unit 250 receives the transmission signal (i.e., the signal generated by the chart signal generating unit 201) in addition to the signal output from the amplifier 205 of that receiving unit 250 (i.e., the received signal received by the receiving antenna 204).

[0061] 5, the receiving antennas 204 of the receiving units 250 can be arranged at positions spatially separated from each other. Therefore, for example, by using a technology called beamforming with signals corresponding to the reception results of each receiving antenna 204 as input, it is possible to calculate the direction of the transmitter of the received signal (i.e., the direction of the object (target) that reflected the transmitted signal).

[0062] 6 shows an example of the configuration of the chirp signal generating section 201. The chirp signal generating section 201 has a timing generating section 211, a frequency control section 212, a PLL (Phase Locked Loop) 213, and a frequency multiplying section 214.

[0063] The PLL 213 generates a signal that serves as the basis for the chirp signal output from the chirp signal generating unit 201. Specifically, the PLL 213 generates a signal (chirp signal) whose frequency changes continuously over time in accordance with the control of the frequency control unit 212, and outputs the signal to the frequency multiplier 214. Therefore, the PLL 213 may include, for example, an oscillator configured to be able to control the frequency. Of course, the configuration of the PLL 213 is not particularly limited as long as it can generate a signal of a desired frequency.

[0064] The frequency multiplier 214 receives the signal generated by the PLL 213 as input, generates a signal with a frequency that is an integer multiple of that signal, and outputs a millimeter wave band signal (chirp signal) as the output from the chirp signal generator 201. In general, it is difficult to directly oscillate a so-called high frequency signal such as a millimeter wave band signal at a more accurate frequency. Therefore, the signal generated by the PLL 213 is multiplied by the frequency multiplier 214 to output a millimeter wave band signal.

[0065] The timing generating unit 211 generates a timing signal that serves as a reference for control along a time series, and outputs the timing signal to the frequency control unit 212. For example, the timing generating unit 211 may generate a reference clock as the timing signal and supply the reference clock to the frequency control unit 212. This allows the frequency control unit 212 to measure time according to the reference clock supplied from the timing generating unit 211, thereby enabling various processes to be executed in synchronization with desired timing based on the reference clock.

[0066] The frequency control unit 212 controls operations related to signal generation by the PLL 213. For example, the frequency control unit 212 may control the operation of the PLL 213 based on the timing signal output from the timing generating unit 211 so that the frequency of the signal output from the PLL 213 changes continuously along a time series. Furthermore, for example, the frequency control unit 212 may control the frequency of the signal output from the PLL 213, assuming that the signal output from the PLL 213 is multiplied by the frequency multiplier 214 and output to the outside. In this case, the frequency control unit 212 may control operations related to signal generation (oscillation) by the PLL 213 so that the PLL 213 oscillates at a frequency that is an integer fraction of the frequency of the signal (chirp signal) output to the outside from the chirp signal generating unit 201.

[0067] The various components of the chirp signal generating unit 201 are configured as described above, and the chirp signal generating unit 201 generates a signal (chirp signal) whose frequency changes continuously over time, and outputs the signal to an external device (for example, the amplifier 202 or mixer 206 shown in FIG. 3 ) outside the chirp signal generating unit 201.

[0068] Fig. 7 shows an example configuration of the signal processing unit 210. This example shows an example configuration of the signal processing unit 210 in the case where a plurality of receiving units 250 is provided as in the example shown in Fig. 5 to calculate the distance to an object (target), the speed of the object (target), and the direction of the object (target). That is, Fig. 7 shows an example configuration of the signal processing unit 210 assuming the use of digital beamforming technology to receive reflected waves of a transmitted signal reflected by an object (target).

[0069] The signal processing unit 210 includes a distance calculation unit 221 , a speed calculation unit 222 , a direction calculation unit 223 , and a signal analysis unit 224 .

[0070] The distance calculation unit 221 performs arithmetic processing related to distance calculation on the signal input to the signal processing unit 210, i.e., the digital beat signal. As a specific example, the distance calculation unit 221 performs distance FFT (Fast Fourier Transform) as signal processing on the input beat signal, and outputs information according to the result to the signal analysis unit 224.

[0071] The velocity calculation unit 222 performs arithmetic processing related to velocity calculation on the signal input to the signal processing unit 210, i.e., the digital beat signal. As a specific example, the velocity calculation unit 222 performs velocity FFT as signal processing on the input beat signal, and outputs information according to the result to the signal analysis unit 224.

[0072] The direction calculation unit 223 performs arithmetic processing related to calculation of the direction on the signal input to the signal processing unit 210, i.e., the digital beat signal. As a specific example, the direction calculation unit 223 performs processing related to detection of phase difference by FFT as signal processing on the received signal according to the reception results from each of the multiple receiving antennas 204, and outputs information according to the result to the signal analysis unit 224.

[0073] The signal analysis unit 224 detects an object (target) according to the results of various calculation processes (various signal processes) performed on the signals input to the signal processing unit 210. Specifically, the signal analysis unit 224 acquires information about the distance to the object (target) based on the result of the distance FFT performed by the distance calculation unit 221. The signal analysis unit 224 also acquires information about the speed of the object (target) based on the result of the velocity FFT performed by the velocity calculation unit 222. The signal analysis unit 224 also acquires information about the direction in which the object (target) is located based on the result of the processing performed by the direction calculation unit 223 related to the detection of a phase difference by FFT.

[0074] The signal analysis unit 224 supplies the acquired various information as an output of the millimeter-wave radar 102 to a predetermined output destination, in this embodiment, to the control unit 104 (see FIG. 2). The signal analysis unit 224 can be configured, for example, by a DSP (Digital Signal Processor). Here, the information on the distance and direction of the object (target) constitutes information on the position of the object (target).

[0075] Returning to Fig. 2, when the control unit 104 starts checking the driver, it sets an initial value of the waiting time until notifying that the check is incomplete in the timer 103. After the initial value of the waiting time is set by the timer 103 and the control unit 104, the timer 103 starts a countdown operation and sequentially sends information on the remaining value of the initial value of the waiting time to the control unit 104. Note that in the example configuration shown in Fig. 2, the timer 103 is located outside the control unit 104, but the control unit 104 may also be configured to include the timer 103 internally.

[0076] The control unit 104 also controls the start and end of operation of the millimeter-wave radar 102. For example, the control unit 104 starts the operation of the millimeter-wave radar 102 when the driver starts to confirm, and ends the operation of the millimeter-wave radar 102 when the driver presses the exit confirmation button 101. After starting operation, the millimeter-wave radar 102 starts transmitting chirp signals, receives reflected signals from objects (targets), and periodically detects information on the position (distance and direction) and speed of the objects (targets), and sends the information to the control unit 104.

[0077] The millimeter-wave radar 102 operates based on setting values ​​(such as the chirp slope (the gradient of the chirp signal) and the chirp duration) supplied from the control unit 104. The maximum detection distance of the millimeter-wave radar 102 is determined by the chirp slope, and the maximum detection speed of the millimeter-wave radar 102 is determined by the chirp duration. The millimeter-wave radar 102 is set so that it can appropriately detect the position and speed of the driver inside the school bus 10.

[0078] Note that the operation of the millimeter-wave radar 102 is not limited to being started at the timing when driver confirmation begins, but may be started at an earlier timing, and it is necessary that the millimeter-wave radar 102 is operating at least after driver confirmation begins. Furthermore, the operation of the millimeter-wave radar 102 is not limited to being ended at the timing when the driver presses the exit confirmation button 101, but may be ended, for example, when a certain time has elapsed since the driver pressed the exit confirmation button 101.

[0079] In addition, the control unit 104 acquires the driver's movements based on the information on the position (distance and direction) and speed of the object (target) periodically sent from the millimeter-wave radar 102, and adjusts the remaining value of the waiting time in the timer 103 based on the driver's movements.

[0080] In this case, the control unit 104 may use the position (distance and direction) and speed information from the millimeter-wave radar 102 after performing a conventionally known tracking process, rather than using the information as is. For example, a Kalman filter method is known as a tracking process. It is also possible to perform the tracking process using a machine learning method such as a neural network, instead of the Kalman filter method. By performing the tracking process in this manner, it is possible to improve the noise resistance of the position (distance and direction) and speed information.

[0081] 1-2-2. Detection of Driver Movement FIGS. 8A and 8B show an example of sensing information of the millimeter wave radar 102, that is, information relating to the position (distance and direction) and speed of an object (target).

[0082] In Figure 8(a), the vertical axis represents depth distance, i.e., distance from the rear of the school bus 10, and the horizontal axis represents speed. Here, large and small black circles roughly represent objects (targets) present inside the school bus 10, such as the driver, nursery teachers, children, seats, etc. Figure 8(a) shows that the speed of objects (targets) is zero at all distances (depth distances) inside the school bus 10, indicating a state in which no one on board the school bus 10 is moving.

[0083] In Figure 8(b), the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the cross-sectional distance, i.e., the distance from the center line of the school bus 10. Here, large and small black circles roughly represent objects (targets) present inside the school bus 10, such as the driver, nursery teachers, children, seats, etc. Figure 8(b) is a two-dimensional view of the interior of the school bus 10. According to this, at the distance of the driver's seat, an image that appears to be the driver appears near the driver's seat.

[0084] From Figures 8(a) and (b), it can be assumed that the school bus 10 is in a state where all passengers on board are not moving, are in motion, or are preparing to disembark.

[0085] In Figure 8(b), the large black circles represent adults and the small black circles represent kindergarten children. This is because adults are taller and have larger builds than kindergarten children, so they reflect more of the transmitted signal from the millimeter-wave radar 102, and therefore, differences in the amount of reflection make it possible to distinguish adults. In this case, large reflections are seen near the driver's seat and near the entrance and exit, and these are presumed to be adults. In this case, it is natural that the large reflection near the driver's seat is presumed to be the driver. Furthermore, in this case, the large reflection near the entrance and exit is presumed to be a nursery teacher.

[0086] 9A and 9B also show an example of sensing information of the millimeter-wave radar 102, i.e., information related to the position (distance and direction) and speed of an object (target). This example shows a state in which the driver has started moving.

[0087] In FIG. 9( a ), as in FIG. 8( a ) described above, the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the speed. Also, in FIG. 9( b ), as in FIG. 8( b ) described above, the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the cross-sectional distance, i.e., the distance from the center line of the school bus 10. From FIG. 9( a ), it can be seen that the image presumed to be the driver is moving at a speed of +v1. Also, from FIG. 9( b ), it can be seen that the image presumed to be the driver has moved away from the driver's seat and near the center line of the school bus 10. In this case, the image presumed to be the driver is identified in advance, and its movement is captured to determine the driver's current position and movement.

[0088] 9(a) and 9(b), images of known objects (targets) such as seats are omitted. Since there are no images of children (small black circles) in these figures, it is presumed that the children have already disembarked. If children remain inside the school bus 10, their presence may be detected based on the sensing information of the millimeter-wave radar 102. However, the reflection from the children is relatively weak and is likely to be affected by the seats, etc., making this detection unreliable. This technology does not confirm the presence of children based on the sensing information of the millimeter-wave radar 102, but rather assumes that the driver will confirm that the children have disembarked.

[0089] 10A and 10B also show an example of sensing information, i.e., information related to the position (distance and direction) and speed of an object (target), of the millimeter-wave radar 102. This example shows a state in which the driver is approaching the rear of the school bus 10, and therefore the millimeter-wave radar 102.

[0090] In Figure 10(a), as in Figure 8(a) above, the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the speed. Also, in Figure 10(b), as in Figure 8(b) above, the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the cross-sectional distance, i.e., the distance from the center line of the school bus 10. From Figure 10(a), it can be seen that the image presumed to be the driver is moving toward the rear of the school bus 10 at a speed of +v2. Also, from Figure 10(b), it can be seen that the image presumed to be the driver is moving to a position near the center line of the school bus 10, and about halfway along the school bus 10.

[0091] 11A and 11B also show an example of sensing information of the millimeter-wave radar 102, i.e., information related to the position (distance and direction) and speed of an object (target). This example shows a state in which the driver is moving backward (backing up) toward the front of the school bus 10.

[0092] In FIG. 11(a), as in FIG. 8(a) above, the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the speed. Also, in FIG. 11(b), as in FIG. 8(b) above, the vertical axis represents the depth distance, i.e., the distance from the rear end of the school bus 10, and the horizontal axis represents the cross-sectional distance, i.e., the distance from the center line of the school bus 10. From FIG. 11(a), it can be seen that the image presumed to be the driver is moving backward toward the front of the school bus 10 at a speed of -v2. Also, from FIG. 11(b), it can be seen that the image presumed to be the driver is moving to a position near the center line of the school bus 10, and slightly backward toward the front of the school bus 10.

[0093] Returning to Figure 2, for example, when the driver's movement is such that there is a possibility that the driver will be late in pressing the exit confirmation button 101, the control unit 104 adjusts the remaining waiting time value in the timer 103 in an increasing direction.

[0094] For example, a movement that may delay the driver's pressing of the alighting confirmation button 101 is a movement away from the alighting confirmation button 101, that is, the driver's movement back toward the front of the school bus 10. For example, if the driver has asked a child to quickly alight at a certain position, but the child is still sitting in the seat, the driver may move back again to urge the child to alight.

[0095] In this case, the control unit 104 adds, for example, a time proportional to the distance traveled backward to the remaining waiting time value in the timer 103. In this case, a fixed value may also be added. When the driver goes backward, it means that he is returning to do something, and the time required to do this is considered to be a fixed value. Here, the time proportional to the distance traveled backward may be found by, for example, referring to a table (not shown) held by the control unit 104, or may be found by calculation using information on the speed at which the driver is moving.

[0096] Furthermore, for example, a movement that may cause a delay in the driver's operation to press the alighting confirmation button 101 is a movement to stop at a predetermined position. For example, if a child falls asleep in the seat at a certain position, the driver may stop to wake the child and encourage them to alight. In this case, the control unit 104 adds, for example, the time spent at the predetermined position to the remaining waiting time value in the timer 103. Note that, even in this case, a fixed value may be further added. This fixed value takes into consideration, for example, that if the driver resumes moving toward the rear of the school bus 10 after stopping at the predetermined position, the driver will not immediately reach a certain speed.

[0097] Furthermore, for example, a movement that may delay the driver's operation of pressing the alight confirmation button 101 is a movement of proceeding along a route that is different from the route leading to the alight confirmation button 101, such as a route leading to an entrance / exit (boarding / alighting gate) 12. In this case, the control unit 104 estimates, for example, the time required to return from the different route to the route leading to the alight confirmation button 101, and adds the estimated time to the remaining value of the waiting time in the timer 103. Note that in this case, it is also possible to add a fixed value to the remaining value of the waiting time in the timer 103 without estimating the time required to return from the different route to the route leading to the alight confirmation button 101.

[0098] Note that the movements that may cause the driver to delay pressing the exit confirmation button 101 are not limited to the above-mentioned examples.

[0099] Furthermore, the control unit 104 adjusts the remaining value of the waiting time in the timer 103 according to, for example, the driver's location.

[0100] In this case, for example, the control unit 104 may adjust the remaining value of the waiting time in the timer 103 according to the distance from the driver's get-off confirmation button 101. For example, the longer the distance from the driver's get-off confirmation button 101, the larger the time to be added to the remaining value of the waiting time in the timer 103 when the movement is such that there is a possibility that the driver's operation of pressing the get-off confirmation button 101 will be delayed, as described above. This is because it is expected that the longer the distance from the driver's get-off confirmation button 101, the greater the delay in the driver's operation of pressing the get-off confirmation button 101.

[0101] In this case, for example, the control unit 104 may adjust the remaining waiting time value in the timer 103 depending on which of the multiple areas into which the interior space of the school bus 10 is divided the driver is in. For example, the farther the area the driver is in from the alighting confirmation button 101, the greater the time to be added to the remaining waiting time value in the timer 103 when the driver's movement may result in a delay in pressing the alighting confirmation button 101 as described above. This is because it is expected that the farther the area the driver is in from the alighting confirmation button 101, the greater the delay in the driver's pressing the alighting confirmation button 101.

[0102] In this case, for example, the control unit 104 may adjust the remaining waiting time value in the timer 103 depending on whether the driver is in an area near the aisle in the center of the interior space of the school bus 10 or in another area. For example, if the driver is in an area near the aisle, the time added to the remaining waiting time value in the timer 103 is reduced when the driver is in a movement that may cause a delay in pressing the alighting confirmation button 101 as described above, compared to when the driver is in another area. This is because it is assumed that the delay in pressing the alighting confirmation button 101 by the driver is smaller when the driver is in an area near the aisle than when the driver is in another area.

[0103] Furthermore, the control unit 104 adjusts the remaining value of the waiting time in the timer 103 in accordance with, for example, the characteristic movements of the driver.

[0104] Here, possible characteristic movement patterns include, for example, repeatedly going backwards or repeatedly stopping. When the control unit 104 detects a characteristic movement, for example, a fixed value previously associated with the characteristic movement pattern is added to the remaining value of the waiting time in the timer 103. This makes it possible to deal with delays in the driver's pressing of the exit confirmation button 101 due to the driver's characteristic movement.

[0105] Furthermore, the control unit 104 outputs a warning message when, for example, the driver's movement is unexpected.

[0106] Here, examples of unexpected movements include the driver going backward (backing up) without pressing the exit confirmation button 101, the driver staying near the driver's seat, the driver heading directly toward the entrance (boarding / exiting door) 12, etc. When the control unit 104 detects unexpected movements, it causes the sound signal generating unit 105 to generate a warning message sound signal and the speaker 106 to output a warning message sound. In this sense, the sound signal generating unit 105 and the speaker 106 constitute a warning message output unit.

[0107] For example, if the driver reverses (backs up) without pressing the exit confirmation button 101, the warning message may be, "You forgot to press the exit confirmation button. Please press the exit confirmation button." If the driver is standing near the driver's seat (driver's seat), the warning message may be, "Please start checking that the children have exited." If the driver is heading directly towards the entrance (entrance / exit) 12, the warning message may be, "Please check that the children have exited and press the exit confirmation button before exiting."

[0108] Furthermore, when the remaining waiting time value of the timer 103 reaches 0 without the exit confirmation button 101 being pressed, the control unit 104 notifies the driver that the exit confirmation has not been completed.

[0109] In this case, the control unit 104 causes the sound signal generating unit 105 to generate a notification sound (such as an alarm sound, a buzzer sound, or a warning message sound) and output the notification sound from the speaker 106. By outputting the notification sound in this manner, it becomes possible to make the driver aware that the process of checking whether the children have disembarked has not been completed.

[0110] 1-2-3. Example of Notification Processing Procedure in Notification System The flowchart in FIG. 12 shows an example of the notification processing procedure in the notification system 100 shown in FIG. 2 above.

[0111] First, in step ST1, the control unit 104 starts processing at the timing when driver confirmation begins, for example, when the power of the school bus 10 is stopped. Next, in step ST2, the control unit 104 sets an initial value of the waiting time until notification that confirmation is incomplete in the timer 103. As a result, the timer 103 starts counting down, and is in a state where it sequentially sends information about the remaining value of the initial value of the waiting time to the control unit 104.

[0112] Next, in step ST3, the control unit 104 starts the operation of the millimeter-wave radar 102. As a result, the millimeter-wave radar 102 starts transmitting chirp signals, receives reflected signals from objects (targets), periodically detects information on the position (distance and direction) and speed of the objects (targets), and sends the information to the control unit 104.

[0113] Next, in step ST4, the control unit 104 adjusts the waiting time of the timer. In this case, the control unit 104 acquires the movement of the driver based on the information on the position (distance and direction) and speed of the object (target) periodically transmitted from the millimeter-wave radar 102, and adjusts the remaining value of the waiting time of the timer 103 based on the movement of the driver.

[0114] Next, in step ST5, the control unit 104 determines whether the remaining waiting time value of the timer 103 is 0. If the remaining waiting time value of the timer 103 is not 0, the control unit 104 determines in step ST6 whether the dismount confirmation button 101 has been pressed. If the dismount confirmation button 101 has not been pressed, the control unit 104 returns to the processing of step ST4. On the other hand, if the dismount confirmation button 101 has been pressed, the control unit 104 stops the operation of the millimeter-wave radar 102 in step ST7 and ends the processing.

[0115] Furthermore, when the waiting time of the timer 103 is 0 in step ST5, a notification sound is generated in step ST8. In this case, the control unit 104 causes the sound signal generating unit 105 to generate a signal for a notification sound (such as an alarm sound, buzzer sound, or warning message sound) and causes the speaker 106 to output the notification sound. Next, the control unit 104 determines in step ST9 whether the dismount confirmation button 101 has been pressed. When the dismount confirmation button 101 has not been pressed, the control unit 104 returns to the processing of step ST8 and continues to generate the notification sound. On the other hand, when the dismount confirmation button 101 has been pressed, the control unit 104 stops the operation of the millimeter-wave radar 102 in step ST7 and ends the processing.

[0116] 1-2-4. Example of Adjustment Process for Timer Waiting Time The flowchart in FIG. 13 shows an example of the adjustment process for the timer waiting time in step ST4 of FIG.

[0117] First, the control unit 104 starts processing in step ST11. Next, the control unit 104 acquires the driver's movement in step ST12. In this case, the control unit 104 acquires the driver's movement based on information on the position (distance and direction) and speed of an object (target) periodically transmitted from the millimeter-wave radar 102.

[0118] In this case, the control unit 104 may use the information on the position (distance and direction) and speed of the object (target) from the millimeter-wave radar 102 after performing tracking processing such as a Kalman filter method or a machine learning method such as a neural network, rather than using the information as is. By performing tracking processing, it is possible to improve the noise resistance of the information on the position (distance and direction) and speed.

[0119] Next, in step ST13, the control unit 104 determines whether the driver's movement is a movement that may delay the pressing of the alighting confirmation button 101. Here, movements that may delay the pressing of the alighting confirmation button 101 include, but are not limited to, a movement away from the alighting confirmation button 101, a movement to stop at a predetermined position, and a movement to proceed along a path that is different from the path leading to the alighting confirmation button 101, such as a path leading to an entrance / exit (boarding / alighting door) 12.

[0120] If there is no movement that may cause a delay in pressing the exit confirmation button 101 in step ST13, for example, if the driver is moving at a constant speed along the route toward the exit confirmation button 101, the control unit 104 ends the processing in step ST14, leaving the remaining value of the waiting time of the timer 103 unchanged.

[0121] On the other hand, if the movement in step ST13 is such that there is a possibility that the pressing of the exit confirmation button 101 will be delayed, the control unit 104 adjusts the remaining value of the waiting time of the timer 103 in a direction to increase it in step ST15.

[0122] For example, if the movement that may delay the driver's pressing of the exit confirmation button 101 is a movement away from the exit confirmation button 101, a time proportional to the distance traveled backward is added to the remaining waiting time value in the timer 103. In this case, a fixed value may also be added.

[0123] Furthermore, for example, if the movement that may delay the driver's pressing of the exit confirmation button 101 is a movement of stopping at a predetermined position, the time spent stopping at the predetermined position is added to the remaining value of the waiting time in the timer 103. Note that, even in this case, a fixed value may be further added.

[0124] Furthermore, for example, if the movement that may delay the driver's pressing of the alight confirmation button 101 is a movement of proceeding along a route that is different from the route leading to the alight confirmation button 101, such as a route leading to an entrance / exit (boarding / alighting gate) 12, the time required to return from that different route to the route leading to the alight confirmation button 101 is estimated, and the estimated time is added to the remaining waiting time value in the timer 103. Note that in this case, a fixed value may be added to the remaining waiting time value in the timer 103 without estimating the time required to return from that different route to the route leading to the alight confirmation button 101.

[0125] When adjusting the remaining value of the waiting time of the timer 103 to increase it, the control unit 104 may adjust it according to the position of the driver, for example.

[0126] In this case, for example, the longer the distance from the driver's dismount confirmation button 101, the greater the time added to the remaining waiting time value in the timer 103 when the driver's movement may delay pressing the dismount confirmation button 101 as described above.

[0127] In this case, for example, the farther the driver is from the disembarkation confirmation button 101 among the multiple areas into which the interior space of the school bus 10 is divided, the greater the time added to the remaining waiting time value in the timer 103 when the driver's movement may delay the operation of pressing the disembarkation confirmation button 101, as described above.

[0128] In this case, for example, if the driver is in an area near the aisle, the time added to the remaining waiting time value in the timer 103 is made smaller than if the driver is in any other area, as described above, when there is a possibility that the driver's pressing of the disembarkation confirmation button 101 will be delayed.

[0129] Furthermore, when adjusting the remaining value of the waiting time in the timer 103 to increase it, the control unit 104 may adjust the remaining value of the waiting time in the timer 103 in accordance with the characteristic movement of the driver.

[0130] In this case, if a characteristic driver movement such as repeatedly going backwards or repeatedly stopping is detected, a fixed value that is pre-assigned to the characteristic movement pattern is added to the remaining waiting time value in timer 103, for example.

[0131] After the process of step ST15 described above, the control section 104 ends the process in step ST14.

[0132] The flowchart of Fig. 14 shows another example of the process for adjusting the waiting time of the timer in step ST4 of Fig. 12. In Fig. 14, steps corresponding to those in Fig. 13 are designated by the same reference numerals, and detailed description thereof will be omitted.

[0133] First, the control unit 104 starts the process in step ST11. Next, the control unit 104 acquires the driver's movements in step ST12.

[0134] Next, in step ST13, the control unit 104 determines whether or not the driver's movement is a movement that may result in a delay in pressing the exit confirmation button 101. If the movement is not a movement that may result in a delay in pressing the exit confirmation button 101, the control unit 104 ends the process in step ST14, leaving the remaining value of the waiting time of the timer 103 as it is.

[0135] On the other hand, if the movement detected in step ST13 is one that may delay the pressing of the exit confirmation button 101, the control unit 104 determines in step ST16 whether the driver's movement is unexpected. Examples of unexpected movement include the driver moving backward (backing up) without pressing the exit confirmation button 101, the driver stopping near the driver's seat, the driver heading directly toward the entrance (entrance / exit) 12, etc.

[0136] If the driver's movement is not unexpected in step ST16, the control unit 104 immediately proceeds to the processing of step ST15. On the other hand, if the driver's movement is unexpected in step ST16, the control unit 104 outputs a warning message in step ST17. In this case, for example, the control unit 104 causes the sound signal generating unit 105 to generate a warning message sound signal and causes the speaker 106 to output a warning message sound.

[0137] For example, if the driver reverses (backs up) without pressing the exit confirmation button 101, the warning message may be, "You forgot to press the exit confirmation button. Please press the exit confirmation button." If the driver is standing near the driver's seat (driver's seat), the warning message may be, "Please start checking that the children have exited." If the driver is heading directly towards the entrance (entrance / exit) 12, the warning message may be, "Please check that the children have exited and press the exit confirmation button before exiting."

[0138] After the process of step ST17, the control unit 104 proceeds to the process of step ST15. In step ST15, the control unit 104 adjusts the remaining value of the waiting time of the timer 103 in an increasing direction. Thereafter, the control unit 104 ends the process in step ST14.

[0139] As described above, in the notification system 100 shown in Figure 2, the remaining waiting time value in the timer 103 for notifying that the confirmation is incomplete is adjusted based on the driver's movements. This makes it possible to prevent the notification that the confirmation is incomplete while the driver is making the confirmation, and enables the driver to smoothly perform the task of confirming that the children have dropped off without putting psychological pressure on the driver.

[0140] 1-3. Other Configuration Examples of the Notification System Figure 15 shows another configuration example of the notification system 100A. In Figure 15, parts corresponding to those in Figure 2 are given the same reference numerals, and detailed descriptions thereof will be omitted as appropriate. The notification system 100A has an alighting confirmation button 101, a millimeter-wave radar 102, a timer 103, a control unit 104, a sound signal generation unit 105, a speaker 106, and a brightness sensor 107.

[0141] The brightness sensor 107 is a sensor that detects the brightness of the interior space of the school bus 10, and although not shown, is located somewhere inside the school bus 10, for example, at the rear of the interior of the school bus 10, similar to the millimeter-wave radar 102 and the disembarkation confirmation button 101. The brightness sensor 107 sends brightness information of the interior space of the school bus 10 to the control unit 104.

[0142] When setting the timer 103 as the initial value of the waiting time until the confirmation is notified that the confirmation is incomplete at the timing of starting the confirmation, the control unit 104 sets the initial value according to the brightness of the interior space of the school bus 10. For example, the initial value of this waiting time is set to a first value when the brightness of the interior space of the school bus 10 is equal to or higher than a predetermined threshold, and is set to a second value larger than the first value when the brightness of the interior space of the school bus 10 is lower than the predetermined threshold. As a result, if the interior space of the school bus 10 is dark and it is difficult for the checker to perform the check work, the initial value of the waiting time set in the timer 103 is increased, which allows the driver to perform the check work slowly and calmly.

[0143] Furthermore, when adjusting the remaining waiting time value on the timer 103 in response to the driver's movements, the control unit 104 adjusts ... that may delay the operation of pressing the disembarkation confirmation button 101. For example, when increasing the remaining waiting time value on the timer 103 when the driver's movements are such that there is a possibility of delaying the operation of pressing the disembarkation confirmation button 101, the increase value is set to a third value when the brightness of the interior space of the school bus 10 is equal to or higher than a predetermined threshold, and to a fourth value greater than the third value when the brightness of the interior space of the school bus 10 is lower than the predetermined threshold. As a result, for example, if the interior space of the school bus 10 is dark and it is difficult for the driver to check, the increase rate when adjusting the remaining waiting time value on the timer 103 is increased, enabling more appropriate adjustment.

[0144] The notification system 100A shown in Figure 15 is configured in the same way as the notification system 100 shown in Figure 2, except that it further has a brightness sensor 103 as described above, and the initial value of the waiting time set in the timer 103 by the control unit 104 is based on the brightness of the interior space of the school bus 10, and when the control unit 104 adjusts the remaining value of the waiting time in the timer 103 in accordance with the driver's movements, it adjusts it based on the brightness of the interior space of the school bus 10.

[0145] The flowchart in Fig. 16 shows an example of the procedure for notification processing in the notification system 100A shown in Fig. 15. In Fig. 16, steps corresponding to those in Fig. 12 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0146] First, in step ST1, the control unit 104 starts processing when the driver starts checking, for example, when the power of the school bus 10 is stopped. Next, in step ST2A, the control unit 104 sets an initial value of the waiting time until notifying the timer 103 that the checking is incomplete, according to the brightness of the interior space of the school bus 10. In this case, for example, the initial value of this waiting time is set to be longer when the brightness of the interior space of the school bus 10 is below a predetermined threshold compared to when the brightness of the interior space of the school bus 10 is equal to or higher than a predetermined threshold.

[0147] Next, in step ST3, the control unit 104 starts the operation of the millimeter-wave radar 102. Next, in step ST4A, the control unit 104 adjusts the waiting time of the timer 103 according to the brightness of the interior space of the school bus 10. In this case, for example, when the remaining value of the waiting time of the timer 103 is increased when the driver's movement is such that there is a possibility that the operation of pressing the disembarkation confirmation button 101 will be delayed, the increase value is set to be larger when the brightness of the interior space of the school bus 10 is lower than a predetermined threshold compared to when the brightness of the interior space of the school bus 10 is equal to or higher than a predetermined threshold.

[0148] Next, in step ST5, the control unit 104 determines whether the remaining waiting time value of the timer 103 is 0. If the remaining waiting time value of the timer 103 is not 0, the control unit 104 determines in step ST6 whether the dismount confirmation button 101 has been pressed. If the dismount confirmation button 101 has not been pressed, the control unit 104 returns to the processing of step ST4A. On the other hand, if the dismount confirmation button 101 has been pressed, the control unit 104 stops the operation of the millimeter-wave radar 102 in step ST7 and ends the processing.

[0149] Furthermore, when the waiting time of the timer 103 is 0 in step ST5, a notification sound is generated in step ST8. Next, the control unit 104 determines whether the dismount confirmation button 101 has been pressed in step ST9. When the dismount confirmation button 101 has not been pressed, the control unit 104 returns to the processing of step ST8 and continues to generate the notification sound. On the other hand, when the dismount confirmation button 101 has been pressed, the control unit 104 stops the operation of the millimeter-wave radar 102 in step ST7 and ends the processing.

[0150] As described above, in the notification system 100A shown in Figure 15, the remaining waiting time value in the timer 103 for notifying that the confirmation is incomplete is adjusted based on the driver's movements. This makes it possible to prevent the driver from being notified that the confirmation is incomplete while the driver is making the confirmation, and enables the driver to smoothly perform the task of confirming that the children have dropped off without putting psychological pressure on the driver.

[0151] In addition, in the notification system 100A shown in Figure 15, the initial value of the waiting time set in the timer 103 by the control unit 104 is based on the brightness of the interior space of the school bus 10, and when the control unit 104 adjusts the remaining value of the waiting time in the timer 103 in accordance with the driver's movements, it is adjusted based on the brightness of the interior space of the school bus 10.Even if the interior space of the school bus 10 is dark and it is difficult for the inspector to perform the inspection work, it is possible for the driver to perform the inspection work slowly and calmly.

[0152] "1-4. Software Processing" The processing in the above-described notification systems 100 and 100A can be performed by hardware, but can also be performed by software. When a series of processes is performed by software, the programs that make up the software are installed from a recording medium into a computer that is built into dedicated hardware, or into, for example, a general-purpose computer that can perform various functions by installing various programs.

[0153] 17 is a block diagram showing an example of the hardware configuration of a computer 600. The computer 600 has a CPU 601, a ROM 602, a RAM 603, a bus 604, an input / output interface 605, an input unit 606, an output unit 607, a storage unit 608, a drive 609, a connection port 610, and a communication unit 611. Note that the hardware configuration shown here is an example, and some of the components may be omitted. Furthermore, the computer 600 may further include components other than those shown here.

[0154] The CPU 601 functions as, for example, an arithmetic processing device or a control device, and controls the overall operation or part of the operation of each component based on various programs recorded in the ROM 602 , the RAM 603 , the storage unit 608 , or the removable recording medium 701 .

[0155] The ROM 602 is a means for storing programs to be read into the CPU 601, data to be used for calculations, etc. The RAM 603 temporarily or permanently stores, for example, the programs to be read into the CPU 601 and various parameters that change as appropriate when the programs are executed.

[0156] The CPU 601, ROM 602, and RAM 603 are connected to one another via a bus 604. On the other hand, various components are connected to the bus 604 via an input / output interface 605.

[0157] The input unit 606 may be, for example, a mouse, a keyboard, a touch panel, a button, a switch, a lever, etc. Furthermore, the input unit 606 may also be a remote controller (hereinafter referred to as a remote control) that is capable of transmitting control signals using infrared rays or other radio waves.

[0158] The output unit 607 is a device capable of visually or audibly notifying the user of acquired information, such as a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, an audio output device such as a speaker or headphones, a printer, a mobile phone, or a facsimile.

[0159] The storage unit 608 is a device for storing various types of data. For example, the storage unit 608 may be a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device.

[0160] The drive 609 is a device that reads information recorded on a removable recording medium 701 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information to the removable recording medium 701 .

[0161] The removable recording medium 701 is, for example, a DVD, a Blu-ray (registered trademark) disc, an HD DVD, various semiconductor storage media, etc. Of course, the removable recording medium 701 may also be, for example, an IC card equipped with a contactless IC chip, an electronic device, etc.

[0162] The connection port 610 is a port for connecting an external device 502, such as a Universal Serial Bus (USB) port, a High-Definition Multimedia Interface (HDMI) port, an IEEE 1394 port, a Small Computer System Interface (SCSI), an RS-232C port, or an optical audio terminal. Note that "HDMI" is a registered trademark. The external device 702 is, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

[0163] The communication unit 611 is a communication device for connecting to the network 703, such as a communication card for wired or wireless LAN, Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication.

[0164] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0165] 2. Modifications In the above embodiment, the driver's movement is acquired based on the information on the position (distance and direction) and speed of the object (target) periodically sent from the millimeter-wave radar 102. However, it is also possible to acquire the driver's movement from only the information on the position (distance and direction) of the object (target). In short, it is sufficient that the sensor information for acquiring the driver's movement is sent to the control unit 104. In addition, when information on the position (distance and direction) and speed of the object (target) is available, tracking using a Kalman filter, for example, allows the position information and speed information to be mathematically correlated and utilized, thereby enabling tracking with higher accuracy.

[0166] Furthermore, in the above-described embodiment, an example has been shown in which the present technology is applied to prevent children from being left behind on the school bus 100, but the scope of application of the present technology is not limited to this. For example, the present technology can also be applied to other vehicles such as airplanes and trains to check whether all passengers have disembarked, whether any belongings have been left behind, etc. Furthermore, the present technology can also be applied to party venues, concert venues, etc. to check whether any guests are still remaining, whether any belongings have been left behind, etc.

[0167] Furthermore, while the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0168] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0169] The present technology can also be configured as follows: (1) An information processing device comprising a control unit that controls: a process of acquiring, based on information from a sensor, the movement of a checker who checks whether any check targets remain in a predetermined space; a process of setting, at the timing of starting the check, an initial value of a waiting time until notifying that the check is incomplete in a timer; a process of adjusting a remaining value of the waiting time in the timer based on the movement of the checker; and a process of notifying the checker that the check is incomplete from a notification unit when the remaining value of the waiting time in the timer reaches 0 without a confirmation button being pressed. (2) The information processing device described in (1), in which, in the adjusting process, when the movement of the checker is such that there is a possibility that the checker's pressing of the confirmation button will be delayed, the remaining value of the waiting time in the timer is adjusted to increase. (3) The information processing device described in (2), in which the movement that may cause a delay in the checker's pressing of the confirmation button is a movement away from the confirmation button. (4) The information processing device according to (2), wherein the movement that may delay the checker's pressing of the confirmation button is a movement of stopping at a predetermined position. (5) The information processing device according to (2), wherein the movement that may delay the checker's pressing of the confirmation button is a movement of moving along a path toward a location different from the path toward the confirmation button. (6) The information processing device according to any of (1) to (5), wherein the adjusting process adjusts the remaining value of the waiting time on the timer depending on the position of the checker. (7) The information processing device according to (6), wherein the adjusting process adjusts the remaining value of the waiting time on the timer depending on the distance of the checker from the confirmation button. (8) The information processing device according to (6), wherein the adjusting process adjusts the remaining value of the waiting time on the timer depending on which of a plurality of areas the checker is in when the specified space is divided. (9) The information processing device according to any of (1) to (8), wherein the adjusting process adjusts the remaining value of the waiting time on the timer depending on a characteristic movement of the checker.(10) The information processing device according to any one of (1) to (9), wherein the control unit further controls a process of outputting a warning message when the movement of the inspector is unexpected. (11) The information processing device according to any one of (1) to (10), wherein the setting process sets the timer to an initial value of the waiting time according to the brightness of the predetermined space. (12) The information processing device according to any one of (1) to (11), wherein the adjusting process adjusts the remaining value of the waiting time in the timer according to the brightness of the predetermined space. (13) The information processing device according to any one of (1) to (12), wherein the acquiring process uses information from the sensor by performing tracking processing. (14) The information processing device according to any one of (1) to (13), wherein the information from the sensor includes information on the position of the inspector that is periodically detected. (15) The information processing device according to any one of (14), wherein the information from the sensor further includes information on the speed of the inspector that is periodically detected. (16) The information processing device according to any one of (1) to (15), wherein the sensor is a millimeter-wave radar. (17) The information processing device according to any one of (1) to (16), wherein the predetermined space is the interior of a school bus, the confirmation target is a kindergartener, and the person making the confirmation is a driver or a nursery school teacher who confirms that the kindergartener has disembarked. (18) The information processing device according to (17), wherein the confirmation button is located at the rear of the interior of the school bus, and the sensor is located at the rear of the interior of the school bus alongside the confirmation button. (19) An information processing method comprising the steps of acquiring the movements of a person making the confirmation based on information from the sensor, checking whether any targets remain in the predetermined space, setting a timer at the timing of starting the confirmation to an initial value for the waiting time until notification that the confirmation is incomplete, adjusting the remaining value of the waiting time on the timer based on the movement of the person making the confirmation, and notifying the person making the confirmation that the confirmation is incomplete when the remaining value of the waiting time on the timer reaches 0 without the confirmation button being pressed.(20) A notification system comprising a sensor, a confirmation button, a timer, a notification unit, and a control unit, wherein the control unit controls: a process of acquiring the movements of a checker who checks whether there are any items remaining to be checked in a specified space based on information from the sensor; a process of setting an initial value of the waiting time until notifying that the check is incomplete in the timer at the timing of starting the check; a process of adjusting the remaining value of the waiting time in the timer based on the movement of the checker; and a process of having the notification unit notify the checker that the check is incomplete when the remaining value of the waiting time in the timer becomes 0 without the check button being pressed.

[0170] DESCRIPTION OF SYMBOLS 10...School bus 11...Vehicle body 12...Entrance / exit (boarding / exiting door) 13...Driver's seat 14...Seat for children and nursery teachers 100, 100A...Notification system 101...Get-out confirmation button 102...Millimeter-wave radar 103...Timer 104...Control unit 105...Sound signal generator 106...Speaker 107...Brightness sensor 201...Chirp signal generator 202...Amplifier 203...Transmitting antenna 204...Receiving antenna 205...Amplifier 206...Mixer 207...Amplifier 208...Low-pass filter (LPF) 209...AD converter 210...Signal processing unit 211...Timing generator 212...Frequency controller 213...PLL 214...Frequency multiplier 221...Distance calculator 222...Speed ​​calculator 223: Direction calculation unit 224: Signal analysis unit 250: Receiving unit

Claims

1. An information processing device comprising a control unit that controls the following processes: acquiring the movements of a checker who checks whether any items remain to be checked in a specified space based on information from a sensor; setting an initial value of the waiting time until a notification that the check is incomplete in a timer at the timing of starting the check; adjusting the remaining value of the waiting time in the timer based on the movements of the checker; and, when the remaining value of the waiting time in the timer becomes 0 without the check button being pressed, causing a notification unit to notify the checker that the check is incomplete.

2. An information processing device as described in claim 1, wherein the adjustment process adjusts the remaining waiting time value in the timer in an increasing direction when the movement of the person making the check is such that there is a possibility that the person making the check will be delayed in pressing the confirmation button.

3. The information processing device according to claim 2, wherein the movement that may cause a delay in the confirmer's pressing of the confirmation button is a movement away from the confirmation button.

4. The information processing device according to claim 2, wherein the movement that may cause a delay in the confirmer's pressing of the confirmation button is a movement of stopping at a predetermined position.

5. The information processing device according to claim 2, wherein the movement that may cause a delay in the checker's pressing of the confirmation button is a movement of proceeding along a path toward a location different from the path toward the confirmation button.

6. The information processing device according to claim 1, wherein the adjustment process adjusts the remaining value of the waiting time in the timer according to the location of the person making the check.

7. The information processing device according to claim 6, wherein the adjustment process adjusts the remaining value of the waiting time in the timer according to the distance of the checker from the confirmation button.

8. An information processing device according to claim 6, wherein the adjustment process adjusts the remaining value of the waiting time in the timer depending on which of a plurality of areas into which the specified space is divided the person making the check is in.

9. The information processing device according to claim 1, wherein the adjustment process adjusts the remaining value of the waiting time in the timer in accordance with a characteristic movement of the verifying person.

10. The information processing device according to claim 1, wherein the control unit further controls a process of outputting a warning message when the movement of the checker is unexpected.

11. The information processing device according to claim 1, wherein the setting process sets an initial value of the waiting time corresponding to the brightness of the predetermined space in the timer.

12. The information processing device according to claim 1, wherein said adjustment process adjusts the remaining value of said waiting time in said timer according to the brightness of said specified space.

13. The information processing device according to claim 1, wherein the acquiring process uses information from the sensor by performing tracking processing.

14. The information processing device according to claim 1, wherein the information from the sensor includes information on the location of the person who is detected periodically.

15. The information processing device according to claim 14, wherein the information from the sensor further includes information on the speed of the person being identified that is detected periodically.

16. The information processing device according to claim 1, wherein the sensor is a millimeter wave radar.

17. The information processing device according to claim 1, wherein the specified space is the interior space of a school bus, the subject of confirmation is a child, and the person confirming the child disembarking is a driver or a nursery school teacher.

18. The information processing device according to claim 17, wherein the confirmation button is located at the rear of the interior space of the school bus, and the sensor is located at the rear of the interior space of the school bus alongside the confirmation button.

19. An information processing method comprising the steps of: acquiring the movements of a checker who is checking whether any items to be checked remain in a specified space based on information from a sensor; setting an initial value of the waiting time until notifying that the check is incomplete in a timer at the timing when the check begins; adjusting the remaining value of the waiting time in the timer based on the movements of the checker; and notifying the checker that the check is incomplete when the remaining value of the waiting time in the timer becomes 0 without the check button being pressed.

20. A notification system comprising a sensor, a confirmation button, a timer, a notification unit, and a control unit, wherein the control unit controls: a process of acquiring the movements of a checker who checks whether any items to be checked remain in a specified space based on information from the sensor; a process of setting an initial value of the waiting time until notifying that the check is incomplete in the timer at the timing of starting the check; a process of adjusting the remaining value of the waiting time in the timer based on the movements of the checker; and a process of having the notification unit notify the checker that the check is incomplete when the remaining value of the waiting time in the timer becomes 0 without the confirmation button being pressed.

Images