Information processing device, information processing method, and leaving-behind prevention system

Abstract

The present invention makes it possible to favorably determine the validity of the pressing of a confirmation button.　According to the present invention, a detection unit detects whether confirmation operations are being performed by a confirming person that is to confirm whether confirmation targets remain in a prescribed space. On the basis of detection results from the detection unit, a determination unit determines whether a confirmation completion operation performed by the confirming person is valid. For example, the confirmation completion operation is determined to be valid when the confirming person was performing confirmation operations during the time until the confirmation completion operation was performed.

Description

Information processing device, information processing method, and system for preventing children from being left behind

[0001] The present technology relates to an information processing device, an information processing method, and an abandonment prevention system, and more particularly to an information processing device or the like that can properly determine the validity of a confirmation completion operation.

[0002] In recent years, accidents in which young children (kindergarten children) are left behind on school buses (shuttle buses) for kindergartens, nurseries (daycare centers), etc. have become a social problem, and there is a need to prevent such accidents from occurring. For example, Patent Document 1 discloses a technology in which a button for confirming whether or not a child is left behind on the bus is installed at the rear of the bus. In this case, a person checking whether or not a child is left behind on the bus completes the check by pressing and operating the button for confirming whether or not a child is left behind on the bus.

[0003] In this case, if the exit confirmation button is not pressed, a warning will be issued when the doors are locked, and the person checking will be alerted. On the other hand, if the exit confirmation button is pressed, no warning will be issued when the doors are locked. However, just because the exit confirmation button is pressed does not necessarily mean that the person checking has actually performed a checking action. For example, it is possible that the person checking will press the exit confirmation button without properly checking under the seat, etc.

[0004] Patent No. 7300782

[0005] An object of the present technology is to enable good determination of the validity of a confirmation completion operation.

[0006] The concept of this technology is an information processing device that includes a detection unit that detects whether a checker is performing a check operation to check whether a check target remains in a specified space, and a judgment unit that, when the checker performs a check completion operation, determines whether the check completion operation is valid based on the detection result of the detection unit.

[0007] In the present technology, a detection unit detects whether a checker is performing a checking action to check whether a check target remains in a predetermined space. For example, the detection unit may be configured to detect whether the checker is performing a checking action based on an image signal of a subject including the checker. Furthermore, for example, the predetermined space may be the interior space of a school bus, the check target may be a child, and the checker may be a driver or a childcare worker who checks whether the child has disembarked.

[0008] When a confirmation completion operation is performed by the checker, the determination unit determines whether the confirmation completion operation is valid based on the detection result of the detection unit. For example, the determination unit may be configured to determine that the confirmation completion operation is valid if the checker has been performing a confirmation action until the confirmation completion operation is performed.

[0009] In this way, this technology detects whether a checker is performing a check action to check whether the item to be checked remains in a specified space, and when the checker performs a check completion operation, it determines whether the check completion operation is valid based on the detection result, making it possible to accurately determine the validity of the check completion operation.

[0010] In addition, in the present technology, for example, when the detection unit detects that the checker has not performed a check action until the check completion operation is performed, a notification unit may be further provided that notifies the checker that the check action has not been performed. This allows the checker to notice that the check action has not been performed at the midpoint of the check and to correct the check action so that the check action will be performed and continue the check action.

[0011] Furthermore, in the present technology, for example, when a confirmation completion operation is performed and the detection unit detects that the checker has not performed a confirmation action, a notification unit may be further provided that notifies the checker that the confirmation action has not been performed. This allows the checker to notice that the confirmation action has not been performed, and makes it possible to ensure the accuracy of the confirmation by performing the confirmation action again from the initial position.

[0012] Furthermore, in the present technology, for example, the check by the checker whether the check target remains in the predetermined space may be performed in a check mode, and a control unit may be further provided that terminates the check mode when the determination unit determines that the check completion operation is valid. This makes it possible to terminate the check mode if the checker has been performing a check operation until the check completion operation is performed, making it possible to appropriately terminate the check mode.

[0013] In this case, for example, the device may further include a user operation unit for selecting the timing to start the confirmation mode from a plurality of options. This makes it possible to select the timing to start the confirmation mode that suits the confirmation operation. Also, in this case, for example, the timing to start the confirmation mode may be the timing when the checker performs a predetermined action. This allows the checker to easily know that the confirmation mode has started, allowing them to smoothly begin the confirmation operation.

[0014] In this case, for example, the device may further include a notification unit that notifies the checker that the device is in the confirmation mode. Here, for example, the notification unit may notify the checker that the device is in the confirmation mode by at least one of sound, light, and vibration. This allows the checker to easily recognize that the device is in the confirmation mode.

[0015] In this case, for example, the control unit may end the confirmation mode and then start a monitoring mode to monitor whether the confirmation target remains in the predetermined space. This makes it possible to start the monitoring mode if the checker has been performing a checking operation until a confirmation completion operation is performed.

[0016] Here, for example, the control unit may be configured to start the monitoring mode after a certain time has elapsed since the confirmation mode was terminated. This allows the person checking the information to leave the specified space before the monitoring mode is started. In this case, for example, the device may further include a user operation unit for setting the certain time. This makes it possible to set the certain time to an appropriate time taking into account the age of the person checking the information, the size of the specified space, etc.

[0017] The system may further include a monitoring unit that monitors whether a confirmation target remains in the predetermined space in the monitoring mode. In this case, the monitoring unit can monitor whether a confirmation target remains in the predetermined space. For example, the monitoring unit may monitor whether a confirmation target remains in the predetermined space based on an image capture signal of a subject including the predetermined space. Also, for example, the monitoring unit may monitor whether the confirmation target remains in the predetermined space based on a sound signal collected in the predetermined space.

[0018] Furthermore, for example, the device may further include a notification unit that notifies people that a target for confirmation remains in the predetermined space when the monitoring unit detects that the target for confirmation remains in the predetermined space. This makes it possible to notify people around that a target for confirmation remains in the predetermined space.

[0019] Another concept of the present technology is an information processing method having a procedure for detecting whether a checker is performing a check operation to check whether a check target remains in a specified space, and a procedure for determining, when the checker performs a check completion operation, whether the check completion operation is valid based on the result of the detection.

[0020] Another concept of the present technology is a system for preventing children from being left behind, which includes an imaging unit, a disembarking confirmation completion operation unit, and an information processing unit, and the information processing unit detects whether a person checking whether any children remain in the interior space of the school bus is performing a checking operation based on an imaging signal of a subject including the person obtained by the imaging unit, and when the person operates the disembarking confirmation completion operation unit, determines whether the operation of the disembarking confirmation completion operation unit is valid based on the result of the detection.

[0021] Fig. 1 is a diagram schematically showing a school bus for a kindergarten, nursery school (daycare center), etc. equipped with an abandonment prevention system according to the present technology. Fig. 2 is a plan view schematically showing the interior of a school bus. Fig. 3 is a block diagram showing an example configuration of an abandonment prevention system. Fig. 4 is a flowchart showing an example of the processing procedure of the abandonment prevention system. Fig. 5 is a flowchart showing another example of the processing procedure of the abandonment prevention system. Fig. 6 is a block diagram showing an example hardware configuration of a computer.

[0022] The following describes modes for carrying out the invention (hereinafter referred to as "embodiments"). The description will be given in the following order: 1. Embodiment 1-1. Example of a school bus 1-2. Example of the configuration of a child abandonment prevention system 1-3. Example of a processing procedure of a child abandonment prevention system 1-4. Another example of a processing procedure of a child abandonment prevention system 1-5. Processing by software 2. Modified examples

[0023] 1. Embodiments> "1-1. Example of a School Bus" Fig. 1 schematically shows a school bus (shuttle bus) 10 for a kindergarten, nursery school (daycare center), etc., equipped with a child abandonment prevention system according to the present technology. Fig. 2 is a plan view schematically showing the interior of the school bus 10.

[0024] The school bus 10 has a vehicle body 11, a boarding / alighting door 12, a driver's seat 13 for the driver, and seats 14 for the children (toddlers) and nursery teachers. The driver's seat 13 is provided in the front part of the interior of the school bus 10. A plurality of seats 14 are provided from the front to the rear of the interior of the school bus 10. A disembarking confirmation button (switch) 103, an imaging unit 104, and an alarm unit 105, which constitute the child abandonment prevention system 100, are arranged in the rear part of the interior of the school bus 10.

[0025] 3 shows an example of the configuration of the abandonment prevention system 100. The abandonment prevention system 100 has a control unit 101, a user operation unit 102, a disembarking confirmation button 103, an imaging unit 104, a notification unit 105, and a recording unit 106.

[0026] The control unit 101 is configured with various processors such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The control unit 101 controls all or part of the functions of the abandonment prevention system 100. The user operation unit 102 is a part that is operated by the user to perform various operations.

[0027] The alighting confirmation button 103 is a button that a person checking, such as a driver, presses after confirming that the children have alighted. The alighting confirmation button 103 constitutes a alighting confirmation completion operation unit. The alighting confirmation completion operation unit is not limited to a configuration in which the alighting confirmation completion instruction is given by pressing a button, such as the alighting confirmation button 103. The alighting confirmation completion operation unit may also be configured to give the instruction to alight confirmation completion by operating, for example, a lever or a touch panel. In the following description, the alighting confirmation completion operation unit is described as being the alighting confirmation button 103. The imaging unit 104 is composed of a camera having, for example, a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and captures an image of the interior space of the school bus 10. Under the control of the control unit 101, the notification unit 105 issues an alert by sound, light, or the like to the inside or outside of the vehicle as necessary.

[0028] The recording unit 106 records the image signal output from the imaging unit 104. The recording unit 106 records the image signal on a recording medium. In this case, in order to save recording capacity, for example, an overwriting process may be performed so that recordings from a certain period of time in the past remain. By recording the image signal output from the imaging unit 104 on the recording unit 106 in this way, it becomes possible to verify the driver's checking actions, etc., within the interior space of the school bus 10 in the event of a problem.

[0029] For example, after stopping the power source (engine or motor) of the school bus 10, the driver stands up from the driver's seat 13 and walks backward, checking to see if any children are still there. After confirming that there are no children left, the driver 13 presses the exit confirmation button 103 to complete the check.

[0030] Here, the checker is not limited to the driver, but may be someone else. For example, the checker may be a nursery school teacher who is on board the school bus 10. In the following explanation, the checker is assumed to be the driver.

[0031] The driver checks whether any children are still inside the school bus 10 while the abandonment prevention system 100 is in the interior confirmation mode (confirmation mode). The control unit 101 switches the abandonment prevention system 100 to the interior confirmation mode at the start timing of the interior confirmation mode.

[0032] The timing for starting the interior confirmation mode is, for example, the timing when the driver performs a predetermined action. Examples of the predetermined action by the driver include stopping the power source (engine or motor) of the school bus 10, the driver pressing a confirmation start button, the driver standing up from the driver's seat, etc. By setting the timing for starting the confirmation mode to the timing when the driver performs a predetermined action, the driver can easily know that the interior confirmation mode has started and can smoothly begin the confirmation action.

[0033] The timing for starting the interior confirmation mode is not limited to the timing when the driver performs a predetermined action, but may also be the timing when the school bus 10 enters the school grounds and stops, or the timing when the school bus 10 enters the school grounds and stops and the boarding / alighting door 12 is opened, etc. For example, a user, such as a manager of the school bus 10, may be able to select the timing for starting the interior confirmation mode from the multiple options described above by operating the user operation unit 102 of the child abandonment prevention system 100. This makes it possible to use a timing for starting the interior confirmation mode that matches the confirmation operation. In the following explanation, the timing for starting the interior confirmation mode will be described as the timing when the driver performs an action to stop the power of the school bus 10.

[0034] Here, while the abandoned vehicle prevention system 100 is in the interior confirmation mode, the fact that the system is in the interior confirmation mode is notified. In this case, the notification is made, for example, by sound, light emission, or vibration. When the notification is made by sound, for example, a predetermined sound (melody) is output from a speaker of the notification unit 105. When the notification is made by light emission, for example, a light-emitting element of the notification unit 105 is made to emit light or flash. When the notification is made by vibration, for example, a mobile terminal such as a smartphone held by the driver is made to vibrate based on a vibration control signal from the notification unit 105 or the control unit 101. By being notified that the system is in the interior confirmation mode in this way, the driver can easily recognize that the system is in the interior confirmation mode and can be aware that a confirmation operation should be performed.

[0035] In the interior confirmation mode, the control unit 101 performs processing related to the interior confirmation mode. In this sense, the control unit 101 constitutes an interior confirmation mode processing unit 101a. In the interior confirmation mode, the control unit 101 detects whether the driver is performing a confirmation operation. In this sense, the control unit 101 constitutes a detection unit serving as the interior confirmation mode processing unit 101a. The imaging unit 104 captures images of the interior space of the school bus 10, and therefore of subjects including the driver. In other words, the imaging unit 104 captures images at a predetermined frame rate of the driver standing up from the driver's seat and moving toward the rear of the school bus 10 while checking to see if any children are still there.

[0036] The control unit 101 detects whether the driver is performing a checking operation based on the image signal output from the imaging unit 104. Whether the driver is performing a checking operation is determined based on whether the driver's checking operation satisfies predetermined conditions. In this case, for example, an AI (artificial intelligence) function determines whether the driver is performing a checking operation based on the direction and posture of the driver's face during the checking operation. For example, if the driver moves toward the rear of the school bus 10 while checking under the left and right seats 14, a checking operation is detected. Also, if the driver moves toward the rear of the school bus 10 while looking straight ahead without checking under the left and right seats 14, a checking operation is detected as not being performed. Also, if the driver checks the left and right seats 14 but moves toward the rear of the school bus 10 without checking under the left and right seats 14, a checking operation may be detected as not being performed. This example illustrates a case where the driver thinks he or she is performing a checking operation, but is not performing the checking operation correctly.

[0037] When the control unit 101 detects that the driver has not performed a check operation, it controls the notification unit 105 to output, for example, a warning sound to notify the driver that a check operation has not been performed. In this case, the notification is an in-vehicle notification, and the warning sound may be output at a volume level that can be heard inside the vehicle. In this case, the notification unit 105 may also output a voice message instructing the driver to perform a check operation, such as "A check operation has not been performed. Please go back a little and perform a check operation." Note that this notification is not limited to sound output, and may also be performed by light emission, flashing, or even by display or vibration on a mobile device held by the driver.

[0038] In this state where it is being notified that a checking operation has not been performed, the control unit 101 monitors the driver's operation based on the image signal output from the image capturing unit 104, and cancels the state when it is confirmed that the driver has stepped back a little and performed a checking operation. By being notified that a checking operation has not been performed in this way, the driver can notice that a checking operation has not been performed at a mid-check position, and can correct the checking operation so that a checking operation will be performed, and continue the checking operation.

[0039] Furthermore, in the interior confirmation mode, when the driver presses the exit confirmation button 103, the control unit 101 determines whether the pressing of the exit confirmation button 103 is valid based on the detection result of whether the driver has performed a confirmation action until the above-mentioned exit confirmation button 103 is pressed. In this sense, the control unit 101 constitutes a determination unit serving as the interior confirmation mode processing unit 101a. In this case, the control unit 101 determines that the pressing of the exit confirmation button 103 is valid if the driver has performed a confirmation action until the exit confirmation button 103 is pressed.

[0040] As described above, in a system in which it is detected whether the driver is performing a confirmation action, an alert is issued if it is determined that the driver is not performing a confirmation action, and the alert is canceled when it is confirmed that the driver has returned a little and performed a confirmation action, when the driver presses the dismount confirmation button 103, it can be determined that the driver is performing a confirmation action until the dismount confirmation button 103 is pressed, and that the pressing of the dismount confirmation button 103 is valid.

[0041] On the other hand, even if it is detected that the driver is not performing the confirmation operation as described above and it is detected that the driver is not performing the confirmation operation, it is possible that the fact that the confirmation operation is not being performed will not be notified at that time. In that case, when the driver presses the exit confirmation button 103, there is a possibility that the driver has not performed the confirmation operation until the exit confirmation button 103 is pressed.

[0042] In this case, when the driver presses the alighting confirmation button 103, the control unit 101 determines whether the driver has performed the confirmation action based on the detection result of whether the driver has performed the above-mentioned confirmation action during the period leading up to the pressing of the alighting confirmation button 103. If the control unit 101 determines that the driver has not performed the confirmation action, it outputs, for example, a warning sound to notify the user that the confirmation action has not been performed. In this case, even if it is detected that the driver has not performed the confirmation action during part of the period leading up to the pressing of the alighting confirmation button 103, it is determined that the driver has not performed the confirmation action.

[0043] In this case, the notification is also intended for the interior of the vehicle, and the warning sound may be output at a volume level that can be heard inside the vehicle. In this case, it is also possible for the notification unit 105 to output a voice message instructing the driver to perform a check operation, such as "The check operation has not been performed. Please return to the initial position and perform the check operation." Note that this notification is not limited to sound output, but may also be performed by light emission, flashing, or even vibration of the mobile device held by the driver. By being notified that the check operation has not been performed in this way, the driver can realize that the check operation has not been performed, and by performing the check operation again from the initial position, it is possible to ensure the accuracy of the check.

[0044] When the control unit 101 determines that the depressing of the exit confirmation button 103 is valid, it ends the interior confirmation mode. This ends the notification that the vehicle is in the interior confirmation mode, as described above. This allows the driver to recognize that the confirmation operation may be ended.

[0045] In this embodiment, after terminating the interior confirmation mode, the control unit 101 initiates an interior monitoring mode (monitoring mode) to monitor whether any children remain in the interior of the bus. In this sense, the control unit 101 constitutes a confirmation / monitoring mode switching unit 101c. After terminating the interior monitoring mode, the control unit 101 initiates the monitoring mode after a certain period of time, e.g., five minutes, has elapsed. This allows the driver to evacuate the interior of the school bus 10 before the monitoring mode is initiated. For example, a user, such as the manager of the school bus 10, may be able to set the certain period of time by operating the user operation unit 102 of the child abandonment prevention system 100. This allows the certain period of time to be set appropriately, taking into account the driver's age, the size of the interior of the school bus 10, and the like.

[0046] In the interior monitoring mode, the control unit 101 performs processing related to the interior monitoring mode. In this sense, the control unit 101 constitutes an interior monitoring mode processing unit 101b. In the interior monitoring mode, the control unit 101 monitors whether any children remain in the interior space of the school bus 10. In this sense, the control unit 101 constitutes a monitoring unit that serves as the interior monitoring mode processing unit 101b. The imaging unit 104 captures images of a subject, including the interior space of the school bus 10, at a predetermined frame period.

[0047] The control unit 101 monitors whether any children remain inside the interior of the school bus 10 based on the image signal output from the imaging unit 104. In this case, by detecting changes between multiple images taken before and after, i.e., movement inside the vehicle, it determines whether any children remain inside the interior of the school bus 10. In this case, it is also possible to further determine whether or not the child is a child by image analysis based on information on the changed parts of the image, thereby accurately determining whether or not any children remain inside the interior of the school bus 10.

[0048] If the in-vehicle monitoring mode is equipped with a function for identifying children, even if the driver (adult) is inside the interior of the school bus 10, it will not be determined that there are children remaining inside the interior of the school bus 10. Therefore, as described above, it is no longer necessary to allow a certain amount of time for the driver to evacuate from the interior of the school bus 10 between the end of the in-vehicle monitoring mode and the start of the monitoring mode.

[0049] When the control unit 101 detects in the monitoring mode that a child remains inside the interior of the school bus 10, it controls the notification unit 105 to, for example, output a warning sound to notify the user that a child remains inside the interior of the school bus 10. In this case, the notification is directed to the outside of the bus, and the warning sound is output at a louder volume level than the notification directed inside the bus. Note that this notification is not limited to sound output, but may be performed by light emission, flashing, or even by display or vibration on a mobile device held by the driver or the school administrator or on a terminal located inside the school.

[0050] In the monitoring mode, monitoring to determine whether any children remain inside the interior of the school bus 10 is performed based on the image signal output from the imaging unit 104 as described above, or alternatively, based on sound signals collected inside the interior of the school bus 10. This is effective when any children remaining inside the interior of the school bus 10 cannot be imaged by the imaging unit 104.

[0051] When the doors of the school bus 10 are unlocked, the control unit 101 ends the interior monitoring mode. This ends the series of processes to prevent children from being left behind that have been performed since the interior check mode was started. The timing for ending the interior monitoring mode is not limited to when the doors of the school bus 10 are unlocked. For example, the timing may be when the driver or the manager of the school bus 10 uses a remote control to end the interior monitoring mode. Alternatively, as described above, if the interior monitoring mode is equipped with a child identification function, the driver may enter the school bus 10 and start the power source (engine or motor) of the school bus 10, press the monitoring end button, or the like.

[0052] 1-3. Example of Processing Procedure of the Abandonment Prevention System The flowchart in FIG. 4 shows an example of processing procedure of the above-mentioned abandonment prevention system 100 shown in FIG.

[0053] First, in step ST1, the control unit 101 starts processing at the timing when the driver stops the power of the school bus 10. Next, in step ST2, the control unit 101 starts the interior confirmation mode. When the interior confirmation mode is started, a notification is sent to the interior space of the school bus 10 that the interior confirmation mode is in effect. With the start of the interior confirmation mode, the person checking (the driver) starts a checking operation to check whether any children remain in the interior space of the school bus 10.

[0054] Next, in step ST3, the control unit 101 detects whether the inspector is performing a checking operation. In this case, the control unit 101 detects whether the inspector is performing a checking operation based on the image signal output from the image capturing unit 104. This detection is performed sequentially at each movement position while the inspector is moving rearward while performing a checking operation in the interior checking mode.

[0055] Next, in step ST4, the control unit 101 determines whether the checker is performing a checking operation based on the detection result. If it determines that the checker is not performing a checking operation, the control unit 101 controls the notification unit 105 in step ST5 to output, for example, an alarm sound to notify the passengers in the vehicle that a checking operation is not being performed. Thereafter, the control unit 101 returns to the processing of step ST3.

[0056] By being notified within the vehicle, the person checking the vehicle can realize that the checking operation has not been performed and can correct the situation so that the checking operation will be performed after going back a little, and then perform the checking operation. As a result, even for a movement position where it has been determined that the checking operation of the checker has not been performed, the control unit 101 can detect that the checking operation of the checker has been performed in the detection process of step ST3. In this way, when it is detected that the checking operation of the checker has been performed for a movement position where it has been determined that the checking operation has not been performed, the control unit 101 controls the notification unit 105 to stop the notification within the vehicle.

[0057] Furthermore, when it is determined in step ST4 that the checker has performed a check operation, the control unit 101 determines in step ST6 whether the get-off confirmation button 103 has been pressed. When it is determined that the get-off confirmation button 103 has not been pressed, the control unit 101 returns to the process of step ST3 and repeats the above-described process.

[0058] Furthermore, when it is determined in step ST6 that the exit confirmation button 103 has been pressed, the control unit 101 determines that this pressing is valid, terminates the interior confirmation mode, and proceeds to the processing of step ST7. With this termination of the interior confirmation mode, the notification that the vehicle is in the interior confirmation mode is terminated.

[0059] As described above, in the case where it is detected whether the person checking is making a confirmation action, and if it is determined that the person checking is not making a confirmation action, an alarm is issued inside the vehicle, and the alarm is cancelled when it is confirmed that the driver has returned a little and made a confirmation action, when the exit confirmation button 103 is pressed, the control unit 101 can determine that the person checking was making a confirmation action until the exit confirmation button 103 was pressed. Thus, when the control unit 101 determines that the exit confirmation button 103 has been pressed, it determines that this press is valid.

[0060] In step ST7, the control unit 101 waits for a certain period of time, for example, five minutes, so that the person checking the information can leave the interior space of the school bus 10 before starting the monitoring mode.

[0061] Next, the control unit 101 starts the interior monitoring mode in step ST8. The control unit 101 starts monitoring whether any children remain in the interior space of the school bus 10 based on the image capture signal output from the image capture unit 104. Next, the control unit 101 determines whether movement inside the vehicle has been detected in step ST9. If it determines that movement inside the vehicle has not been detected, the control unit 101 determines whether the door has been unlocked in step ST10. If it determines that the door has not been unlocked, the control unit 101 returns to the processing of step ST9. On the other hand, if it determines that the door has been unlocked, the control unit 101 ends the interior monitoring mode in step ST11, and ends the series of processing.

[0062] Furthermore, when it is determined in step ST9 that movement inside the vehicle has been detected, the control unit 101 controls the alarm unit 105 in step ST12, assuming that a child remains in the interior space of the school bus 10, and outputs a warning sound, for example, to notify people outside the vehicle that a child remains in the interior space of the school bus 10.

[0063] Next, in step ST13, the control unit 101 determines whether the door has been unlocked. If it determines that the door has not been unlocked, the control unit 101 returns to the process of step ST12 and continues to notify the outside. On the other hand, if it determines that the door has been unlocked, the control unit 101 ends the in-vehicle monitoring mode in step ST11, and ends the example process.

[0064] "1-4. Another example of the processing procedure of the system for preventing abandonment" The flowchart in Fig. 5 shows another example of the processing procedure of the system for preventing abandonment 100 shown in Fig. 3. In the flowchart in Fig. 5, steps corresponding to those in the flowchart in Fig. 4 are denoted by the same reference numerals.

[0065] First, in step ST1, the control unit 101 starts processing at the timing when the driver stops the power of the school bus 10. Next, in step ST2, the control unit 101 starts the interior confirmation mode. When the interior confirmation mode is started, a notification is sent to the interior space of the school bus 10 that the interior confirmation mode is in effect. With the start of the interior confirmation mode, the person checking (the driver) starts a checking operation to check whether any children remain in the interior space of the school bus 10.

[0066] Next, in step ST3, the control unit 101 detects whether the inspector is performing a checking operation. In this case, the control unit 101 detects whether the inspector is performing a checking operation based on the image signal output from the image capturing unit 104. This detection is performed sequentially at each movement position while the inspector is moving rearward while performing a checking operation in the interior checking mode.

[0067] Next, in step ST6, the control unit 101 determines whether or not the alighting confirmation button 103 has been pressed. If it determines that the alighting confirmation button 103 has not been pressed, the control unit 101 returns to the processing of step ST3 and repeats the above-described processing.

[0068] Furthermore, when it is determined in step ST6 that the alighting confirmation button 103 has been pressed, the control unit 101 determines in step ST21 whether the confirming action of the person checking has been performed until the alighting confirmation button 103 has been pressed. In this case, when the control unit 101 detects that the confirming action of the person checking has not been performed at least partly until the alighting confirmation button 103 has been pressed, it determines that the confirming action of the person checking has not been performed until the alighting confirmation button 103 has been pressed.

[0069] When it is determined in step ST21 that the checker has not performed the check operation, the control unit 101 controls the notification unit 105 in step ST22 to output, for example, a warning sound to notify the passengers in the vehicle that the check operation has not been performed. After that, the control unit 101 returns to the processing of step ST3.

[0070] By being notified inside the vehicle, the person checking the vehicle notices that the checking operation has not been performed and can ensure the accuracy of the checking by performing the checking operation again from the initial position. As a result, in the detection process of step ST3, the control unit 101 detects that the person checking the vehicle has performed the checking operation, and in the determination process of step ST21, the control unit 101 can determine that the person checking the vehicle has performed the checking operation.

[0071] If it is determined in step ST21 that the checker has performed a check operation, the control unit 101 determines that the depression of the exit check button 103 is valid, terminates the interior check mode, and proceeds to the processing of step ST7. With this termination of the interior check mode, the notification that the interior check mode is in effect is terminated.

[0072] In the flowchart shown in FIG. 5, steps ST7 and thereafter are the same as those in the flowchart shown in FIG. 4 described above, and therefore a description thereof will be omitted.

[0073] As described above, the abandonment prevention system 100 shown in Figure 3 detects whether a checker (driver) is checking to see if any children remain in the interior space of the school bus 10, and when the checker presses the alighting confirmation button 103, it determines based on the detection result whether pressing the alighting confirmation button 103 is valid. This makes it possible to accurately determine the validity of pressing the alighting confirmation button 103, and prevents the checker from overlooking children if they remain in the interior space of the school bus 10.

[0074] "1-5. Processing by Software" The processing in the abandonment prevention system 100 shown in Figure 3 above can be executed by hardware, but can also be executed by software. When a series of processes is executed by software, the programs that make up the software are installed from a recording medium into a computer built into dedicated hardware, or into, for example, a general-purpose computer that can execute various functions by installing various programs.

[0075] 6 is a block diagram showing an example of the hardware configuration of a computer 600. The computer 600 has a CPU 601, a ROM 602, a RAM 603, a bus 604, an input / output interface 605, an input unit 606, an output unit 607, a storage unit 608, a drive 609, a connection port 610, and a communication unit 611. Note that the hardware configuration shown here is an example, and some of the components may be omitted. Furthermore, the computer 600 may include components other than those shown here.

[0076] The CPU 601 functions as, for example, an arithmetic processing device or a control device, and controls the overall operation or part of the operation of each component based on various programs recorded in the ROM 602 , the RAM 603 , the storage unit 608 , or the removable recording medium 701 .

[0077] The ROM 602 is a means for storing programs to be read into the CPU 601, data to be used for calculations, etc. The RAM 603 temporarily or permanently stores, for example, the programs to be read into the CPU 601 and various parameters that change as appropriate when the programs are executed.

[0078] The CPU 601, ROM 602, and RAM 603 are connected to one another via a bus 604. On the other hand, various components are connected to the bus 604 via an input / output interface 605.

[0079] The input unit 606 may be, for example, a mouse, a keyboard, a touch panel, a button, a switch, a lever, etc. Furthermore, the input unit 606 may also be a remote controller (hereinafter referred to as a remote control) that is capable of transmitting control signals using infrared rays or other radio waves.

[0080] The output unit 607 is a device capable of visually or audibly notifying the user of acquired information, such as a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, an audio output device such as a speaker or headphones, a printer, a mobile phone, or a facsimile.

[0081] The storage unit 608 is a device for storing various types of data. For example, the storage unit 608 may be a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device.

[0082] The drive 609 is a device that reads information recorded on a removable recording medium 701 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information to the removable recording medium 701 .

[0083] The removable recording medium 701 is, for example, a DVD, a Blu-ray (registered trademark) disc, an HD DVD, various semiconductor storage media, etc. Of course, the removable recording medium 701 may also be, for example, an IC card equipped with a contactless IC chip, an electronic device, etc.

[0084] The connection port 610 is a port for connecting an external device 502, such as a Universal Serial Bus (USB) port, a High-Definition Multimedia Interface (HDMI) port, an IEEE 1394 port, a Small Computer System Interface (SCSI), an RS-232C port, or an optical audio terminal. Note that "HDMI" is a registered trademark. The external device 702 is, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

[0085] The communication unit 611 is a communication device for connecting to the network 703, such as a communication card for wired or wireless LAN, Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication.

[0086] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0087] 2. Modifications In the above-described embodiment, the abandonment prevention system 100 first starts the interior confirmation mode, and after the interior confirmation mode ends, the system transitions to the interior monitoring mode, and the series of processes ends when the interior monitoring mode ends. However, an example in which the series of processes ends after the interior confirmation mode ends is also conceivable.

[0088] Furthermore, in the above-described embodiment, an example has been shown in which the present technology is applied to prevent children from being left behind inside the school bus 10, but the scope of application of the present technology is not limited to this. For example, the present technology can also be applied to other vehicles such as airplanes and trains to check whether all passengers have disembarked, whether any belongings have been left behind, etc. Furthermore, the present technology can also be applied to party venues, concert venues, etc. to check whether any guests remain, whether any belongings have been left behind, etc.

[0089] Furthermore, while the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0090] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0091] The present technology may also be configured as follows: (1) An information processing device including: a detection unit that detects whether a check operation by a checker is being performed to check whether a check target remains in a predetermined space; and a determination unit that, when a check completion operation is performed by the checker, determines whether the check completion operation is valid based on a detection result of the detection unit. (2) The information processing device described in (1), wherein the determination unit determines that the check completion operation is valid if the check operation by the checker was being performed until the check completion operation was performed. (3) The information processing device described in (1) or (2), wherein the detection unit detects whether the check operation by the checker is being performed based on an image capture signal of a subject including the checker. (4) The information processing device described in any of (1) to (3), further including a notification unit that notifies that a check operation has not been performed when the detection unit detects that the check operation by the checker has not been performed until the check completion operation is performed. (5) The information processing device according to any one of (1) to (3), further comprising: an alarm unit that notifies the checker that a check operation has not been performed when the detection unit detects that the checker has not performed a check operation upon the check completion operation. (6) The information processing device according to any one of (1) to (5), further comprising: a control unit that terminates the check mode when the checker checks whether a check target remains in the predetermined space in a check mode and when the determination unit determines that the check completion operation is valid. (7) The information processing device according to (6), further comprising: a user operation unit that selects a start timing of the check mode from a plurality of options. (8) The information processing device according to (6), further comprising: an alarm unit that notifies the checker that the checker is in the check mode. (9) The information processing device according to any one of (6) to (8), further comprising: an alarm unit that notifies the checker that the checker is in the check mode. (10) The information processing device according to (9), wherein the alarm unit notifies the checker that the check mode is in the check mode by at least one of sound, light, and vibration.(11) The information processing device according to any one of (6) to (10), wherein the control unit starts a monitoring mode for monitoring whether the confirmation target remains in the predetermined space after terminating the confirmation mode. (12) The information processing device according to (11), wherein the control unit starts the monitoring mode after a certain time has elapsed after terminating the confirmation mode. (13) The information processing device according to (12), further comprising a user operation unit for setting the certain time. (14) The information processing device according to any one of (11) to (13), further comprising a monitoring unit that monitors whether the confirmation target remains in the predetermined space in the monitoring mode. (15) The information processing device according to (14), wherein the monitoring unit monitors whether the confirmation target remains in the predetermined space based on an image capture signal of a subject including the predetermined space. (16) The information processing device according to (14) or (15), wherein the monitoring unit monitors whether the confirmation target remains in the predetermined space based on a sound signal collected in the predetermined space. (17) The information processing device according to any of (14) to (16), further comprising an alarm unit that, when the monitoring unit determines that the confirmation target remains in the predetermined space, notifies that the confirmation target remains in the predetermined space. (18) The information processing device according to any of (1) to (17), wherein the predetermined space is the interior space of a school bus, the confirmation target is a child, and the person checking is a driver or childcare worker who checks that the child has disembarked. (19) An information processing method, comprising: a step of detecting whether a checker is performing a check operation to check whether the confirmation target remains in the predetermined space; and a step of determining, when a check completion operation is performed by the checker, whether the check completion operation is valid based on a result of the detection. (20) A system for preventing children from being left behind, comprising an imaging unit, a disembarking confirmation completion operation unit, and an information processing unit, wherein the information processing unit detects whether a person checking whether any children remain in the interior space of a school bus based on an imaging signal of a subject including the person obtained by the imaging unit, and when the person operates the disembarking confirmation completion operation unit, determines whether the operation of the disembarking confirmation completion operation unit is valid based on the result of the detection.

[0092] DESCRIPTION OF SYMBOLS 10: School bus 11: Vehicle body (body) 12: Boarding / exiting door 13: Driver's seat 14: Seat 100: Left-behind prevention system 101: Control unit 101a: In-vehicle confirmation mode processing unit 101b: In-vehicle monitoring mode processing unit 101c: Confirmation / monitoring mode switching unit 102: User operation unit 103: Exit confirmation button 104: Imaging unit 105: Notification unit 106: Recording unit

Claims

1. An information processing device comprising: a detection unit that detects whether a checker is performing a check operation to check whether a check target remains in a specified space; and a judgment unit that, when the checker performs a check completion operation, judges whether the check completion operation is valid based on the detection result of the detection unit.

2. The information processing device according to claim 1, wherein the determination unit determines that the confirmation completion operation is valid if the checker has been performing a confirmation action until the confirmation completion operation is performed.

3. The information processing device according to claim 1, wherein the detection unit detects whether the person making the confirmation action is performing based on an image capture signal of a subject including the person making the confirmation action.

4. The information processing device according to claim 1, further comprising an alarm unit that notifies the user that a confirmation operation has not been performed if the detection unit detects that the user has not performed a confirmation operation before the confirmation completion operation is performed.

5. The information processing device according to claim 1, further comprising an alarm unit that, when the confirmation completion operation is performed, notifies the user that a confirmation operation has not been performed if the detection unit detects that the confirmation operation has not been performed by the user.

6. The information processing device according to claim 1, further comprising: a control unit that terminates the confirmation mode when the checker checks whether there are any check targets remaining in the specified space; and a control unit that terminates the confirmation mode when the judgment unit judges that the confirmation completion operation is valid.

7. The information processing device according to claim 6, further comprising a user operation unit for selecting the timing to start the confirmation mode from a plurality of options.

8. The information processing device according to claim 6, wherein the confirmation mode is started when the person making the confirmation performs a predetermined action.

9. The information processing device according to claim 6, further comprising a notification unit that notifies the person checking that the device is in the checking mode.

10. The information processing device according to claim 9, wherein the notification unit notifies the person checking that the device is in the check mode by at least one of sound, light, and vibration.

11. The information processing device according to claim 6, wherein the control unit, after terminating the confirmation mode, starts a monitoring mode for monitoring whether the confirmation target remains in the predetermined space.

12. The information processing device according to claim 11, wherein the control unit starts the monitoring mode after a certain time has elapsed since the confirmation mode was ended.

13. The information processing device according to claim 12, further comprising a user operation unit for setting the certain period of time.

14. The information processing device according to claim 11, further comprising a monitoring unit that monitors whether the confirmation target remains in the predetermined space in the monitoring mode.

15. The information processing device according to claim 14, wherein the monitoring unit monitors whether the confirmation target remains in the predetermined space based on an image signal of a subject including the predetermined space.

16. The information processing device according to claim 14, wherein the monitoring unit monitors whether the confirmation target remains in the predetermined space based on a sound signal collected in the predetermined space.

17. The information processing device according to claim 14, further comprising an alarm unit that, when the monitoring unit detects that the confirmation target remains in the specified space, issues an alarm that the confirmation target remains in the specified space.

18. The information processing device according to claim 1, wherein the specified space is the interior space of a school bus, the object of confirmation is a child, and the person confirming confirmation is a driver or a nursery school teacher who confirms that the child has disembarked.

19. An information processing method comprising: a step of detecting whether a checker is performing a check operation to check whether a check target remains in a specified space; and a step of determining, when the checker performs a check completion operation, whether the check completion operation is valid based on the result of the detection.

20. A system for preventing children from being left behind, comprising an imaging unit, a disembarking confirmation completion operation unit, and an information processing unit, wherein the information processing unit detects whether a person checking to see if any children remain in the interior of the school bus based on an image signal of a subject including the person obtained by the imaging unit, and when the person operates the disembarking confirmation completion operation unit, determines whether the operation of the disembarking confirmation completion operation unit is valid based on the detection result.

Images