Vehicle controller

Abstract

To determine infants left behind in a room of a vehicle with high accuracy.SOLUTION: Performed is infant leaving-behind determination processing using image information including an indoor image of a vehicle and a periphery image of the vehicle. According to the leaving-behind determination processing, determination of being seated on infant child seats, and collection of the total number of non-infants that rides on the vehicle are carried out by recognition processing using the image information during IG-ON of the vehicle. Further, determination of leaving from the infant child seats, and collection of the total number of non-infants that gets off the vehicle are carried out by the recognition processing using the image information during IG-OFF of the vehicle. Then, when the total number of non-infants collected during the IG-OFF is identical to that of being collected during the IG-ON, it is determined that the leaving-behind occurs, when a result of the determination of being seated during the IG-OFF contradicts a result of the determination of leaving during the IG-ON.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to a technology for monitoring whether an infant or young child has been left behind inside a vehicle. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2021-66275 discloses a device for monitoring whether an infant has been left behind inside a vehicle. This conventional device acquires images captured by a camera that captures the interior of the vehicle while the vehicle is stopped. If the image of the vehicle interior captured by the camera includes an image of a child car seat, this conventional device determines whether an infant has been left behind based on an image of the area including the image of the child car seat. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-66275 Summary of the Invention [Problem to be solved by the invention]

[0004] There are various ways in which child seats are installed in the interior of a vehicle. Therefore, depending on the relative positions of the camera and the child seat, an image of the child seat may not be recognized. For example, consider a case in which a child seat is installed behind the front seat, facing back to back. In this case, the child seat is located in the blind spot of the camera installed in the front part of the vehicle, and an image of the child seat will not be recognized. Therefore, there is room for improvement in determining whether an infant has been left behind, regardless of the positions of the camera and the child seat.

[0005] One object of the present disclosure is to provide a device that can accurately determine whether an infant has been left behind inside a vehicle. [Means for solving the problem]

[0006] The present disclosure relates to a vehicle control device and has the following features. The vehicle control device includes an interior camera, a surrounding camera, and an information processing device. The interior camera acquires an interior image of the vehicle. The surrounding camera acquires an image of the surroundings of the vehicle. The information processing device performs an infant abandonment determination process using image information including the interior image and the surrounding image. In the abandonment determination process, the information processing device performs a recognition process using the image information when the vehicle ignition is on to determine whether infants using child seats in the vehicle are seated in the child seats and to tally the total number of non-infants who have boarded the vehicle, and performs a recognition process using the image information when the vehicle ignition is off to determine whether the infants have left the child seats and to tally the total number of non-infants who have exited the vehicle.If the total number of non-infants tallied when the ignition is off matches the number tallied when the ignition is on, and the result of the seating determination when the ignition is off contradicts the result of the leaving determination when the ignition is on, it determines that abandonment has occurred. [Effects of the Invention]

[0007] According to the present disclosure, an abandonment determination process is performed. In the abandonment determination process, image information including an interior image and an ambient image is used to determine whether a person is seated when the ignition is on and whether a person is not seated when the ignition is off. In the abandonment determination process, the total number of non-infants who entered the vehicle when the ignition was on and the number of non-infants who exited the vehicle when the ignition was off are also counted using the image information. Then, in the abandonment determination, whether or not an abandonment has occurred is determined by combining the consistency results of the seating determination and the not-entering determination with the consistency results of the total number of passengers and the total number of passengers exiting the vehicle. Therefore, it is possible to determine with high accuracy whether an abandonment has occurred. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a vehicle control device according to an embodiment. [Figure 2] 1 is a diagram showing an example of the actions of an occupant and a vehicle when placing an infant in a child seat; [Figure 3] 10A and 10B are diagrams illustrating an example of the actions of an occupant and a vehicle when removing an infant from a child seat. [Figure 4] 10A and 10B are diagrams showing another example of the actions of the occupant and the vehicle when placing an infant in a child seat or removing an infant from a child seat. [Figure 5] 10 is a flowchart showing the flow of information processing particularly related to the embodiment. [Figure 6] 10 is a flowchart showing the flow of information processing particularly related to the embodiment. [Figure 7] 10 is a flowchart showing the flow of information processing particularly related to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, the structures and the like described in the following embodiments are not necessarily essential to the present disclosure unless specifically stated or clearly specified in principle.

[0010] 1.Configuration example A vehicle control device according to an embodiment is installed in a vehicle capable of mounting a child car seat, such as a private car or a rental car. FIG. 1 is a diagram illustrating an example of the configuration of a vehicle control device according to an embodiment. In the example shown in FIG. 1, the vehicle control device includes an interior monitoring camera 1, a surrounding monitoring camera 2, a door 3, an ignition (IG) switch 4, a courtesy switch 5, an air conditioning device 6, a power window 7, a communication device 8, and an information processing device 9. The information processing device 9 includes an image processing device 91 and a control device 92.

[0011] The interior monitoring camera 1 is a camera that captures images of the interior of the vehicle. The interior monitoring camera 1 is installed, for example, above the front window of the vehicle. The interior monitoring camera 1 may also be installed above the rear window of the vehicle or on the ceiling of the vehicle. The interior monitoring camera 1 acquires images of the interior of the vehicle and transmits them to the image processing device 91. On the other hand, the surroundings monitoring camera 2 is a camera that captures images of the surroundings of the vehicle. The surroundings monitoring camera 2 is installed, for example, above the front window, above the rear window, or below the left and right mirrors. The surroundings monitoring camera 2 acquires images of the surroundings of the vehicle and transmits them to the image processing device 91.

[0012] The image processing device 91 is a microcomputer including at least one processor 91a and at least one storage device 91b. The processor 91a executes various processes. Examples of the processor 91a include a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), and a field-programmable gate array (FPGA). The storage device 91b stores various pieces of information. Examples of the storage device 91b include a volatile memory, a non-volatile memory, a hard disk drive (HDD), and a solid state drive (SSD).

[0013] The various processes performed by the processor 91a include person recognition processing using image information of at least one of an interior image and a surrounding image. In the person recognition processing, people present inside the vehicle are recognized based on the interior image. In the person recognition processing, people present around the vehicle are also recognized based on the surrounding image. In the person recognition processing, the action of putting an infant into a child seat (putting action) and the action of removing an infant from a child seat (removing action) are further recognized using image information of at least one of the interior image and the surrounding image. Note that the recognition of the actions of putting an infant into and removing an infant from the child seat is performed based on a known image recognition technology based on a machine learning model.

[0014] The image processing device 91 transmits the results of the person recognition processing to the control device 92. The control device 92 is a microcomputer including at least one processor 92a and at least one storage device 92b. The basic configuration of the control device 92 is the same as that of the image processing device 91. The various processes performed by the processor 92a include an abandonment determination process using the results of the person recognition processing. In the abandonment determination process, in addition to the results of the person recognition processing, a door lock signal and a door unlock signal for locking the door 3, an IG-ON signal and an IG-OFF signal output from the IG switch 4, and an open signal and a close signal for the door 3 output from the courtesy switch 5 are used.

[0015] The various processes performed by the processor 92a include abandonment countermeasure control based on the results of the abandonment determination process. The abandonment countermeasure control is performed when it is determined in the abandonment determination process that an abandonment has occurred. The abandonment countermeasure control performs at least one of the following: operation of the air conditioning device 6, operation of the power windows 7, and external communication of emergency information using the communication device 8.

[0016] 2. Features of the embodiment FIG. 2 is a diagram showing an example of the behavior of the occupants and vehicle when placing an infant in a child seat. The example shown in FIG. 2 assumes the behavior of the vehicle user (meaning the vehicle occupants excluding the infant; the same applies below) at the departure point. Time T1 shown in FIG. 2 is the timing when the control device 92 detects a door unlock signal. The vehicle user approaches the vehicle and opens the door 3. Time T2 is the timing when the control device 92 detects an open signal output from the courtesy switch 5. Having opened the door 3, the vehicle user gets into the vehicle.

[0017] In the example shown in FIG. 2, the vehicle user starts loading an infant at time T3. At time T4 after the loading operation is completed, the vehicle user operates the IG switch 4, causing the control device 92 to detect the IG-ON signal. The IG switch 4 may also be operated during the loading operation. After the loading operation is completed, the vehicle user closes the door 3. At time T5, the control device 92 detects a close signal output from the courtesy switch 5. After all of the vehicle doors 3 are closed, the vehicle starts at time T6 due to the driving operation of the vehicle user. At time T7 after the vehicle starts, the control device 92 detects a door lock signal. The door lock signal may also be detected before the vehicle starts.

[0018] FIG. 3 is a diagram showing an example of the actions of an occupant and a vehicle when removing an infant from a child car seat. The example shown in FIG. 3 is based on the actions of the vehicle user at the destination. Time T8 shown in FIG. 3 is the timing when the vehicle stops, and time T9 is the timing when the control device 92 detects a door unlock signal. The vehicle user opens the door 3 to get out of the vehicle. Time T10 is the timing when the control device 92 detects an open signal output from the courtesy switch 5.

[0019] The vehicle user starts the baby unloading operation at time T11. After the unloading operation is completed, at time T12, the vehicle user operates the IG switch 4, which causes the control device 92 to detect the IG-OFF signal. The IG switch 4 may also be operated during the unloading operation. After the unloading operation is completed, the vehicle user closes the door 3. At time T13, the control device 92 detects the close signal output from the courtesy switch 5. At time T14, the control device 92 detects the door lock signal.

[0020] Times T1 to T14 shown in Figures 2 and 3 are arranged in chronological order. Therefore, if a loading action is recognized when the IG-ON signal is shown in Figure 2 but a removal action is not recognized when the IG-OFF signal is shown in Figure 3, it is possible that an infant has been left behind. Here, "IG-ON" refers to the time period from when the door unlock signal is output (time T1 in Figure 2) to when the start of the vehicle is detected (time T7 in Figure 2) when the IG-ON signal is output. The end of the IG-ON time may be when a time α (predetermined time) has elapsed since the door close signal was output (time T7 in Figure 2). Furthermore, "IG-OFF" refers to the time period from when the IG-OFF signal is output (time T8 in Figure 3) to when the stop of the vehicle is detected (time T14 in Figure 3).

[0021] However, even if the removal action is not recognized when the ignition is turned off, it is assumed that some of the vehicle users remain in the vehicle with the infant. Therefore, in the embodiment, a consistency check is performed between the seating determination result when the ignition is turned on and the leaving determination result when the ignition is turned off, and a consistency check is also performed between the total number of users who got into the vehicle when the ignition is turned on and the number of users who got out of the vehicle when the ignition is turned off. By performing these two types of consistency checks in the abandonment determination process, it is possible to accurately determine whether abandonment has occurred.

[0022] FIG. 4 is a diagram showing another example of the actions of the occupant and the vehicle when placing an infant in a child car seat or removing an infant from the child car seat. The explanations of FIGS. 2 and 3 are based on the assumption that the vehicle travels directly from the departure point to the destination. However, it is also assumed that some of the vehicle's users may get on or off the vehicle at an intermediate point. It is also assumed that the infant may be handed over to or from the vehicle at this intermediate point. Such an example is explained in FIG. 4.

[0023] 4, time T15 is the timing when the vehicle stops, and time T16 is the timing when the control device 92 detects a door unlock signal. Some of the vehicle users open the door 3 to get in or out of the vehicle. Time T17 is the timing when the control device 92 detects an open signal output from the courtesy switch 5.

[0024] The vehicle user starts loading or unloading an infant at time T18. After loading or unloading is completed, the vehicle user closes the door 3. Time T19 is the timing when the control device 92 detects a close signal output from the courtesy switch 5. After all of the vehicle doors 3 are closed, the vehicle starts moving at time T20 due to the driving operation of the vehicle user. After the vehicle starts moving, time T21 is the timing when the control device 92 detects a door lock signal. The door lock signal may also be detected before the vehicle starts moving.

[0025] Times T15 to T21 shown in FIG. 4 are timings between time T7 in FIG. 2 and time T8 in FIG. 3. As such, when a vehicle temporarily stops at a route point, the total number of users of the vehicle may increase or decrease. In addition, the act of loading or unloading an infant may be recognized. Therefore, in this embodiment, when the vehicle temporarily stops, the result of the seating determination when the ignition is turned on and the total number of users who boarded the vehicle when the ignition is turned on are corrected. Here, when the vehicle is temporarily stopped, the ignition-off signal is not output, and refers to the time period from the time when the stop of the vehicle is detected (time T15 in FIG. 4) to the time when the start of the vehicle is detected (time T20 in FIG. 4). The temporary stop may end when a predetermined time α has elapsed since the time when the door close signal is output (time T19 in FIG. 4).

[0026] 3. Information processing example 5, 6, and 7 are flowcharts showing the flow of information processing particularly related to the embodiment. Figures 5 and 6 are also flowcharts showing the basic flow of abandonment determination processing. Figure 7 is also a flowchart showing the flow of abandonment countermeasure control processing.

[0027] The routine shown in Fig. 5 is repeatedly executed by the information processing device 9 (processors 91a and 92a) while the vehicle is stopped, for example. In the example shown in Fig. 5, first, it is determined whether or not a door unlock signal has been detected (step S11). The processing of step S11 is repeatedly executed until a positive result is obtained.

[0028] If the determination result in step S11 is positive, person recognition processing is started (step S12). In the person recognition processing in step S12, the action of putting an infant on the vehicle is recognized based on the surrounding image. When the action of putting an infant on the vehicle is performed at the departure point, it is considered that the vehicle user is working while standing on the side of the vehicle. The action of putting the infant on the vehicle is recognized based on, for example, a known image recognition technology based on a machine learning model.

[0029] Following the process of step S12, it is determined whether or not an open signal for the door 3 has been detected (step S13). The process of step S13 is repeatedly executed until a positive result is obtained.

[0030] If the determination result of step S13 is positive, person recognition processing is started (step S14). In the person recognition processing of step S14, the action of putting an infant into the vehicle is recognized based on an image of the interior. When the action of putting an infant into the vehicle is performed at the departure point, it is assumed that the user who has entered the vehicle may be working inside the vehicle. The action of putting the infant into the vehicle is recognized based on, for example, a known image recognition technology based on a machine learning model. In the person recognition processing of step S14, the user inside the vehicle is also recognized. The user is recognized by, for example, recognizing the user's face.

[0031] Following the process of step S14, the number of users who have entered the vehicle and the number of users who have exited the vehicle are counted (step S15). In the process of step S15, for example, the total number of faces of the vehicle users recognized in the process of step S14 that are recognized as belonging to the same person is counted.

[0032] Following the process of step S15, it is determined whether the baby is seated (step S16). In the process of step S16, if a putting action is recognized in the process of step S12 or S14, it is determined that the baby is seated. If a putting action is not recognized, it is determined that the baby is not seated.

[0033] Following the process of step S16, it is determined whether or not a door 3 close signal has been detected (step S17). The process of step S17 is repeatedly executed until a positive result is obtained. If the determination result of step S17 is negative, the process returns to step S12. If the determination result of step S17 is positive, a counter is started.

[0034] If the determination result in step S17 is positive, it is determined whether or not the time α has elapsed since the start of the counter (step S18). The process of step S18 is repeatedly executed until a positive result is obtained. Note that instead of executing the processes of steps S17 and S18, it may be determined whether or not the start of the vehicle has been detected.

[0035] If the determination result in step S18 is positive, the current result of the baby seating determination is confirmed (step S19). The current result means the most recent result in the process of step S16. The process of step S19 also confirms the total number of users currently in the vehicle.

[0036] The routine shown in Fig. 6 is repeatedly executed by the information processing device 9 (processors 91a and 92a) while the vehicle is traveling (decelerating), for example. In the example shown in Fig. 6, first, it is determined whether the vehicle has stopped (step S21). The processing of step S21 is repeatedly executed until a positive result is obtained.

[0037] If the determination result of step S21 is positive, person recognition processing is started (step S22). In the person recognition processing of step S22, the action of unloading the infant is recognized based on an interior image. When the action of unloading the infant is performed at the destination, it is assumed that the user of the vehicle sitting next to the child seat is working inside the vehicle. The unloading action is recognized based on, for example, a known image recognition technology based on a machine learning model. In the person recognition processing of step S22, the user in the vehicle is also recognized. The user is recognized, for example, by recognizing the user's face.

[0038] Following the process of step S22, it is determined whether or not an open signal for the door 3 has been detected (step S23). The process of step S23 is repeatedly executed until a positive result is obtained.

[0039] If the determination result in step S23 is positive, person recognition processing is initiated (step S24). In the person recognition processing in step S24, the action of unloading the infant is recognized based on the surrounding image. When the action of unloading the infant is performed at the destination, it is assumed that the user who has gotten out of the vehicle may work on the side of the vehicle. The unloading action is recognized based on, for example, a known image recognition technology based on a machine learning model.

[0040] Following the process of step S24, the number of users who have entered the vehicle and the number of users who have exited the vehicle are counted (step S25). In the process of step S25, for example, the total number of faces of the vehicle users recognized in the process of step S22 that are recognized as belonging to the same person is counted.

[0041] Following the process of step S25, it is determined whether the infant has left the seat (step S26). In the process of step S26, if a dropping-off action is recognized in the process of step S22 or S24, it is determined that the infant has left the seat. If a dropping-off action is not recognized, it is determined that the infant has not left the seat.

[0042] Following the process of step S26, it is determined whether or not a door lock signal has been detected (step S27). The process of step S27 is repeatedly executed until a positive result is obtained. If the determination result of step S27 is negative, the process returns to the process of step S22.

[0043] If the determination result in step S27 is positive, the current result of the determination of whether the infant has left the vehicle is confirmed (step S28). The current result means the most recent result in the processing of step S26. The processing of step S28 also confirms the total number of users who have currently exited the vehicle.

[0044] Following the processing of step S28, an abandonment determination is made (step S29). In the abandonment determination, it is determined whether the result of the absence determination determined in the processing of step S28 is consistent with the result of the seating determination determined in the processing of step S19 of FIG. 5. For example, if the result of the absence determination is positive (the person has left their seat) and the result of the seating determination is also positive (the person has taken their seat), it is determined that the two results are consistent. If the result of the absence determination is negative (the person has not left their seat) and the result of the seating determination is also positive (the person has taken their seat), it is determined that the two results are inconsistent.

[0045] In the abandonment determination, it is also determined whether the total number of users disembarking the vehicle determined in the processing of step S28 matches the total number of users riding in the vehicle determined in the processing of step S19 of FIG. 5. Then, based on the result of matching this total number and the result of matching the above-mentioned seating and leaving determination, it is determined whether abandonment has occurred. For example, if the total number of users disembarking matches the total number of users riding, and the result of the leaving seat determination matches the result of the seating determination, it is determined that abandonment has not occurred. On the other hand, if the total number of users disembarking matches the total number of users riding, and the result of the leaving seat determination contradicts the result of the seating determination, it is determined that abandonment has occurred. If the total number of users disembarking does not match the total number of users riding, and the result of the leaving seat determination contradicts the result of the seating determination, it is determined that abandonment has not occurred.

[0046] The routine shown in Fig. 7 is repeatedly executed by the information processing device 9 (processor 92a) while the vehicle is stopped, for example. In the example shown in Fig. 7, first, it is determined whether or not an abandoned vehicle has occurred (step S31). The processing of step S31 is repeatedly executed until a positive result is obtained.

[0047] If the determination result in step S31 is positive, the air conditioning device 6 is operated (step S32), and person recognition processing is started (step S33). In the person recognition processing in step S33, a person present around the vehicle is recognized based on the surrounding image. In the processing in step S33, the presence of a person identical to the vehicle user recognized in the processing in step S22 of FIG. 6 may be recognized based on the face of the person included in the surrounding image.

[0048] Following the process of step S33, it is determined whether or not there is a person around the vehicle (step S34). The process of step S34 is performed based on the person recognition result obtained by the process of step S33. If the determination result of step S34 is negative, that is, if it is determined that there is a person around the vehicle, the process returns to the process of step S33.

[0049] If the determination result in step S34 is positive, it is determined whether the heatstroke risk is equal to or greater than a threshold (step S35). The heatstroke risk is calculated, for example, using a formula with variables including the outside temperature and the presence or absence of direct sunlight. If the determination result in step S35 is positive, a time β (predetermined time) is set and a counter is started. If not, a time γ (predetermined time, γ<β) is set and a counter is started.

[0050] If the determination result of step S35 is positive, it is determined whether or not a time β has elapsed since the start of the counter (step S36). If the determination result of step S35 is positive, it is determined whether or not a time γ has elapsed since the start of the counter (step S37). The processes of steps S36 and S37 are both repeatedly executed until a positive result is obtained.

[0051] If the determination result in step S36 or S37 is positive, the power window 7 is operated and / or emergency information is transmitted to the outside (step S38). By operating the power window 7, outside air is taken into the vehicle. By transmitting the emergency information to the outside, the user of the vehicle or a third party is notified that the vehicle has been abandoned.

[0052] Following the processing of step S38, it is determined whether or not a door unlock signal has been detected (step S39). The detection of a door unlock signal means that the user of the vehicle or a third party has noticed that the vehicle has been left behind and unlocked the doors. Therefore, in this case, the execution of the abandoned vehicle countermeasure control is terminated. If the determination result of step S39 is negative, the processing returns to step S38.

[0053] In the example shown in FIG. 7, the "predetermined condition" of the present disclosure corresponds to the case where the judgment results of steps S34, S35, and S36 are all positive, or the judgment results of steps S34 and S36 are all positive and the judgment result of step S35 is negative.

[0054] 4.Effects According to the embodiment described above, abandonment determination is performed. In abandonment determination, two types of cameras, an interior monitoring camera 1 and a surrounding monitoring camera 2, are used to recognize the act of putting an infant on when the ignition is on (or the act of taking an infant off when the ignition is off), and a seating determination (or an absconding determination) is performed. In abandonment determination, the two types of cameras are also used to count the total number of users who got on the vehicle when the ignition is on (or got off when the ignition is off). Then, in abandonment determination, whether abandonment has occurred is determined by combining the matching results of the seating determination and the absconding determination with the matching results of the total number of people getting on and the total number of people getting off. Therefore, it is possible to determine with high accuracy whether abandonment has occurred.

[0055] Furthermore, according to the embodiment, the result of the seating determination when the vehicle is stopped at a route point and the total number of users who boarded the vehicle when the vehicle is turned on are corrected by the recognition process when the vehicle is stopped at a route point. Therefore, even when users get on or off the vehicle or when an infant is handed over to or from the vehicle at a route point, it is possible to accurately determine whether a user has been left behind.

[0056] Furthermore, according to the embodiment, when it is determined that an infant has been left behind, an abandonment countermeasure process is performed. Therefore, even if an infant has been left behind, it is possible to resolve the situation as soon as possible while maintaining the infant's health. [Explanation of symbols]

[0057] 1...indoor surveillance camera, 2...surrounding surveillance camera, 3...door, 4...IG switch, 5...courtesy switch, 6...air conditioning device, 7...power window, 8...communication device, 9...information processing device, 91...image processing device, 91a, 92a processor, 91b, 92b...storage device, 92...control device

Claims

1. an interior camera for capturing images of the interior of the vehicle; a surroundings camera for acquiring an image of the surroundings of the vehicle; an information processing device that performs an infant abandonment determination process using image information including the indoor image and the surrounding image; Equipped with In the abandonment determination process, the information processing device By performing a recognition process using the image information when the ignition of the vehicle is turned on, it is determined whether an infant using a child seat in the vehicle is seated in the child seat, and the total number of non-infants in the vehicle is tallied, By performing a recognition process using the image information when the ignition of the vehicle is turned off, it is determined whether the infant has left the child car seat and the total number of non-infants who have exited the vehicle is tallied; If the total number of non-infants tallied when the ignition is off coincides with the total number tallied when the ignition is on, and if the result of the seating determination when the ignition is off contradicts the result of the absence determination when the ignition is on, it is determined that an abandonment has occurred. A vehicle control device characterized by:

2. The ignition-on time is a time period that starts from the output timing of a door lock release signal in the vehicle when an ignition-on signal in the vehicle is output, and ends when a predetermined time has elapsed since the output timing of a door close signal in the vehicle, or when a start of the vehicle is detected, In the recognition process when the ignition is turned on, if an image of an infant being placed in the vehicle is recognized in the surrounding image or the interior image during the time period when the ignition is turned on, it is determined that the infant is seated in the child seat.

2. The vehicle control device according to claim 1.

3. the ignition-off time is a time period that starts from a timing when an ignition-off signal is output from the vehicle and that ends when a door lock signal is output from the vehicle, In the recognition process when the ignition is off, if an image of an action of putting an infant down is recognized in the interior image or the surrounding image during the time period when the ignition is off, it is determined in the leaving determination that the infant has left the child seat.

2. The vehicle control device according to claim 1.

4. The information processing device further comprises: By performing a recognition process using the image information when the vehicle is temporarily stopped, the total number of people who got on and off the vehicle is counted, and the seating determination and the absence determination are performed; the temporary stop is a time period that is calculated from the timing of detecting the stop of the vehicle when an ignition-off signal of the vehicle is not detected, and ends when a predetermined time has elapsed since the timing of outputting a door-close signal of the vehicle, or when it is detected that the vehicle has started moving, Correcting the total number of passengers counted when the ignition was turned on using the total number of passengers who got on and off along the way; The result of the seating determination when the ignition is turned on is corrected using the results of the seating determination and the absence determination when the vehicle is temporarily stopped.

3. The vehicle control device according to claim 1 or 2.

5. The information processing device further comprises: When it is determined that abandonment has occurred in the abandonment determination process, an abandonment countermeasure control is performed; The abandoned vehicle countermeasure control includes operating an air conditioning device of the vehicle, operating a power window of the vehicle in response to the establishment of a predetermined condition after the air conditioning device is operated, and / or transmitting emergency information to an external device.

4. The vehicle control device according to claim 1, wherein the vehicle control device is a vehicle control device.

Images