Abandoned vehicle alarm system

Abstract

To properly output an alarm output according to a situation, so-called left event in which passengers such as children are left in a vehicle.SOLUTION: A left event alarm device 20 of a vehicle 1 comprises: a riding object detection part 41 detecting riding objects including passengers in a passenger compartment 3 of the vehicle 1; and an alarm control part 31 that controls, in the case where a passenger remains in the passenger compartment 3 after a driver gets off the vehicle 1, a plurality of pieces of alarm output including at least outputting of left event alarm to a portable terminal 80 of the driver 11. When the driver 11 gets off the vehicle 1, the alarm control part 31 causes the riding object detection part 41 to detect the passenger remaining in the passenger compartment 3, determines, when the passenger remains in the passenger compartment 3 following the driver 11 getting off, whether the portable terminal 80 of the driver 11 getting off remains in the passenger compartment 3, and switches the alarm output for left event alarm depending on whether the portable terminal 80 of the driver 11 getting off remains in the passenger compartment 3.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a vehicle abandonment warning device. [Background technology]

[0002] In a vehicle such as an automobile, after the driver has exited the vehicle, other occupants, such as children, may remain in the vehicle. If the driver forgets that such an occupant has been left behind and leaves the occupant in the vehicle for a long period of time in the hot sun, the occupant may be affected. In particular, if the driver exits the vehicle while an infant or small child is sleeping, the impact of leaving the occupant behind may have an adverse effect on the health of the infant or small child. For this reason, Patent Document 1 discloses that the vehicle and the driver's mobile device are linked together, and when a child is left in the vehicle, a leaving warning is sent to the mobile device a predetermined number of times under predetermined conditions, and if there is no response after the predetermined number of leaving warnings to the mobile device, an emergency call for leaving the child in the vehicle is made. By issuing such a leaving warning, it becomes less likely that a child will be left in the vehicle for a long period of time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-139739 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the alarm output for abandonment in Patent Document 1 is a fixed and uniform alarm output as described above. On the other hand, when an occupant is abandoned in a vehicle such as an automobile, the situation of the recipient of the warning is not limited to a certain situation limited by the situation of the vehicle, but a wide variety of situations can be assumed regardless of the situation of the vehicle. As a result, there remains a possibility that the output of the occupant abandonment warning in Patent Document 1 may not necessarily be appropriate in response to the situation of the recipient of the warning when the abandonment warning is issued. For example, in a situation where the driver has left his / her mobile terminal in the vehicle, even if a warning is output to the driver, the warning cannot be delivered to the driver.

[0005] In this manner, when an occupant such as a child is left behind in a vehicle, it is required to output an alarm about the leaving of the child appropriately depending on the situation. [Means for solving the problem]

[0006] The vehicle abandonment alarm device according to the present invention includes an object detection unit that detects objects including occupants in a vehicle compartment, and when an occupant remains in the vehicle compartment after the driver gets off the vehicle, warning of abandonment by the vehicle's horn; Abandonment warning sent to driver's mobile device , for sending a warning to a mobile device of a person other than the driver, and for sending an emergency call to a server device Control multiple alarm outputs possible and an alarm control unit, wherein when a driver gets off the vehicle, the alarm control unit causes the vehicle object detection unit to detect an occupant remaining in the vehicle compartment, and when an occupant remains in the vehicle compartment after the driver gets off, An alarm is output by the horn, and after the alarm by the horn, A determination is made as to whether or not the mobile terminal of the driver who has got off remains in the vehicle compartment, and if the mobile terminal of the driver who has got off remains in the vehicle compartment, If there is no such warning, an abandoned vehicle warning is output to the mobile terminal of the driver who has dismounted, and if the mobile terminal of the driver who has dismounted remains in the vehicle compartment, an abandoned vehicle warning is output to the mobile terminal of a person other than the driver who has dismounted, and it is determined whether there is a response to either the executed warning output to the mobile terminal of the driver who has dismounted or the executed warning output to the mobile terminal of a person other than the driver who has dismounted, and if there is no response to the executed warning output to the mobile terminal, an emergency call is output to the server device, and if there is a response to the executed warning output to the mobile terminal, an emergency call is not output to the server device.

[0012] Preferably, the vehicle object detection unit detects vehicles, including occupants, in the vehicle cabin using a millimeter wave sensor that outputs millimeter wave radio waves toward the vehicle cabin and detects millimeter wave reflections from objects inside the vehicle, such as occupants or luggage, in the vehicle cabin. [Effects of the Invention]

[0013] In the present invention, when the driver gets off the vehicle, the alarm control unit causes the vehicle object detection unit to detect any occupants remaining in the vehicle cabin, and when any occupants remain in the vehicle cabin after the driver gets off, determines whether the mobile terminal of the driver who got off remains in the vehicle cabin.The alarm control unit then switches the alarm output for the abandoned alarm depending on whether the mobile terminal of the driver who got off remains in the vehicle cabin. In this way, in the present invention, the multiple warning outputs regarding abandonment output by the warning control unit are switched depending on the status of the mobile terminal of the driver who has exited the vehicle. With the present invention, it is expected that even if the driver has left his / her mobile terminal in the vehicle, for example, it will be possible to appropriately output a warning regarding the abandonment of an occupant such as a child depending on the status. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a schematic plan view of an automobile to which an abandonment warning device according to an embodiment of the present invention is applied. [Figure 2] FIG. 2 is a schematic longitudinal sectional view of the automobile of FIG. [Figure 3] FIG. 3 is an explanatory diagram of a control system that functions as an abandoned vehicle warning device in the automobile of FIG. [Figure 4] FIG. 4 is an explanatory diagram of a method for determining the type of an object inside a vehicle based on the detection level of the millimeter wave sensor in FIG. [Figure 5] FIG. 5 is an explanatory diagram of an emergency contact list recorded in the memory of the vehicle interior object monitoring device of FIG. [Figure 6] FIG. 6 is a flowchart of a pre-abandonment warning control by the CPU of the vehicle interior object monitoring device of FIG. [Figure 7] FIG. 7 is a flowchart of abandoned object warning control by the CPU of the vehicle interior object monitoring device of FIG. [Figure 8] FIG. 8 is an explanatory diagram of an example of a warning screen displayed on the driver's mobile terminal by the abandonment warning control of FIG. [Figure 9]FIG. 9 is an explanatory diagram of an example of a warning screen displayed on a mobile terminal of a person other than the driver by the abandonment warning control of FIG. [Figure 10] FIG. 10 is a flowchart of rescue control by the CPU of the vehicle interior object monitoring device of FIG. [Figure 11] FIG. 11 is an explanatory diagram of an example of a rescue screen displayed on a mobile terminal of a person other than the driver by the rescue control of FIG. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0016] FIG. 1 is a schematic plan view of an automobile 1 to which an abandonment warning device according to an embodiment of the present invention is applied. FIG. 2 is a schematic longitudinal cross-sectional view of the automobile 1 of FIG. 1 taken at a central position Y0 in the width direction of the automobile 1. As shown in FIG. The automobile 1 is an example of a vehicle. The power source of the automobile 1 may be an internal combustion engine that burns gasoline or ethanol, an electric motor that uses stored power, or a power source that uses hydrogen, or a combination of these.

[0017] An automobile 1 shown in Figures 1 and 2 has a vehicle body 2. The vehicle body 2 has a passenger compartment 3 capable of accommodating multiple passengers. The passenger compartment 3 is provided with multiple seats 4 to 6 arranged in the longitudinal direction of the automobile 1. The multiple seats 4 to 6 of the automobile 1 in Figure 1 are, in order from the front, multiple front-row seats 4, 5 in which a driver 11 or a passenger 12 can be seated, and a rear-row seat 6 in which multiple passengers can be seated in a row in the width direction of the automobile 1. A luggage compartment is provided behind the rear-row seat 6. A dashboard 7 is provided in front of the multiple front-row seats 4, 5.

[0018] The driver 11 opens and closes the right front door (not shown), enters the vehicle compartment 3, sits in the driver's seat 4 in the front row, and then opens and closes the right front door to exit the vehicle compartment 3. For example, the passenger 12 opens and closes the left front door (not shown), enters the passenger compartment 3, sits in the seat 5 for the passenger 12 in the front row, and then opens and closes the left front door to exit the passenger compartment 3. The child 13 enters the vehicle interior 3 by opening and closing the right or left rear door (not shown), sits in the rear seat 6, and then leaves the vehicle interior 3 by opening and closing the right or left rear door. For example, if the child requires assistance, such as an infant, an adult such as the driver 11 or passenger 12 opens and closes the right or left rear door, attaches a child seat 14 to the rear seat 6, and places the infant in the child seat 14. The child 13 may also be seated in the front seat 5 for the passenger 12. The passenger 12 may also be seated in the rear seat 6. Adults and children 13 seated directly in the seats 4 to 6 fasten seat belts (not shown). As a result, the occupants sit in the seats 4 to 6 with their upper bodies leaning against the backrests of the seats 4 to 6. The seating positions of the occupants seated in the seats 4 to 6 basically fall within a certain range.

[0019] The automobile 1 travels with occupants including a driver 11 and a passenger 12 seated in seats 4 to 6 in the passenger compartment 3, and is driven by the driver 11, with driving assistance, or by automatic driving. In such an automobile 1, it is desirable to monitor, for example, the occupants, including the driver 11, who are in the passenger compartment 3 while the automobile is in motion, and to monitor the abandonment of occupants, such as children 13, who remain in the passenger compartment 3 after the driver 11 gets out of the automobile.

[0020] FIG. 3 is an explanatory diagram of a control system 20 that functions as an abandoned vehicle warning device in the automobile 1 of FIG. The abandonment warning device of the automobile 1 can monitor the abandonment of passengers such as children 13 remaining in the passenger compartment 3 after the driver 11 has exited the automobile 1 and output a warning. The control system 20 of Figure 3 includes an in-vehicle object monitoring device 21, a driver monitoring device (DMS) 22, a sensor device 23, a user interface device (UI device) 24, an output device 25, an air conditioning device 26, an external communication device 27, and an in-vehicle network 28 to which these are connected.

[0021] The in-vehicle network 28 may be a wired communication network for the automobile 1 that complies with, for example, a CAN (Controller Area Network) or a LIN (Local Interconnect Network). The in-vehicle network 28 may be a communication network such as a LAN, or a combination of these. A wireless communication network may be included as part of the in-vehicle network 28. The above-mentioned various devices 21 to 27 connected to the in-vehicle network 28 can input and output data to and from each other by, for example, sending and receiving encrypted packets to which an ID for each device is attached.

[0022] An in-vehicle camera 42 is connected to the driver monitoring device 22. The in-vehicle camera 42 may be mounted, for example, on the dashboard 7 to capture images of the vehicle interior 3 from the front, so as to be able to capture images of, for example, the driver 11 in the vehicle interior 3. Multiple in-vehicle cameras 42 may be connected to the driver monitoring device 22. One of the multiple in-vehicle cameras may be configured to capture images of the driver 11, while the other may capture images of the entire vehicle interior 3 at a wide angle. An LED that emits infrared light or the like may be connected to the driver monitoring device 22. The driver monitoring device 22 may identify occupants, such as the driver 11 of the automobile 1, based on images captured by the in-vehicle camera 42 and monitor the occupant's condition. The driver monitoring device 22 may monitor the occupant's condition, such as distraction or drowsiness, based on the direction of the occupant's face and eyes. By irradiating the occupant with infrared light, the occupant's vein pattern can be captured, allowing the driver monitoring device 22 to generate information such as pulse rate. The driver monitoring device 22 may output the image of the vehicle interior 3 captured by the in-vehicle camera 42 and information based on the image to other devices via the in-vehicle network 28.

[0023] The sensor device 23 is connected to various sensors provided in the automobile 1, such as an ignition switch 43, a door open / close sensor 44, a door lock sensor 45, a GNSS receiver 46, and an acceleration sensor 47. Note that some of the sensors, such as the GNSS receiver 46, may be directly connected to the in-vehicle network 28.

[0024] The ignition switch 43 is a toggle switch that the driver 11 operates when driving the automobile 1. When the ignition switch 43 is operated once, the power source of the automobile 1 is activated or ready to be activated. When the power source of the automobile 1 is activated or ready to be activated, the automobile 1 can be driven by that power. When the ignition switch 43 is operated twice, the power source of the automobile 1 is stopped.

[0025] The door opening / closing sensor 44 detects the opening and closing of a door (not shown) of the automobile 1. The door opening / closing sensor 44 may be provided for each of a plurality of doors provided in the automobile 1. When an occupant gets in or out of the automobile 1, the occupant opens and closes the door. The door opening / closing sensor 44 detects the door opening and closing operation.

[0026] The door lock sensor 45 detects the locked state of a door (not shown) of the automobile 1. The door lock sensor 45 may be provided for each of the multiple doors of the automobile 1, together with a door locker. The door locker locks the doors of the automobile 1 so that they cannot be opened or closed. The door lock sensor 45 may detect whether the door locker is locked or unlocked.

[0027] The GNSS receiver 46 receives radio waves from GNSS satellites (not shown) and generates the position of the GNSS receiver 46 as the vehicle position of the automobile 1 in which the GNSS receiver 46 is installed. The GNSS receiver 46 may generate accurate time information based on the radio waves from the GNSS satellites, along with the vehicle position.

[0028] The acceleration sensor 47 detects acceleration acting on the automobile 1. The acceleration sensor 47 may detect acceleration in three axes, i.e., the longitudinal direction, the vertical direction, and the width direction of the automobile 1. The acceleration sensor 47 may generate the yaw acceleration, pitch acceleration, roll acceleration, yaw velocity, pitch velocity, and roll velocity of the automobile 1 based on the detection of the acceleration in the three axes.

[0029] The sensor device 23 may acquire detected values ​​from the sensors 43 to 47 connected thereto, and output the detected values ​​or information based thereon to other devices via the in-vehicle network 28.

[0030] A speaker 48 and a microphone 49 are connected to the user interface device 24. In addition, a touch-type display device and various switches may be connected to the user interface device 24. The speaker 48 outputs audio and the like to the vehicle interior 3. The microphone 49 collects sounds from the vehicle interior 3. The touch-type display device displays a screen that can be operated by the occupants. The user interface device 24 may output sound data collected by the microphone 49 to other devices via the in-vehicle network 28.

[0031] The output device 25 is connected to the horn 50, blinkers 51, headlights 52, and meter liquid crystal panel 53 of the automobile 1. The horn 50, blinkers 51, and headlights 52 are provided on the outer surface of the body 2 of the automobile 1. In addition to these, automatic driving lamps and the like provided on the outer surface of the body 2 of the automobile 1 may also be connected to the output device 25. The meter liquid crystal panel 53 is provided in front of the driver 11 on the dashboard 7, and displays driving information of the automobile 1 to the driver 11.

[0032] The air conditioner 26 conditions the temperature of the passenger compartment 3 of the automobile 1, for example, so that the temperature of the passenger compartment 3 becomes a set temperature.

[0033] The external communication device 27 establishes a communication path with a base station 61 outside the automobile 1 and transmits and receives wireless data between the server device 62 and the mobile terminal 63 connected to the base station 61. Wireless communication standards include, for example, IMT-2020 (International Mobile Telecommunications-2020) and IEEE (Institute of Electrical and Electronics Engineers) 802.11ax. The base station 61 may be a base station 61 provided by a carrier of the mobile terminal 63 or a base station 61 for an intelligent transport system (ITS). The server device 62 may be a computer device with a communication function used by, for example, an automobile manufacturer, a mobile phone carrier, an automobile service company, a public service organization such as a police station, a fire department, or a hospital, or a private service organization. For example, when the server device 62 receives an emergency call from the external communication device 27 of the automobile 1, the public service organization dispatches an emergency response and rescues the occupants. The mobile terminal 63 may be a portable computer device with a communication function used by, for example, the driver 11, the passenger 12, or another person of the automobile 1.

[0034] An application program capable of communicating with the abandonment warning device provided in the automobile 1 via the base station 61 may be installed in the server device 62 or the mobile terminal 63 in an executable manner. The server device 62 or the mobile terminal 63 and the control system 20 functioning as an abandonment warning device realize a system 60 for notifying abandonment of an occupant in the automobile 1.

[0035] The vehicle interior object monitoring device 21 includes, for example, a CPU 31, a memory 32, a timer 33, an input / output unit 34, and an internal bus 35 to which these components are connected. A millimeter wave sensor 41 is connected to the internal bus 35. Like the interior object monitoring device 21, the above-described various devices 22 to 27 may also have a CPU, a memory, a timer, an input / output unit, and an internal bus to which these are connected. Similarly to the interior object monitoring device 21, the server device 62 or the mobile terminal 63, which is a computer device with a communication function, may also have a CPU, memory, timer, external communication device, and an internal bus to which these are connected.

[0036] The input / output unit 34 is connected to the in-vehicle network 28. The input / output unit 34 outputs an encrypted packet containing data that the CPU 31 of the interior object monitoring device 21 intends to transmit, to which the ID of the destination device is added, to the in-vehicle network 28. The input / output unit 34 monitors the in-vehicle network 28 and acquires, from the in-vehicle network 28, an encrypted packet addressed to itself, to which its own ID is added as the destination. The input / output unit 34 outputs the acquired data to the CPU 31.

[0037] The timer 33 measures time and hour. The time of the timer 33 may be calibrated by the time generated by the GNSS receiver 46. The timer 33 may measure, for example, a program execution period, and output an interrupt signal to the CPU 31 each time it measures the execution period.

[0038] As shown in FIG. 1 , the millimeter wave sensor 41 is provided in the upper front portion of the vehicle interior 3, for example, in a so-called overhead console. The millimeter wave sensor 41 may include, for example, two transmitting antennas for transmitting millimeter waves and four receiving antennas for receiving millimeter waves. In this case, the millimeter wave sensor 41 has eight channels. The millimeter wave frequency may be in the 24 GHz band, the 60 GHz band, or the 74 GHz band. The millimeter-wave sensor 41 outputs millimeter waves from the upper front of the vehicle interior 3 to a predetermined range centered in the lower rear direction. The millimeter waves pass through the backrests of the front seats 4 and 5, which are not made of metal plates, and are reflected by the backrest of the rear seat 6, which is made of metal plates. For example, by scanning the vehicle interior 3 in the vehicle width direction with millimeter waves, the millimeter-wave sensor 41 can receive millimeter-wave reflections reflected from substantially the entire vehicle interior 3, including reflections from the foot area of ​​the rear seat 6 behind the front seats 4 and 5 and reflections from the luggage compartment behind the rear seat 6. The reflected millimeter waves contain different components when a human body is present, when luggage is present, and when neither of these is present. Furthermore, an increase in the reflected wave components increases the detection level of the reflected waves. In this way, the millimeter wave sensor 41 can output millimeter waves toward the passenger compartment 3 of the automobile 1 and detect the millimeter waves reflected by passengers or objects inside the passenger compartment 3 of the automobile 1, such as luggage.

[0039] The memory 32 stores programs executed by the CPU 31, data used in executing the programs, and data generated by executing the programs. The memory 32 may be composed of a volatile memory such as a RAM and a non-volatile memory such as an SSD or HDD.

[0040] The CPU 31 reads and executes a program from the memory 32. This allows the interior object monitoring device 21 to function as a control unit that controls the overall operation of the device. The CPU 31 as a control unit of the vehicle interior object monitoring device 21 may activate the millimeter wave sensor 41 and detect vehicle interior objects such as passengers and luggage present in the vehicle compartment 3 based on the detection level of the millimeter wave reflected by the millimeter wave sensor 41. The CPU 31 may also monitor the state and presence or absence of the detected vehicle interior objects. At this time, the CPU 31 may select and switch the frequency of the millimeter waves output from the millimeter wave sensor 41 from a plurality of preset frequencies. Low-frequency millimeter waves are resistant to obstruction. High-frequency millimeter waves can detect the movement of the occupant's chest. The surface of the occupant's chest changes in response to breathing. The CPU 31 may determine the type of object present in the passenger compartment 3 of the automobile 1 by comparing the detection level of the reflected millimeter wave with a threshold value.

[0041] FIG. 4 is an explanatory diagram of a method for determining the type of an object inside a vehicle based on the detection level of the millimeter wave sensor 41 in FIG. 4, the vertical axis represents the detection level of the reflected wave by the millimeter wave sensor 41. The horizontal axis represents the type of object inside the vehicle. Here, three types of object inside the vehicle are shown: luggage, children 13, and adults.

[0042] The range of detection levels of reflected waves from luggage, the range of detection levels of reflected waves from children 13, and the range of detection levels of reflected waves from adults can be separated from one another as shown in FIG. Therefore, the CPU 31 can distinguish between the baggage and the child 13 based on the lower threshold between the detection level of the wave reflected by the baggage and the detection level of the wave reflected by the child 13. Furthermore, the CPU 31 can distinguish between the child 13 and an adult based on the high threshold between the detection level of the reflected wave from the child 13 and the detection level of the reflected wave from an adult. The low threshold and the high threshold may be fixed values ​​or may be variable depending on the situation. The CPU 31 can detect vehicles including passengers in the passenger compartment 3 of the automobile 1 using the millimeter wave sensor 41 as a vehicle vehicle detection unit.

[0043] 3 may determine whether an occupant, such as a child 13, has been left behind using millimeter waves, and may output an alarm to the driver 11 informing the driver that an occupant has been left behind. Possible methods for outputting the warning to the driver 11 include outputting the warning to the meter LCD panel 53, outputting the warning from the horn 50, and outputting the warning to the driver's mobile terminal 63. As one of the output methods for outputting the warning, the CPU 31 may output an emergency call to a server device 62 such as a public service organization. The CPU 31, as an alarm control unit, executes multiple alarm outputs, including outputting the warning to the driver's mobile terminal 63, when an occupant remains in the passenger compartment 3 after the driver 11 has exited the automobile 1. However, even if an abandoned vehicle warning is output to the meter LCD panel 53 or from the horn 50 when the driver 11 is already far away from the vehicle 1, the abandoned vehicle warning will not reach the driver 11. Also, if the driver 11 has left the mobile terminal 63 in the vehicle compartment 3, the abandoned vehicle warning will not reach the driver 11 even if it is output to the mobile terminal 63. In these cases, the driver 11 cannot take action regarding the occupant left in the vehicle compartment 3. In this case, the only available means of response is to make an emergency call to the server device 62 of a public service agency or the like. This places a heavy burden on the public service agency or the like. If the number of calls increases, there is a possibility that the public service agency or the like will not be able to respond appropriately. For this reason, it is important for the CPU 31 that outputs the warning about occupant abandonment to improve the warning that it outputs.

[0044] FIG. 5 is an explanatory diagram of an emergency contact list recorded in the memory 32 of the vehicle interior object monitoring device 21 of FIG. The CPU 31 can execute multiple alert outputs, including output of a leaving alert to the mobile terminals 63 of multiple people including at least the driver 11, based on the emergency contact list of FIG. The emergency contact list stored in memory 32 has a record for each destination of the abandoned vehicle alarm. Each record includes the notification order, notification method, notification content, and acquired information. Figure 5 adds examples of targets for each record.

[0045] The record in the first row belongs to the first driver of the automobile 1. The first driver is assigned the first notification order. The record is set to notify the first driver of the location of the automobile 1, detailed information on the leaving of the automobile 1 (captured images of the passenger compartment 3), and the like through communication with an application program executed on the driver's mobile terminal 63.

[0046] The record in the second row is for the second driver of the automobile 1. The second driver is assigned the second notification order. The system is set to notify the second driver of the location of the automobile 1, detailed information on the abandonment (captured images of the passenger compartment 3), and the like through communication with an application program executed on the driver's mobile terminal 63.

[0047] The record in the third row is for passenger 12 of automobile 1. Passenger 12 is assigned the third notification order. It is set so that passenger 12 is notified of the position of automobile 1, detailed information about the vehicle being abandoned (captured images of passenger compartment 3), and the like, via email communication that can be viewed on passenger 12's mobile terminal 63.

[0048] The record on the fifth line is for the first emergency call destination (emergency call 1), and is set to call the first emergency call destination and report the location of automobile 1, general information about where it was left, contact information for the first driver and other persons included in the emergency contact list, and so on.

[0049] The record on the sixth line is for a second emergency call destination (emergency call 2). The record is set to notify the second emergency call destination, through predetermined communication with the server device 62, of the vehicle's own position, detailed information on the abandonment (images of the vehicle interior 3, biological information of the abandoned occupant such as breathing and pulse), contact information of the first driver and the like included in the emergency contact list, and the like.

[0050] FIG. 6 is a flowchart of the pre-removal warning control by the CPU 31 of the vehicle interior object monitoring device 21 of FIG. The CPU 31 repeatedly executes the control of FIG. 6 as an abandoned occupant warning control unit.

[0051] In step ST1, the CPU 31 of the interior object monitoring device 21 determines whether the automobile 1 has stopped traveling and the engine, which is the power source of the automobile 1, has been stopped. The CPU 31 may determine whether the engine has been stopped, for example, based on whether the ignition switch 43 has been operated to stop the engine that was running. If the engine has been stopped, the CPU 31 proceeds to step ST2. If the engine has not been stopped, the CPU 31 ends this control.

[0052] In step ST2, the CPU 31 of the vehicle interior object monitoring device 21 outputs an abandoned object warning to the meter liquid crystal panel 53 provided in front of the driver 11 on the dashboard 7, regardless of whether or not an occupant has actually been abandoned in the vehicle compartment 3. The CPU 31 of the vehicle interior object monitoring device 21 outputs the abandoned object warning to the output device 25 via the input / output unit 34 and the in-vehicle network 28. The output device 25 acquires the abandoned object warning and displays it on the meter liquid crystal panel 53. This allows the driver 11, who has stopped the engine after the automobile 1 has finished traveling, to be alerted before getting out of the vehicle to ensure that an occupant or the like is not abandoned. Thereafter, the CPU 31 ends this control.

[0053] FIG. 7 is a flowchart of abandoned object warning control by the CPU 31 of the vehicle interior object monitoring device 21 of FIG. The CPU 31 repeatedly executes the control of FIG. 7 as an abandoned occupant warning control unit.

[0054] In step ST11, the CPU 31 determines whether the driver 11 has exited the vehicle. For example, the CPU 31 may determine that the driver 11 has exited the vehicle when the ignition switch 43 is operated to stop the engine that was running, the processing of step ST2 in FIG. 6 is executed, and further the door opening / closing sensor 44 detects the opening / closing operation of the door for the driver 11 or the door lock sensor 45 detects the unlocked state of the door. The CPU 31 repeats this processing until it determines that the driver 11 has exited the vehicle. When the driver 11 has exited the vehicle, the CPU 31 proceeds to step ST12.

[0055] In step ST12, the CPU 31 executes an occupant detection process (a vehicle object detection process) to confirm whether or not an occupant remains in the vehicle compartment 3 after the driver 11 has exited the vehicle. The millimeter wave sensor 41 of the vehicle interior object monitoring device 21 outputs millimeter waves to the vehicle compartment 3 after the driver 11 has exited the vehicle, and detects the reflected waves from the vehicle compartment 3. The CPU 31 determines the presence or absence of an object such as an occupant remaining in the vehicle compartment 3 after the driver 11 has exited the vehicle, and the type of the object, based on a comparison between the detection level of the millimeter wave sensor 41 and a threshold value, for example, as shown in FIG. 4 .

[0056] In step ST13, the CPU 31 determines whether or not an occupant has been left behind based on the detection result of step ST12. If it is determined in step ST12 that an occupant, such as a child 13, remains, the CPU 31 determines that an occupant has been left behind and proceeds to step ST14. If no occupant remains, the CPU 31 ends this control.

[0057] In step ST14, the CPU 31 outputs a horn 50 warning to the driver 11 who has dismounted, based on the determination that an occupant has been left in the vehicle compartment 3 after the driver 11 has dismounted. The output device 25 activates the horn 50 to output a sound for warning of the driver being left behind, based on an instruction from the CPU 31. If the driver 11 who has dismounted is near the automobile 1, he or she can hear the sound of the horn 50 and become aware of the possibility that the driver has been left behind.

[0058] In step ST15, the CPU 31 issues a voice call to the driver's mobile terminal 80 (driver terminal) shown in FIG. 8 (described later) and checks whether or not there is a response. The user interface device 24 outputs the voice call from the speaker 48 based on an instruction from the CPU 31. The output voice may be a predetermined call message to which an assistant application installed on the driver's mobile terminal 80 can automatically respond. The output voice may be synthesized by the user interface device 24 or a recorded call from the driver 11. In this way, the CPU 31 issues a voice call to the mobile terminal 80 of the driver who has exited the vehicle. If the mobile terminal 80 of the driver who has exited the vehicle remains in the vehicle compartment 3 after the driver 11 has exited the vehicle, the driver's mobile terminal 80 outputs a response sound in response to the voice call. After outputting the voice call from the speaker 48, the user interface device 24 monitors the input sound of the microphone 49 and can detect the response sound from the driver's mobile terminal 80. The user interface device 24 outputs to the CPU 31 the detection result as to whether or not there is a response sound from the mobile terminal 80 of the driver.

[0059] In step ST16, the CPU 31 determines whether the driver's mobile terminal 80 has been left in the vehicle compartment 3. If a response sound is not detected in response to the voice call output to the driver's mobile terminal 80 in step ST15, the CPU 31 determines that the mobile terminal 80 of the driver who has dismounted has not been left in the vehicle compartment 3, and proceeds to step ST17. If a response sound is detected in response to the voice call output to the driver's mobile terminal 80 in step ST15, the CPU 31 determines that the mobile terminal 80 of the driver who has dismounted has been left in the vehicle compartment 3, and proceeds to step ST21. In this way, the CPU 31 can determine whether the driver's mobile terminal 80 has been left in the vehicle compartment 3 when an occupant has been left in the vehicle compartment 3 after the driver 11 has dismounted.

[0060] From step ST17, the CPU 31 starts processing to output an abandonment warning when the driver's mobile terminal 80 has not been left in the vehicle interior 3. In this case, it is highly likely that the driver 11 has gotten off the vehicle and is carrying the mobile terminal 63. The CPU 31 reads the record of the driver 11 from the emergency contact list in the memory 32 and outputs an abandonment warning to the mobile terminal 80 of the driver who has gotten off the vehicle. Based on an instruction from the CPU 31, the external communication device 27 transmits an abandonment warning to the driver's mobile terminal 80 via the base station 61. The driver's mobile terminal 80 receives the abandonment warning and returns an acknowledgement response when, for example, the driver 11 operates the abandonment warning. The external communication device 27 outputs to the CPU 31 whether or not there has been a response from the driver's mobile terminal 80.

[0061] In step ST18, the CPU 31 determines whether or not there is a response from the mobile terminal 80 of the driver who output the abandonment warning. If there is no response from the mobile terminal 80 of the driver, the CPU 31 proceeds to step ST19. If there is a response from the mobile terminal 80 of the driver, the CPU 31 ends this control.

[0062] In step ST19, the CPU 31 determines whether a predetermined waiting time has elapsed since the abandonment alarm was output to the driver's mobile terminal 80. The timer 33 measures the time elapsed since the abandonment alarm was output to the driver's mobile terminal 80, and outputs a timer 33 interrupt to the CPU 31 when the predetermined waiting time has elapsed. If there is no interrupt from the timer 33, that is, if the predetermined waiting time has not elapsed, the CPU 31 returns the process to step ST18. This allows the CPU 31 to continue waiting for a response from the driver's mobile terminal 80 during the predetermined waiting time. When the waiting time has elapsed, the CPU 31 proceeds to step ST20.

[0063] In step ST20, since no response is received from the driver 11, the CPU 31 reads the record of the emergency contact destination from the emergency contact list in the memory 32 and outputs an emergency call notification about the vehicle being abandoned to the server device 62 or the like as an emergency measure. The CPU 31, as an alarm control unit, outputs an emergency call notification for an abandoned vehicle alarm if there is no response within a predetermined waiting time to the alarm output to the mobile terminal 80 of the driver who has gotten out of the vehicle. The external communication device 27 outputs the emergency call about the vehicle being abandoned to, for example, the server device 62 through the base station 61 based on an instruction from the CPU 31. When the server device 62 receives the emergency call from the external communication device 27 of the vehicle 1, for example, a public service organization using the server device 62 makes an emergency call to rescue the occupant. Thereafter, the CPU 31 ends this control.

[0064] From step ST21, the CPU 31 starts processing for outputting a warning that the driver's mobile terminal 80 has been left in the vehicle interior 3. The CPU 31 reads and acquires the emergency contact list of FIG.

[0065] In step ST22, the CPU 31 checks the locations of the multiple other mobile terminals 90 included in the acquired emergency contact list. In the emergency contact list, the locations of the other mobile terminals 90 other than the driver's mobile terminal 80 may be updated with the latest location information transmitted from each of the other mobile terminals 90. The CPU 31 may execute processing to acquire new location information, as necessary, for other mobile terminals 90 for which there is insufficient location information or for other mobile terminals 90 for which a period of time has passed since the other mobile terminals 90 acquired their location information.

[0066] In step ST23, the CPU 31 determines which mobile terminals 63 to exclude from the emergency contact list and the order in which to issue an alert, based on the location information of the mobile terminals 63. The CPU 31 may determine the order in which to issue an alert, for example, in order of decreasing distance between the vehicle position of the automobile 1 as determined by the GNSS receiver 46 and the position of each mobile terminal 63. The CPU 31 may exclude from the targets of this report mobile terminals 63 that are farther away than a certain distance or mobile terminals 63 for which location information cannot be obtained.

[0067] In step ST24, the CPU 31 outputs an abandonment alarm to the other mobile terminals 90 other than the mobile terminal 80 of the driver included in the emergency contact list in the order determined in step ST23. The external communication device 27 transmits the abandonment alarm to the other mobile terminals 90 of people other than the driver 11 via the base station 61 based on an instruction from the CPU 31. The people other than the driver receive the abandonment alarm at the other mobile terminals 90 and perform operations in response to the abandonment alarm. The external communication device 27 outputs to the CPU 31 whether or not there has been a response from the other mobile terminals 90 of people other than the driver.

[0068] In step ST25, the CPU 31 determines whether or not there is a response from the other portable terminal 90 that output the abandonment alarm. As in step ST19, the CPU 31 may wait for a waiting time to elapse for a response from the other portable terminal 90 that output the abandonment alarm. If there is no response from the other portable terminal 90 that output the abandonment alarm, the CPU 31 proceeds to step ST26. If there is a response from the other portable terminal 90, the CPU 31 proceeds to step ST27.

[0069] In step ST26, the CPU 31 determines whether there are any other unprocessed mobile terminals 90 included in the emergency contact list. If the output of the abandonment alarm to all other mobile terminals 90 included in the emergency contact list has not been completed, or if the output of the abandonment alarm to all other mobile terminals 90 other than the excluded mobile terminals has not been completed, the CPU 31 determines that there are other unprocessed mobile terminals 90 remaining, and returns the process to step ST24. The CPU 31 repeats the processes from step ST24 to step ST26 until there are no other unprocessed mobile terminals 90. When there are no other unprocessed mobile terminals 90 remaining, the CPU 31 proceeds the process to step ST20. As a result, the CPU 31, as an alarm control unit, outputs an abandonment alarm to other mobile terminals 90 of people other than the driver who has exited the vehicle if the mobile terminal 80 of the driver who has exited the vehicle remains in the vehicle compartment 3. Furthermore, the CPU 31, as an alarm control unit, outputs an emergency call for an abandonment alarm if there is no response within a predetermined waiting time to the output of the abandonment alarm to the mobile terminal 90 of people other than the driver who has exited the vehicle, as will be described later with reference to FIG. 9.

[0070] In step ST27, the CPU 31 sets a rescuer. The CPU 31 changes the rescuer setting in the memory 32, which is set to the driver 11 when the automobile 1 starts traveling, to the person using the other mobile terminal 90 who responded. Thereafter, the CPU 31 ends this control. As an alarm control unit, if there is a response to the output of the abandonment alarm to the other mobile terminal 90 of a person other than the driver who has gotten out of the vehicle, the CPU 31 ends the control in FIG. 7 without outputting an emergency call for the abandonment alarm.

[0071] In this way, the CPU 31 of the vehicle interior object monitoring device 21, as an alarm control unit, switches the output destination of the abandonment alarm to the mobile terminals 63 of the multiple people, including the mobile terminal 80 of the driver who has alighted, and whether to output an emergency call for the abandonment alarm, depending on whether the mobile terminal 80 of the driver who has alighted remains in the vehicle compartment 3. Specifically, when the mobile terminal 80 of the driver who alighted does not remain in the vehicle compartment 3, the CPU 31 outputs the abandonment alarm only to the mobile terminal 80 of the driver who alighted among the multiple people's mobile terminals 63, and when the mobile terminal 80 of the driver who alighted remains in the vehicle compartment 3, the CPU 31 outputs the abandonment alarm sequentially to the other mobile terminals 90 of the multiple people's mobile terminals 63 excluding the mobile terminal 80 of the driver who alighted. This prevents unnecessary output of an emergency call to the driver 11 who is expected to be unable to respond to the emergency call, while also including people other than the driver as targets for outputting the emergency call, thereby reducing the number of times the CPU 31 outputs an emergency call for the abandonment alarm and reducing the burden on the emergency call destination. In the above description, the CPU 31 always outputs the abandonment alarm to the meter liquid crystal panel 53 of the automobile 1 and the abandonment alarm by the horn 50 of the automobile 1, regardless of whether the mobile terminal 80 of the driver who has dismounted remains in the passenger compartment 3. Alternatively, the CPU 31 may switch the output depending on whether the mobile terminal 80 of the driver who has dismounted remains in the passenger compartment 3. The CPU 31 may also switch the output order and necessity of a plurality of abandonment alarms depending on whether the mobile terminal 80 of the driver who has dismounted remains in the passenger compartment 3.

[0072] FIG. 8 is an explanatory diagram of an example of a warning screen 81 displayed on the driver's mobile terminal 80 by the abandonment warning control of FIG. In step ST17 of FIG. 7, the CPU 31 of the vehicle interior object monitoring device 21 transmits an abandoned object warning screen 81 of FIG. 8 to the mobile terminal 80 of the driver.

[0073] The warning screen 81 for the abandonment warning in Figure 8 displays an image 82 of the vehicle interior 3 captured by the in-vehicle camera 42 after the driver 11 has exited the vehicle, along with an OK button 83 that is operated when the abandonment situation is confirmed and accepted. When the driver 11 operates the acknowledge button 83, the driver's mobile terminal 80 returns a response indicating that the driver 11 has confirmed the leaving status and acknowledged it to the interior object monitoring device 21 via the base station 61 and the external communication device 27. The CPU 31 of the interior object monitoring device 21 may use this response for the response determination in step ST18.

[0074] FIG. 9 is an explanatory diagram of an example of a warning screen 91 displayed on the mobile terminal 90 of a person other than the driver by the abandonment warning control of FIG. In step ST24 of FIG. 7, the CPU 31 of the vehicle interior object monitoring device 21 transmits the warning screen 91 of the abandonment warning of FIG. 9 to the mobile terminal 90 of a person other than the driver.

[0075] The warning screen 91 for the abandonment warning in Figure 9 displays an image 92 of the vehicle interior 3 captured by the in-vehicle camera 42 after the driver 11 has exited the vehicle, as well as a rescue agreement button 95 that is operated when rescue for the abandoned situation is agreed upon. In addition, the warning screen 91 of the abandonment warning in Figure 9 also displays a message 93 informing the driver that there is a possibility that the message will not reach the driver's mobile terminal 80, as well as the current vehicle position 94 of the vehicle 1. When the rescue acknowledgement button 95 is operated, the mobile terminal 90 of the person other than the driver confirms the abandoned state and returns a response indicating that the person has acknowledged the rescue to the interior object monitoring device 21 via the base station 61 and the external communication device 27. The CPU 31 of the interior object monitoring device 21 may use this response in the response determination in step ST25.

[0076] FIG. 10 is a flowchart of rescue control by the CPU 31 of the vehicle interior object monitoring device 21 of FIG. The CPU 31 repeatedly executes the control of FIG. 10 as an abandoned occupant warning control unit. For example, the CPU 31 may execute the control of FIG. 10 following the abandonment warning control of FIG.

[0077] In step ST31, the CPU 31 of the vehicle interior object monitoring device 21 acquires the latest rescuer setting from the memory 32. The rescuer setting is basically the driver 11, but if the driver's mobile terminal 80 is left in the vehicle compartment 3, a person other than the driver included in the emergency contact list is set as the rescuer.

[0078] In step ST32, the CPU 31 notifies the mobile terminal 63 of the rescuer, who is set as the rescuer in the memory 32, of a plurality of executable rescue operations as a continuation of the abandonment alarm. Based on the instruction of the CPU 31, the external communication device 27 transmits the plurality of executable rescue operations to the mobile terminal 63 of the rescuer via the base station 61. The mobile terminal 63 of the rescuer transmits the rescue operation selected by the rescuer from the plurality of executable rescue operations. The external communication device 27 outputs the rescue operation received from the mobile terminal 63 of the rescuer to the CPU 31.

[0079] In step ST33, the CPU 31 determines whether or not an instruction to execute rescue processing has been received from the rescuer's mobile terminal 63. If a rescue processing instruction has been received from the rescuer's mobile terminal 63, the CPU 31 determines that an instruction to execute rescue processing has been received and proceeds to step ST34. If a rescue processing instruction has not been received from the rescuer's mobile terminal 63, the CPU 31 determines that an instruction to execute rescue processing has not been received and proceeds to step ST35.

[0080] In step ST34, the CPU 31 executes the instructed rescue process. If there is a response to the rescue process from the mobile terminal 63, the CPU 31 executes the rescue process according to the response.

[0081] In step ST35, the CPU 31 acquires the latest location information from the mobile terminal 63 of the rescuer. For example, if there is a response from another mobile terminal 90 of a person other than the driver, the CPU 31 acquires the latest terminal location from the other mobile terminal 90.

[0082] In step ST36, the CPU 31 compares the position of the rescuer's mobile terminal 63 with the position of the automobile 1. Then, the CPU 31 determines whether the rescuer's mobile terminal 63 is close enough to the automobile 1 that the rescuer can open and close the door of the automobile 1. If the rescuer is not close, the CPU 31 returns the process to step ST33 and repeats the processes from step ST33 to step ST36. The CPU 31 waits for the rescuer to approach the automobile 1 in a state where it is ready to accept rescue processing from the rescuer. Then, when the rescuer's mobile terminal 63 approaches the position of the automobile 1, the CPU 31 proceeds to step ST37.

[0083] In step ST37, the CPU 31 unlocks the doors. If the terminal location acquired from the rescuer's mobile terminal 63 is approaching the vehicle location of the vehicle 1, the CPU 31 unlocks the doors of the vehicle 1. This allows the rescuer who has rushed to the vehicle 1 to rescue the victim to enter the passenger compartment 3 of the vehicle 1 and perform rescue operations for occupants such as the child 13 who have been left behind in the passenger compartment 3, even if the rescuer does not have a key device for unlocking the doors of the vehicle 1.

[0084] In this way, the CPU 31 of the vehicle interior object monitoring device 21, as an alarm control unit, can communicate with the other mobile terminal 90 that responded when there is a response to the output of an abandonment alarm to another mobile terminal 90 of a person other than the driver who has dismounted, and can perform rescue control for the occupants remaining in the vehicle compartment 3 after the driver 11 has dismounted.

[0085] FIG. 11 is an explanatory diagram of an example of a rescue screen 101 displayed on the mobile terminal 90 of a person other than the driver by the rescue control of FIG. In step ST32 of FIG. 10, the CPU 31 of the vehicle interior object monitoring device 21 transmits the rescue screen 101 of FIG. 11 to the mobile terminal 63 of the rescuer.

[0086] 11 displays a latest captured image 102 of the vehicle interior 3 captured by the in-vehicle camera 42 after the driver 11 has exited the vehicle, as well as a plurality of operation buttons 105 to 109 for each of a plurality of rescue processes that can be performed. Here, the plurality of operation buttons 105 to 109 include an air conditioning on operation button 105 for starting the air conditioning device 26, an emergency call operation button 106 for making an emergency call, a call connection operation button 107 for connecting to the user interface device 24 of the vehicle 1 to enable communication with occupants remaining in the vehicle interior 3, a horn activation operation button 108 for sounding the horn 50 to notify people around the vehicle 1 of an emergency, and an operation button 109 for flashing the blinker 51. The plurality of operation buttons 105 to 109 may also be displayed on the alarm screen, as shown by the dotted lines on the alarm screen 81 in FIG. 8 or the alarm screen 91 in FIG. 11 also displays a message 103 informing the driver that there is a possibility that the message may not reach the driver's mobile terminal 80, and the current vehicle position 104 of the vehicle 1. In this way, the CPU 31, as an alarm control unit, transmits to the mobile terminal 63 that has responded the vehicle position of the vehicle 1, a captured image 102 of the interior of the vehicle 1, a message 103 to the mobile terminal 80 of the driver who has dismounted the vehicle to warn that the message may not reach the driver, and a plurality of selectable rescue process operation buttons 105 to 109.

[0087] The rescuer can move toward the position of the vehicle 1 displayed on the rescue screen 101 of FIG. 11 and perform rescue work for the occupant left behind in the vehicle 1. Furthermore, if the condition of an occupant left in the vehicle 1 changes before the vehicle 1 reaches its own location, the driver can operate the operation buttons 105 to 109 to start the air conditioning unit 26, talk to the occupant, sound the horn 50, flash the blinker 51, or make an emergency call.

[0088] As described above, in this embodiment, when the driver 11 gets out of the automobile 1, the CPU 31 of the vehicle interior object monitoring device 21 detects any occupants remaining in the passenger compartment 3 of the automobile 1 using the millimeter wave sensor 41, and if any occupants remain in the passenger compartment 3 after the driver 11 gets out, determines whether or not the mobile terminal 80 of the driver who got out remains in the passenger compartment 3. Then, the CPU 31 switches the alarm output for the abandoned alarm depending on whether or not the mobile terminal 80 of the driver who got out remains in the passenger compartment 3. As described above, in this embodiment, the CPU 31 switches between multiple warning outputs regarding abandonment depending on the state of leaving the mobile terminal 80 of the driver who has exited the vehicle in the vehicle compartment 3. In this embodiment, even if the driver 11 has left his / her own mobile terminal 63 in the vehicle compartment 3, it is expected that the warning regarding the abandonment of an occupant such as a child 13 will be appropriately switched and output depending on the state.

[0089] The above-described embodiment is an example of a preferred embodiment of the present invention, but the present invention is not limited to this, and various modifications and changes are possible within the scope of the gist of the invention.

[0090] In the above-described embodiment, the vehicle interior object monitoring device 21 detects vehicle interior objects such as occupants based on detection by the millimeter wave sensor 41. Alternatively, for example, the vehicle interior object monitoring device 21 may detect vehicle interior objects such as occupants based on images captured by the in-vehicle camera 42.

[0091] In the above-described embodiment, the CPU 31 of the vehicle interior object monitoring device 21 controls switching between outputting the above-described series of multiple abandonment alarms and notifying and executing multiple rescue processes based on the detection of an occupant after the driver 11 gets out of the vehicle. In addition to this, for example, the output of the above-mentioned series of multiple abandonment alarms and the notification and execution of multiple rescue processes may be switched and controlled by the CPU of other devices 22 to 27 provided in the control system 20 of the automobile 1 other than the CPU 31 of the interior object monitoring device 21, or by cooperation of multiple CPUs. In addition, in order to reduce the processing load of the control system 20 of the automobile 1, the output of the series of multiple abandonment alarms and the notification and execution of multiple rescue processes described above may be performed by the CPU of the base station 61 or the server device 62.

[0092] In the above-described embodiment, the CPU 31 as the alarm control unit makes a voice call to the mobile terminal of the driver who has dismounted the vehicle, and if there is a response to the voice call, it can be determined that the mobile terminal of the driver who has dismounted remains in the vehicle compartment. [Explanation of symbols]

[0093] 1...Automobile (vehicle), 2...Vehicle body, 3...Vehicle compartment, 4-6...Seat, 7...Dashboard, 11...Driver, 12...Passenger, 13...Child, 14...Child seat, 20...Control system, 21...In-vehicle object monitoring device, 22...Driver monitoring device, 23...Sensor device, 24...User interface device, 25...Output device, 26...Air conditioning device, 27...External communication device, 28...In-vehicle network, 31...CPU (alarm control unit), 32...Memory, 33...Timer, 34...Input / output unit, 35...Internal bus, 41...Millimeter wave sensor (vehicle object detection unit), 42...In-vehicle camera, 43...Ignition switch, 44...Door opening / closing sensor, 45...Door Lock sensor, 46...GNSS receiver, 47...acceleration sensor, 48...speaker, 49...microphone, 50...horn, 51...blinker, 52...headlight, 53...meter LCD panel, 60...system, 61...base station, 62...server device, 63...mobile terminal, 80...driver's mobile terminal, 81...alarm screen, 82...captured image, 83...acknowledge button, 90...mobile terminal of person other than the driver, 91...alarm screen, 92...captured image, 93...message, 94...own vehicle position, 95...rescue acknowledge button, 101...rescue screen, 102...captured image, 103...warning message, 104...own vehicle position, 105-109...operation buttons

Claims

1. a vehicle object detection unit that detects a vehicle object including an occupant in a vehicle cabin; an alarm control unit capable of controlling a plurality of alarm outputs, when an occupant remains in the vehicle compartment after the driver has exited the vehicle, including an abandonment alarm using a horn of the vehicle, an abandonment alarm to a mobile terminal of the driver, an abandonment alarm to a mobile terminal of a person other than the driver, and an emergency call to a server device; and The alarm control unit When the driver gets off the vehicle, the vehicle object detection unit detects any occupants remaining in the vehicle compartment; When an occupant remains in the vehicle compartment after the driver gets out of the vehicle, an alarm is output by the horn; After the horn is sounded, it is determined whether the mobile terminal of the driver who has exited the vehicle remains in the vehicle compartment; If the mobile terminal of the driver who has got off the vehicle is not left in the vehicle compartment, a leaving alarm is output to the mobile terminal of the driver who has got off the vehicle; If the mobile terminal of the driver who has got off the vehicle remains in the vehicle compartment, a leaving alarm is output to the mobile terminal of a person other than the driver who has got off the vehicle; Determine whether there is a response to either the alarm output to the mobile terminal of the driver who has gotten off the vehicle or the alarm output to the mobile terminal of a person other than the driver who has gotten off the vehicle; If there is no response to the alarm output to the mobile terminal, an emergency call is output to the server device; If there is a response to the executed alarm output to the mobile terminal, an emergency call is not output to the server device. Abandoned vehicle alarm system.

2. The vehicle object detection unit detects vehicle objects, including occupants, in the vehicle compartment of the vehicle using a millimeter wave sensor that outputs millimeter wave radio waves toward the vehicle compartment of the vehicle and detects the millimeter wave reflected by objects in the vehicle compartment, such as occupants or luggage, in the vehicle compartment of the vehicle.

2. The vehicle abandonment warning device according to claim 1.

Images