Method for reminding child left in car

Abstract

The invention discloses a method for reminding children left in a vehicle, which comprises the following steps of: 1, initializing a system and acquiring authority: when the vehicle is ignited, firstly initializing the system, including binding related services, finishing handshake and instantiating an interface, then acquiring the authority of a vehicle cabin observation camera, and when the authority is OFF, performing basic monitoring through a safety belt and seat weight state; and if the authority is ON, preparing to use a camera to acquire an image for analysis. According to the invention, through system initialization and permission acquisition during vehicle ignition, a basic monitoring or image analysis mode can be intelligently selected to monitor the condition in the vehicle according to the permission state of a cabin observation camera, when the permission of the camera is started, the AI algorithm and the camera image are utilized to monitor the occupying personnel in the vehicle, and the safety of the occupying personnel in the vehicle is improved. Adults, children and child seats can be accurately identified, and secondary correction is carried out in combination with vehicle information and user actions, so that child leaving detection is effectively carried out.

Description

Technical Field

[0001] The invention relates to the technical field of monitoring the child left behind in a vehicle, and in particular to a method for realizing a reminder of the child left behind in a vehicle. Background Art

[0002] The problem of children left behind in cars is a long-standing and increasingly concerning serious safety hazard. With the accelerated pace of modern life, parents often accidentally forget their children in the car while they are busy. This situation is particularly dangerous, especially in hot weather. Since the interior space of the vehicle is relatively closed, direct sunlight and the heat emitted by the vehicle itself can cause the temperature inside the car to rise rapidly, far exceeding the normal tolerance range of the human body. For children, due to their weak ability to regulate body temperature, high temperature environment may lead to serious consequences such as heat stroke and heat stroke, and even endanger their lives. Summary of the invention

[0003] In order to overcome the above technical problems, an object of the present invention is to provide a method for realizing a child left behind reminder in a vehicle.

[0004] The purpose of the present invention can be achieved through the following technical solutions:

[0005] A method for realizing a child left behind reminder in a vehicle comprises the following steps:

[0006] Step 1: System initialization and permission acquisition: When the vehicle is turned on, the system is initialized first, including binding related services, completing handshakes and instantiating interfaces, and then obtaining the permission for the cabin observation camera. When the permission is OFF, the basic monitoring of the seat belt and seat weight status is performed. When the permission is ON, the camera is used for image analysis.

[0007] Step 2: Monitoring of occupants in the car: Use cameras and AI algorithms to monitor the occupancy of people in the car, identify adults, children and child seats, and make secondary corrections based on vehicle information and user actions, and finally perform child abandonment detection;

[0008] Step 3: Output and judgement of stable state value: Calculate and determine the functional level of DA output, mobile phone push, horn flashing light and in-car voice reminder according to the stable state value of the seat;

[0009] Step 4: Child Left Behind Reminder: After the vehicle is turned off, the rear seat is continuously monitored. If a child is detected to be left behind and the reminder switch is turned on, a child left behind reminder is issued through the lights or horn, voice broadcast in the car, and mobile phone push according to the set delay time or the time after locking the vehicle;

[0010] Step 5: System sleep: If the system does not detect any operation or reminder requirements, the system enters sleep mode to save power.

[0011] As a further solution of the present invention: in the step one, when the vehicle is ignited, the system is first initialized, including binding the camera SDK service, completing the handshake with the aisproxy service, and instantiating the interface for obtaining the camera image frame. The system obtains the CWC (Cabin Watch Camera) permission. If the permission is OFF, basic monitoring is performed through the seat belt and seat weight status. If the permission is ON, the system is prepared to obtain images through the camera for analysis.

[0012] As a further solution of the present invention: in the step 2, if the CWC authority is ON, the system turns on the CWC camera, and uses the AI ​​algorithm to monitor the occupants in the car based on the image information obtained by the camera. The SoC (System on Chip) receives the image data of the Camera and sends it to the CPD AI SDK (Application Software Development Kit) for CPD (Child Presence Detection) detection. The CPD AI SDK analyzes the image data, identifies the occupancy information of the five seats in the car, including adults, children, child seats or unknown status, and sends the identification results to the MCU (Microcontroller Unit). The MCU combines the vehicle information and user actions to make a secondary correction to the detection results, and combines the corrected results with the CRS (Child Restraint Seat) information for CPD judgment.

[0013] As a further solution of the present invention: in the step three, after the SoC sends the initial state value of each seat and the value result when the state changes to the MCU, the MCU imports the data into the seat correction state machine to run, and calculates and exports the stable state values ​​of the five seats respectively. The MCU calculates the function level for DA output, mobile phone push, horn and flashing lights and in-car voice reminder according to the stable state value of the seat.

[0014] As a further solution of the present invention: in step four, after the vehicle is turned off, the system continues to monitor the status of the seats in the vehicle. If the MCU detects that a child is left in the back seat of the vehicle and the child left behind reminder switch status is on, the system triggers a reminder method according to different scenarios. If a warning delay time is set, then after the delay time is reached, if a child is still detected to be left in the back seat, a reminder is given. If the warning delay time is not set or is set to 0, a child left behind reminder is given at a predetermined time after the vehicle is locked.

[0015] As a further solution of the present invention: in step 4, the reminder method includes:

[0016] Control the vehicle lights or horn through BCAN to alert the driver if there is a child left in the vehicle by honking the horn or flashing the lights;

[0017] Voice notification is made through the in-car speaker to remind the owner that there are children left behind in the back seat;

[0018] Push child reminder information to the owner's mobile phone through VSP (Vehicle Service Platform).

[0019] Beneficial effects of the present invention:

[0020] The method can monitor the situation in the car intelligently according to the permission status of the cabin observation camera by initializing the system and obtaining the permission when the vehicle is ignited, and can select the basic monitoring or image analysis method to monitor the situation in the car. When the camera permission is turned on, the AI ​​algorithm and camera image are used to monitor the occupants in the car, and can accurately identify adults, children and child seats, and make secondary corrections in combination with vehicle information and user actions, so as to effectively detect children left behind. In addition, according to the stable state value of the seat, the method can accurately calculate and determine the level of different reminder functions to ensure the timeliness and accuracy of the reminder. When the vehicle is turned off, the system continues to monitor the rear seat in the car. If a child is detected to be left behind and the reminder switch is turned on, the child will be left behind in a variety of ways according to the set delay time or the time after locking the car. This all-round reminder method can attract the attention of the owner to the greatest extent and avoid dangerous situations that may be caused by children being forgotten in the car. In addition, the method also has an intelligent sleep function. If the system does not detect any operation or reminder needs, it will automatically enter the sleep state to save power, thereby improving the energy efficiency and practicality of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The present invention will be further described below in conjunction with the accompanying drawings.

[0022] Figure 1 It is a schematic diagram of the steps of the present invention;

[0023] Figure 2 is a timing diagram of the present invention;

[0024] Figure 3 It is a flow chart of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] like Figure 1-3 As shown, a method for realizing a child left behind reminder in a vehicle comprises the following steps:

[0027] Step 1, system initialization and permission acquisition: when the vehicle is ignited, the system is initialized first, including binding related services, completing handshakes and instantiating interfaces, and then obtaining permissions for the cabin watch camera. When the permission is OFF, basic monitoring is performed through the weight status of the seat belts and seats. If the permission is ON, the camera is prepared to be used for image analysis. In the step 1, when the vehicle is ignited, the system is first initialized, including binding the camera SDK service, completing handshakes with the aisproxy service, and instantiating interfaces for obtaining camera image frames. The system obtains permissions for CWC (Cabin Watch Camera). If the permission is OFF, basic monitoring is performed through the weight status of the seat belts and seats. If the permission is ON, the camera is prepared to obtain images for analysis.

[0028] Step 2, monitoring of occupants in the car: monitor the occupancy of occupants in the car through cameras and AI algorithms, identify adults, children and child seats, and make secondary corrections in combination with vehicle information and user actions, and finally perform child presence detection. In the step 2, if the CWC authority is ON, the system turns on the CWC camera, and uses the AI ​​algorithm to monitor the occupants in the car for the image information obtained by the camera. The SoC (System on Chip) receives the image data of the Camera and sends it to the CPD AI SDK (Application Software Development Kit) for CPD (Child Presence Detection) detection. The CPD AI SDK analyzes the image data and identifies the occupancy information of the five seats in the car, including adults, children, child seats or unknown states, and sends the identification results to the MCU (Microcontroller Unit). The MCU combines the vehicle information and user actions to make secondary corrections to the detection results, and combines the correction results with the CRS (Child Restraint Seat) information for CPD judgment;

[0029] Step 3, stable state value output and judgment: Calculate and determine the functional level of DA output, mobile phone push, horn flashing light and in-car voice reminder according to the stable state value of the seat. In the step 3, after the SoC sends the initial state value of each seat and the value result when the state changes to the MCU, the MCU imports the data into the seat correction state machine to run, and calculates and derives the stable state values ​​of the five seats respectively. The MCU calculates the functional level for DA output, mobile phone push, horn flashing light and in-car voice reminder respectively according to the stable state value of the seat;

[0030] Step 4, child left behind reminder: after the vehicle is turned off, the rear seat in the car is continuously monitored. If a child left behind is detected and the reminder switch is turned on, a child left behind reminder is given through the car lights or horn, voice broadcast in the car and mobile phone push according to the set delay time or the time after the car is locked. In the step 4, after the vehicle is turned off, the system continues to monitor the status of the seats in the car. If the MCU detects that a child is left behind in the rear seat in the car and the status of the child left behind reminder switch is turned on, the system triggers the reminder method according to different scenarios. If the warning delay time is set, then after the delay time is reached, if a child left behind is still detected in the rear seat, a reminder is given. If the warning delay time is not set or is set to 0, a child left behind reminder is given at a predetermined time after the car is locked.

[0031] Step 5: System hibernation: If the system does not detect any operation or reminder requirements, the system enters a hibernation state to save power. In step 4, the reminder method includes:

[0032] Control the vehicle lights or horn through BCAN to alert the driver if there is a child left in the vehicle by honking the horn or flashing the lights;

[0033] Voice notification is made through the in-car speaker to remind the owner that there are children left behind in the back seat;

[0034] Push child reminder information to the owner's mobile phone through VSP (Vehicle Service Platform).

[0035] Working principle of the present invention:

[0036] When the vehicle is started, the system first performs initialization operations, including binding the cabin observation camera (CWC) service, completing the handshake protocol with the aisproxy service, and instantiating the interface to obtain the camera's image frame. During this process, the system will try to obtain the permission to use CWC. If the permission is OFF, the system relies on the status of the seat belt and the weight of the seat for basic monitoring; if the permission is ON, the system is ready to capture images through the camera for analysis. When the camera permission is turned on, the system starts the CWC camera and uses the AI ​​algorithm to process the images captured by the camera to identify the occupancy of each seat in the car, including adults, children, and child seats. The system-level chip (SoC) receives the image data from the camera and sends it to the CPD AI SDK (child left behind detection application software development kit) for further analysis. The SDK can identify the occupancy information of the five seats in the car and send the identification results to the microcontroller unit (MCU). The MCU combines the real-time information of the vehicle and the user's operation to make a secondary correction to the AI ​​detection results, and combines the information of the car Bluetooth seat (CRS) to comprehensively judge whether there is a child left in the car. Then, the SoC sends the initial state value of each seat to the MCU. The MCU uses the seat correction state machine to process this data and calculate the stable state value of each seat. According to these stable state values, the MCU can determine the activation level of different reminder functions (such as DA output, mobile phone push, horn flashing lights, and in-car voice reminders). In particular, when the vehicle is turned off, the system continues to monitor the status of the seats in the vehicle. If the MCU detects that a child is left in the back seat and the child left behind reminder switch is on, the system will trigger the corresponding reminder mechanism according to the preset warning delay time or the scheduled time after locking the vehicle. The reminder methods include controlling the vehicle's lights or horns through BCAN to sound the horn and flash the lights to remind, voice broadcasting through the speakers in the car, and sending child left behind reminder information to the owner's mobile phone through the vehicle service platform (VSP). If the system does not detect any operation or reminder needs within a certain period of time, it will automatically enter sleep mode to reduce energy consumption and improve the energy efficiency and practicality of the system.

[0037] The above is a detailed description of an embodiment of the present invention, but the content is only a preferred embodiment of the present invention and cannot be considered to limit the scope of implementation of the present invention. All changes and improvements made according to the scope of application of the present invention should still fall within the scope of the patent coverage of the present invention.

Claims

1. A method for realizing a reminder of a child left behind in a vehicle, characterized in that: The following steps are involved: Step 1: System initialization and permission acquisition: When the vehicle is turned on, the system is initialized first, including binding related services, completing handshakes and instantiating interfaces, and then obtaining the permission for the cabin observation camera. When the permission is OFF, the basic monitoring of the seat belt and seat weight status is performed. When the permission is ON, the camera is used for image analysis. Step 2: Monitoring of occupants in the car: Use cameras and AI algorithms to monitor the occupancy of people in the car, identify adults, children and child seats, and make secondary corrections based on vehicle information and user actions, and finally perform child abandonment detection; Step 3: Output and judgement of stable state value: Calculate and determine the functional level of DA output, mobile phone push, horn flashing light and in-car voice reminder according to the stable state value of the seat; Step 4: Child Left Behind Reminder: After the vehicle is turned off, the rear seat is continuously monitored. If a child is detected to be left behind and the reminder switch is turned on, a child left behind reminder is issued through the lights or horn, voice broadcast in the car, and mobile phone push according to the set delay time or the time after locking the vehicle; Step 5: System sleep: If the system does not detect any operation or reminder requirements, the system enters sleep mode to save power.

2. A method for realizing a child left behind reminder in a vehicle according to claim 1, characterized in that: In step one, when the vehicle is ignited, the system is first initialized, including binding the camera SDK service, completing the handshake with the aisproxy service, and instantiating the interface for obtaining the camera image frame. The system obtains the CWC (Cabin Watch Camera) permission. If the permission is OFF, basic monitoring is performed through the seat belt and seat weight status. If the permission is ON, it is prepared to obtain images through the camera for analysis.

3. A method for realizing a child left behind reminder in a vehicle according to claim 1, characterized in that: In the step 2, if the CWC authority is ON, the system turns on the CWC camera and uses the AI ​​algorithm to monitor the occupants in the car based on the image information obtained by the camera. The SoC (System on Chip) receives the image data from the Camera and sends it to the CPDAI SDK (Application Software Development Kit) for CPD (Child Presence Detection) detection. The CPD AI SDK analyzes the image data and identifies the occupancy information of the five seats in the car, including adults, children, child seats or unknown status, and sends the identification results to the MCU (Microcontroller Unit). The MCU combines the vehicle information and user actions to make a secondary correction to the detection results, and combines the corrected results with the CRS (Child Restraint Seat) information for CPD judgment.

4. A method for realizing a child left behind reminder in a vehicle according to claim 1, characterized in that: In step three, after the SoC sends the initial state value of each seat and the value result when the state changes to the MCU, the MCU imports the data into the seat correction state machine and calculates and exports the stable state values ​​of the five seats respectively. The MCU calculates the function level for DA output, mobile phone push, horn and flashing lights, and in-car voice reminder according to the stable state value of the seat.

5. A method for realizing a child left behind reminder in a vehicle according to claim 1, characterized in that: In step four, after the vehicle is turned off, the system continues to monitor the status of the seats in the vehicle. If the MCU detects that a child is left in the back seat of the vehicle and the child left behind reminder switch status is on, the system triggers reminders according to different scenarios. If a warning delay time is set, then after the delay time is reached, if a child is still detected to be left in the back seat, a reminder will be given. If the warning delay time is not set or is set to 0, a child left behind reminder will be given at a predetermined time after the vehicle is locked.

6. A method for realizing a child left behind reminder in a vehicle according to claim 5, characterized in that: In step 4, the reminder method includes: Control the vehicle lights or horn through BCAN to alert the driver if there is a child left in the vehicle by honking the horn or flashing the lights; Voice notification is made through the in-car speaker to remind the owner that there are children left behind in the back seat; Push child reminder information to the owner's mobile phone through VSP (Vehicle Service Platform).

Images