Vehicle left-behind reminder device, method, vehicle and storage medium

Through the combination of image acquisition and reminder equipment, the design of vehicle legacy reminder devices is optimized, and the cost increase caused by complex device design in the prior art is solved, and higher safety and intelligence are achieved.

CN115257537BActive Publication Date: 2024-11-12CHONGQING CHANGAN AUTOMOBILE CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202210723950.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-23
Publication Date
2024-11-12
Estimated Expiration
2042-06-23

AI Technical Summary

Technical Problem

The design of existing vehicle legacy reminder devices is too complicated, resulting in unscientific vehicle costs and assembly processes, which increases management and after-sales costs.

Method used

Image acquisition parts are used to collect images in the vehicle, reminding them through reminding them including acoustic and optical equipment, and the control parts generate acquisition instructions after the vehicle is turned off, and optical or acoustic reminders are made based on the image to identify living objects, and detect brightness, distance and reminder modes. Optimize reminder methods.

Benefits of technology

It effectively avoids safety accidents caused by the remnant of living things, improves the safety and reliability of the vehicle, reduces management and after-sales costs, and improves user experience and intelligence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115257537B_ABST
    Figure CN115257537B_ABST
Patent Text Reader

Abstract

The present application relates to a vehicle left-behind reminder device, method, vehicle and storage medium, which include: an image acquisition component for acquiring actual images in the vehicle; a reminder component for reminding the user of the left-behind, wherein the reminder component includes at least one acoustic reminder device and at least one optical display device; and a control component for generating a collection instruction after the vehicle is turned off, and sending the collection instruction to the image acquisition component, and controlling the reminder component to perform optical reminders and / or acoustic reminders when a living thing is recognized to be left in the vehicle based on the actual image. The present application protects the life safety of children or pets left in the vehicle, reminds the driver to pay attention to the children or pets in the vehicle, and thus prevents tragedies from happening. It has constructive significance from the perspective of life safety. In addition, it simplifies the design of the reminder device and reduces management and after-sales costs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of short-range sound and light alarm control, and in particular to a vehicle legacy reminder device, method, vehicle and storage medium. Background Art

[0002] At present, every year there are children or pets left in cars. The temperature inside the car will rise suddenly due to the increase in ambient temperature. The children or pets will suffer from temperature regulation dysfunction due to the high temperature and excessive accumulation of heat in the body, which will cause damage to the nervous organs and lead to death.

[0003] In the related art, a pressure sensor is combined with a temperature sensor, that is, the pressure sensor senses that the child is in the seat, and the temperature sensor senses high temperature. In addition, the reminder device in the related art can also be composed of a temperature sensor, a human infrared sensor, an oxygen concentration sensor, and more control loops and controllers, thereby triggering warning conditions according to the detection results of the sensor.

[0004] However, the design and layout of the early warning reminder device in the relevant technology is too complicated, involving many sensors and controllers, and the detection accuracy is low. It is also not scientific enough from the perspective of vehicle cost and assembly process, resulting in increased management cost and after-sales cost, which needs to be solved urgently. Summary of the invention

[0005] The present application provides a vehicle legacy reminder device, method, vehicle and storage medium to solve the problems in the related art that the design and layout of the reminder device are too complicated, not scientific enough in terms of vehicle cost and assembly process, resulting in increased management cost and after-sales cost.

[0006] The first aspect of the present application provides a vehicle left-behind reminder device, comprising: an image acquisition component for acquiring actual images inside the vehicle; a reminder component for reminding a user of the left-behind reminder, wherein the reminder component comprises at least one acoustic reminder device and at least one optical display device; and a control component for generating a collection instruction after the vehicle is turned off, and sending the collection instruction to the image acquisition component, and controlling the reminder component to perform an optical reminder and / or an acoustic reminder when it is recognized that there are living things left in the vehicle based on the actual image.

[0007] According to the above-mentioned technical means, the embodiment of the present application performs living thing detection in the car based on the in-car image data, thereby preventing living things such as children, the elderly, and pets from being left in the car, effectively avoiding safety accidents, improving the safety and reliability of the vehicle, and effectively meeting the user's usage needs.

[0008] Optionally, in one embodiment of the present application, it further includes: a first detection component, used to detect the actual brightness inside the vehicle; and a compensation component, used to perform lighting compensation on the interior of the vehicle when the actual brightness is lower than a preset brightness.

[0009] According to the above technical means, the embodiments of the present application can detect the actual brightness inside the car through a photosensitive touch sensor, and use a fill light to compensate for the lighting inside the car when the actual brightness is lower than the preset brightness, thereby ensuring the clarity and smoothness of images and videos and the quality of the images output by the camera.

[0010] Optionally, in one embodiment of the present application, it also includes: a second detection component, used to detect whether the vehicle is in the vehicle leaving living thing reminder mode, so that the control component generates the collection instruction when it detects that the vehicle is in the vehicle leaving living thing reminder mode and the vehicle is parked and the door is locked.

[0011] According to the above-mentioned technical means, the embodiment of the present application can detect whether the vehicle is in the leaving vehicle living thing reminder mode, so that the control component generates a collection instruction when it detects that the vehicle is in the leaving vehicle living thing reminder mode and the vehicle parking brake is on and the door is locked. Therefore, it can determine whether to perform data collection and subsequent warnings based on the specific wishes of the user, thereby avoiding false reminders and reducing the reliability of the vehicle and the user's experience.

[0012] Optionally, in one embodiment of the present application, the control component includes: an acquisition unit, used to acquire the actual distance between the user and the vehicle; a control unit, used to control the at least one acoustic reminder device and the at least one optical display device to give a reminder when the actual distance is less than or equal to a first preset distance, and when the actual distance is greater than the first preset distance, control the at least one acoustic reminder device and the at least one optical display device to give a reminder while sending a reminder signal to the user's mobile terminal.

[0013] According to the above technical means, the embodiment of the present application can obtain the actual distance between the user and the vehicle, and compare the distance with the set threshold to determine the reminder method, so as to make the reminder more effective and reliable, and improve the safety of vehicle use and the intelligence level of the car.

[0014] Optionally, in one embodiment of the present application, it also includes: a distress component, which is used to count the duration of the reminder of the vehicle, and when the duration of the reminder is greater than a preset duration, send a distress signal to a preset terminal.

[0015] According to the above technical means, the embodiment of the present application can determine that the user ignores the reminder when the reminder is too long, and thus ask for help from other users or devices, further improving the reliability and practicality of the reminder, making the vehicle safer and more reliable, and protecting property and life safety.

[0016] Optionally, in one embodiment of the present application, it also includes: a driving member, used to match the optimal reminder parameters of the at least one acoustic reminder device and the at least one optical display device according to the duration of the reminder, and control the operation of the at least one acoustic reminder device and the at least one optical display device according to the optimal reminder parameters.

[0017] According to the above-mentioned technical means, the embodiments of the present application can match the actual reminder needs and can quantify the urgency of the reminder according to the duration of the reminder, thereby further improving the intelligence and effectiveness of vehicle reminders.

[0018] Optionally, in one embodiment of the present application, the control component also includes: an identity collection component for collecting the identity type of the living thing; a first judgment component for controlling the vehicle to enter a preset soothing mode if the identity type is an infant type, turning on the car audio to play a preset song, and turning on the car air conditioner to work with preset comfort parameters; a second judgment component for controlling the vehicle to unlock the doors if the identity type is an elderly type.

[0019] According to the above-mentioned technical means, the embodiment of the present application can collect the identity type of living things, and control the vehicle to perform corresponding operations according to the specific identity type, so as to execute corresponding strategies according to the actual situation in the car, thereby ensuring the safety of passengers' lives to the greatest extent and further improving the user's driving experience.

[0020] The second aspect of the present application provides a method for reminding a vehicle of a thing left behind, comprising the following steps: generating a collection instruction after the vehicle is turned off; collecting an actual image inside the vehicle according to the collection instruction; and controlling the reminder to perform an optical reminder and / or an acoustic reminder when a living thing is identified as being left behind in the vehicle according to the actual image.

[0021] Optionally, in one embodiment of the present application, the actual brightness inside the vehicle is detected; when the actual brightness is lower than a preset brightness, lighting compensation is performed on the interior of the vehicle.

[0022] Optionally, in one embodiment of the present application, it is detected whether the vehicle is in the vehicle leaving living thing reminder mode, so that the control component generates the collection instruction when it is detected that the vehicle is in the vehicle leaving living thing reminder mode and the vehicle is parked and the door is locked.

[0023] Optionally, in one embodiment of the present application, the actual distance between the user and the vehicle is obtained; when the actual distance is less than or equal to a first preset distance, the at least one acoustic reminder device and the at least one optical display device are controlled to give a reminder, and when the actual distance is greater than the first preset distance, the at least one acoustic reminder device and the at least one optical display device are controlled to give a reminder while sending a reminder signal to the user's mobile terminal.

[0024] Optionally, in one embodiment of the present application, the duration of the reminder of the vehicle is counted, and when the duration of the reminder is greater than a preset duration, a distress signal is sent to a preset terminal.

[0025] Optionally, in one embodiment of the present application, optimal reminder parameters of the at least one acoustic reminder device and the at least one optical display device are matched according to the reminder duration, and the at least one acoustic reminder device and the at least one optical display device are controlled to operate according to the optimal reminder parameters.

[0026] Optionally, in one embodiment of the present application, the identity type of the living thing is collected; if the identity type is an infant type, the vehicle is controlled to enter a preset soothing mode, the car audio is turned on to play a preset song, and the car air conditioner is turned on to work with preset comfort parameters; if the identity type is an elderly type, the vehicle is controlled to unlock the doors.

[0027] A third aspect of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle legacy reminder method as described in the above embodiment.

[0028] A fourth aspect of the present application provides a computer-readable storage medium, which stores a computer program that, when executed by a processor, implements the above-mentioned vehicle legacy reminder method.

[0029] Therefore, the embodiments of the present application have the following beneficial effects:

[0030] (1) The embodiments of the present application perform living object detection in the vehicle based on the in-vehicle image data to prevent living objects such as children, the elderly, and pets from being left in the vehicle, effectively avoid safety accidents, improve the safety and reliability of the vehicle, and effectively meet the user's usage needs.

[0031] (2) The actual brightness inside the vehicle can be detected by a photosensitive touch sensor, and a fill light can be used to compensate for the lighting inside the vehicle when the actual brightness is lower than the preset brightness, thereby ensuring the clarity and smoothness of images and videos and the quality of the images output by the camera.

[0032] (3) By detecting whether the vehicle is in the leaving-vehicle living thing reminder mode, the control unit generates a collection instruction when it detects that the vehicle is in the leaving-vehicle living thing reminder mode and the vehicle parking brake is engaged and the door is locked. In this way, it is possible to determine whether to perform data collection and subsequent warnings based on the specific wishes of the user, thereby avoiding false reminders and reducing the reliability of the vehicle and the user's experience.

[0033] (4) The actual distance between the user and the vehicle can be obtained, and the distance can be compared with the set threshold to determine the reminder method, making the reminder more effective and reliable, thereby improving the safety of vehicle use and the intelligence level of the vehicle.

[0034] (5) When the reminder is too long, it can be determined that the user has ignored the reminder, so that other users or devices can be asked for help, further improving the reliability and practicality of the reminder, making the vehicle safer and more reliable, and protecting property and life safety.

[0035] (6) It can match actual reminder needs and quantify the urgency of reminders based on the duration of reminders, thereby further improving the intelligence and effectiveness of vehicle reminders.

[0036] (7) The identity type of living things can be collected, and the vehicle can be controlled to perform corresponding operations based on the specific identity type, thereby executing corresponding strategies based on the actual situation inside the vehicle, thereby ensuring the safety of passengers to the greatest extent and further improving the user's driving experience.

[0037] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0039] Figure 1 is an exemplary diagram of a vehicle left-behind reminder device according to an embodiment of the present application;

[0040] Figure 2 A schematic diagram of a data acquisition structure provided according to an embodiment of the present application;

[0041] Figure 3 A schematic diagram of the principle of an intelligent in-vehicle entertainment information terminal provided according to an embodiment of the present application;

[0042] Figure 4 A schematic diagram of the principle of a vehicle left-behind reminder device provided according to an embodiment of the present application;

[0043] Figure 5 A schematic diagram of execution logic of a vehicle legacy reminder device provided according to an embodiment of the present application;

[0044] Figure 6 A flowchart of a vehicle legacy reminder method provided according to an embodiment of the present application;

[0045] Figure 7 A schematic diagram of the structure of a vehicle provided for an application embodiment.

[0046] Among them, 10 is a legacy reminder device of the vehicle, 100 is an image acquisition component, 200 is a reminder component, 300 is a control component, 701 is a memory, 702 is a processor, and 703 is a communication interface. DETAILED DESCRIPTION

[0047] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0048] The following describes the vehicle left-behind reminder device, method, vehicle and storage medium of the embodiment of the present application with reference to the accompanying drawings. In view of the problems mentioned in the above background technology, the present application provides a vehicle left-behind reminder device. The embodiment of the present application collects the actual image in the vehicle through the image acquisition component, and then uses the reminder component to remind the user of the left-behind reminder, wherein the reminder component includes at least one acoustic reminder device and at least one optical display device, and then generates a collection instruction through the control component after the vehicle is turned off, and sends the collection instruction to the image acquisition component, and when it is recognized that there is a living thing left in the car according to the actual image, the reminder component is controlled to perform an optical reminder or an acoustic reminder, thereby protecting the life safety of children or pets left in the car, reminding the driver to pay attention to the children or pets in the car, thereby preventing the occurrence of tragedies, which is constructive from the perspective of life safety. In addition, the design of the reminder device is simplified to reduce management costs and after-sales costs. Therefore, the problems that the design and layout of the reminder device in the related art are too complicated, and it is not scientific enough from the perspective of the whole vehicle cost and assembly process, resulting in increased management costs and after-sales costs are solved.

[0049] Specifically, Figure 1 It is a block diagram of a vehicle legacy reminder device according to an embodiment of the present application.

[0050] like Figure 1 As shown, the vehicle legacy reminder device 10 includes: an image acquisition component 100 , a reminder component 200 and a control component 300 .

[0051] The image acquisition component 100 is used to acquire the actual image inside the vehicle.

[0052] The reminder 200 is used to remind the user of the leftovers, wherein the reminder 200 includes at least one acoustic reminder device and at least one optical display device.

[0053] The control component 300 is used to generate a collection instruction after the vehicle is turned off, and send the collection instruction to the image collection component. When a living thing is identified in the vehicle according to the actual image, the reminder component 200 is controlled to make an optical reminder and / or an acoustic reminder.

[0054] The embodiment of the present application controls the image acquisition component 100 such as the in-vehicle camera to capture and collect image information in the vehicle through the above-mentioned control component 300, and determines whether there are children or pets in the vehicle and whether there are safety risks based on the above-mentioned image data, and issues a warning in time through the reminder component 200, thereby ensuring the life safety of children or pets left in the vehicle and improving the safety and reliability of the vehicle.

[0055] Optionally, in one embodiment of the present application, the vehicle legacy reminder device 10 further includes: a first detection component and a compensation component 400 .

[0056] The first detection element is used to detect the actual brightness inside the vehicle.

[0057] The compensating component is used to compensate the lighting inside the vehicle when the actual brightness is lower than the preset brightness.

[0058] Specifically, the image acquisition component 100 may be a camera, and the compensation component may be an infrared fill light, such as Figure 2 In order to ensure the clarity and smoothness of the collected images and videos, during the implementation process, the embodiment of the present application can be shot by a high-definition camera with a pixel of not less than 2 million pixels, such as installing it in the B-pillar and other positions in the car, so that its vertical field of view can cover the rear seat headrest position to the rear floor and the co-pilot position to the floor position, and the horizontal field of view needs to cover the entire upper space in the car.

[0059] In addition, in the specific implementation process, the above-mentioned first detection component, such as a photosensitive sensor and other equipment, can be used to detect the actual brightness inside the car. If the actual brightness inside the car is lower than the brightness threshold in the vehicle-mounted system, it is determined that the actual brightness inside the car is low. Therefore, the embodiments of the present application can use compensation components such as infrared fill lights to compensate for the light of the camera when the brightness inside the car is low under environments such as night driving with no lights in the car, thereby meeting application scenarios such as night driving with no lights in the car, further improving the quality of the acquired images or videos, and ensuring the integrity and reliability of the captured images.

[0060] It should be noted that before performing the image acquisition operation, the embodiment of the present application also needs to detect whether the vehicle is in the leaving vehicle living thing reminder mode in order to further improve the user experience and avoid the occurrence of false reminders.

[0061] Optionally, in one embodiment of the present application, the vehicle's legacy reminder device 10 also includes: a second detection component, used to detect whether the vehicle is in a leaving-vehicle living thing reminder mode, so that the control component generates a collection instruction when it detects that the vehicle is in a leaving-vehicle living thing reminder mode and the vehicle is parked and the door is locked.

[0062] In the embodiments of the present application, there are many ways to detect whether the vehicle is in the leaving vehicle alert mode. For example, a leaving vehicle alert soft switch can be set in the vehicle, and the user can turn on or off the switch according to his own wishes. The vehicle collects the state of the leaving vehicle alert switch, and when the state is on, it is determined that the vehicle is in the leaving vehicle alert mode. It should be noted that the determination of the leaving vehicle alert condition to determine whether the user has actually left the vehicle will be described in detail below.

[0063] It can be understood that in the embodiments of the present application, the above method of determining whether the vehicle is in the leaving vehicle living thing reminder mode can effectively identify the user's actual intention, improve the accuracy of the reminder, and avoid disturbing reminders.

[0064] For example, when the user temporarily stops, there is no need for corresponding reminders, and the vehicle can be out of the vehicle leaving reminder mode, thereby avoiding invalid reminders and improving the user experience.

[0065] When it is detected that the vehicle is in the leaving-vehicle living creature reminder mode and the vehicle ends the driving state, such as after driving to the destination, the user pulls up the handbrake and leaves the vehicle. At this time, there will be a parking brake activation signal on the vehicle network signal, and the camera, leaving-vehicle living creature reminder soft switch and other equipment activation signals will be sent periodically. At the same time, after pressing the key remote control locking action, the body controller in the vehicle will send a door locking signal on the bus. At this time, it is determined that the user has left the vehicle. Once there is a living creature in the car, it is determined that the user has truly left it.

[0066] Furthermore, the embodiments of the present application can determine whether the vehicle is in the vehicle leaving living thing reminder mode by detecting the above signal through the non-sleeping vehicle computer. When the above signal is detected to be valid, a control signal will be sent to the IMS (Intelligent Mutually Systems) for in-vehicle living thing detection. The IMS will capture the scene inside the vehicle through the camera, thereby collecting the in-vehicle image data.

[0067] It should be noted that the embodiments of the present application can perform image or video recognition and analysis through an in-vehicle entertainment information terminal, and the in-vehicle entertainment information terminal can be connected to the car lights and the car audio through the body wiring harness, thereby realizing light and voice prompts. Figure 3 It is a schematic diagram of the principle of the intelligent vehicle entertainment information terminal. Figure 3 As shown, it includes three parts: image processing function, algorithm analysis function and command control function.

[0068] As an implementable method, after generating a data acquisition instruction, an embodiment of the present application can collect in-vehicle images or video data through the above-mentioned high-definition camera in combination with a compensation component. Furthermore, the original format video signal transmitted by the camera can be parsed through an image deserializer, and then the parsed image data can be subjected to algorithmic analysis and processing.

[0069] Specifically, the embodiments of the present application can detect and identify the received image data through target detection algorithms such as Faster-RCNN to determine whether there are living creatures such as children or pets in the current image, thereby accurately analyzing and determining whether there are living creatures in the car and the identity type of the living creatures, avoiding invalid reminders caused by misidentification, and improving the user experience and vehicle reliability. Afterwards, the driver can be reminded accordingly based on the results of image detection and recognition.

[0070] Optionally, in one embodiment of the present application, the control component 300 includes: an acquisition unit and a control unit.

[0071] The acquisition unit is used to acquire the actual distance between the user and the vehicle.

[0072] A control unit is used to control at least one acoustic reminder device and at least one optical display device to remind when the actual distance is less than or equal to a first preset distance, and when the actual distance is greater than the first preset distance, control at least one acoustic reminder device and at least one optical display device to remind and send a reminder signal to the user's mobile terminal.

[0073] As an implementation method, when the vehicle door is locked and the presence of a living thing is detected in the vehicle, the embodiment of the present application can determine whether to remind the user and in what manner by obtaining the actual distance between the user and the vehicle.

[0074] For example, when the vehicle calculates the distance between the user and the vehicle through sensors and other equipment or a user terminal, those skilled in the art may also obtain the above distance through camera ranging and other methods, without any specific limitation.

[0075] After obtaining the above distance, it is fed back to the vehicle computer, and the vehicle computer compares the fed-back distance data with the distance threshold, so as to control the vehicle to give an alarm reminder through a buzzer, horn or other device. For example, when the distance between the user and the vehicle is less than or equal to 10m, an alarm control request will be sent to the body controller. After receiving the alarm request signal, the body controller controls the corresponding power chip through the MCU (Micro Controller Unit, its own motor control unit) to set parameters such as the light flashing duty cycle, such as setting the light flashing duty cycle to 50%, the frequency to 85 times / minute, etc., to control the flashing of the left and right turn signals and the horn to sound a reminder.

[0076] When the distance between the user and the vehicle is greater than 10m, in addition to controlling the vehicle to drive the left and right turn lights to flash and honk the horn to give a reminder, a reminder signal can also be sent to the user, or the mobile terminal of the emergency contact pre-stored by the user, thereby further improving the reliability and effectiveness of the vehicle reminder and ensuring the safety of living things in the car.

[0077] Optionally, in one embodiment of the present application, the vehicle's legacy reminder device 10 further includes: a distress component for counting the duration of the vehicle's reminder, and sending a distress signal to a preset terminal when the reminder duration is greater than a preset duration.

[0078] In an embodiment of the present application, statistics can also be collected on the duration of vehicle reminders to reflect the urgency of the reminder situation, so as to further determine whether it is necessary to send a distress signal.

[0079] For example, when a child is stranded in a car, the vehicle will alert the user through the headlights or horn. If the user does not notice the alert for other reasons, and when the vehicle's continuous alert duration is greater than a time threshold, such as ten minutes, the vehicle will be controlled to send a distress signal to the terminal used by the user, the mobile phone will be controlled to vibrate and ring, and the user will be reminded of the presence of living things in the car and other distress information through the relevant mobile phone APP; distress information can also be sent to emergency contacts through the communication method of the emergency contacts pre-stored by the user. In this way, the reliability and effectiveness of vehicle reminders can be maximized through a variety of methods to ensure the life safety of living things in the car.

[0080] Optionally, in one embodiment of the present application, the legacy reminder device 10 of the vehicle also includes: a driving member, used to match the optimal reminder parameters of at least one acoustic reminder device and at least one optical display device according to the duration of the reminder, and control the operation of at least one acoustic reminder device and at least one optical display device according to the optimal reminder parameters.

[0081] It can be understood that in order to further enhance the user's safety awareness and improve the safety of vehicle use, in an embodiment of the present application, the optimal reminder parameters of the acoustic reminder device or the optical display device can be matched according to the duration of the above reminder.

[0082] For example, when the reminder lasts for more than 10 minutes, the vehicle can be controlled to increase the loudness and frequency of the alarm of acoustic reminder devices such as buzzers or horns. When it is more than 15 minutes, the vehicle can be controlled to increase the frequency of flashing the left and right turn lights, etc., to quantify the urgency of the reminder, thereby improving the intelligence and effectiveness of the vehicle reminder.

[0083] Optionally, in one embodiment of the present application, the control component further includes: an identity collection component, a first judgment component and a second judgment component.

[0084] Among them, the identity collection part is used to collect the identity type of living things.

[0085] The first judgment element is used to control the vehicle to enter a preset soothing mode if the identity type is an infant type, turn on the car audio to play a preset song, and turn on the car air conditioner to work with preset comfort parameters.

[0086] The second judgment element is used to control the vehicle to unlock the doors if the identity type is the elderly type.

[0087] In order to further enhance the intelligence of the vehicle and make it more humane, while controlling the vehicle to give relevant reminders, the embodiments of the present application can also use the in-vehicle camera and SSD (Single Shot MultiBox Detector) and other target recognition and detection algorithms based on deep learning or machine learning to quickly and accurately identify the type of living things in the vehicle, and then control the vehicle to perform corresponding operations according to the identity type of the living thing.

[0088] For example, when a living creature in the car is identified as an infant, since it does not have the ability to open the door or window independently, the vehicle is controlled to enter the soothing mode. By turning on the car audio to play children's songs to soothe its emotions, the windows and sunroof can be opened or the car air conditioner can be turned on and the temperature suitable for children can be set, such as 20 degrees Celsius, to avoid threats to its life safety due to excessive temperature. If the identity type of the living creature is identified as an elderly person, the vehicle is controlled to unlock the door and make relevant voice reminders, such as "the door is unlocked", etc., to avoid infants, the elderly and pets from being accidentally locked in the car and causing loss of life and property, thereby improving the intelligence and humanization of the vehicle.

[0089] When the car owner notices the sound and light alarm, he / she unlocks the door, and the corresponding door unlocking signal appears on the vehicle network segment. After receiving the door unlocking signal, the vehicle computer notifies the BCM (Body Control Module) to interrupt the remaining alarm times of the light and horn in this alarm.

[0090] Figure 4 The schematic diagram of the structure of the vehicle left behind reminder device is as follows: Figure 4 As shown in the figure, as a specific implementation method, it can be composed of four parts: an in-vehicle entertainment information terminal, a camera unit, an in-vehicle audio system, and a hazard warning light. After the vehicle is turned off, the in-vehicle entertainment information terminal sends a command to take a picture of the interior of the vehicle to the camera unit, and the camera unit transmits the image or video information to the in-vehicle entertainment information terminal through the coaxial line of the vehicle body. The in-vehicle entertainment information terminal processes the image or video information through algorithm analysis to determine whether there are children or pets left in the vehicle. If so, the in-vehicle entertainment information terminal issues a control command to give a voice prompt through the in-vehicle audio system and a light prompt through the hazard warning light.

[0091] The working principle of the vehicle left-behind reminder device proposed in this application is described below through an embodiment.

[0092] Figure 5 The execution logic of the vehicle's legacy reminder device when it is working is shown, such as Figure 5 As shown, the working steps of the embodiment of the present application include:

[0093] S501: When the driver stops the car and turns off the engine, the in-vehicle entertainment information terminal sends a command to the camera unit;

[0094] S502: The camera captures image data inside the vehicle;

[0095] S503: Feeding the image data back to the in-vehicle entertainment information terminal, and then the image processing unit analyzes the image;

[0096] S504: The data is output to the algorithm analysis unit to determine whether there are children or pets in the car;

[0097] S505: If yes, the in-vehicle entertainment information terminal sends a control command to the in-vehicle audio system and hazard warning lights for voice and light prompts;

[0098] S506: After receiving the prompt, the driver takes the child or pet out of the car.

[0099] According to the vehicle left-behind reminder device proposed in the embodiment of the present application, the embodiment of the present application collects the actual image in the car through the image acquisition component, and then uses the reminder component to remind the user of the left-behind reminder, wherein the reminder component includes at least one acoustic reminder device and at least one optical display device, and then generates a collection instruction through the control component after the vehicle is turned off, and sends the collection instruction to the image acquisition component, and when it is recognized that there are living things left in the car according to the actual image, the reminder component is controlled to perform optical reminder or acoustic reminder, thereby realizing the protection of the life safety of children or pets left in the car, reminding the driver to pay attention to the children or pets in the car, thereby preventing the occurrence of tragedy, which is constructive from the level of life safety, and also simplifies the design of the reminder device to reduce management costs and after-sales costs.

[0100] Next, the vehicle legacy reminder method proposed in accordance with the embodiment of the present application is described with reference to the accompanying drawings.

[0101] Figure 6 A schematic flow chart of a vehicle legacy reminder method provided in an embodiment of the present application.

[0102] like Figure 6 As shown, the vehicle legacy reminder method includes the following steps:

[0103] In step S601, a collection instruction is generated after the vehicle is turned off;

[0104] In step S602, an actual image inside the vehicle is collected according to a collection instruction;

[0105] Optionally, in one embodiment of the present application, it is detected whether the vehicle is in the vehicle leaving living thing reminder mode, so that the control component generates a collection instruction when it detects that the vehicle is in the vehicle leaving living thing reminder mode and the vehicle parking brake is on and the door is locked.

[0106] Optionally, in one embodiment of the present application, the actual brightness inside the vehicle is detected; when the actual brightness is lower than a preset brightness, lighting compensation is performed inside the vehicle.

[0107] In step S603, when it is recognized according to the actual image that there is a living thing left in the vehicle, the reminder is controlled to make an optical reminder and / or an acoustic reminder.

[0108] Optionally, in one embodiment of the present application, the actual distance between the user and the vehicle is obtained; when the actual distance is less than or equal to a first preset distance, at least one acoustic reminder device and at least one optical display device are controlled to give a reminder, and when the actual distance is greater than the first preset distance, at least one acoustic reminder device and at least one optical display device are controlled to give a reminder, and a reminder signal is sent to the user's mobile terminal.

[0109] Optionally, in one embodiment of the present application, the duration of the reminder of the vehicle is counted, and when the duration of the reminder is greater than a preset duration, a distress signal is sent to a preset terminal.

[0110] Optionally, in one embodiment of the present application, optimal reminder parameters of at least one acoustic reminder device and at least one optical display device are matched according to the reminder duration, and the at least one acoustic reminder device and at least one optical display device are controlled to operate according to the optimal reminder parameters.

[0111] Optionally, in one embodiment of the present application, the identity type of the living thing is collected; if the identity type is an infant type, the vehicle is controlled to enter a preset soothing mode, the car audio is turned on to play preset songs, and the car air conditioner is turned on to work with preset comfort parameters; if the identity type is an elderly type, the vehicle is controlled to unlock the doors.

[0112] It should be noted that the above explanation of the embodiment of the vehicle's legacy reminder device is also applicable to the vehicle's legacy reminder method of this embodiment, and will not be repeated here.

[0113] According to the vehicle left-behind reminder method proposed in the embodiment of the present application, a collection instruction is generated after the vehicle is turned off; the actual image inside the vehicle is collected according to the collection instruction; when it is recognized that there are living things left in the vehicle according to the actual image, the reminder component is controlled to perform optical reminders and / or acoustic reminders, thereby protecting the life safety of children or pets left in the vehicle, reminding the driver to pay attention to the children or pets in the vehicle, and preventing tragedies from happening. From the perspective of life safety, the vehicle left-behind reminder device proposed in the present application has constructive significance.

[0114] Figure 7 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application. The vehicle may include:

[0115] A memory 701 , a processor 702 , and a computer program stored in the memory 701 and executable on the processor 702 .

[0116] When the processor 702 executes the program, the vehicle legacy reminder method provided in the above embodiment is implemented.

[0117] Furthermore, the vehicle also includes:

[0118] The communication interface 703 is used for communication between the memory 701 and the processor 702 .

[0119] The memory 701 is used to store computer programs that can be executed on the processor 702 .

[0120] The memory 701 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0121] If the memory 701, the processor 702 and the communication interface 703 are implemented independently, the communication interface 703, the memory 701 and the processor 702 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0122] Optionally, in a specific implementation, if the memory 701, the processor 702 and the communication interface 703 are integrated on a chip, the memory 701, the processor 702 and the communication interface 703 can communicate with each other through an internal interface.

[0123] The processor 702 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0124] This embodiment also provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the above-mentioned vehicle legacy reminder method is implemented.

[0125] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0126] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0127] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0128] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways as necessary and then storing it in a computer memory.

[0129] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0130] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0131] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0132] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A vehicle left-behind reminder device, characterized in that: include: An image acquisition component, used to acquire actual images inside the vehicle; A reminder, for reminding a user of a legacy, wherein the reminder comprises at least one acoustic reminder device and at least one optical display device; and A control component, for generating a collection instruction after the vehicle is turned off, and sending the collection instruction to the image collection component, and controlling the reminder component to perform an optical reminder and / or an acoustic reminder when a living thing is identified in the vehicle according to the actual image; The control element further includes: An identity collection component, used to collect the identity type of the living thing; The first judgment element is used to control the vehicle to enter a preset soothing mode if the identity type is an infant type, turn on the vehicle audio to play a preset song, and turn on the vehicle air conditioner to work with preset comfort parameters; The second judgment element is used to control the vehicle to unlock the doors if the identity type is an elderly person.

2. The device according to claim 1, characterized in that Also includes: A first detection element, used to detect the actual brightness inside the vehicle; The compensating member is used to perform lighting compensation in the vehicle when the actual brightness is lower than the preset brightness.

3. The device according to claim 1, characterized in that Also includes: The second detection component is used to detect whether the vehicle is in the vehicle leaving living thing reminder mode, so that the control component generates the collection instruction when it detects that the vehicle is in the vehicle leaving living thing reminder mode and the vehicle parking brake is on and the door is locked.

4. The device according to claim 1, characterized in that The control element comprises: An acquisition unit, used to acquire an actual distance between the user and the vehicle; A control unit is used to control the at least one acoustic reminder device and the at least one optical display device to remind when the actual distance is less than or equal to a first preset distance, and to control the at least one acoustic reminder device and the at least one optical display device to remind when the actual distance is greater than the first preset distance, while sending a reminder signal to the user's mobile terminal.

5. The device according to claim 1, characterized in that Also includes: The distress signal is used to count the duration of the reminder of the vehicle, and when the duration of the reminder is greater than a preset duration, send a distress signal to a preset terminal.

6. The device according to claim 5, characterized in that Also includes: A driving member is used to match the optimal reminder parameters of the at least one acoustic reminder device and the at least one optical display device according to the reminder duration, and control the at least one acoustic reminder device and the at least one optical display device to operate according to the optimal reminder parameters.

7. A vehicle left-behind reminder method, characterized in that: Using the vehicle legacy reminder device according to any one of claims 1 to 6, wherein the method comprises the following steps: Generate a collection instruction after the vehicle is turned off; Collecting the actual image inside the vehicle according to the collection instruction; When it is recognized according to the actual image that there is a living thing left in the vehicle, the reminder is controlled to perform an optical reminder and / or an acoustic reminder.

8. A vehicle, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle legacy reminder method as claimed in claim 7.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the vehicle legacy reminder method as claimed in claim 7 .

Citation Information

Patent Citations

  • Vehicle safety monitoring system based on internet of vehicles

    CN105774653A

  • Reminding method for baby left inside vehicle

    CN107839596A

  • Alarm control method, device and equipment, and automobile

    CN111994030A

  • Automatic window closing control system and method

    CN113323538A

  • Method for monitoring an occupant and a device therefor

    US20210334564A1