Remote control method, device and equipment based on in-vehicle living object detection and storage medium

Abstract

The invention discloses a remote control method, device and equipment based on in-vehicle living thing detection and a storage medium, relates to the technical field of automobile safety, and discloses a remote control method based on in-vehicle living thing detection, and the method comprises the steps: obtaining in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment equipment state information; determining an in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment equipment state information; when the in-vehicle living thing detection result meets a preset condition, pushing an in-vehicle living thing reminding message and a user control interface to the user side according to the in-vehicle living thing detection result, so that the user side feeds back a user remote control instruction based on the in-vehicle living thing reminding message and the user control interface; the remote control instruction of the user is responded, the vehicle is remotely controlled, and the safety risk prevention capability of the vehicle in the living object detection process can be enhanced.

Description

Technical Field

[0001] The present application relates to the field of automobile safety technology, and in particular to a remote control method, device, equipment and storage medium based on in-vehicle living thing detection. Background Art

[0002] With the development of society and the advancement of technology, people have higher and higher requirements for vehicle safety. In particular, the safety hazard of living things being left in the car during vehicle use has received increasing attention. In high or low temperature environments, the environment inside the car can quickly become dangerous, leading to serious health risks or even death. Therefore, it is necessary to develop a system that can intelligently detect living things in the car and prevent them from being forgotten, in order to improve the overall safety of the vehicle.

[0003] Currently, existing solutions mainly rely on in-vehicle image data to extract object features and identify living things. However, the accuracy of image data may be affected by many factors, such as insufficient light in the car, camera resolution or angle problems, and occlusion of objects in the car. If the image quality is poor, it may lead to recognition errors or missed detections, which in turn affects the accuracy and reliability of the system. Therefore, how to enhance the vehicle's ability to prevent safety risks during the process of detecting living things has become an urgent problem to be solved.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a remote control method, device, equipment and storage medium based on in-vehicle living thing detection, aiming to solve the technical problem of how to enhance the vehicle's safety risk prevention capabilities during the living thing detection process.

[0006] To achieve the above objectives, the present application proposes a remote control method based on in-vehicle living thing detection, the method comprising:

[0007] The in-vehicle living thing detection and remote control method comprises:

[0008] Obtain in-car camera information, in-car sound source detection information, seat pressure detection information, and entertainment device status information;

[0009] Determine the in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information;

[0010] When the in-vehicle living thing detection result meets a preset condition, a in-vehicle living thing reminder message and a user control interface are pushed to a user terminal according to the in-vehicle living thing detection result, so that the user terminal feeds back a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface;

[0011] In response to the user remote control instruction, the vehicle is remotely controlled.

[0012] In one embodiment, the step of determining the living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information includes:

[0013] Determine whether there is a living thing in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information, and obtain a living thing presence detection result;

[0014] When the in-vehicle living being detection result indicates that a living being exists in the vehicle, in-vehicle living being detection source information is obtained, and the living being presence detection result carrying the in-vehicle living being detection source information is used as the in-vehicle living being detection result, wherein the in-vehicle living being detection source information includes at least one of living being visual information, living being sound source information, living being seat information and the entertainment device status information.

[0015] In one embodiment, when the in-vehicle living thing detection result meets a preset condition, the step of pushing an in-vehicle living thing reminder message and a user control interface to a user terminal according to the in-vehicle living thing detection result includes:

[0016] When the in-vehicle living thing detection result meets a preset condition, determining a living thing reminder type according to the in-vehicle living thing detection signal source information;

[0017] According to the living thing reminder type, an in-vehicle living thing reminder message and a user control interface are pushed to the user terminal.

[0018] In one embodiment, the step of pushing the in-vehicle living thing reminder message and the user control interface to the user terminal according to the living thing reminder type includes:

[0019] Generate an in-vehicle living thing reminder message and a remote control option according to the living thing reminder type, wherein the remote control option includes at least two of an in-vehicle camera viewing option, a door control option, an in-vehicle speaker control option, an entertainment device control option, and an alarm control option;

[0020] determining a user control interface according to the remote control;

[0021] The in-vehicle living thing reminder message and the user control interface are pushed to the user terminal.

[0022] In one embodiment, after the step of determining the in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information, the step further includes:

[0023] When it is detected that the owner has left the car and the result of the detection of living things in the car does not meet the preset conditions, the signal strength of the owner's smart key is collected, and the distance of the owner from the car is determined according to the signal strength of the owner's smart key;

[0024] When the distance between the vehicle owner and the vehicle is greater than a preset distance threshold, the vehicle door is locked and a locking confirmation message is sent to the user terminal.

[0025] In one embodiment, the step of remotely controlling the vehicle in response to the user remote control instruction includes:

[0026] When the user remote control instruction is a remote unlocking instruction, acquiring a remote unlocking duration based on the remote unlocking instruction;

[0027] The vehicle is remotely controlled based on the remote unlocking duration.

[0028] In one embodiment, before the step of obtaining in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information, the step further includes:

[0029] Get the number of reminders of leaving the vehicle and the interval between reminders;

[0030] The leaving-vehicle living thing reminder function is started based on the leaving-vehicle living thing reminder times and the leaving-vehicle living thing reminder time interval to obtain in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information.

[0031] In addition, to achieve the above-mentioned purpose, the present application also proposes a remote control device based on in-vehicle living thing detection, the remote control device based on in-vehicle living thing detection comprising:

[0032] An information acquisition module is used to obtain in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information;

[0033] A living thing detection module, used to determine a living thing detection result in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information;

[0034] A user push module, configured to push an in-vehicle living thing reminder message and a user control interface to a user terminal according to the in-vehicle living thing detection result when the in-vehicle living thing detection result meets a preset condition, so that the user terminal can feedback a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface;

[0035] The remote control module is used to respond to the user's remote control command and remotely control the vehicle.

[0036] In addition, to achieve the above-mentioned purpose, the present application also proposes a remote control device based on in-vehicle living thing detection, the device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the remote control method based on in-vehicle living thing detection as described above.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the remote control method based on in-vehicle living thing detection as described above are implemented.

[0038] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the remote control method based on in-vehicle living thing detection as described above are implemented.

[0039] One or more technical solutions proposed in this application have at least the following technical effects:

[0040] Acquire in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information; determine in-vehicle living thing detection results according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information; when the in-vehicle living thing detection results meet the preset conditions, push in-vehicle living thing reminder messages and user control interfaces to the user end according to the in-vehicle living thing detection results, so that the user end can feedback the user remote control command based on the in-vehicle living thing reminder message and the user control interface; respond to the user remote control command, remotely control the vehicle, detect living things in the vehicle by combining multiple sensors, monitor the activity status in the vehicle in real time, identify whether there are living things in the vehicle in time, and actively push alarm information and corresponding user control interfaces, so as to provide car owners with a flexible management method to solve the problem of living things left in the vehicle, enhance the vehicle's safety risk prevention capabilities during the process of living thing detection, and reduce safety accidents caused by living things left in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0042] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0043] Figure 1 A flowchart of a first embodiment of a remote control method based on in-vehicle living thing detection provided by the present application;

[0044] Figure 2 A flow chart of a second embodiment of a remote control method based on in-vehicle living thing detection provided by the present application;

[0045] Figure 3 This is a schematic diagram of the module structure of a remote control device based on in-vehicle living thing detection according to an embodiment of the present application;

[0046] Figure 4 Schematic diagram of the device structure of the hardware operating environment involved in the remote control method based on in-vehicle living thing detection in the embodiment of the present application.

[0047] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0048] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0049] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0050] The main solution of the embodiment of the present application is: obtaining in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information; determining the in-vehicle living thing detection result based on the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information; when the in-vehicle living thing detection result meets the preset conditions, pushing the in-vehicle living thing reminder message and the user control interface to the user terminal according to the in-vehicle living thing detection result, so that the user terminal feeds back the user remote control command based on the in-vehicle living thing reminder message and the user control interface; and remotely controlling the vehicle in response to the user remote control command.

[0051] In this embodiment, for ease of description, the following description is based on identifying the vehicle end as the execution subject.

[0052] Existing solutions mainly rely on in-vehicle image data to extract object features and identify living things. However, the accuracy of image data may be affected by many factors, such as insufficient light in the car, camera resolution or angle problems, and occlusion of objects in the car. If the image quality is poor, it may lead to recognition errors or missed detections, which in turn affects the accuracy and reliability of the system. Therefore, how to enhance the vehicle's ability to prevent safety risks during the process of detecting living things has become an urgent problem to be solved.

[0053] The present application provides a solution, which includes obtaining in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information; determining in-vehicle living thing detection results according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information; when the in-vehicle living thing detection results meet preset conditions, pushing in-vehicle living thing reminder messages and user control interfaces to a user terminal according to the in-vehicle living thing detection results, so that the user terminal can feedback user remote control instructions based on the in-vehicle living thing reminder messages and the user control interface; remotely controlling the vehicle in response to the user remote control instructions, and detecting living things in the vehicle by combining multiple sensors, so as to monitor the activity status in the vehicle in real time, timely identify whether there are living things in the vehicle, and actively push alarm information and corresponding user control interfaces, so as to provide a flexible management method for the car owner to solve the problem of living things left in the vehicle, enhance the vehicle's safety risk prevention capabilities during the process of living thing detection, and reduce safety accidents caused by living things left in the vehicle.

[0054] It should be noted that the execution subject of this embodiment may be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a vehicle terminal, etc. The following takes the vehicle terminal as an example to illustrate this embodiment and the following embodiments.

[0055] Based on this, the embodiment of the present application provides a remote control method based on in-vehicle living thing detection, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the remote control method based on in-vehicle living thing detection of the present application.

[0056] In this embodiment, the remote control method based on in-vehicle living thing detection includes steps S10 to S40:

[0057] Step S10, obtaining in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information;

[0058] It should be understood that the in-car camera information can be obtained by capturing real-time video streams through an in-car camera installed inside the vehicle to obtain in-car image data. The in-car camera can be installed in the front seat, rear seat or important area of ​​the vehicle to cover the key field of view in the vehicle. The in-car sound source detection information can be obtained by a vehicle-mounted microphone or sound sensor installed inside the vehicle. The microphone or sound sensor can detect audio signals in the car such as human voices, pet calls, abnormal noises, etc. The seat pressure detection information can be obtained by obtaining a pressure value through a pressure sensor installed under the seat. According to the pressure value, the pressure change of the seat can be detected, and according to the seat pressure change, it can be determined whether there is an object on the seat. The entertainment device status information can be obtained through the status information collected by the control unit of the entertainment devices inside the vehicle, such as audio and air conditioning. The entertainment device status information can specifically include the running time information of the entertainment device.

[0059] Step S20, determining a result of detecting a living thing in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information;

[0060] It should be understood that the live object detection function in this solution is executed when the owner is detected to leave the car, and the live objects detected are people in the car (such as babies, children and adults, etc.) and pets in the car (such as cats, dogs, etc.). The live object detection results include the presence of live objects in the car and the absence of live objects in the car.

[0061] It should be noted that the pre-trained live object detection algorithm can extract visual feature parameters such as form, movement and color based on the in-car camera information, identify whether there are live features in the image based on the visual feature parameters, and obtain visual live object detection results. The pre-trained live object sound recognition algorithm can extract audio feature parameters such as volume, frequency, and duration based on the in-car sound source detection information, identify whether there are live sounds (such as human voices, baby crying or pet calls, etc.) based on the audio feature parameters, and obtain audio live object detection results.

[0062] In addition, it should be noted that, according to the seat pressure detection information, it is possible to monitor whether the seat cushion changes. When the seat cushion changes due to someone being in the seat are detected according to the seat pressure detection information, the time and position of the seat cushion change will be recorded. According to the recorded time and position information, the temperature data during the seat cushion change is obtained from the corresponding seat temperature sensor to monitor the temperature change caused by human body heat. At the same time, the door sensor data and motion sensor data of the corresponding time period are collected to determine the door switch changes and detect the motion state of objects in the car, and then determine whether the seat cushion change is caused by a living thing. When there is a living thing on the seat that causes the seat cushion to change, the seat liveness detection result is determined to be that there is a living thing on the seat, otherwise the seat liveness detection result is determined to be that there is no living thing on the seat. In addition, according to the entertainment device status information, the entertainment device operation time information can be obtained. When it is detected that the entertainment device is continuously running according to the entertainment device operation time information, it is determined that there is a living thing in the car, and the entertainment device liveness detection result is obtained.

[0063] It should be understood that after obtaining the visual liveness detection results, audio liveness detection results, seat liveness detection results and entertainment device liveness detection results respectively based on the in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information, the in-vehicle liveness detection results can be determined by combining the visual liveness detection results, audio liveness detection results, seat liveness detection results and entertainment device liveness detection results to enhance the vehicle's safety risk identification capabilities during the liveness detection process.

[0064] In a feasible implementation, step S20 may include steps S21 to S22:

[0065] Step S21, determining whether there is a living thing in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information, and obtaining a living thing presence detection result;

[0066] Specifically, it is possible to determine whether there are people or pets left in the car in the back seat or in a conspicuous position in the car based on the in-car camera information, determine whether there are abnormal sounds or dynamic sounds in the car (such as pet barking, baby crying, etc.) based on the in-car sound source detection information, determine whether the seat cushion of the monitored seat is changed by someone based on the seat pressure detection information, and determine whether the in-car audio, air conditioning or other entertainment equipment has been running for a long time based on the entertainment device status information. When the result of any of the in-car camera information, the in-car sound source detection information, the seat pressure detection information and the entertainment device status information is yes, then the living thing presence detection result is determined to be that there are living things in the car; when all of them are no, then the living thing presence detection result is determined to be that there are no living things in the car.

[0067] Step S22, when the in-vehicle living being detection result is that there is a living being in the vehicle, obtain in-vehicle living being detection source information, and use the in-vehicle living being detection result carrying the in-vehicle living being detection source information as the in-vehicle living being detection result, wherein the in-vehicle living being detection source information includes at least one of living being visual information, living being sound source information, living being seat information and the entertainment device status information.

[0068] It should be understood that when the result of the in-car living creature detection is that there is a living creature in the car, it means that at least one of the in-car camera information, in-car sound source detection information, seat pressure detection information and entertainment device status information meets the living creature detection conditions. At this time, the information that meets the living creature detection conditions will be obtained, and the corresponding in-car living creature detection source information will be obtained.

[0069] Specifically, when the in-car camera information meets the living thing detection condition, that is, there are people or pets left in the car in the back seat or in an obvious position in the car, the facial information of the person or the shape information of the pet will be extracted according to the in-car camera information to obtain the living thing visual information. When the in-car sound source detection information meets the living thing detection condition, that is, whether there are abnormal sounds or dynamic sounds (such as pet barking, baby crying, etc.) in the car is determined according to the in-car sound source detection information, the abnormal audio (such as human voice, baby crying, pet barking, etc.) will be extracted according to the in-car sound source detection information to obtain the living thing sound source information.

[0070] In addition, when the seat pressure detection information meets the living thing detection condition, that is, when the seat cushion changes due to someone in the seat is monitored according to the seat pressure detection information, the time and position of the seat cushion change will be recorded, and the temperature data during the seat cushion change will be obtained from the corresponding seat temperature sensor according to the recorded time and position information, and the door sensor data and motion sensor data of the corresponding time period will be collected to obtain the living thing seat information. When the entertainment device status information meets the living thing detection condition, that is, it is determined according to the entertainment device status information whether the audio, air conditioning or other entertainment devices in the car have been running for a long time, the entertainment device status information, that is, the entertainment device operation time information, is used as one of the living thing detection source information in the car.

[0071] It should be understood that when the result of the in-vehicle living thing presence detection is that there is a living thing in the car, the living thing presence detection result carrying the in-vehicle living thing detection source information will be used as the in-vehicle living thing detection result; when the in-vehicle living thing presence detection result is that there is no living thing in the car, the in-vehicle living thing presence detection result will be used as the in-vehicle living thing detection result.

[0072] In a feasible implementation, after step S20, it may also include: when it is detected that the car owner has left the car and the result of the living thing detection in the car does not meet the preset conditions, collecting the signal strength of the car owner's smart key, and determining the distance the car owner has left the car based on the signal strength of the car owner's smart key; when the distance the car owner has left the car is greater than a preset distance threshold, locking the car door and sending a lock confirmation message to the user end.

[0073] It should be noted that the owner's leaving the vehicle can be detected by the door sensor and motion sensor equipped in the vehicle. The signal strength of the owner's smart key can be collected through proximity sensing technology such as radio frequency identification (RFID) or Bluetooth technology, which is the wireless signal strength when the smart key communicates with the vehicle. The wireless signal strength can reflect the distance between the smart key and the vehicle. The preset distance threshold can be set by the user as needed. The user end is the application end of the owner's mobile phone, such as a mobile phone APP, and the vehicle can be remotely controlled at the application end.

[0074] It should be understood that when the owner leaves the car, the live detection result in the car obtained by real-time detection will be obtained. When the live detection result in the car shows that there is no live thing in the car (that is, the live detection result in the car does not meet the preset conditions), the signal strength of the owner's smart key will be collected, and the distance between the owner and the vehicle will be calculated according to the change of the smart key signal strength through the signal attenuation model and the known signal propagation parameters, and the distance between the owner and the vehicle will be obtained. When the distance between the owner and the car is greater than the preset distance threshold, the door locking operation is performed, and the locking confirmation information is sent to the user end to notify the owner that the vehicle has been safely locked, which can avoid the problem of the owner forgetting to lock the car or not closing the door, and ensure the safety of the vehicle. The locking confirmation information can specifically include the locked status and locking time of the vehicle.

[0075] Step S30, when the in-vehicle living thing detection result meets a preset condition, pushing an in-vehicle living thing reminder message and a user control interface to a user terminal according to the in-vehicle living thing detection result, so that the user terminal feeds back a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface;

[0076] It should be noted that when the result of the in-vehicle living thing detection is that there is a living thing in the car (that is, the preset conditions are met), the type of living thing in the car will be determined based on the in-vehicle living thing detection source information carried by the in-vehicle living thing detection result, and the corresponding in-vehicle living thing reminder message and user control interface will be pushed to the car owner's user terminal, so that after the car owner receives the corresponding in-vehicle living thing reminder message on the user terminal, he can perform corresponding remote control operations on the vehicle based on the pushed user control interface, so as to feedback the user's remote control instructions to the vehicle terminal.

[0077] In a feasible implementation, step S30 may include steps S31 to S32:

[0078] Step S31, when the in-vehicle living thing detection result meets a preset condition, determining the type of living thing reminder according to the in-vehicle living thing detection signal source information;

[0079] It should be noted that the in-car living thing detection source information includes at least one of living thing visual information, living thing sound source information, living thing seat information, and entertainment device status information. The in-car living thing type can be identified according to the in-car living thing detection source information through a pre-trained living thing type recognition algorithm to obtain a living thing reminder type. Considering the situation where there is less in-car living thing detection source information (such as only entertainment device status information), the in-car living thing type recognition may fail, and an unknown living thing type result is generated. The living thing reminder type includes a known living thing type and an unknown living thing type.

[0080] Step S32: Pushing an in-vehicle living thing reminder message and a user control interface to a user terminal according to the living thing reminder type.

[0081] It should be understood that according to the type of living thing reminder, a corresponding in-car living thing reminder message and user control interface can be generated and pushed to the user end, so that the owner can check the living thing situation in the car according to the in-car living thing reminder message after leaving the car, and respond and handle the living thing-related situation in the car in a timely manner through the user control interface.

[0082] It should be noted that the living creature reminder type of a known living creature type will include specific living creature type information, and the living creature reminder type of an unknown living creature type will include specific in-vehicle living creature detection source information. Specifically, the living creature type information can be a pet type and a person type, and further, the person type can be a stranger type and an authorized person type.

[0083] In a feasible implementation, step S32 may include: generating an in-vehicle living thing reminder message and a remote control option according to the living thing reminder type, wherein the remote control option includes at least two of an in-vehicle camera viewing option, a door control option, an in-vehicle speaker control option, an entertainment device control option, and an alarm control option; determining a user control interface according to the remote control; and pushing the in-vehicle living thing reminder message and the user control interface to the user end.

[0084] It should be understood that according to the type of living thing reminder, an in-car living thing reminder message and a remote control option can be generated, and then the user control interface pushed to the car owner is determined according to the remote control option. The remote control option at least includes an in-car camera viewing option, a door control option, an in-car speaker control option, an entertainment device control option, and an in-car camera viewing option and a door control option in the alarm control option. Different types of living thing reminders generate different remote control options.

[0085] Step S40, responding to the user remote control instruction to remotely control the vehicle.

[0086] It should be understood that after the vehicle receives the user remote control command sent by the user end, it will perform corresponding remote control operations on the vehicle according to the user remote control command to remotely control the vehicle. The remote control operation can be a door control command, an in-vehicle speaker control command, an entertainment device control command, and an alarm control command. The door control command can include a remote unlock command and a remote lock command.

[0087] For example, for a scenario where a pet is left in the car, when the type of the living creature reminder is identified as a pet type according to the source information of the living creature detection in the car (such as the visual information of the living creature), a pet type living creature reminder message such as "There is a pet left in the car, please confirm", and a user control interface including the camera viewing option in the car and the door control option will be generated and pushed to the owner. If the owner confirms the remote locking command of locking the car according to the feedback of the door control option, the vehicle will be locked at this time. If the door is not unlocked within 30 minutes, the leaving vehicle living creature reminder function can be started again to collect the camera information in the car, the sound source detection information in the car, the seat pressure detection information and the entertainment device status information again, and obtain an updated result of the living creature detection in the car. Based on the updated result of the living creature detection in the car, the corresponding living creature reminder message and user control interface are continuously pushed. The owner checks the surveillance video in the car. If it is confirmed that there is indeed a pet left in the car, the door can be remotely unlocked to let the pet out. If it is confirmed that there is no pet or no one in the car, the door is kept locked.

[0088] In the scenario where a stranger breaks into the car, when the type of live alert is identified as a stranger type based on the live detection source information in the car (such as live sound source information and live seat information), a live alert message of the stranger type such as "There is a stranger in the car, there may be a safety risk" and a user control interface including the in-car camera viewing option, door control option, in-car speaker control option and alarm control option will be generated and pushed to the car owner. If the car owner checks the in-car camera video according to the in-car camera viewing option and confirms that there is a stranger in the car, the in-car speaker control option can issue a voice warning of "Please leave the vehicle", and the alarm control option can be used to trigger the alarm if the stranger has not left, and the door can be forcibly locked through the door control option to ensure the safety of the car owner and the vehicle.

[0089] In the scenario where the in-car entertainment system is running for a long time, when the type of living creature reminder is identified as an unknown living creature type based on the in-car living creature detection source information (such as entertainment device status information), a living creature reminder message of the unknown living creature type such as "The car audio and air conditioning are still working, is there any living creature left?" and a user control interface containing in-car camera viewing options, door control options, and entertainment device control options will be generated and pushed to the owner. If the owner does not respond to the user remote control command based on the user control interface within the preset time (such as 30 minutes), the vehicle will be locked to reduce energy consumption and improve safety.

[0090] It should be understood that if the conditions for the presence of living things in the car are no longer met (such as no one in the car or the pet has been taken away), the car will automatically relock after a set time (such as 30 minutes), preventing the owner from ignoring the unlocked door and further ensuring the safety of the vehicle.

[0091] In a feasible implementation, step S40 may include: when the user remote control instruction is a remote unlocking instruction, acquiring a remote unlocking duration based on the remote unlocking instruction; and remotely controlling the vehicle based on the remote unlocking duration.

[0092] It should be understood that when the owner receives a reminder message about living things in the car, and checks the car camera according to the car camera viewing option to confirm that there are living things left in the car, he can enter the remote unlocking duration in the door control option of the pushed user control interface according to his needs to generate the corresponding remote unlocking instruction. When the user's remote control instruction is a remote unlocking instruction, the remote unlocking duration will be obtained according to the remote unlocking instruction, and the vehicle will be remotely unlocked based on the remote unlocking duration. When the door unlocking time reaches the remote unlocking duration, the door will be locked to avoid safety hazards caused by unlocking the door for a long time.

[0093] The present embodiment provides a remote control method based on in-vehicle living thing detection, which obtains in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information; determines the in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information; when the in-vehicle living thing detection result meets the preset condition, pushes the in-vehicle living thing reminder message and the user control interface to the user terminal according to the in-vehicle living thing detection result, so that the user terminal feeds back the user remote control instruction based on the in-vehicle living thing reminder message and the user control interface; responds to the user remote control instruction, remotely controls the vehicle, detects the living things in the vehicle by combining multiple sensors, monitors the activity status in the vehicle in real time, promptly identifies whether there are living things in the vehicle, and actively pushes the alarm information and the corresponding user control interface, so as to provide the car owner with a flexible management method to solve the problem of living things left in the vehicle, enhance the vehicle's safety risk prevention capability in the process of living thing detection, and reduce the safety accidents caused by the living things left in the vehicle.

[0094] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 2 Before step S10, the remote control method based on in-vehicle living thing detection further includes steps S01 to S02:

[0095] Step S01, obtaining the number of reminders of leaving the vehicle and the time interval of reminders of living things;

[0096] It should be understood that the number of reminders for leaving the vehicle and the time interval for reminders for leaving the vehicle are the number of reminders and the time interval for reminders set by the vehicle owner in the in-vehicle control system, and the vehicle owner can set the number of reminders for leaving the vehicle according to his or her needs.

[0097] Step S02, based on the number of leaving-vehicle reminders and the time interval of the reminders, a leaving-vehicle reminder function is started to obtain in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information.

[0098] It should be noted that when the car owner does not leave the car, the system will continue to collect in-car camera information, in-car sound source detection information, seat pressure detection information and entertainment device status information. When the car owner leaves the car, it will determine whether there are living things in the car based on the collected in-car camera information, in-car sound source detection information, seat pressure detection information and entertainment device status information. If there are living things in the car and the owner leaves the car, the corresponding in-car living thing reminder message and user control interface will be immediately pushed to the car owner, so that the car owner can perform corresponding remote control operations in time.

[0099] Specifically, if the owner is unaware of the existence of living things in the car, the owner can set the number of reminders for leaving the car to 1. At this time, the default interval for reminders for living things is 0. The reminder function for leaving the car will only be activated once when the owner leaves the car to prevent the owner from forgetting to leave living things behind. If the owner knows that there are people and pets left in the car, the owner can set the number of reminders for living things to multiple times, such as 3 times, according to his needs, and set the interval for reminders for living things to 30 minutes. At this time, in addition to activating the reminder function for leaving the car when the owner leaves the car, the reminder function for leaving the car will also be activated every 30 minutes until the number of activations for leaving the car reaches 3 times.

[0100] This embodiment obtains the number of leaving vehicle alive reminders and the time interval of the alive reminders, and starts the leaving vehicle alive reminder function based on the number of leaving vehicle alive reminders and the time interval of the alive reminders, so as to obtain the in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information, and starts the leaving vehicle alive reminder function once or multiple times after the owner leaves the vehicle according to the number of leaving vehicle alive reminders, so that the alive reminder situation can meet the actual needs of the owner to avoid frequent reminders disturbing the owner.

[0101] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the remote control method based on in-vehicle living thing detection of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0102] This application also provides a remote control device based on in-vehicle living thing detection, please refer to Figure 3 , the remote control device based on in-vehicle living thing detection comprises:

[0103] The information acquisition module 10 is used to acquire in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information;

[0104] A living thing detection module 20, configured to determine a living thing detection result in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information;

[0105] A user push module 30 is used to push an in-vehicle living thing reminder message and a user control interface to a user terminal according to the in-vehicle living thing detection result when the in-vehicle living thing detection result meets a preset condition, so that the user terminal can feedback a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface;

[0106] The remote control module 40 is used to respond to the user remote control command and remotely control the vehicle.

[0107] In one embodiment, the living thing detection module 20 is further used to determine whether there is a living thing in the car based on the in-car camera information, the in-car sound source detection information, the seat pressure detection information and the entertainment device status information, and obtain a living thing presence detection result; when the in-car living thing presence detection result is that there is a living thing in the car, obtain the in-car living thing detection source information, and use the living thing presence detection result carrying the in-car living thing detection source information as the in-car living thing detection result, wherein the in-car living thing detection source information includes at least one of the living thing visual information, the living thing sound source information, the living thing seat information and the entertainment device status information.

[0108] In one embodiment, the user push module 30 is further used to determine the type of living thing reminder according to the living thing detection source information in the vehicle when the living thing detection result in the vehicle meets the preset conditions; and push the living thing reminder message and user control interface in the vehicle to the user terminal according to the living thing reminder type.

[0109] In one embodiment, the user push module 30 is also used to generate an in-vehicle living thing reminder message and a remote control option according to the living thing reminder type, wherein the remote control option includes at least two of an in-vehicle camera viewing option, a door control option, an in-vehicle speaker control option, an entertainment device control option, and an alarm control option; determine a user control interface according to the remote control; and push the in-vehicle living thing reminder message and the user control interface to the user terminal.

[0110] In one embodiment, the user push module 30 is also used to collect the signal strength of the owner's smart key when it is detected that the owner has left the car and the result of the living thing detection in the car does not meet the preset conditions, and determine the distance the owner has left the car based on the signal strength of the owner's smart key; when the distance the owner has left the car is greater than the preset distance threshold, the car door is locked and a lock confirmation message is sent to the user end.

[0111] In one embodiment, the remote control module 40 is further configured to, when the user remote control instruction is a remote unlocking instruction, obtain a remote unlocking duration based on the remote unlocking instruction; and remotely control the vehicle based on the remote unlocking duration.

[0112] In one embodiment, the information acquisition module 10 is also used to obtain the number of leaving vehicle living reminders and the living reminder time interval; based on the number of leaving vehicle living reminders and the living reminder time interval, the leaving vehicle living reminder function is started to obtain in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information.

[0113] The remote control device based on in-vehicle live object detection provided by the present application adopts the remote control method based on in-vehicle live object detection in the above-mentioned embodiment, which can solve the technical problem of how to enhance the vehicle's ability to prevent safety risks during live object detection. Compared with the prior art, the beneficial effects of the remote control device based on in-vehicle live object detection provided by the present application are the same as the beneficial effects of the remote control method based on in-vehicle live object detection provided by the above-mentioned embodiment, and the other technical features of the remote control device based on in-vehicle live object detection are the same as the features disclosed in the above-mentioned embodiment method, which will not be repeated here.

[0114] The present application provides a remote control device based on in-vehicle living thing detection, and the remote control device based on in-vehicle living thing detection includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the remote control method based on in-vehicle living thing detection in the above-mentioned embodiment one.

[0115] Reference below Figure 4 , which shows a schematic diagram of the structure of a remote control device based on in-vehicle live object detection suitable for implementing the embodiment of the present application. The remote control device based on in-vehicle live object detection in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The remote control device based on in-vehicle living thing detection shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0116] like Figure 4As shown, the remote control device based on in-vehicle living thing detection may include a processing device 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the remote control device based on in-vehicle living thing detection are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems may be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 may allow the remote control device based on in-vehicle live object detection to communicate wirelessly or wired with other devices to exchange data. Although the figure shows a remote control device based on in-vehicle live object detection with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.

[0117] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0118] The remote control device based on in-vehicle live object detection provided by the present application adopts the remote control method based on in-vehicle live object detection in the above-mentioned embodiment, which can solve the technical problem of how to enhance the vehicle's ability to prevent safety risks during live object detection. Compared with the prior art, the beneficial effects of the remote control device based on in-vehicle live object detection provided by the present application are the same as the beneficial effects of the remote control method based on in-vehicle live object detection provided by the above-mentioned embodiment, and the other technical features of the remote control device based on in-vehicle live object detection are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0119] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0120] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0121] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the remote control method based on in-vehicle living thing detection in the above-mentioned embodiment.

[0122] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0123] The computer-readable storage medium may be included in the remote control device based on in-vehicle living thing detection; or may exist independently without being assembled into the remote control device based on in-vehicle living thing detection.

[0124] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by a remote control device based on in-vehicle living thing detection, the remote control device based on in-vehicle living thing detection: obtains in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information and entertainment device status information; determines an in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information; when the in-vehicle living thing detection result meets a preset condition, pushes an in-vehicle living thing reminder message and a user control interface to a user terminal according to the in-vehicle living thing detection result, so that the user terminal feeds back a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface; and remotely controls the vehicle in response to the user remote control instruction.

[0125] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0126] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0127] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0128] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned remote control method based on in-vehicle living thing detection, and can solve the technical problem of how to enhance the vehicle's safety risk prevention capabilities during the process of living thing detection. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the remote control method based on in-vehicle living thing detection provided by the above-mentioned embodiment, and will not be repeated here.

[0129] The present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the above-mentioned remote control method based on in-vehicle living thing detection.

[0130] The computer program product provided by this application can solve the technical problem of how to enhance the safety risk prevention capability of a vehicle during the process of detecting living things. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the remote control method based on in-vehicle living thing detection provided by the above embodiment, and will not be elaborated here.

[0131] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A remote control method based on in-vehicle living thing detection, characterized in that: The in-vehicle living thing detection and remote control method comprises: Obtain in-car camera information, in-car sound source detection information, seat pressure detection information, and entertainment device status information; Determine the in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information; When the in-vehicle living thing detection result meets a preset condition, a in-vehicle living thing reminder message and a user control interface are pushed to a user terminal according to the in-vehicle living thing detection result, so that the user terminal feeds back a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface; In response to the user remote control instruction, the vehicle is remotely controlled.

2. The method according to claim 1, characterized in that The step of determining the living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information comprises: Determine whether there is a living thing in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information, and the entertainment device status information, and obtain a living thing presence detection result; When the in-vehicle living being detection result indicates that a living being exists in the vehicle, in-vehicle living being detection source information is obtained, and the living being presence detection result carrying the in-vehicle living being detection source information is used as the in-vehicle living being detection result, wherein the in-vehicle living being detection source information includes at least one of living being visual information, living being sound source information, living being seat information and the entertainment device status information.

3. The method according to claim 1, characterized in that The step of pushing a vehicle-based living thing reminder message and a user control interface to a user terminal according to the vehicle-based living thing detection result when the vehicle-based living thing detection result meets a preset condition includes: When the in-vehicle living thing detection result meets a preset condition, determining a living thing reminder type according to the in-vehicle living thing detection signal source information; According to the living thing reminder type, an in-vehicle living thing reminder message and a user control interface are pushed to the user terminal.

4. The method according to claim 3, characterized in that The step of pushing the in-vehicle living thing reminder message and the user control interface to the user terminal according to the living thing reminder type includes: Generate an in-vehicle living thing reminder message and a remote control option according to the living thing reminder type, wherein the remote control option includes at least two of an in-vehicle camera viewing option, a door control option, an in-vehicle speaker control option, an entertainment device control option, and an alarm control option; determining a user control interface according to the remote control; The in-vehicle living thing reminder message and the user control interface are pushed to the user terminal.

5. The method according to claim 1, characterized in that After the step of determining the in-vehicle living thing detection result according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information, the step further includes: When it is detected that the owner has left the car and the result of the detection of living things in the car does not meet the preset conditions, the signal strength of the owner's smart key is collected, and the distance of the owner from the car is determined according to the signal strength of the owner's smart key; When the distance between the vehicle owner and the vehicle is greater than a preset distance threshold, the vehicle door is locked and a locking confirmation message is sent to the user terminal.

6. The method according to claim 1, characterized in that The step of remotely controlling the vehicle in response to the user remote control instruction includes: When the user remote control instruction is a remote unlocking instruction, acquiring a remote unlocking duration based on the remote unlocking instruction; The vehicle is remotely controlled based on the remote unlocking duration.

7. The method according to any one of claims 1 to 6, characterized in that: Before the step of obtaining in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information, the step further includes: Get the number of reminders of leaving the vehicle and the interval between reminders; The leaving-vehicle living thing reminder function is started based on the leaving-vehicle living thing reminder times and the leaving-vehicle living thing reminder time interval to obtain in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information.

8. A remote control device based on in-vehicle living thing detection, characterized in that: The device comprises: An information acquisition module is used to obtain in-vehicle camera information, in-vehicle sound source detection information, seat pressure detection information, and entertainment device status information; A living thing detection module, used to determine a living thing detection result in the vehicle according to the in-vehicle camera information, the in-vehicle sound source detection information, the seat pressure detection information and the entertainment device status information; A user push module, configured to push an in-vehicle living thing reminder message and a user control interface to a user terminal according to the in-vehicle living thing detection result when the in-vehicle living thing detection result meets a preset condition, so that the user terminal can feedback a user remote control instruction based on the in-vehicle living thing reminder message and the user control interface; The remote control module is used to respond to the user's remote control command and remotely control the vehicle.

9. A remote control device based on in-vehicle living thing detection, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the remote control method based on in-vehicle living thing detection as described in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the remote control method based on in-vehicle living thing detection as described in any one of claims 1 to 7 are implemented.

Images