Method and device for detecting and expelling intruding animals in vehicle, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses an in-vehicle invading animal detection and expelling method and device, electronic equipment and a storage medium, and the method comprises the steps: continuously detecting an in-vehicle animal invasion condition through a microphone, and obtaining a preliminary detection result, the in-vehicle animal invasion condition comprising whether there is animal invasion in a corresponding vehicle; on the basis of the preliminary detection result, carrying out supplementary detection on the in-vehicle animal invasion condition through visible light camera equipment to obtain a supplementary detection result; when the supplementary detection result is no animal invasion, whether the supplementary detection result is credible is evaluated, and when the evaluation result is uncredible, the in-vehicle animal invasion condition is verified and detected to obtain a verification detection result; and expelling the invading animal when the supplementary detection result or the verification detection result is that the animal invades. According to the embodiment of the invention, the invading animals in the vehicle can be detected, found and repelled in time.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method, device, electronic equipment and storage medium for detecting and driving away intruding animals in a vehicle. Background Art

[0002] When a vehicle forgets to close the window or opens the window to wait for a red light, various animals such as mice, cats, dogs, cockroaches, flies and mosquitoes may enter the vehicle. These animals may cause various problems in the vehicle: fecal odor, animal carcass decay odor, gnawing electronic components (such as wiring harnesses) to cause malfunctions, gnawing interior decoration, biting the driver and passengers, and spreading diseases. Currently, after the user discovers the animal, the user needs to use medicine or sticks to drive it away. However, because the user needs to take the initiative to discover it, it is often too late, and the animal may have multiplied in large numbers, causing damage or loss. Summary of the invention

[0003] The embodiments of the present invention provide a method, device, electronic device and storage medium for detecting and driving away animals invading a vehicle, which can detect and drive away animals invading a vehicle in a timely manner.

[0004] In a first aspect, an embodiment of the present invention provides a method for detecting and removing intruding animals in a vehicle, comprising:

[0005] Continuously detecting the intrusion of animals in the vehicle by a microphone to obtain a preliminary detection result, wherein the intrusion of animals in the vehicle includes whether there is an intrusion of animals in the corresponding vehicle;

[0006] Based on the preliminary detection result, a supplementary detection is performed on the animal intrusion situation in the vehicle by using a visible light camera device to obtain a supplementary detection result;

[0007] When the supplementary detection result is that there is no animal intrusion, evaluating whether the supplementary detection result is credible, and when the evaluation result is unreliable, performing a verification test on the animal intrusion situation in the vehicle to obtain a verification test result; and

[0008] When the supplementary detection result or the verification detection result indicates that there is animal invasion, the invading animal is driven away.

[0009] In a second aspect, an embodiment of the present invention provides a method including:

[0010] A preliminary detection module, used to continuously detect the intrusion of animals in the vehicle through a microphone to obtain a preliminary detection result, wherein the intrusion of animals in the vehicle includes whether there is an animal intrusion in the corresponding vehicle;

[0011] A supplementary detection module, used for performing supplementary detection on the animal intrusion situation in the vehicle through a visible light camera device based on the preliminary detection result to obtain a supplementary detection result;

[0012] A verification detection module, used to evaluate whether the supplementary detection result is credible when the supplementary detection result is no animal intrusion, and to perform a verification detection on the animal intrusion situation in the vehicle to obtain a verification detection result when the evaluation result is unreliable; and

[0013] The expelling module is used to expel invading animals when the supplementary detection result or the verification detection result indicates that there is animal invasion.

[0014] In a third aspect, an embodiment of the present invention further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a method for detecting and removing intrusive animals in a vehicle as described in any one of the embodiments of the present invention is implemented.

[0015] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for detecting and removing intruding animals in a vehicle as described in any one of the embodiments of the present invention.

[0016] The embodiments of the present invention provide a method, device, electronic device and storage medium for detecting and expelling intrusive animals in a vehicle. First, a low-cost microphone is used to continuously detect intrusion of animals in the vehicle, so that preliminary detection results can be obtained in real time at a low cost. Then, supplementary detection of intrusion of animals in the vehicle is performed based on the preliminary detection results, so as to further improve the accuracy of detection. In addition, the embodiments of the present invention evaluate whether the supplementary detection results are credible when the supplementary detection results are no animal intrusion, and verify the intrusion of animals in the vehicle when the evaluation results are unreliable, so as to further improve the detection accuracy, avoid missed detection, ensure timely detection and expel intrusive animals in the vehicle, and avoid the intrusive animals from multiplying in large numbers or causing damage and loss. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solution of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a flow chart of a method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention;

[0019] Figure 2 is another flow chart of the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention;

[0020] Figure 3is another flow chart of the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention;

[0021] Figure 4 is another flow chart of the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention;

[0022] Figure 5 is another flow chart of the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention;

[0023] Figure 6 is another flow chart of the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention;

[0024] Figure 7 1 is a schematic diagram of the structure of a device for detecting and repelling intruding animals in a vehicle provided by an embodiment of the present invention;

[0025] Figure 8 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] Figure 1A flowchart of a method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention is provided. The method can be performed by a device for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention. The device can be implemented in software and / or hardware. In a specific embodiment, the device can be integrated into an electronic device, such as a computer, a server, etc. The following embodiments will be described by taking the device integrated into an electronic device as an example. Figure 1 , the method may specifically include the following steps:

[0029] Step 101, the microphone is used to continuously detect the intrusion of animals in the vehicle to obtain a preliminary detection result, and the intrusion of animals in the vehicle includes whether there is an animal intrusion in the corresponding vehicle. This step can obtain the preliminary detection result of the intrusion of animals in the vehicle in real time at a low cost, which is conducive to supplementary detection based on the preliminary detection result to obtain the real situation of the intrusion of animals in the vehicle in a timely manner.

[0030] Optionally, the in-vehicle animal intrusion situation also includes the category of the intruding animal when there is an animal intrusion.

[0031] Optionally, the invading animal categories include: animals that can be automatically driven away and animals that cannot be automatically driven away.

[0032] Specifically, the animals that can be automatically driven away may include, for example, insects such as cockroaches, flies and mosquitoes.

[0033] Specifically, the animals that cannot be automatically driven away may include, for example, small mammals such as cats, dogs and mice.

[0034] Optionally, the above-mentioned invasive animal categories further include specific types of invasive animals, for example, specific animal types such as cats, dogs, mice, cockroaches, etc.

[0035] Optionally, the above process of continuously detecting animal intrusion in the vehicle through a microphone to obtain preliminary detection results includes: acquiring real-time sound data corresponding to the interior environment of the vehicle through a microphone; judging whether there is animal intrusion in the corresponding vehicle based on pre-stored background noise data and various activity sound data such as biting, flying and crawling of possible invading animals.

[0036] Specifically, the animal category of the invading animal may also be determined based on the activity sound data corresponding to different categories of animals.

[0037] Step 102: Based on the preliminary detection result, a supplementary detection is performed on the intrusion of animals in the vehicle by using a visible light camera to obtain a supplementary detection result. This step can improve the accuracy of the intrusion detection of animals in the vehicle, so as to obtain the real situation of the intrusion of animals in the vehicle in a timely manner.

[0038] Optionally, the above-mentioned process of obtaining supplementary detection results by performing supplementary detection on the animal intrusion situation in the vehicle through the visible light camera equipment based on the preliminary detection results includes: determining the start time of the camera equipment based on whether the preliminary detection result is animal intrusion, and starting the camera equipment at the corresponding time to perform supplementary detection on the animal intrusion situation in the vehicle.

[0039] Optionally, when the preliminary detection result is that there is an animal intrusion, the current time is determined as the start-up time of the camera device, and the camera device is immediately activated to perform supplementary detection on the animal intrusion situation in the vehicle to obtain a supplementary detection result.

[0040] Optionally, when the preliminary detection result is that there is no animal intrusion, the camera device startup time can be determined based on a pre-set supplementary detection rule, and the camera device can be activated at the corresponding time to perform supplementary detection of animal intrusion in the vehicle to obtain a supplementary detection result. The above-mentioned supplementary detection rule can, for example, determine the time when the light in the vehicle is the best as the camera device startup time.

[0041] Optionally, the above-mentioned process of performing supplementary detection on the animal intrusion situation in the vehicle by using the visible light camera equipment to obtain supplementary detection results includes: when the preliminary detection result is that there is animal intrusion, taking a visible light image of the vehicle interior environment by using the visible light camera equipment, and based on the corresponding visible light image of the vehicle interior environment, detecting again whether there is animal intrusion to obtain supplementary detection results.

[0042] Optionally, the above-mentioned process of supplementary detection of animal intrusion in the vehicle by visible light camera equipment to obtain supplementary detection results includes: when the preliminary detection result is that there is no animal intrusion, obtaining a visible light image of the vehicle interior environment by using the visible light camera equipment, and further supplementary detection based on the visible light image of the vehicle interior environment to determine whether there is animal intrusion in the corresponding vehicle to obtain a supplementary detection result.

[0043] Step 103, if the supplementary detection result is no animal intrusion, evaluate whether the supplementary detection result is credible, and if the evaluation result is unreliable, perform verification detection on the animal intrusion in the vehicle to obtain a verification detection result. This step can further improve the detection accuracy of animal intrusion in the vehicle and avoid missed detection.

[0044] Optionally, the above process of evaluating whether the supplementary detection result is credible when the supplementary detection result is no animal invasion includes: when the preliminary detection result is animal invasion and the supplementary detection result is no animal invasion, determining the evaluation result as unreliable.

[0045] It is understandable that when the visible light camera equipment captures visible light images of the vehicle's interior environment, there may be blind spots or insufficient light, which may cause the visible light image to miss information about invading animals. Therefore, when the preliminary detection result is that there is animal intrusion and the supplementary detection result is that there is no animal intrusion, the supplementary detection result will be determined to be unreliable, and further verification testing will be performed to avoid missed detection.

[0046] Optionally, the process of verifying the animal intrusion situation in the vehicle and obtaining the verification detection result when the evaluation result is unreliable includes: turning on the lights in the vehicle and re-detecting whether there is an animal intrusion in the vehicle through the above-mentioned visible light camera equipment, or releasing aromatherapy for a certain period of time to make the possible invading animals move and then re-detecting whether there is an animal intrusion in the vehicle through the above-mentioned visible light equipment.

[0047] Optionally, the process of performing verification detection on the intrusion of animals in the vehicle to obtain the verification detection result includes:

[0048] The infrared thermal image of the vehicle interior environment is obtained through infrared imaging camera equipment, and the animal intrusion situation in the vehicle is determined based on the corresponding infrared thermal image to obtain a verified detection result.

[0049] Optionally, the above process of determining the animal intrusion situation in the vehicle based on the corresponding infrared thermal image to obtain a verified detection result includes: determining whether there is an animal intrusion in the corresponding vehicle based on the corresponding infrared thermal image, and determining the category of the invading animal based on the infrared thermal image when there is an animal intrusion.

[0050] Specifically, the size and appearance characteristics of the invading animal can be determined based on the infrared thermal image, and the category of the invading animal can be determined based on the pre-stored size and appearance characteristics of various animals that may invade and the size and appearance characteristics of the invading animal.

[0051] It is understandable that the resources required to detect animal intrusion in the vehicle through infrared cameras are higher than those through visible light cameras. Therefore, verification testing through visible light cameras should be performed only when the supplementary detection results obtained through visible light cameras are unreliable, which can help reduce overall resource consumption.

[0052] Step 104, when the supplementary detection result or the verification detection result shows that there is an animal invasion, the invading animal is driven away. Based on steps 101 to 103, this step can ensure timely detection and expulsion of the invading animal in the vehicle, and prevent the invading animal from multiplying in large numbers or causing damage and loss.

[0053] Optionally, the above process of driving away intruding animals includes: determining a driving away strategy based on the operating status of the corresponding vehicle, and executing the driving away strategy to drive away the intruding animals.

[0054] Optionally, the process of driving away invading animals includes: determining a driving away strategy based on the category of the invading animals, and executing the driving away strategy to drive away the invading animals.

[0055] Optionally, the above process of driving away invading animals includes: automatically driving away invading animals and sending an intrusion notification to a user client, so that the user can be informed of the animal intrusion situation in the vehicle and determine the driving away strategy and driving away the invading animals.

[0056] The following further describes the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention. Figure 2 As shown, the following steps may be included:

[0057] Step 201, continuously detecting the intrusion of animals in the vehicle through a microphone to obtain a preliminary detection result, where the intrusion of animals in the vehicle includes whether there is an intrusion of animals in the corresponding vehicle.

[0058] Step 202, when the preliminary detection result is that there is an animal intrusion, immediately start the visible light camera device to obtain a visible light image of the corresponding vehicle interior environment, and determine the animal intrusion situation in the vehicle based on the corresponding visible light image to obtain a supplementary detection result.

[0059] Specifically, the number of the visible light camera may be one or more.

[0060] Specifically, the visible light camera may be a rotatable camera, and specifically may be a camera that can be rotated horizontally and vertically.

[0061] Optionally, the process of immediately starting the visible light camera device to acquire the visible light image of the corresponding in-vehicle environment includes: immediately starting the visible light camera device to capture and acquire the environment images of various areas in the vehicle.

[0062] Optionally, the above process of determining the animal intrusion situation in the vehicle based on the corresponding visible light image to obtain a supplementary detection result includes: re-detecting whether there is animal intrusion and the type of the intruding animal based on the corresponding visible light image.

[0063] Specifically, the process of re-detecting whether there is animal invasion and the category of invading animals based on the corresponding visible light image includes: re-detecting whether there is animal invasion and the category of invading animals based on pre-stored image feature information of various types of animals that may invade.

[0064] Optionally, the above process of detecting the category of the invading animal includes: determining the size information and / or appearance information of the invading animal based on the corresponding visible light image, and judging the category of the invading animal based on the size information and / or appearance information of the invading animal.

[0065] Specifically, when the preliminary detection result is that there is an animal invasion, a notification may be sent to the user to enable the user to operate and start the visible light camera.

[0066] Step 203, when the supplementary detection result is that there is no animal intrusion, it is evaluated whether the supplementary detection result is credible, and when the evaluation result is unreliable, a verification test is performed on the animal intrusion situation in the vehicle to obtain a verification test result.

[0067] Step 204, when the supplementary detection result or the verification detection result indicates that there is an animal invasion, the invading animal is driven away.

[0068] The embodiment of the present invention can immediately perform supplementary detection when the preliminary detection result indicates that there is an animal invasion, which can help improve the detection accuracy and facilitate the subsequent formulation of appropriate expulsion strategies to expel the invading animals in a timely manner based on the high-precision detection results.

[0069] The following further describes the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention. Figure 3 As shown, the following steps may be included:

[0070] Step 301, continuously detecting the intrusion of animals in the vehicle through a microphone to obtain a preliminary detection result, where the intrusion of animals in the vehicle includes whether there is an intrusion of animals in the corresponding vehicle.

[0071] Step 302, when the preliminary detection result is no animal intrusion, periodically start the visible light camera device based on the supplementary detection cycle to obtain visible light images of the corresponding vehicle interior environment, and determine the animal intrusion situation in the vehicle based on the corresponding visible light images to obtain supplementary detection results.

[0072] Specifically, the above-mentioned supplementary detection cycle can be set according to user needs.

[0073] Specifically, multiple optional supplementary detection periods may be provided so that the user can select one as the above supplementary detection period, for example, 4 hours, 8 hours, 12 hours, 1 day, 3 days and 1 week may be provided as optional supplementary detection periods.

[0074] Specifically, the supplementary detection cycle may be determined based on the current season, weather, and other external environmental conditions. For example, when there are many insects on rainy days in summer, the supplementary detection cycle may be determined to be a shorter cycle to increase the frequency of supplementary detection.

[0075] Step 303, when the supplementary detection result is no animal intrusion, assess whether the supplementary detection result is credible, and when the assessment result is unreliable, perform a verification test on the animal intrusion situation in the vehicle to obtain a verification test result.

[0076] Step 304, when the supplementary detection result or the verification detection result indicates that there is an animal invasion, the invading animal is driven away.

[0077] The embodiments of the present invention can avoid continuous detection failure caused by equipment failure and the like, thereby avoiding missed detection and improving the accuracy of detecting animal intrusion in a vehicle.

[0078] The following further describes the method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention. Figure 4 As shown, Figure 1 Step 103 in the method may include the following steps:

[0079] Step 1031 , judging whether the light inside the vehicle is too dark based on the visible light image corresponding to the supplementary detection result.

[0080] Optionally, the process of judging whether the light inside the vehicle is too dark based on the visible light image corresponding to the supplementary detection result includes: judging whether the light inside the vehicle is too dark based on exposure parameter-related values ​​and / or image data-related values ​​of the corresponding visible light image.

[0081] Specifically, the above exposure parameter related values ​​may include, for example: an aperture value, a shutter speed and / or a sensitivity value, namely, an ISO value.

[0082] Specifically, the above-mentioned image data related values ​​may include, for example: average brightness value, gray value, and three primary color values, namely, RGB values.

[0083] It is understandable that the larger the aperture value corresponding to the captured image, the smaller the aperture, and the less light entering the camera. When other parameters remain unchanged, it may mean that the ambient light is dark and the aperture needs to be narrowed to control the exposure; a slower shutter speed, such as 1 / 30 second, 1 / 15 second or even slower, may be because the ambient light is dark and the camera needs a longer exposure to capture enough light; the higher the ISO value, the more sensitive the camera is to light. In a dark environment, it is usually necessary to increase the ISO to increase the exposure. When the ISO value reaches 800, 1600 or even higher, it is likely that the ambient light is dark.

[0084] In addition, if the average brightness value of the image is low, such as between 0-80 (value range 0-255), it may indicate that the ambient light is dim; if it is above 128, the light is usually sufficient; the grayscale value in the image can also reflect the light conditions. The grayscale value mainly reflects the brightness of the pixels in the image, and the range is generally 0-255, with 0 representing pure black and 255 representing pure white. If the grayscale values ​​of most pixels in the image are concentrated in the lower range, it means that the overall image is dark and the ambient light may be insufficient; each pixel of the image is composed of three color channels, RGB (red, green, and blue), and the value range of each channel is 0-255. When the values ​​of the three RGB channels are generally low, such as below 80, the image will appear darker, indicating that the ambient light is dim; if the values ​​are high and balanced, such as above 180, the light is usually good.

[0085] Therefore, it is determined whether the light inside the vehicle is too dark based on the exposure parameter-related values ​​and / or image data-related values ​​of the corresponding visible light image.

[0086] Step 1032: If the light inside the vehicle is determined to be too dark, the evaluation result is determined to be unreliable; otherwise, the evaluation result is determined to be reliable.

[0087] The embodiments of the present invention can help avoid missed detection caused by too dark light inside the vehicle when performing supplementary detection through a visible light camera device, thereby helping to improve the detection accuracy when detecting animal intrusion in the vehicle.

[0088] The following is a further description of a method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention.

[0089] Optionally, when the vehicle is in the start state, Figure 5 As shown, Figure 1 Step 104 in the method may include the following steps:

[0090] Step 104A1 : providing a plurality of optional strategies for a user of a corresponding vehicle on a corresponding client.

[0091] Specifically, the above-mentioned multiple optional strategies may be provided to the user by displaying an expulsion strategy selection interface.

[0092] Optionally, the above multiple optional strategies include: a strategy of driving away insects through specific audio, a strategy of driving away insects through specific smells, a strategy of driving away insects through specific light, a strategy of driving away insects through opening windows, a strategy of driving away insects through ventilation, a strategy of driving away insects through insect repellent aromatherapy, and a strategy of driving away insects manually.

[0093] Specifically, the above client may be a vehicle-mounted client or a mobile client.

[0094] Step 104A2, notifying the user to select from multiple optional strategies through in-car voice and client push.

[0095] Optionally, while notifying the user to select from a plurality of optional strategies through in-car voice and client push, the user is also notified of the category of the intruding animal in the car.

[0096] Step 104A3: Determine the expulsion strategy based on the user's selection result.

[0097] This step can enable the user to promptly drive away the invading animals according to his or her own preferences and concerns when the vehicle is in the start-up state and the user is using the corresponding vehicle, thereby improving the user experience.

[0098] It is understandable that when the vehicle is in the startup state, there is a high probability that someone is in the vehicle. Therefore, the user can be notified by voice in the vehicle to select an expulsion strategy at the same time as the client push occurs, so as to expel the intruding animals in time.

[0099] The following is a further description of a method for detecting and removing intruding animals in a vehicle provided by an embodiment of the present invention.

[0100] Optionally, when the vehicle is in the engine-off state, an expulsion strategy is determined based on the category of the intruding animal.

[0101] Optionally, the process of determining the expulsion strategy based on the category of the invading animal includes: when the category of the invading animal is an animal that cannot be automatically expelled, determining the expulsion strategy to notify the user by means of client push so that the user can expel the invading animal by himself.

[0102] It is understandable that animals that cannot be automatically driven away may be pets such as cats and dogs. After the user is notified through client push, the user can choose not to drive them away.

[0103] Optionally, the process of determining the expulsion strategy based on the category of the invading animal includes: when the category of the invading animal is an animal that can be automatically expelled, obtaining the expulsion strategy by obtaining a selection result selected by the user from a plurality of optional strategies in advance.

[0104] Optional, when the invading animal is an animal that can be automatically driven away, such as Figure 6 As shown, Figure 1 Step 104 in the method may include the following steps:

[0105] 104B1 , providing a plurality of optional strategies for a user of a corresponding vehicle on a corresponding client.

[0106] 104B2, notifying the user to select from multiple optional strategies through client push.

[0107] Optionally, while notifying the user to select from a plurality of optional strategies through client push, the user is also notified of the category of the intruding animal in the vehicle.

[0108] 104B3, determine the expulsion strategy based on the user's selection result.

[0109] The embodiments of the present invention can proactively and timely drive away intruding animals according to the user's preferences or concerns when the vehicle is in an ignition-off state and the user is not using the corresponding vehicle, thereby improving the user experience.

[0110] Figure 7 1 is a structural diagram of a vehicle intrusion animal detection and expulsion device provided by an embodiment of the present invention, and the device is suitable for executing the vehicle intrusion animal detection method provided by an embodiment of the present invention. Figure 7 As shown, the device may specifically include:

[0111] The preliminary detection module 701 is used to continuously detect the intrusion of animals in the vehicle through a microphone to obtain preliminary detection results, and the intrusion of animals in the vehicle includes whether there is an animal intrusion in the corresponding vehicle. The preliminary detection results of the intrusion of animals in the vehicle can be obtained in real time at a low cost, which is conducive to supplementary detection based on the preliminary detection results to obtain the real situation of the intrusion of animals in the vehicle in a timely manner.

[0112] Optionally, the in-vehicle animal intrusion situation also includes the category of the intruding animal.

[0113] Optionally, the invading animal categories include: animals that can be automatically driven away and animals that cannot be automatically driven away.

[0114] The supplementary detection module 702 is used to perform supplementary detection on the intrusion of animals in the vehicle through a visible light camera device based on the preliminary detection result to obtain supplementary detection results, which can improve the accuracy of intrusion detection on animals in the vehicle, so as to obtain the real situation of intrusion of animals in the vehicle in a timely manner.

[0115] Optionally, the supplementary detection module 702 can be specifically used to immediately start the visible light camera device to obtain a visible light image of the corresponding in-vehicle environment when the preliminary detection result is animal intrusion, and determine the animal intrusion situation in the vehicle based on the corresponding visible light image to obtain a supplementary detection result.

[0116] Optionally, the supplementary detection module 702 can be specifically used to, when the preliminary detection result is no animal intrusion, periodically start the visible light camera device based on the supplementary detection cycle to obtain visible light images of the corresponding in-vehicle environment, and determine the animal intrusion situation in the vehicle based on the corresponding visible light images to obtain supplementary detection results.

[0117] The verification detection module 703 is used to evaluate whether the supplementary detection result is credible when the supplementary detection result is no animal intrusion, and to perform verification detection on the animal intrusion in the vehicle to obtain a verification detection result when the evaluation result is unreliable. This can further improve the detection accuracy of the animal intrusion in the vehicle and avoid missed detection.

[0118] Optionally, the verification detection module 703 can be specifically used to determine whether the light inside the vehicle is too dark based on the visible light image corresponding to the supplementary detection result; if the light inside the vehicle is determined to be too dark, the evaluation result is determined to be unreliable, otherwise the evaluation result is determined to be credible.

[0119] Optionally, the verification detection module 703 can be specifically used to obtain an infrared thermal image of the vehicle interior environment through an infrared imaging camera device, and determine the animal intrusion situation in the vehicle based on the corresponding infrared thermal image to obtain a verification detection result.

[0120] The expelling module 704 is used to expel invading animals when the detection result is supplemented or verified. It can be combined with modules 701 to 703 to ensure timely detection and expulsion of invading animals in the vehicle to prevent invading animals from multiplying in large numbers or causing damage and losses.

[0121] Optionally, the expulsion module 704 can be specifically used to determine an expulsion strategy based on the operating status of the corresponding vehicle, and execute the expulsion strategy to expel the intruding animal.

[0122] Optionally, the above-mentioned expulsion module 704 can be specifically used to provide multiple optional strategies for the user of the corresponding vehicle in the corresponding client when the vehicle's operating state is the startup state; notify the user to choose from multiple optional strategies through in-vehicle voice and client push; and determine the expulsion strategy based on the user's selection result.

[0123] Optionally, the expulsion module 704 can be specifically used to determine an expulsion strategy based on the category of the intruding animal when the vehicle is in an ignition-off state.

[0124] Optionally, the above-mentioned expulsion module 704 can be specifically used to, when the category of the invading animal is an animal that can be automatically expelled, obtain the expulsion strategy by obtaining the selection result of the user in advance from multiple optional strategies, or provide multiple optional strategies for the user of the corresponding vehicle in the corresponding client; notify the user to select from multiple optional strategies by client push; and determine the expulsion strategy based on the user's selection result.

[0125] Optionally, the expelling module 704 can be specifically used to, when the category of the invading animal is an animal that cannot be automatically expelled, determine the expelling strategy as notifying the user through a client push so that the user can expel the invading animal by himself.

[0126] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example for illustration. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the functional modules described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0127] An embodiment of the present invention further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for detecting and removing intruding animals in a vehicle provided in any of the above embodiments is implemented.

[0128] An embodiment of the present invention further provides a computer-readable medium having a computer program stored thereon, and when the program is executed by a processor, the method for detecting and removing intruding animals in a vehicle provided in any of the above embodiments is implemented.

[0129] An embodiment of the present invention further provides a computer program product, including a computer program, which, when executed by a processor, implements the method for detecting and removing intruding animals in a vehicle as described in any one of the embodiments of the present invention.

[0130] Reference below Figure 8 , which shows a schematic diagram of the structure of a computer system 800 of an electronic device suitable for implementing an embodiment of the present invention. Figure 8 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0131] like Figure 8 As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage part 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the system 800 are also stored. The CPU 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0132] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed, so that a computer program read therefrom is installed into the storage section 808 as needed.

[0133] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processing unit (CPU) 801, the above-mentioned functions defined in the system of the present invention are executed.

[0134] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0135] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0136] The modules and / or units involved in the embodiments of the present invention may be implemented in software or hardware. The modules and / or units described may also be set in a processor. For example, they may be described as: a processor includes a preliminary detection module, a supplementary detection module, a verification detection module, and a drive-off module. The names of these modules do not, in some cases, constitute limitations on the modules themselves.

[0137] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device implements: continuously detecting the intrusion of animals in the vehicle through a microphone to obtain a preliminary detection result, and the intrusion of animals in the vehicle includes whether there is an animal intrusion in the corresponding vehicle; based on the preliminary detection result, supplementary detection of the intrusion of animals in the vehicle is performed through a visible light camera to obtain a supplementary detection result; when the supplementary detection result is no animal intrusion, evaluating whether the supplementary detection result is credible, and when the evaluation result is unreliable, verifying the intrusion of animals in the vehicle to obtain a verification detection result; and driving away the intruding animal when the supplementary detection result or the verification detection result is animal intrusion.

[0138] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for detecting and removing intruding animals in a vehicle, characterized in that: include: Continuously detecting the intrusion of animals in the vehicle by a microphone to obtain a preliminary detection result, wherein the intrusion of animals in the vehicle includes whether there is an intrusion of animals in the corresponding vehicle; Based on the preliminary detection result, a supplementary detection is performed on the animal intrusion situation in the vehicle by using a visible light camera device to obtain a supplementary detection result; When the supplementary detection result is that there is no animal intrusion, evaluating whether the supplementary detection result is credible, and when the evaluation result is unreliable, performing a verification test on the animal intrusion situation in the vehicle to obtain a verification test result; as well as When the supplementary detection result or the verification detection result indicates that there is animal invasion, the invading animal is driven away.

2. The method for detecting and removing intruding animals in a vehicle according to claim 1, characterized in that: The supplementary detection of the animal intrusion situation in the vehicle by using a visible light camera device based on the preliminary detection result to obtain a supplementary detection result includes: When the preliminary detection result is that there is an animal intrusion, immediately start the visible light camera device to obtain a visible light image of the corresponding vehicle interior environment, and determine the animal intrusion situation in the vehicle based on the corresponding visible light image to obtain the supplementary detection result; and / or When the preliminary detection result is that there is no animal intrusion, the visible light camera device is periodically started based on a supplementary detection cycle to obtain visible light images of the corresponding in-vehicle environment, and the animal intrusion situation in the vehicle is determined based on the corresponding visible light images to obtain the supplementary detection result.

3. The method for detecting and removing intruding animals in a vehicle according to claim 2, characterized in that: The evaluating whether the supplementary test result is credible includes: Determining whether the light inside the vehicle is too dark based on the visible light image corresponding to the supplementary detection result; If the light inside the vehicle is determined to be too dark, the evaluation result is determined to be unreliable; otherwise, the evaluation result is determined to be reliable.

4. The method for detecting and removing intruding animals in a vehicle according to claim 1, characterized in that: The verification test of the animal intrusion in the vehicle to obtain the verification test result includes: An infrared thermal image of the vehicle interior environment is acquired by an infrared imaging camera device, and the animal intrusion situation in the vehicle is determined based on the corresponding infrared thermal image to obtain the verification detection result.

5. The method for detecting and removing intruding animals in a vehicle according to claim 1, characterized in that: The method of driving away invading animals includes: A repelling strategy is determined based on the operating status of the corresponding vehicle, and the repelling strategy is executed to repel the intruding animal.

6. The method for detecting and removing intruding animals in a vehicle according to claim 5, characterized in that: The vehicle intrusion situation also includes the category of the intruding animal, and the expulsion strategy is determined based on the running state of the corresponding vehicle, including: When the running state of the vehicle is the startup state, providing a plurality of optional strategies for a user of the corresponding vehicle on the corresponding client; notifying the user to select from the plurality of optional strategies by means of in-vehicle voice and client push; and determining the expulsion strategy based on the selection result of the user; When the vehicle is in an ignition-off state, the expulsion strategy is determined based on the type of the intruding animal.

7. The method for detecting and removing intruding animals in a vehicle according to claim 6, characterized in that: The categories of invading animals include: animals that can be automatically driven away and animals that cannot be automatically driven away; and determining the driving away strategy based on the categories of the invading animals includes: When the category of the invading animal is an animal that can be automatically driven away, the driving away strategy is obtained by obtaining a selection result of the user pre-selected from the multiple optional strategies, or multiple optional strategies are provided to the user of the corresponding vehicle on the corresponding client; the user is notified to select from the multiple optional strategies by means of client push; and the driving away strategy is determined based on the selection result of the user; When the category of the invading animal is an animal that cannot be automatically driven away, the driving away strategy is determined to notify the user by means of client push so that the user can drive away the invading animal by himself.

8. A device for detecting and removing intruding animals in a vehicle, characterized in that: include: A preliminary detection module, used to continuously detect the intrusion of animals in the vehicle through a microphone to obtain a preliminary detection result, wherein the intrusion of animals in the vehicle includes whether there is an animal intrusion in the corresponding vehicle; A supplementary detection module, used for performing supplementary detection on the animal intrusion situation in the vehicle through a visible light camera device based on the preliminary detection result to obtain a supplementary detection result; A verification detection module is used to evaluate whether the supplementary detection result is credible when the supplementary detection result is no animal intrusion, and to perform a verification detection on the animal intrusion situation in the vehicle to obtain a verification detection result when the evaluation result is unreliable; as well as The expelling module is used to expel invading animals when the supplementary detection result or the verification detection result indicates that there is animal invasion.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the method for detecting and removing intruding animals in a vehicle as described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method for detecting and removing intruding animals in a vehicle as described in any one of claims 1 to 7 is implemented.

Images