Animal repelling method, device and system applied to vehicle

Through image and audio detection of the vehicle's surrounding environment and ultrasonic signals to drive away animals, the problem of animal interference during parking is solved, and simple and efficient discharging without a protective cover is achieved, reducing costs and operational complexity.

CN119018051APending Publication Date: 2024-11-26XG TECHNOLOGIES PTE LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411267375.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-07-30
Filing Date
2024-09-10
Publication Date
2024-11-26

Smart Images

  • Figure CN119018051A_ABST
    Figure CN119018051A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an animal repelling method, device and system applied to a vehicle, and the method comprises the steps: firstly, determining whether a stayable area of a first animal exists in a surrounding environment or not based on an image of the surrounding environment of the vehicle, if yes, determining whether the first animal exists in the stayable area or not based on the audio of the surrounding environment, and if yes, determining whether the first animal exists in the stayable area; if yes, a first ultrasonic signal used for repelling the first animal is determined and sent, and the first animal is repelled through the first ultrasonic signal. Through the scheme provided by the embodiment of the invention, the first animal can be repelled, and the interference of the first animal to the vehicle is reduced. According to the scheme, a protective cover does not need to be purchased, so that the cost for purchasing the protective cover does not need to be increased, a user does not need to disassemble and assemble the protective cover, and the operation is simple and convenient for the user. In addition, according to the scheme of the invention, whether the first animal exists in the parking area or not can be jointly determined in combination with the image of the surrounding environment of the vehicle and the audio of the surrounding environment, so that the accuracy is relatively high.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to a Chinese patent application filed with the State Intellectual Property Office on July 30, 2024, with application number 202411040560.X and invention name “A method, device and system for driving away animals for vehicles”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present disclosure relates to the field of vehicle control technology, and in particular to an animal driving away method, device and system applied to a vehicle. Background Art

[0003] When vehicles are parked on the street or in public areas such as open plots, they are sometimes disturbed by animals, for example, bird droppings may fall on the roof of the vehicle.

[0004] The interference of animals will seriously affect the experience of vehicle users. In order to reduce the interference of animals, users currently usually cover the vehicle with a protective cover when the vehicle is in the parked state.

[0005] However, this solution not only increases the cost of purchasing an additional protective cover, but also requires the user to install the protective cover every time the vehicle is parked, and to remove the protective cover before starting the vehicle, which is relatively cumbersome. Summary of the invention

[0006] In order to solve the above technical problems, the present disclosure provides an animal repelling method, device and system applied to a vehicle to reduce the cost of purchasing a protective cover and simplify the operation.

[0007] A first aspect of the present disclosure provides an animal driving away method applied to a vehicle, comprising:

[0008] Based on the image of the surrounding environment of the vehicle, determining whether there is an area in the surrounding environment where the first animal can stay;

[0009] If the stayable area exists, determining whether the first animal exists in the stayable area based on the audio of the surrounding environment;

[0010] If the first animal exists, a first ultrasonic signal for driving away the first animal is determined and sent.

[0011] A second aspect of the present disclosure provides an animal repelling device for a vehicle, comprising:

[0012] An area determination module, configured to determine whether there is an area where the first animal can stay in the surrounding environment based on an image of the surrounding environment of the vehicle;

[0013] an animal determination module, configured to determine whether the first animal exists in the stayable area based on the audio of the surrounding environment if the area determination module determines that the stayable area exists;

[0014] The signal determination module is used to determine and send a first ultrasonic signal for driving away the first animal if the animal determination module determines that the first animal exists.

[0015] According to a third aspect of the present disclosure, a computer-readable storage medium is provided, wherein the storage medium stores a computer program for executing the animal repelling method applied to a vehicle as described in the first aspect.

[0016] According to a fourth aspect of the present disclosure, an electronic device is provided, the electronic device comprising:

[0017] processor;

[0018] a memory for storing instructions executable by the processor;

[0019] The processor is used to read the executable instructions from the memory and execute the instructions to implement the animal repelling method applied to a vehicle as described in the first aspect above.

[0020] The solution provided by the embodiment of the present disclosure can drive away the first animal and reduce the interference of the first animal on the vehicle. In addition, since the solution does not require the purchase of a protective cover, there is no need to increase the cost of purchasing the protective cover. Moreover, the solution is executed by an electronic device and does not require the user to disassemble and install the protective cover, so the operation is relatively simple for the user.

[0021] In addition, the solution of the present disclosure can combine the image of the surrounding environment of the vehicle and the audio of the surrounding environment to jointly determine whether the first animal exists in the stayable area, so it has a higher accuracy.

[0022] Furthermore, the solution determines whether there is a stayable area for the first animal in the surrounding environment based on the audio of the surrounding environment, that is, a two-level determination mechanism is adopted. If there is no stayable area in the surrounding environment, it usually indicates that there is no first animal in the surrounding environment. In this case, the subsequent operation (i.e., the operation of determining whether there is a stayable area for the first animal based on the audio of the surrounding environment) may not be performed. The energy consumption in the process of determining whether there is a stayable area for the first animal in the surrounding environment is usually less than the energy consumption in the process of determining whether there is a stayable area for the first animal. Therefore, the solution provided by the embodiment of the present disclosure does not determine whether there is a stayable area for the first animal after determining that there is no stayable area in the surrounding environment, thereby reducing the waste of power consumption.

[0023] Moreover, the two-stage determination mechanism can improve the accuracy of determining whether the first animal exists, reduce the ineffective use of the first ultrasonic signal, and thus can reduce sound pollution.

[0024] Furthermore, after determining the existence of the first animal, the present invention drives away the first animal through a first ultrasonic signal. The first ultrasonic signal is usually an ultrasonic signal with a better effect of driving away the first animal. Therefore, it can not only improve the effect of driving away the first animal, but also avoid a large amount of sound pollution caused by blindly playing ultrasonic signals. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is an architectural diagram applicable to the present disclosure.

[0026] Figure 2 It is a flowchart of an animal driving away method applied to a vehicle provided by an exemplary embodiment of the present disclosure.

[0027] Figure 3 It is a flowchart of an animal driving away method applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0028] Figure 4 It is a flowchart of an animal driving away method applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0029] Figure 5 It is a flowchart of an animal driving away method applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0030] Figure 6 It is a flowchart of an animal driving away method applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0031] Figure 7 It is a flowchart of an animal driving away method applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0032] Figure 8 It is a flowchart of an animal driving away method applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0033] Fig. 9 It is a schematic structural diagram of an animal repelling device applied to a vehicle provided by an exemplary embodiment of the present disclosure.

[0034] Fig.10 2 is a schematic structural diagram of an animal repelling device applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0035] Fig.11 2 is a schematic structural diagram of an animal repelling device applied to a vehicle provided by another exemplary embodiment of the present disclosure.

[0036] Fig.12 is a structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0037] To explain the present disclosure, example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. It should be understood that the present disclosure is not limited to the example embodiments.

[0038] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0039] Application Overview

[0040] As a flexible and comfortable means of transportation, vehicles have been widely used. Among them, vehicles usually include two basic states, namely parking state and driving state. The parking state refers to the state in which the vehicle is stationary, for example, when the vehicle is parked in a parking lot, on the street or in an open community, the vehicle is in the parking state.

[0041] When the vehicle is parked, it may be disturbed by animals. For example, if the vehicle is parked on the side of the street, the droppings of birds resting on the trees on the side of the street may fall on the roof of the vehicle. This will not only affect the user experience in the vehicle, but also interfere with the user's vision if the droppings fall on the windshield.

[0042] In order to reduce the interference of animals to vehicles, currently users usually cover the vehicle with a protective cover when the vehicle is in a parking state, so that the vehicle is protected from interference by animals through the protective cover.

[0043] However, this solution not only increases the cost of purchasing an additional protective cover, but also requires the user to install the protective cover every time the vehicle is parked, and to remove the protective cover before starting the vehicle, which is relatively cumbersome.

[0044] In order to solve the above-mentioned problem, the present disclosure provides an animal repelling method applied to a vehicle, which can not only repel animals and keep them away from the vehicle to prevent the vehicle from being disturbed by the animals, but also does not require a protective cover to be provided for the vehicle, so there is no need to disassemble and assemble the protective cover, and accordingly there is no problem of cumbersome operation caused by disassembling and assembling the protective cover.

[0045] Exemplary Systems

[0046] The embodiments of the present disclosure may be applied to application scenarios where animals in the surrounding environment of a vehicle need to be driven away to prevent the animals from interfering with the vehicle.

[0047] In a feasible implementation, the electronic device to which the embodiments of the present disclosure are applied may include a vehicle, etc., and the electronic device is provided with a visual sensor, through which an image of the surrounding environment of the vehicle is captured, or the electronic device may interact with the visual sensor through a wired connection and / or a wireless connection to obtain an image of the surrounding environment of the vehicle transmitted by the visual sensor. Exemplarily, the visual sensor may include at least one of a camera, a still camera, and a video recorder, wherein if the electronic device is a vehicle, the visual sensor may include a vehicle-mounted camera. Of course, the visual sensor may also include other devices with image acquisition functions, which is not limited by the present disclosure.

[0048] Furthermore, the electronic device may be provided with a sound sensor, through which the audio of the surrounding environment is collected, or the electronic device may interact with the sound sensor through a wired connection and / or a wireless connection to obtain the audio of the surrounding environment of the vehicle collected by the sound sensor. Exemplarily, the sound sensor includes at least one of a microphone, a microphone array, a voice recorder, and a voice recorder, wherein if the electronic device is a vehicle, the sound sensor may include a vehicle-mounted microphone array. Of course, the sound sensor may also include other devices with audio collection functions, which is not limited in the present disclosure.

[0049] Further, the electronic device may also be provided with an ultrasonic sounder, or may interact with the ultrasonic sounder via a wired connection and / or a wireless connection to send an ultrasonic signal to the ultrasonic sounder. Exemplarily, if the electronic device is a vehicle, the ultrasonic sounder may include a vehicle-mounted ultrasonic sounder.

[0050] The electronic device uses the solution provided by the embodiment of the present disclosure to determine whether there is a first animal that needs to be driven away based on the image and audio of the surrounding environment, and if so, determines a first ultrasonic signal for driving away the first animal, and sends the first ultrasonic signal through an ultrasonic sounder, thereby driving away the first animal through the first ultrasonic signal.

[0051] In another possible implementation, see Figure 1 As shown in the schematic diagram of the structure, the electronic device may be a vehicle-mounted terminal 001 in a vehicle, and the vehicle is provided with a vehicle-mounted camera 002 as a visual sensor, a microphone array 003 as a sound sensor, and an ultrasonic sounder 004. Accordingly, the vehicle-mounted terminal 001 may interact with the vehicle-mounted camera 002, the microphone array 003, and the ultrasonic sounder 004 in a wired manner and / or wireless manner.

[0052] The vehicle-mounted terminal 001 can obtain images of the surrounding environment captured by the vehicle-mounted camera 002 based on the interaction with the vehicle-mounted camera 002, and obtain audio of the surrounding environment collected by the microphone array 003 based on the interaction with the microphone array 003, and based on the scheme provided by the embodiment of the present disclosure, determine whether there is a first animal through the image and audio, and if there is, the vehicle-mounted terminal 001 determines a first ultrasonic signal and transmits the first ultrasonic signal to the ultrasonic sounder 004, so that the ultrasonic sounder 004 sends the first ultrasonic signal after receiving the first ultrasonic signal, thereby driving away the first animal through the first ultrasonic signal.

[0053] Alternatively, in another feasible implementation, at least one of the visual sensor, the sound sensor, and the ultrasonic sounder may be independent of the vehicle, that is, not set on the vehicle, and the vehicle-mounted terminal executes the animal repelling method applied to the vehicle provided by the embodiment of the present disclosure. For example, the visual sensor may be a surveillance camera set in the surrounding environment of the vehicle.

[0054] In this case, the vehicle-mounted terminal 001 can also receive images of the surrounding environment taken by the visual sensor, and receive audio collected by the sound sensor, and when it is determined that there is a first animal, transmit the first ultrasonic signal used to drive away the first animal to the ultrasonic sounder, and the ultrasonic sounder sends the first ultrasonic signal to drive away the first animal.

[0055] Alternatively, in another feasible implementation, the animal repelling method applied to a vehicle provided by an embodiment of the present disclosure is executed by a server independent of the vehicle, and the server may be arranged around the vehicle, or the server may be a remote server. The server receives an image of the surrounding environment of the vehicle transmitted by a visual sensor, and receives audio collected by a sound sensor, and when it is determined that there is a first animal, transmits a first ultrasonic signal for repelling the first animal to an ultrasonic sounder, and the ultrasonic sounder sends the first ultrasonic signal.

[0056] Of course, the solution provided in the embodiments of the present disclosure may also be applied to other architectures, and the present disclosure is not limited to this.

[0057] Exemplary Methods

[0058] Figure 2 FIG. 1 is a flow chart of an animal repelling method applied to a vehicle provided by an exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices, such as Figure 2 As shown, the following steps are included:

[0059] Step S201: Based on the image of the surrounding environment of the vehicle, determine whether there is an area in the surrounding environment where a first animal can stay.

[0060] The electronic device implementing this embodiment may be provided with a visual sensor, or the electronic device may be connected to the visual sensor. After the visual sensor captures an image of the surrounding environment of the vehicle, the electronic device may obtain the image and determine based on the image whether there is an area in the surrounding environment where the first animal can stay.

[0061] In a feasible implementation, the first animal may include a bird, and the droppings of the bird may fall on the roof and / or windshield of the vehicle, thereby affecting the user experience, blocking the user's sight, and causing interference to the vehicle user. In this case, the area where the first animal can stay may include trees and / or electric poles above the vehicle. If it is determined based on the image recognition result that there are trees and / or electric poles above the vehicle, the electronic device determines that there is an area where the first animal can stay in the surrounding environment.

[0062] In addition, in this implementation, the visual sensor can be set on the roof and take images above the roof. After receiving the image of the surrounding environment taken by the visual sensor, the electronic device can determine the distance between the object and the roof and the effective horizontal projection area of ​​the object on the roof according to the focal length of the visual sensor and the size of the object included in the image in the image, and judge whether the object is a stayable area such as a tree and / or a telephone pole. Among them, the height of the tree and / or the telephone pole is usually within a certain height range, and the height of the vehicle is also within a certain height range. If the difference between the height of the tree and / or the telephone pole determined according to these two height ranges and the height of the vehicle is consistent with the distance between the object and the roof, and the shape and / or area of ​​the effective horizontal projection area is consistent with the projection area of ​​the tree and / or the telephone pole, then it can be determined that the object in the image is a stayable area such as a tree and / or the telephone pole, and accordingly it can be determined that there is a stayable area for the first animal in the surrounding environment.

[0063] In another feasible implementation, the first animal may include a walking animal (such as a puppy and / or a kitten, etc.), and the chassis area of ​​the vehicle is a disturbed area. Walking animals may spray urine on the tires of the vehicle, accelerating the aging of the tires. In this case, the area where the first animal can stay may include roads and / or lawns around the vehicle. If it is determined based on the image recognition result that there are roads and / or lawns around the vehicle, the electronic device determines that there is an area where the first animal can stay in the surrounding environment.

[0064] In this implementation, the visual sensor can capture images near the chassis of the vehicle. After receiving the image of the surrounding environment captured by the visual sensor, the electronic device can determine the type of object included in the image by performing image recognition on the image. If the object in the image includes a road and / or a lawn, etc., it can be determined that there is an area in the surrounding environment where the first animal can stay.

[0065] Of course, in actual scenarios, the first animal may also include other types of animals, and accordingly, the stayable area may also include other areas, which is not limited in the present disclosure.

[0066] If it is determined that there is a place where the first animal can stay in the surrounding environment, it indicates that the first animal may exist in the place where the first animal can stay. In this case, step S202 can be continued. In addition, if it is determined that there is no place where the first animal can stay in the surrounding environment, it indicates that the possibility of the first animal existing in the surrounding environment is small. In this case, the operation of step S202 can be terminated, and the operation of step S201 can be performed again after the vehicle stops at another location.

[0067] Step S202: If there is a stayable area, determine whether there is a first animal in the stayable area based on the audio of the surrounding environment.

[0068] Different animals make different calls, so in this step, it can be detected whether the audio includes the call of the first animal. If so, it can be determined that the first animal exists in the stayable area.

[0069] Step S203: if the first animal exists, determine and send a first ultrasonic signal for driving away the first animal.

[0070] After determining the first ultrasonic signal, the electronic device can send the first ultrasonic signal through the ultrasonic sounder to play the first ultrasonic signal, thereby driving away the first animal through the first ultrasonic signal.

[0071] The disclosed embodiment provides an animal repelling method applied to a vehicle. The method first determines whether there is an area in the surrounding environment where a first animal can stay based on an image of the surrounding environment of the vehicle. If there is an area in the surrounding environment, the method determines whether there is the first animal in the area based on the audio of the surrounding environment. If there is, a first ultrasonic signal for repelling the first animal is determined and sent, so as to repel the first animal by the first ultrasonic signal.

[0072] The solution provided by the embodiment of the present disclosure can drive away the first animal and reduce the interference of the first animal on the vehicle. In addition, since the solution does not require the purchase of a protective cover, there is no need to increase the cost of purchasing the protective cover. Moreover, the solution is executed by an electronic device and does not require the user to disassemble and install the protective cover, so the operation is relatively simple for the user.

[0073] In addition, the solution of the present disclosure can combine the image of the surrounding environment of the vehicle and the audio of the surrounding environment to jointly determine whether the first animal exists in the stayable area, so it has a higher accuracy.

[0074] Furthermore, the solution determines whether there is a stayable area for the first animal in the surrounding environment based on the audio of the surrounding environment, that is, a two-level determination mechanism is adopted. If there is no stayable area in the surrounding environment, it usually indicates that there is no first animal in the surrounding environment. In this case, the subsequent operation (i.e., the operation of determining whether there is a stayable area for the first animal based on the audio of the surrounding environment) may not be performed. The energy consumption in the process of determining whether there is a stayable area for the first animal in the surrounding environment is usually less than the energy consumption in the process of determining whether there is a stayable area for the first animal. Therefore, the solution provided by the embodiment of the present disclosure does not determine whether there is a stayable area for the first animal after determining that there is no stayable area in the surrounding environment, thereby reducing the waste of power consumption.

[0075] Moreover, the two-stage determination mechanism can improve the accuracy of determining whether the first animal exists, reduce the ineffective use of the first ultrasonic signal, and thus can reduce sound pollution.

[0076] Furthermore, after determining the existence of the first animal, the present invention drives away the first animal through a first ultrasonic signal. The first ultrasonic signal is usually an ultrasonic signal with a better effect of driving away the first animal. Therefore, it can not only improve the effect of driving away the first animal, but also avoid a large amount of sound pollution caused by blindly playing ultrasonic signals.

[0077] See also Figure 3 The workflow diagram shown in the figure, in another embodiment of the present disclosure, after determining that there is a stayable area, the following steps are also included:

[0078] Step S204: determining an activation threshold of the audio based on the audio of the surrounding environment and / or based on the battery life of the vehicle.

[0079] Step S205: determining whether the audio satisfies an activation condition based on the activation threshold, so as to determine whether the first animal exists in the stayable area if the audio satisfies the activation condition.

[0080] In which, usually when the energy of the audio is greater than or equal to the activation threshold, it is determined that the audio meets the activation condition. Exemplarily, the energy of the audio is characterized by the volume of the audio, and when the volume of the audio is greater than or equal to the volume corresponding to the activation threshold, it can be determined that the audio meets the activation condition.

[0081] Through the solution provided by the embodiment of the present disclosure, the audio activation threshold can be determined based on the audio of the surrounding environment and the battery life of the vehicle, and only when it is determined that the audio meets the activation condition based on the activation threshold can it be determined whether there is a first animal in the stayable area.

[0082] The embodiment of the present disclosure determines whether there is a first animal in the stayable area after determining that there is a stayable area for the first animal in the surrounding environment and the audio of the surrounding environment meets the activation conditions. That is, on the basis of the two-level determination mechanism, an operation of determining whether the audio of the surrounding environment meets the activation conditions is added. Therefore, it can be called a multi-level determination mechanism.

[0083] In the process of determining whether there is a first animal in the stayable area based on the audio of the surrounding environment, a large amount of power consumption is usually generated. Therefore, in the embodiment of the present disclosure, it is possible to first determine whether the audio meets the activation condition, and then determine whether there is a first animal in the stay area if the activation condition is met. Correspondingly, if the audio of the surrounding environment does not meet the activation condition, it is not necessary to determine whether there is a first animal in the stay area, thereby saving energy consumption.

[0084] In addition, through the multi-level determination mechanism disclosed in the present invention, only when it is determined that there is an area where the first animal can stay in the surrounding environment and it is determined that the audio of the surrounding environment meets the activation conditions, is it determined based on the audio of the surrounding environment whether there is the first animal in the area where the animal can stay, thereby further reducing the ineffective use of the first ultrasonic signal and reducing sound pollution.

[0085] In the above embodiment, a step of determining an audio activation threshold based on audio and / or the battery life of the vehicle is provided. In a feasible implementation of the embodiment of the present disclosure, the audio activation threshold may be determined based on audio, and the operation may include the following steps:

[0086] First, based on the frequency spectrum distribution of the audio, the type of the audio is determined, wherein the audio type includes stationary noise and non-stationary noise.

[0087] Steady-state noise refers to noise whose statistical characteristics (such as mean, variance, autocorrelation function, etc.) do not change over time, or change to a small extent. In the frequency domain distribution, the energy distribution of this steady-state noise is relatively uniform. Non-stationary noise is a type of noise whose statistical characteristics change greatly over time. In the frequency domain distribution, the energy distribution of this non-stationary noise usually changes over time, and its distribution is relatively uneven.

[0088] Therefore, in this step, the type of audio can be determined based on whether the frequency spectrum distribution of the audio is uniform, wherein if the frequency spectrum distribution of the audio in the surrounding environment is relatively uniform, the audio is steady-state noise, and if the frequency spectrum distribution of the audio is not very uniform, the audio is non-steady-state noise.

[0089] Then, if the type of the audio is steady-state noise, an activation threshold is determined based on a first parameter of the audio, where the first parameter includes at least one of the following: a full-band energy threshold (FBET) and a zero crossing rate (ZCR).

[0090] Full-band energy refers to the sum of the energy of the signal in all frequency ranges, which is usually obtained by calculating the power spectrum density of the signal and then integrating it in the entire frequency range. Full-band energy threshold is a threshold set for full-band energy. Usually, a sound signal is considered valid only when the full-band energy of the sound signal exceeds this threshold.

[0091] The zero-crossing rate is a parameter that describes how fast the signal waveform of a sound signal changes. It refers to the number of times the signal waveform crosses the zero axis per unit time.

[0092] In the embodiment of the present disclosure, if the audio in the surrounding environment is steady-state noise, the activation threshold can be determined based on the first parameter. According to the information included in the first parameter, the activation threshold can be determined in the following manner:

[0093] (Method 1) If the first parameter includes a full-band energy threshold, the activation threshold may be a full-band energy threshold;

[0094] In this case, if the full-band energy of the audio is greater than the full-band energy threshold, that is, if the audio is valid, it is determined that the audio meets the activation condition, thereby reducing the false detection rate.

[0095] (Method 2) If the first parameter includes a zero-crossing rate, a correspondence between different zero-crossing rates and different activation thresholds may be preset, and then the activation threshold of the audio of the surrounding environment is determined based on the zero-crossing rate of the audio of the surrounding environment and the correspondence;

[0096] Generally, in this corresponding relationship, the higher the zero-crossing rate is, the higher the activation threshold is, and the less likely the audio is to meet the activation condition, thereby increasing the difficulty of sending the first ultrasonic signal and reducing power consumption.

[0097] For example, the first animal is a bird, and the fundamental frequency of the bird's call is usually above 600Hz, and its zero-crossing rate is greater than 2*60 times / 100ms. If the zero-crossing rate of the audio in the surrounding environment is 2*60 times / 100ms, the corresponding activation threshold can be set to 75dB in the corresponding relationship; if the zero-crossing rate of the audio is 2*200 times / 100ms, the corresponding activation threshold can be set to 65dB in the corresponding relationship; if the zero-crossing rate of the audio is 2*600 times / 100ms, the corresponding activation threshold can be set to 60dB in the corresponding relationship.

[0098] Of course, the above correspondence between the zero-crossing rate of the audio and the activation threshold is only an example provided by the present disclosure. Other forms of correspondence may also be applied in practical applications, and the present disclosure does not limit this.

[0099] (Method 3) If the first parameter includes both the full-band energy threshold and the zero-crossing rate, the first activation threshold corresponding to the full-band energy threshold and the second activation threshold corresponding to the zero-crossing rate can be first determined, and then the activation threshold can be determined based on the first activation threshold and the second activation threshold, for example, the average of the first activation threshold and the second activation threshold can be determined as the activation threshold.

[0100] Of course, the first parameter may also include other types of parameters. Accordingly, the activation threshold may also be determined in other ways, which is not limited in the present disclosure.

[0101] In addition, if the type of the audio is non-steady-state noise, the probability that the audio includes the call of the first animal is determined by the first model, and the activation threshold is determined based on the probability.

[0102] The first model can receive the audio of the surrounding environment and determine the probability of the audio including the call of the first animal. Exemplarily, the first model can include a mixed Gaussian model and / or a small neural network (NN) model. Of course, the first model can also be other models that can determine the probability of the audio including the call of the first animal, which is not limited by the present disclosure.

[0103] In the disclosed embodiment, the correspondence between different probabilities and different activation thresholds can be preset, and then the activation threshold can be determined based on the correspondence and the probability that the audio of the surrounding environment includes the call of the first animal. In this correspondence, generally, the lower the probability that the audio includes the call of the first animal, the higher the corresponding activation threshold, and the less likely the audio is to meet the activation condition. Therefore, when the probability that the audio includes the call of the first animal is low, the difficulty of the audio meeting the activation condition is increased, which can increase the difficulty of sending the first ultrasonic signal and reduce power consumption.

[0104] Exemplarily, if the probability that the audio includes the call of the first animal is 0.5, then in the corresponding relationship, the corresponding activation threshold can be set to 75dB; if the probability that the audio includes the call of the first animal is 0.8, then in the corresponding relationship, the corresponding activation threshold can be set to 65dB; if the probability that the audio includes the call of the first animal is 0.95, then in the corresponding relationship, the corresponding activation threshold can be set to 60dB.

[0105] Of course, the above correspondence between the probability of the first animal's call and the activation threshold is only an example provided by the present disclosure. Other forms of correspondence may also be applied in practical applications, and the present disclosure does not limit this.

[0106] In another feasible implementation of the embodiment of the present disclosure, if the vehicle is a rechargeable vehicle (such as an electric car), and the electronic device executing the embodiment of the present disclosure includes a vehicle-mounted terminal of the vehicle, the activation threshold of the audio can be determined based on the battery life of the vehicle. This operation can be implemented by the following steps:

[0107] The activation threshold is determined based on the vehicle's endurance power and a first corresponding relationship, where the first corresponding relationship is used to indicate a corresponding relationship between the endurance power and the activation threshold.

[0108] Typically, in the first corresponding relationship, the lower the battery life, the higher the activation threshold corresponding to the battery life, and the higher the battery life, the lower the activation threshold corresponding to the battery life.

[0109] Exemplarily, if the battery life is 90%, then in the first correspondence, the corresponding activation threshold can be set to 60dB; if the battery life is 50%, then in the first correspondence, the corresponding activation threshold can be set to 70dB; if the battery life is 20%, then in the first correspondence, the corresponding activation threshold can be set to 80dB.

[0110] Of course, the above-mentioned first corresponding relationship is only an example provided by the present disclosure. Other forms of corresponding relationships may also be applied in practical applications, and the present disclosure does not limit this.

[0111] The electronic device may be provided with a memory, or may access a memory independent of the electronic device, and the first corresponding relationship may be stored in the memory.

[0112] When the battery life of the vehicle is low, the user of the vehicle often prefers to keep the battery life for driving rather than driving the animal away. Therefore, in the first corresponding relationship, the lower the battery life, the higher the activation threshold corresponding to the battery life. Therefore, when the battery life is low, the vehicle is less likely to be activated, and it is not easy to perform the operation of determining whether there is a first animal in the stayable area. Therefore, when the battery life of the vehicle is low, it is more difficult for the audio to meet the activation condition, so as to maintain the battery life of the vehicle.

[0113] In the above embodiment of the present disclosure, an operation of determining whether a first animal exists in the surrounding environment based on the audio of the surrounding environment is provided. In a feasible implementation, the operation may include the following steps:

[0114] Based on the audio and the second model, it is determined whether the first animal exists in the surrounding environment, and the second model is a model for detecting whether the audio includes the call of the first animal. The second model can receive the audio of the surrounding environment, detect whether the audio includes the call of the first animal, and output the corresponding detection result.

[0115] Exemplarily, the second model may include a sound detection model, which is a system for identifying and analyzing sound signals. Commonly used sound detection models may include convolutional recursive neural network models, deep belief network models, and recurrent neural network models, etc. Of course, the second model may also include other models, which are not limited in the present disclosure.

[0116] Through the feasible implementation scheme provided by the embodiment of the present disclosure, it is possible to determine whether the first animal exists in the surrounding environment based on the second model and the audio of the surrounding environment. Therefore, it is possible to combine the image, audio and second model of the surrounding environment to jointly determine whether the first animal exists in the surrounding environment, and accordingly, the accuracy of determining whether the first animal exists in the surrounding environment can be improved.

[0117] Alternatively, in another feasible implementation, based on the audio of the surrounding environment, the operation of determining whether the first animal exists in the surrounding environment may include the following steps:

[0118] If the light intensity of the surrounding environment is less than the light threshold, it is determined whether there is a first animal in the surrounding environment based on infrared imaging of the resident area, audio of the surrounding environment and a second model.

[0119] If the vehicle is in night or bad weather conditions, such as rainy weather, the illumination of the surrounding environment may be less than the illumination threshold. In this case, the electronic device can also obtain infrared imaging of the area where the vehicle can stay.

[0120] Among them, the electronic device may be provided with an infrared imaging sensor, or the electronic device may be connected to the infrared imaging sensor by wire and / or wirelessly, and accordingly, the electronic device may obtain infrared imaging taken by the infrared imaging sensor for the stayable area.

[0121] Generally speaking, the higher the temperature of an object, the stronger the infrared radiation it emits, and the infrared imaging sensor can detect this infrared radiation and convert it into electrical signals to generate an image. In this case, after the electronic device obtains the infrared image, it can determine whether the area photographed by the infrared imaging sensor includes a living body based on the infrared image.

[0122] In this step, if the electronic device determines that there is a living being in the stayable area based on infrared imaging, and determines that the audio includes the call of the first animal based on the audio and the second model, it can be determined that there is a first animal in the surrounding environment.

[0123] Through the feasible implementation scheme provided by the embodiment of the present disclosure, it is possible to combine infrared imaging, images of the surrounding environment, audio and the second model to jointly determine whether the first animal exists in the surrounding environment, which can further improve the accuracy of determining whether the first animal exists in the surrounding environment.

[0124] In step S203 of the present disclosure, the operation of determining and sending the first ultrasonic signal for driving away the first animal is disclosed. In order to improve the effect of driving away the first animal, see Figure 4 The workflow diagram shown in the figure can be achieved by following the steps below:

[0125] Step S2031, determining a second parameter of the first ultrasonic signal, where the second parameter includes at least one of the following: transmission direction, frequency, and transmission energy.

[0126] The transmission energy may include at least one of transmission power, signal amplitude and energy density, which is not limited in the present disclosure.

[0127] Step S2032: Send the first ultrasonic signal according to the second parameter.

[0128] If the first ultrasonic signal is sent in no specific direction, for example, the first ultrasonic signal is sent in a manner of changing direction at a constant speed within 360 degrees, it will cause omnidirectional sound pollution. In this case, the second parameter determined by the embodiment of the present disclosure may include the sending direction, so that in step S2032, the first ultrasonic signal can be sent in a specific sending direction to reduce sound pollution.

[0129] If the second parameter includes a transmission direction, illustratively, determining the second parameter of the first ultrasonic signal may include the following steps:

[0130] The sending direction of the first ultrasonic signal is determined based on the location of the stayable area and / or the sound positioning information of the audio indication.

[0131] Among them, the position of the allowed staying area can be determined by the shooting direction of the visual sensor and the position of the allowed staying area in the image of the vehicle's surrounding environment. Correspondingly, the sending direction of the first ultrasonic signal can be towards the position of the allowed staying area.

[0132] In addition, the sending direction of the first ultrasonic signal can also be determined by the sound localization information indicated by the audio. In this case, the sound localization information of the audio in the surrounding environment can be determined by the sound source localization technology, that is, the sound source position of the audio can be determined. The sound source localization technology can also be called sound source tracking technology or sound source detection technology, which can be used to determine the position of the sound source. In this case, the sending direction of the first ultrasonic signal can be toward the sound source position of the audio.

[0133] Furthermore, the sending direction of the first ultrasonic signal can also be determined based on the location of the stayable area and the sound positioning information indicated by the audio. In this case, when the location of the stayable area and the sound positioning information indicated by the audio point to the same location, the sending direction of the first ultrasonic signal is determined to be the location, and the location can be considered as the sound source location of the audio.

[0134] The sending direction of the first ultrasonic signal determined by this scheme is toward the sound source position of the audio. Sending the first ultrasonic signal according to this sending direction rather than sending the first ultrasonic signal without a specific direction can reduce sound pollution.

[0135] The same animal usually reacts differently to ultrasonic signals of different frequencies. Therefore, the second parameter determined in the embodiment of the present disclosure may include frequency, so as to drive away the first animal by an ultrasonic signal with a better driving-away effect.

[0136] If the second parameter includes a transmission frequency, illustratively, determining the second parameter of the first ultrasonic signal may include the following steps:

[0137] The first step is to determine the type of the first animal based on the vehicle's positioning information, the time period for sending the first ultrasonic signal and the second corresponding relationship. The second corresponding relationship is used to indicate the type of the first animal at at least one location in at least one time period. The time period for sending the first ultrasonic signal belongs to the time period included in the second corresponding relationship.

[0138] The vehicle may be positioned based on a global positioning system, an inertial navigation system and / or a satellite navigation system, and the positioning information of the vehicle may be determined, and the positioning information is used to indicate the location of the vehicle.

[0139] In addition, in the embodiment of the present disclosure, the electronic device may be provided with a memory, or the electronic device may access a memory independent of the electronic device, and the second correspondence may be stored in the memory. When it is necessary to determine the type of the first animal, the electronic device may obtain the second correspondence by querying the memory. The first correspondence and the second correspondence may be stored in the same memory or in different memories, which is not limited by the present disclosure.

[0140] There are differences in climate and ecological environment in different places and at different times, which may lead to different distribution types of the first animal. For example, in the south of my country, common birds in May and June include: orioles, thrushes and cuckoos, etc., while in the north of my country, common birds in May and June include: woodpeckers, larks and magpies, etc. In order to improve the effect of driving away the first animal, in the present disclosure, the type of the first animal can be determined based on the second corresponding relationship.

[0141] The time period for sending the first ultrasonic signal may be a time range, such as a time range consisting of May and June, or a season, etc. Correspondingly, the second corresponding relationship may include the types of the first animal distributed at multiple locations in multiple time periods, such as the types of the first animal distributed at different locations in summer and winter.

[0142] For example, the first animal is a bird, and the second correspondence may include the species of birds distributed in Northeast China in summer and winter, wherein the birds distributed in summer include the following species: yellow bittern, red-billed gull, house martin, pond heron, crested heron, Grebes, herons, common kingfishers, coots, whiskered gulls and Chinese sparrows; birds distributed in winter include the following species: tin-billed sparrow and snowy owl.

[0143] Of course, the above second corresponding relationship is only an example provided by the present disclosure. Other forms of corresponding relationships may also be applied in practical applications, and the present disclosure does not limit this.

[0144] In this case, based on the time period when the first ultrasonic signal needs to be sent, the positioning information of the vehicle and the second corresponding relationship, the type of the first animal distributed at the position of the vehicle during the time period when the first ultrasonic signal needs to be sent can be determined.

[0145] Exemplarily, if the second corresponding relationship conforms to the above example, the positioning information of the vehicle is in Northeast China, and the period for sending the first ultrasonic signal is winter, then based on the second corresponding relationship, it can be determined that the first animals distributed at the location of the vehicle include tin-billed sparrows and snowy owls.

[0146] In the second step, the frequency of the first ultrasonic signal is determined based on the type of the first animal and a third correspondence, wherein the third correspondence is used to indicate the frequency of the ultrasonic signal whose reliability exceeds a first threshold when driving away different types of first animals.

[0147] In the disclosed embodiment, different kinds of first animals can be driven away in advance by ultrasonic signals of different frequencies, and the reliability of each drive away can be recorded, and the third corresponding relationship can be determined accordingly. The reliability of each drive away can be a percentage value, which is used to indicate the ratio of the number of first animals successfully driven away to the total number of first animals. In this case, the first threshold value can also be a percentage value. If the reliability of an ultrasonic signal of a certain frequency exceeds the first threshold value, it indicates that when the first animals are driven away by the ultrasonic signal of this frequency, a larger number of first animals can be driven away, and a better driving effect can be achieved.

[0148] For example, the first animal includes birds, and the frequency of the ultrasonic signal used to drive away various birds is usually between 16kHz and 20kHz, which is beyond the hearing range of human ears, but is a strong stimulus to birds. Ultrasonic signals of this frequency will make birds feel uncomfortable, thereby achieving the effect of driving away birds. And, in this example, the first threshold is 50%.

[0149] However, different birds react differently to ultrasonic signals in the range of 16kHz to 20kHz. The first type of bird reacts more strongly to some ultrasonic signals in the range of 16kHz to 20kHz (e.g., 16kHz to 18kHz), which can have a better effect of driving away the first type of bird. When the first type of bird is driven away by the ultrasonic signal of this frequency, the reliability exceeds the first threshold, that is, the number of the first type of bird successfully driven away is greater than 50% of the total number of the first type of bird. The second type of bird reacts more strongly to another part of the ultrasonic signal (e.g., 18kHz to 19kHz), which can have a better effect of driving away the second type of bird. When the second type of bird is driven away by the ultrasonic signal of this frequency, the reliability exceeds the first threshold, that is, the number of the second type of bird successfully driven away is greater than 50% of the total number of the first type of bird. In this case, in the third corresponding relationship, it can be set that when driving away the first type of bird, the corresponding ultrasonic signal is the frequency of 16kHz to 18kHz, and when driving away the second type of bird, the corresponding ultrasonic signal is the frequency of 18kHz to 19kHz.

[0150] Of course, the above description is only an example, and the third corresponding relationship may also include other corresponding relationships, and the first threshold may also be other values, which is not limited in the present disclosure.

[0151] In addition, the third correspondence relationship may be stored in a memory provided in the electronic device, or the third correspondence relationship may be stored in a memory accessible to the electronic device and independent of the electronic device. Furthermore, the third correspondence relationship may be stored in the same memory as the first correspondence relationship and the second correspondence relationship, or may be stored in a different memory, which is not limited in the present disclosure.

[0152] In this case, the frequency of the first ultrasonic signal can be determined based on the type of the first animal and the third corresponding relationship. When the first ultrasonic signal is sent at the frequency of the first ultrasonic signal determined by this solution, it often has higher reliability and better repelling effect.

[0153] If the transmission energy of the first ultrasonic signal is low, the effect of driving away the first animal is poor, and if the transmission energy of the first ultrasonic signal is too high, it will lead to energy waste and may also interfere with animals far away from the vehicle. For example, if the first ultrasonic signal is stationed in a parking lot of a community, ideally, only the first animal in the parking lot needs to be driven away, but if the transmission energy of the first ultrasonic signal is too high, the first ultrasonic signal may also interfere with the first animal in other areas of the community (such as residential buildings in the community) during transmission.

[0154] In view of this situation, the second parameter determined by the embodiment of the present disclosure may include the transmission energy, so that the first ultrasonic signal can be transmitted according to the transmission energy. In a feasible implementation of the present disclosure, the operation of determining the second parameter of the first ultrasonic signal may include the following steps:

[0155] In the first step, the distance between the vehicle and the possible stay area is determined based on the imaging parameters of the visual sensor that captures the image and the area of ​​the possible stay area in the image.

[0156] The imaging parameters may include focal length, etc., which may be used to reflect the imaging range of the visual sensor during imaging. In addition, the distance between the stayable area and the vehicle may include the center distance and / or surface distance between the stayable area and the vehicle.

[0157] Among them, the center distance between the stayable area and the vehicle refers to the distance between the center point of the stayable area and the vehicle; the surface distance between the stayable area and the vehicle refers to the shortest straight-line distance between the stayable area and the vehicle.

[0158] Of course, the distance between the stopable area and the vehicle may also include other types of distances, which is not limited in the present disclosure.

[0159] In the second step, the transmission energy of the first ultrasonic signal is determined based on the distance between the resident area and the vehicle, the signal-to-noise ratio of the first ultrasonic signal, the noise energy of the audio, and the energy consumption of the first ultrasonic signal per unit distance.

[0160] This implementation method comprehensively considers the distance between the allowed staying area and the vehicle, the signal-to-noise ratio of the first ultrasonic signal, the noise energy of the audio, and the energy consumption of the first ultrasonic signal per unit distance when determining the sending energy of the first ultrasonic signal, thereby avoiding the problem of poor repelling effect caused by too small sending energy and avoiding the problem of interference to other animals caused by too large sending energy.

[0161] Exemplarily, the transmission energy of the first ultrasonic signal may include transmission power. In this case, the transmission power of the first ultrasonic signal may be determined by the following formula:

[0162] P = (Q + N + D) + 20 * log10 (L / 1);

[0163] Among them, P represents the transmission power of the first ultrasonic signal, L represents the distance between the stayable area and the vehicle, Q represents the signal-to-noise ratio of the first ultrasonic signal, N represents the noise energy of the audio, and D represents the energy consumption of the first ultrasonic signal per unit distance (for example, 1 meter).

[0164] In addition, L in the above formula may be the center distance between the stayable area and the vehicle, or the surface distance, or the average value between the center distance and the surface distance.

[0165] In this way, the transmission power of the first ultrasonic signal can be determined, and the formula takes into account the distance between the stayable area and the vehicle, the signal-to-noise ratio of the first ultrasonic signal, the noise energy of the audio, and the energy consumption of the first ultrasonic signal per unit distance when determining the transmission power. Therefore, the transmission power of the determined first ultrasonic signal can be within a reasonable range, avoiding the problem of poor repelling effect caused by too small transmission power and the problem of interference to other animals caused by too large transmission power.

[0166] Through the operation of step S202, it can be determined whether there is a first animal in the stayable area. In this case, see Figure 5 As shown in the workflow diagram, another embodiment of the present disclosure further includes the following steps:

[0167] Step S206: after determining that the first animal exists in the stayable area, determine the target location where the first animal exists based on the positioning information of the vehicle.

[0168] The target position is the position of the vehicle indicated by the positioning information of the vehicle.

[0169] Exemplarily, the determined target location may be stored in a database, which may be located in a memory provided in the electronic device, or in a memory that is accessible to the electronic device and is independent of the electronic device.

[0170] Step S207: When the vehicle travels to the vicinity of the target location, a first prompt information is displayed, and the first prompt information indicates that a first animal exists at the target location.

[0171] If the target location is stored in a database in step S206, the electronic device may periodically query the database during vehicle travel and determine whether the vehicle has traveled to the vicinity of the target location in combination with the environmental map.

[0172] After the vehicle leaves the target location, it may continue to drive in the direction of the target location. When the vehicle stops at the target location, it will be disturbed by the first animal. Therefore, in the embodiment of the present disclosure, when the vehicle drives to the vicinity of the target location, the first prompt information can be displayed to prompt the user of the vehicle that there is a first animal at the target location, so that the user can park the vehicle at a location other than the target location. In this case, the vehicle can be free from interference from the first animal, and there is no need to drive away the first animal through the first ultrasonic signal, which can reduce power consumption accordingly.

[0173] In the above-mentioned various embodiments of the present disclosure, a solution is provided for determining whether a first animal exists in a stayable area based on an image of a surrounding environment and an audio of the surrounding environment.

[0174] However, in some scenarios, the clarity of the image is low. For example, the lighting in the surrounding environment is poor, the vehicle is parked in bad weather such as rainy weather, or the visual sensor used to take the image is faulty. These may result in low image clarity, affecting the accuracy of determining whether there is a possible staying area based on the image of the surrounding environment, resulting in a high false detection rate.

[0175] In addition, in some scenarios, the volume of the audio in the surrounding environment may be relatively loud. In this case, it usually indicates that there is ambient noise with a relatively loud volume in the surrounding environment. This noise will interfere with the process of determining whether there is a first animal in the stayable area based on the audio, thereby reducing accuracy and causing a higher false detection rate.

[0176] In view of this situation, the present disclosure provides another embodiment, see Figure 6 The workflow diagram shown in FIG. 1 includes the following steps:

[0177] Step S208, before determining whether there is an area where the first animal can stay in the surrounding environment based on the image of the surrounding environment of the vehicle, determine whether the clarity of the image does not meet the clarity requirement, and / or, before determining whether there is an area where the first animal can stay in the surrounding environment based on the audio of the surrounding environment, determine whether the volume of the audio is greater than a volume threshold.

[0178] If it is determined that the clarity of the image meets the clarity requirement, an operation of determining whether there is a stayable area for the first animal in the surrounding environment based on the image of the surrounding environment of the vehicle (i.e., the operation of step S201) may be performed. In addition, if it is determined whether the volume of the audio is less than or equal to the volume threshold, an operation of determining whether there is a stayable area for the first animal based on the audio of the surrounding environment (i.e., the operation of step S202) may be performed. If the clarity of the image does not meet the clarity requirement and / or the volume of the audio is greater than the volume threshold, the operation of step S209 is performed.

[0179] Exemplarily, the clarity of the image can be measured by at least one image parameter of contrast, resolution, color depth and noise level. Accordingly, an image parameter threshold corresponding to the image parameter can be preset, and based on the comparison result between the image parameter and the corresponding image parameter threshold, it is determined whether the clarity of the image meets the clarity requirement. If the clarity of the image does not meet the clarity requirement, it indicates that the clarity of the image is low.

[0180] Of course, the clarity of an image may also be measured by other image parameters, which is not limited in the present disclosure.

[0181] In addition, if the volume of the audio in the surrounding environment is greater than the volume threshold, it indicates that the audio includes relatively loud environmental noise.

[0182] Step S209, determining the type of the first animal based on the positioning information of the vehicle, the time period during which the second ultrasonic signal needs to be sent, and the fifth corresponding relationship.

[0183] The fifth corresponding relationship is used to indicate the type of the first animal distributed at at least one location in at least one time period, and the time period during which the second ultrasonic signal needs to be sent belongs to the time period included in the fifth corresponding relationship.

[0184] Exemplarily, the second correspondence and the fifth correspondence may be different correspondences. Alternatively, the second correspondence and the fifth correspondence may be the same correspondence, and the time periods included in the correspondence include the time periods when the first ultrasonic signal needs to be sent and the time periods when the second ultrasonic signal needs to be sent. The correspondence may also be referred to as a first animal distribution database, which is used to characterize the distribution information of the first animal.

[0185] Step S210, determining the frequency of the second ultrasonic signal based on the type of the first animal and a sixth corresponding relationship, wherein the sixth corresponding relationship is used to indicate the frequency of the ultrasonic signal whose reliability exceeds a third threshold when driving away different types of first animals.

[0186] The third threshold value may be the same as or different from the first threshold value, and the present disclosure does not limit this. If the third threshold value is the same as the first threshold value, the third correspondence relationship and the sixth correspondence relationship may be the same correspondence relationship, which may also be referred to as the first animal repelling database, and is used to characterize the frequency of the ultrasonic signal that repelled the first animal.

[0187] Step S211, based on the battery life of the vehicle, determine the third parameter of the second ultrasonic signal, the third parameter including at least one of the following: transmission energy, transmission cycle and single transmission duration of each transmission cycle.

[0188] If the clarity of the image does not meet the clarity requirements and / or the volume of the audio is greater than the volume threshold, the result of determining whether the first animal exists in the stayable area based on the image and audio may have a large error. Therefore, in this embodiment, the first ultrasonic signal may no longer be determined, and the third parameter of the second ultrasonic signal may be determined based on the vehicle's endurance power.

[0189] The transmission energy in the third parameter may include at least one of transmission power, signal amplitude and energy density.

[0190] In this embodiment, generally, the more sufficient the battery life of the vehicle is, the higher the transmission energy is, the shorter the transmission cycle is, and the longer the single transmission duration of each transmission cycle is, so as to increase the transmission duration of the second ultrasonic signal and improve the effect of driving away the first animal. On the other hand, the lower the battery life of the vehicle is, the lower the transmission energy is, the longer the transmission cycle is, and the shorter the single transmission duration of each transmission cycle is, so as to reduce the transmission duration of the second ultrasonic signal and avoid wasting the battery life of the vehicle.

[0191] Step S212: Send a second ultrasonic signal according to the frequency of the second ultrasonic signal and the third parameter.

[0192] Through the operation of this embodiment, when the clarity of the image does not meet the clarity requirement and / or the volume of the audio is greater than the volume threshold, a second ultrasonic signal corresponding to the third parameter can be sent according to the vehicle's battery life, thereby avoiding large errors in determining whether there is a first animal in the stayable area based on the image and audio, thereby improving the removal effect.

[0193] In addition, if the third parameter includes transmission energy, and the transmission energy includes transmission power, in the process of transmitting the second ultrasonic signal according to the transmission power, if the transmission power is too high, it will cause a waste of ultrasonic signals and interfere with other animals other than the surrounding environment of the vehicle. If the transmission power is too low, it will lead to poor driving away effect. Therefore, if the third parameter includes transmission power, the embodiment of the present disclosure may also include the following steps:

[0194] Before determining the third parameter of the second ultrasonic signal, determine the minimum drive-away signal-to-noise ratio and the maximum drive-away signal-to-noise ratio of the second ultrasonic signal for driving away the first animal, wherein the first number is less than the second number, the first number being the number of types of first animals driven away when the second ultrasonic signal corresponding to the minimum drive-away signal-to-noise ratio is sent, and the second number being the number of types of first animals driven away when the second ultrasonic signal corresponding to the maximum drive-away signal-to-noise ratio is sent.

[0195] In the embodiment of the present disclosure, the lowest drive-away signal-to-noise ratio and the highest drive-away signal-to-noise ratio may be determined in advance through multiple experiments.

[0196] In this case, based on the battery life of the vehicle, the operation of determining the third parameter of the second ultrasonic signal may include the following steps:

[0197] The transmit power is determined based on the range of the battery life. The higher the range of the battery life, the greater the transmit power. The transmit power is greater than or equal to the minimum drive-away signal-to-noise ratio and less than or equal to the maximum drive-away signal-to-noise ratio. The transmit power is between the minimum drive-away signal-to-noise ratio and the maximum drive-away signal-to-noise ratio.

[0198] Through the solution provided by the embodiment of the present disclosure, the minimum drive-away signal-to-noise ratio and the maximum drive-away signal-to-noise ratio of the second ultrasonic signal are predetermined, and the transmission power is determined based on the range of the battery life. The determined transmission power is between the minimum drive-away signal-to-noise ratio and the maximum drive-away signal-to-noise ratio, thereby ensuring the drive-away effect and avoiding power consumption waste and interference to other animals caused by excessive sound power.

[0199] In another embodiment of the present disclosure, an odor sensor may also be used. In this case, the embodiment includes the following steps:

[0200] First, before sending the second ultrasonic signal corresponding to the third parameter, the odor sensor is used to detect whether the surrounding environment includes a target odor, and the target odor originates from the first animal. For example, if the first animal includes birds, and the feces of birds generally include components such as hydrogen sulfide, methyl mercaptan, acetone, and aromatic compounds, then the target odor may be the odor of components such as hydrogen sulfide, methyl mercaptan, acetone, and aromatic compounds.

[0201] Then, if the surrounding environment includes the target odor, a second ultrasonic signal is sent according to the third parameter.

[0202] If the surrounding environment includes the target odor, the possibility that the surrounding environment includes the first animal is high, and in this case, the second ultrasonic signal is sent according to the third parameter. In addition, if the surrounding environment does not include the target odor, the possibility that the surrounding environment includes the first animal is low, and the operation of sending the second ultrasonic signal according to the third parameter is no longer required, thereby avoiding the waste of the second ultrasonic signal.

[0203] Through the above embodiments of the present disclosure, the first animal that may interfere with the vehicle can be driven away when the vehicle is in a parking state. However, when the vehicle is in a driving state, it may still be interfered with by other animals. For example, when the vehicle is driving, birds and flying insects may fly onto the fender of the vehicle, affecting the vision of the user in the vehicle.

[0204] In view of this situation, the present disclosure provides another embodiment, see Figure 7 The workflow diagram shown in FIG. 1 includes the following steps:

[0205] Step S301, based on the positioning information of the vehicle and the time period in which the vehicle is located, determine a second animal that can fly to the tailgate of the vehicle.

[0206] The second animal may include flying insects and / or birds. Of course, the second animal may also include other animals, which is not limited in the present disclosure.

[0207] In this step, a correspondence between at least one time period and at least one location and the distributed animals may be predetermined, and then the second animal may be determined based on the correspondence.

[0208] Step S302: determining parameters of the third ultrasonic signal based on a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate a corresponding relationship between the parameters of the ultrasonic signal whose reliability exceeds a second threshold when driving away the second animal and the second animal.

[0209] Among them, the parameter may include at least one of the frequency, transmission energy and transmission cycle of the ultrasonic signal. In addition, if the parameter includes the transmission cycle, it may also include the single transmission duration of each transmission cycle. The transmission energy may include transmission power and / or amplitude, etc.

[0210] Exemplarily, the second animal may include a moth, the parameters of the third ultrasonic signal include frequency, the second threshold is 60%, and the frequency of the ultrasonic signal with a reliability of more than 60% when driving away the moth is 60kHz to 80kHz. Then, in the fourth corresponding relationship, it can be indicated that when driving away the moth, the frequency of the ultrasonic signal with a reliability of more than 60% is 60kHz to 80kHz.

[0211] Step S303: When the vehicle is in a driving state, a third ultrasonic signal is sent toward the baffle based on the parameters of the third ultrasonic signal.

[0212] By sending the third ultrasonic signal in the direction of the baffle, the second animal can be effectively driven away to prevent the second animal from colliding with the baffle of the vehicle and interfering with the field of vision of the user in the vehicle, thereby improving the safety of the vehicle during driving.

[0213] In order to clarify the animal driving away method applied to a vehicle provided by the present disclosure, the present disclosure provides an example, in which the first animal includes a bird, see Figure 8 As shown in the flowchart, this example includes the following steps:

[0214] Step S11, acquiring an image of the surrounding environment of the vehicle through a visual sensor.

[0215] Step S12, based on the image of the surrounding environment of the vehicle, determine whether there is an area in the surrounding environment where the first animal can stay. If so, perform the operation of step S13.

[0216] Among them, since the first animals include birds, and birds usually rest on trees and / or electric poles, etc., in this step, the resting area includes trees and / or electric poles, etc.

[0217] Step S13, obtaining the audio of the surrounding environment collected by the sound sensor.

[0218] Step S14, performing activation detection on the audio.

[0219] In the activation detection process, the activation threshold of the audio may be determined first, and then, based on the activation threshold of the audio, it may be determined whether the audio meets the activation condition. If the activation condition is met, it may be determined that the audio has passed the activation detection.

[0220] Step S15, if the audio passes the activation detection, based on the positioning information of the vehicle, the time period in which the first ultrasonic signal needs to be played and the second corresponding relationship, the type of the first animal is determined to achieve detection of the type of bird.

[0221] In this step, the second corresponding relationship can be determined by accessing a database storing the second corresponding relationship. Exemplarily, the database storing the second corresponding relationship can be the first animal distribution database mentioned above.

[0222] Step S16, determining the frequency of the first ultrasonic signal based on the type of the first animal and the third corresponding relationship, the third corresponding relationship being used to indicate the frequency of the ultrasonic signal whose reliability exceeds a first threshold when driving away different types of first animals.

[0223] In this step, the third corresponding relationship can be determined by accessing a database storing the third corresponding relationship. Exemplarily, the database storing the third corresponding relationship can be the first animal-repelling database mentioned above.

[0224] Step S17, determining the transmission power of the first ultrasonic signal based on the distance between the resident area and the vehicle, the signal-to-noise ratio of the first ultrasonic signal, the noise energy of the audio, and the energy consumption of the first ultrasonic signal per unit distance.

[0225] Step S18: determining the sending direction of the first ultrasonic signal based on the direction of the stayable area and / or the sound positioning information of the audio indication.

[0226] Step S19: Send the first ultrasonic signal according to the frequency, transmission direction and transmission power of the first ultrasonic signal determined in the above steps.

[0227] Since in this step, the first ultrasonic signal is sent in a specific sending direction, this step can be called directionally sending the first ultrasonic signal.

[0228] Step S20, if the clarity of the image does not meet the clarity requirement and / or the volume of the audio is greater than the volume threshold, determine the frequency of the second ultrasonic signal and determine the third parameter of the second ultrasonic signal through the fifth corresponding relationship and the sixth corresponding relationship.

[0229] Exemplarily, the database storing the fifth corresponding relationship may be the first animal distribution database mentioned above, and the database storing the sixth corresponding relationship may be the first animal drive-away database mentioned above.

[0230] Step S21, sending the second ultrasonic signal according to the frequency of the second ultrasonic signal and the third parameter. Since in this step, the clarity of the image is poor, and / or the volume of the audio is greater than the volume threshold, the accuracy of determining the sending direction of the second ultrasonic signal through the image and audio is low, therefore, in this step, the second ultrasonic signal is usually sent in a wide direction.

[0231] In the present disclosure, transmitting an ultrasonic signal in a wide direction refers to transmitting an ultrasonic signal in multiple directions, and transmitting an ultrasonic signal in a direction refers to transmitting an ultrasonic signal in a specific direction.

[0232] If the first animal is driven away by the first ultrasonic signal, and the second parameter of the first ultrasonic signal includes a sending direction, the first ultrasonic signal can be sent in the sending direction to achieve directional sending of the first ultrasonic signal, so as to reduce sound pollution and improve the driving away effect.

[0233] When the second ultrasonic signal is used to drive away the first animal, since the accuracy of determining the sending direction of the second ultrasonic signal through images and audio is low, if the second ultrasonic signal is still sent in a directional manner, the driving away effect will be poor. In this case, the driving away effect can be improved by sending the second ultrasonic signal in a wide direction.

[0234] Exemplary device 1

[0235] Fig. 9 : is a structural diagram of an animal repelling device applied to a vehicle provided by an exemplary embodiment of the present disclosure. The animal repelling device applied to a vehicle can be set in an electronic device such as a terminal device, a server, etc., to execute the method of any of the above embodiments of the present disclosure. The electronic device can be set in a vehicle, such as an on-board terminal of the vehicle, or the electronic device can be independent of the vehicle. Fig. 9 As shown, the animal repelling device applied to a vehicle of this embodiment includes: an area determination module 201 , an animal determination module 202 and a signal determination module 203 .

[0236] The area determination module 201 is used to determine whether there is an area where the first animal can stay in the surrounding environment based on the image of the surrounding environment of the vehicle;

[0237] An animal determination module 202 is configured to determine whether the first animal exists in the stayable area based on the audio of the surrounding environment if the area determination module 201 determines that the stayable area exists;

[0238] The signal determination module 203 is configured to determine and send a first ultrasonic signal for driving away the first animal if the animal determination module 202 determines that the first animal exists.

[0239] The device can drive away the first animal and reduce the interference of the first animal on the vehicle. In addition, since the solution does not require the purchase of a protective cover, there is no need to increase the cost of purchasing the protective cover. Moreover, the solution is executed by an electronic device and does not require the user to disassemble and install the protective cover, so the operation is relatively simple for the user.

[0240] For further information, see Fig.10 As shown in the structural diagram, the device may further include an activation module 204, which is used to:

[0241] After the area determination module 201 determines that the stayable area exists, the activation threshold of the audio is determined based on the audio and / or based on the battery life of the vehicle; based on the activation threshold, it is determined whether the audio meets the activation condition, so that when the audio meets the activation condition, the animal determination module 202 determines whether the first animal exists in the stayable area.

[0242] In the process of determining whether there is a first animal in the stayable area based on the audio of the surrounding environment, a large amount of power consumption is usually generated. Therefore, in the embodiment of the present disclosure, it is possible to first determine whether the audio meets the activation condition, and then determine whether there is a first animal in the stay area if the activation condition is met. Correspondingly, if the audio of the surrounding environment does not meet the activation condition, it is not necessary to determine whether there is a first animal in the stay area, thereby saving energy consumption.

[0243] The activation module 204 is specifically used to determine the type of the audio based on the frequency spectrum distribution of the audio; if the type of the audio is steady-state noise, determine the activation threshold based on a first parameter of the audio, the first parameter including at least one of the following: a full-band energy threshold and a zero-crossing rate; if the type of the audio is non-steady-state noise, determine the probability that the audio includes the call of the first animal through a first model, and determine the activation threshold based on the probability;

[0244] The operation of determining the audio activation threshold based on the battery life of the vehicle performed by the activation module 204 includes:

[0245] The activation threshold is determined based on the battery life of the vehicle and a first corresponding relationship, where the first corresponding relationship is used to indicate a corresponding relationship between the battery life and the activation threshold.

[0246] In a feasible implementation, the animal determination module 202 is specifically used to determine whether the first animal exists in the surrounding environment based on the audio and the second model, where the second model is a model for detecting whether the audio includes the call of the first animal;

[0247] Alternatively, if the illumination of the surrounding environment is less than a light threshold, it is determined whether the first animal exists in the surrounding environment based on infrared imaging of the resident area, the audio and the second model.

[0248] In a feasible implementation, the signal determination module 203 is specifically used to determine a second parameter of the first ultrasonic signal, where the second parameter includes at least one of the following: a transmission direction, a frequency, and a transmission energy; and send the first ultrasonic signal according to the second parameter.

[0249] Accordingly, the signal determination module 203 performs an operation of determining the second parameter of the first ultrasonic signal, including the following steps:

[0250] Determine a sending direction of the first ultrasonic signal based on the location of the stayable area and / or the sound positioning information of the audio indication;

[0251] Alternatively, the type of the first animal is determined based on the positioning information of the vehicle, the time period during which the first ultrasonic signal needs to be sent, and a second corresponding relationship, the second corresponding relationship is used to indicate the type of the first animal distributed at at least one location in at least one of the time periods, and the time period during which the first ultrasonic signal needs to be sent belongs to the time period included in the second corresponding relationship;

[0252] determining the frequency of the first ultrasonic signal based on the type of the first animal and a third correspondence, wherein the third correspondence is used to indicate the frequency of the ultrasonic signal whose reliability exceeds a first threshold when driving away different types of the first animals;

[0253] Alternatively, determining the distance between the stayable area and the vehicle based on imaging parameters of a visual sensor that captures the image and an area of ​​the stayable area in the image;

[0254] The transmission energy of the first ultrasonic signal is determined based on the distance, the signal-to-noise ratio of the first ultrasonic signal, the noise energy of the audio, and the energy consumption of the first ultrasonic signal per unit distance.

[0255] If the transmission energy includes transmission power, the signal determination module 203 determines the transmission power of the first ultrasonic signal by the following formula:

[0256] P = (Q + N + D) + 20 * log10 (L / 1);

[0257] Among them, P represents the transmission power of the first ultrasonic signal, L represents the distance between the stayable area and the vehicle, Q represents the signal-to-noise ratio of the first ultrasonic signal, N represents the noise energy of the audio, and D represents the energy consumption of the first ultrasonic signal per unit distance.

[0258] Furthermore, in a feasible implementation, the device also includes a prompt module, which is used to determine the target location where the first animal exists based on the positioning information of the vehicle after determining that the first animal exists in the stayable area; when the vehicle travels to the vicinity of the target location, display a first prompt information, and the first prompt information indicates that the first animal exists at the target location.

[0259] The image acquired by the electronic device may have a low definition, and / or the audio acquired by the electronic device may have a high volume. In view of this situation, the device provided by the present disclosure also includes: a first signal sending module.

[0260] The first signal sending module can perform the following operations:

[0261] If the clarity of the image does not meet the clarity requirement and / or the volume of the audio is greater than the volume threshold, the type of the first animal is determined based on the positioning information of the vehicle, the time period in which the second ultrasonic signal needs to be sent, and a fifth corresponding relationship, the fifth corresponding relationship is used to indicate the type of the first animal distributed at at least one location in at least one of the time periods, and the time period in which the second ultrasonic signal needs to be sent belongs to the time period included in the fifth corresponding relationship;

[0262] determining the frequency of the second ultrasonic signal based on the type of the first animal and a sixth corresponding relationship, wherein the sixth corresponding relationship is used to indicate the frequency of the ultrasonic signal whose reliability exceeds a third threshold when driving away different types of the first animal;

[0263] Based on the battery life of the vehicle, determining a third parameter of the second ultrasonic signal, the third parameter including at least one of the following: transmission energy, transmission cycle, and single transmission duration of each transmission cycle;

[0264] The second ultrasonic signal is transmitted according to the frequency of the second ultrasonic signal and the third parameter.

[0265] Through this device, when the image clarity is low and / or the audio volume is high, the animal can be driven away by the second ultrasonic signal.

[0266] Furthermore, the first signal sending module can also be used to determine the minimum drive-away signal-to-noise ratio and the maximum drive-away signal-to-noise ratio of the second ultrasonic signal for driving away the first animal before determining the third parameter of the second ultrasonic signal, wherein the first number is less than the second number, the first number being the number of species of the first animal driven away when the second ultrasonic signal corresponding to the minimum drive-away signal-to-noise ratio is sent, and the second number being the number of species of the first animal driven away when the second ultrasonic signal corresponding to the highest drive-away signal-to-noise ratio is sent.

[0267] In this case, if the third parameter includes the transmission energy, and the transmission energy includes the transmission power, the operation of determining the third parameter of the second ultrasonic signal based on the endurance power of the vehicle performed by the first signal sending module includes:

[0268] The transmit power is determined based on the range to which the battery life power belongs. The higher the range, the greater the transmit power. The transmit power is greater than or equal to the minimum drive-away signal-to-noise ratio and less than or equal to the maximum drive-away signal-to-noise ratio.

[0269] Furthermore, in another feasible embodiment of the present disclosure, it also includes: an odor detection module, which is used to detect whether the surrounding environment includes a target odor based on an odor sensor before sending the second ultrasonic signal corresponding to the third parameter, and the target odor originates from the first animal; if the surrounding environment includes the target odor, the signal determination module 203 sends the second ultrasonic signal according to the third parameter.

[0270] Furthermore, in another feasible implementation of the present disclosure, it further includes: a second signal sending module. The second signal sending module is used to perform the following operations:

[0271] Determining a second animal that can fly to a fender of the vehicle based on the positioning information of the vehicle and the time period in which the vehicle is located;

[0272] determining a parameter of the third ultrasonic signal based on a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate a corresponding relationship between the parameter of the ultrasonic signal whose reliability exceeds a second threshold and the second animal when driving away the second animal;

[0273] While the vehicle is in a driving state, the third ultrasonic signal is sent in the direction of the baffle based on the parameters of the third ultrasonic signal.

[0274] The third ultrasonic signal can be used to drive away a second animal that may fly to the tailgate of the vehicle while the vehicle is traveling.

[0275] Exemplary Device 2

[0276] Fig.11 : is a hardware architecture diagram of a vehicle provided by an exemplary embodiment of the present disclosure. The vehicle can execute the animal repelling method applied to the vehicle provided by the above-mentioned various embodiments of the present disclosure. The vehicle may include an intelligent networked vehicle. An intelligent networked vehicle is a new generation of vehicle that integrates advanced sensors, controllers, actuators and communication technologies, which can achieve all-round connection between vehicles, vehicles and roads, vehicles and people, and vehicles and service platforms.

[0277] In one embodiment, the vehicle may include a computing platform 100, a perception system 200, a positioning and navigation system 300, and a driving control system 400. In one example, the computing platform 100, the perception system 200, the positioning and navigation system 300, the communication system, and the driving control system 400 cooperate with each other to realize the intelligent driving function of the vehicle. Therefore, for the sake of convenience, the set consisting of hardware such as the computing platform 100, the perception system 200, the positioning and navigation system 300, and the driving control system 400 and their corresponding software can be referred to as the intelligent driving domain.

[0278] The computing platform 100 serves as the "brain" of the vehicle. It is responsible for processing data collected by the perception system 200, the positioning and navigation system 300, etc., executing relevant algorithms and making decisions, and controlling the driving control system 400 to execute decisions, so as to realize the vehicle's automatic / assisted driving (or intelligent driving) related functions.

[0279] The computing platform 100 may include one or more processors, such as processors 111 to 11n. In the disclosed embodiment, the processor may include a general-purpose processor, such as a central processing unit (CPU), a graphics processing unit (GPU), etc., or a processor designed specifically for a specific task, such as a deep learning task, an autonomous driving task, etc., such as a neural processing unit (NPU), etc.

[0280] In one implementation, the multiple processors of the computing platform 100 may be independent devices or integrated devices. For example, the multiple processors may be integrated on one or more system on chip (SoC). For example, the SoC may include one or more central processing units (CPUs), and / or one or more graphics processing units (GPUs), and / or one or more neural network processors (NPUs).

[0281] In the present disclosure, the computing platform 100 may run various models, such as a first model and a second model. The first model may include a mixed Gaussian model and / or a small NN model, etc., and the second model may include a sound detection model, etc.

[0282] In one implementation, the computing platform 100 may further include one or more memories 120, in which program instructions and algorithms executable by a processor may be stored. The processor may load and execute the program instructions and algorithms in the memory 120 to implement corresponding functions.

[0283] Exemplarily, the processor may execute the animal driving away method applied to a vehicle provided by the above-mentioned various embodiments of the present disclosure.

[0284] The one or more memories 120 may store the correspondences used in the above-mentioned embodiments of the present disclosure, such as at least one of the first correspondence, the second correspondence, the third correspondence, the fourth correspondence, the fifth correspondence, and the sixth correspondence. Different correspondences may be stored in different memories or in different storage spaces of the same memory. In addition, if the second correspondence and the fifth correspondence constitute a first animal distribution database, and the third correspondence and the sixth correspondence constitute a first animal drive-away database, the memory may store the first animal distribution database and the first animal drive-away database.

[0285] In addition, the one or more memories 120 may also store other information involved in the above-mentioned embodiments of the present disclosure, such as images of the surrounding environment and / or audio of the surrounding environment, as well as location information of the location where the first animal is distributed, etc., which is not limited by the present disclosure.

[0286] Exemplarily, the memory 120 may include, for example, a volatile memory, such as a dynamic random access memory (DRAM), a static random access memory (SRAM), etc.; it may also include a non-volatile memory (NVM), such as a read-only memory (ROM), a flash memory, etc. Exemplarily, the memory may exist independently and be connected to the processor via a bus, or the memory may be integrated into the processor and become a part of the processor.

[0287] The perception system 200 is the "sense organ" of the vehicle, responsible for sensing the surrounding environment of the vehicle and collecting real-time data about the surrounding environment of the vehicle. The perception system 200 may include one or more sensors for sensing the surrounding environment of the vehicle and collecting real-time data about the surrounding environment of the vehicle.

[0288] In the present disclosure, the perception system 200 may include a visual sensor 210, a sound sensor 220, an odor sensor 230, an infrared imaging sensor 240, and the like.

[0289] Among them, the visual sensor 210 can capture images of the surrounding environment of the vehicle and transmit the images to the computing platform 100; the sound sensor 220 can collect audio of the surrounding environment and transmit the audio to the computing platform 100; the odor sensor 230 can detect whether the surrounding environment includes a target odor and transmit the detection result to the computing platform 100; the infrared imaging sensor 240 can collect infrared images of the surrounding environment and transmit the infrared images to the computing platform 100. After receiving the information transmitted by each sensor, the computing platform 100 can realize the expulsion of animals by executing the methods provided by various embodiments of the present disclosure.

[0290] Of course, the perception system 200 may also include other types of sensors, and the embodiment of the present disclosure does not limit the specific implementation of the perception system 200.

[0291] The positioning and navigation system 300 is used to locate the vehicle and plan the driving route during navigation. The positioning and navigation system 300 may include a global navigation satellite system (GNSS) 310, which is used to provide the location information of the vehicle; an inertial measurement unit (IMU) 320, including an accelerometer and a gyroscope, etc., which is used to provide the motion state information of the vehicle. High-precision map data is used to provide accurate road information. Among them, GNSS 310 may include, for example, a global positioning system (GPS), which is not limited in the embodiments of the present disclosure.

[0292] In the present disclosure, the positioning of the vehicle can be achieved based on the positioning and navigation system 300 to obtain the positioning information of the vehicle, so that the computing platform 100 can determine the type of the first animal based on the positioning information of the vehicle and the second correspondence and the fifth correspondence.

[0293] The driving control system 400 can execute the decision of the computing platform 100 or the intention of the driver, and control the driving of the vehicle, such as controlling the acceleration, deceleration, braking, steering, braking force distribution, anti-lock braking, electronic stability, energy recovery, etc. of the vehicle, and coordinating the power distribution of the electric motor and other on-board equipment (such as air conditioning, lighting, audio, display screen, etc.) of the electric vehicle to improve the energy utilization efficiency of the whole vehicle and extend the cruising range. In one implementation, the functions of the driving control system 400 can be implemented by executing the instructions of the computing platform 100 by one or more electronic control units (ECUs), such as ECUs 411 to ECU41n, and the embodiments of the present disclosure are not limited to this.

[0294] In one embodiment, the vehicle may further include an infotainment system 500. The infotainment system 500 may include, for example, a display device 510, an interactive device 520, an environmental device 530, etc. In one implementation, the various devices in the infotainment system 500 cooperate with each other to implement functions in the vehicle cockpit, such as infotainment, instrument display, human-computer interaction, environmental control, etc. Therefore, for the sake of convenience, the set consisting of hardware such as the display device 510, the interactive device 520, the environmental device 530, and their corresponding software may be referred to as a cockpit domain.

[0295] The display device 510 may include one or more display screens. In one implementation, the display device 510 may include a digital instrument display screen located in front of the driver's seat, a central control screen 512 located in the central control area, and a co-pilot screen 513 located in front of the co-pilot seat. Among them, the digital instrument display screen is used to replace the traditional instrument panel and can be used to display key information of the vehicle, such as speed, speed, fuel consumption, power consumption, temperature, warning information, navigation instructions, driving assistance system status, vehicle fault warning and other information. The central control screen 512 is used to provide vehicle infotainment functions, such as audio playback, video playback, navigation system, Bluetooth connection, mobile phone screen projection, display of reversing images, display of 360-degree panoramic images, display of relevant information of intelligent driving, etc. In addition, the central control screen 512 can also provide vehicle function settings, such as adjusting air conditioning, seats, lights, driving mode, power output configuration, etc. In addition, the central control screen 512 can also provide vehicle human-computer interaction functions, such as touch control, gesture control, etc., to realize turning on and off air conditioning, adjusting seats, playing / stopping music, turning on / off navigation, turning on and off lights, etc. The front passenger screen 513 can be used to provide entertainment or information services for the front passenger, such as playing music, videos, providing game content, displaying navigation information, etc.

[0296] In one implementation, the display device 510 may also include a head-up display (HUD) 514, which can project key information of the vehicle, such as speed, navigation instructions, etc., onto the front windshield of the vehicle. In this way, the driver can see this information without looking at the dashboard or instrument display below, thereby avoiding the user's attention diverting while driving, thereby improving driving safety and comfort.

[0297] In one implementation, the display device 510 may include one or more of a digital instrument screen 511 , a central control screen 512 , a passenger screen 513 , and a head-up display 514 .

[0298] In the present disclosure, the display device 510 may display first prompt information under the instruction of the computing platform 100 to prompt that the first animal exists at the target location.

[0299] The interactive device 520 may include a speaker 521, a microphone 522, an in-cabin camera 523, a button 524, etc. Among them, the number of speakers 521 can be multiple, and the multiple speakers 521 can be distributed in different positions in the cabin. The microphone 522 can be a single microphone 522, or a microphone 522 array composed of multiple microphones 522. The microphone 522 can collect the voice of the user in the cabin to achieve functions such as voice recognition and call noise reduction. The in-cabin camera 523 can collect images of the user in the cabin, and the button 524 can allow the user to set vehicle functions or control the vehicle by pressing or touching.

[0300] Furthermore, the interactive device 520 may also include an ultrasonic sounder 525, which may be used to send at least one of the first ultrasonic signal, the second ultrasonic signal, and the third ultrasonic signal. Of course, the ultrasonic sounder 525 may also send other ultrasonic signals, which is not limited in the present disclosure.

[0301] The environmental devices 530 may include, for example, an air conditioning system, a fresh air system, a fragrance system, a lighting system, a seat heating / ventilation / massage system, etc. In one implementation, the environmental devices 530 may be controlled by a user through the interactive device 520, or by a processor based on the vehicle's usage status, cabin temperature, humidity, etc.

[0302] In one embodiment, the vehicle may further include a bus system 600 , which may enable interconnection and communication between various devices in the vehicle.

[0303] Exemplarily, the bus system 600 may include a controller area network (CAN) bus, an Ethernet bus, etc., to realize data transmission between the computing platform 100, the perception system 200, the positioning and navigation system 300, the driving control system 400 or other devices / systems in the vehicle.

[0304] In one embodiment, the vehicle may further include a communication module 700, which may enable the vehicle to be interconnected with other electronic devices such as mobile phones and tablet computers, and enable the vehicle to access the Internet. In one implementation, the communication module 700 may include, for example, a mobile communication module 710 and a wireless communication module 720.

[0305] The mobile communication module 710 is used to enable the vehicle to access the Internet based on mobile communication technologies such as 2G, 3G, 4G, and 5G, and to communicate with servers, other vehicles, base stations, smart devices, etc. that are connected to the Internet. The mobile communication module 710 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), a modem, etc. The wireless communication module 720 is used to implement the vehicle's wireless fidelity (Wi-Fi), Bluetooth (BT), near-field communication (NFC), and other functions to achieve wireless connection between the vehicle and mobile phones and other electronic devices, cross-device calls and media streaming, provide wireless hotspots, and achieve NFC keyless entry and contactless payment.

[0306] The beneficial technical effects corresponding to the exemplary embodiment of the present device can be found in the corresponding beneficial technical effects of the above exemplary method section, which will not be repeated here.

[0307] Exemplary Electronic Devices

[0308] Fig.12 A structural diagram of an electronic device provided in an embodiment of the present disclosure includes at least one processor 11 and a memory 12.

[0309] The processor 11 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

[0310] The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may execute one or more computer program instructions to implement the animal repelling method applied to the vehicle and / or other desired functions of the various embodiments of the present disclosure described above.

[0311] In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected via a bus system and / or other forms of connection mechanisms (not shown). Further, the input device 13 of the electronic device 10 may include at least one of a visual sensor, a sound sensor, an odor sensor, and an infrared imaging sensor.

[0312] The output device 14 can output various information to the outside, and may include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, etc. For example, the display can be used to display a first prompt message, and when the vehicle travels to the vicinity of the target location, the first prompt message is used to prompt the user that a first animal exists at the target location.

[0313] Of course, to simplify, Fig.12 Only some of the components related to the present disclosure in the electronic device 10 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 10 may also include any other appropriate components.

[0314] Exemplary computer program products and computer-readable storage media

[0315] In addition to the above-mentioned methods and devices, embodiments of the present disclosure may also provide a computer program product, including computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the animal removal method applied to a vehicle of various embodiments of the present disclosure described in the above-mentioned “Exemplary Method” section.

[0316] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0317] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the processor executes the steps of the animal removal method applied to a vehicle of various embodiments of the present disclosure described in the above “Exemplary Method” section.

[0318] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium is, for example, but not limited to, a system, device or device including electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0319] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and cannot be considered as necessary for each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, rather than limitation, and the above details do not limit the present disclosure to being implemented by adopting the above specific details.

[0320] Those skilled in the art may make various changes and modifications to the present disclosure without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the present disclosure claims and their equivalents, the present disclosure is also intended to include these modifications and variations.

Claims

1. A method for driving away animals from a vehicle, comprising: Based on the image of the surrounding environment of the vehicle, determining whether there is an area in the surrounding environment where the first animal can stay; If the stayable area exists, determining whether the first animal exists in the stayable area based on the audio of the surrounding environment; If the first animal exists, a first ultrasonic signal for driving away the first animal is determined and sent.

2. The method according to claim 1, wherein: Also includes: After determining that the stayable area exists, determining an activation threshold of the audio based on the audio and / or based on the battery life of the vehicle; Based on the activation threshold, it is determined whether the audio satisfies an activation condition, so that if the audio satisfies the activation condition, it is determined whether the first animal exists in the stayable area.

3. The method according to claim 2, wherein: The determining, based on the audio, an activation threshold of the audio comprises: Determining the type of the audio based on the frequency spectrum distribution of the audio; If the type of the audio is steady-state noise, determining the activation threshold based on a first parameter of the audio, the first parameter including at least one of the following: a full-band energy threshold and a zero-crossing rate; If the type of the audio is non-steady-state noise, determining the probability that the audio includes the call of the first animal through a first model, and determining the activation threshold based on the probability; and / or The determining of the audio activation threshold based on the battery life of the vehicle includes: The activation threshold is determined based on the battery life of the vehicle and a first corresponding relationship, where the first corresponding relationship is used to indicate a corresponding relationship between the battery life and the activation threshold.

4. The method according to claim 1, wherein: The determining whether the first animal exists in the surrounding environment based on the audio of the surrounding environment includes: Determine whether the first animal exists in the surrounding environment based on the audio and the second model, wherein the second model is a model for detecting whether the audio includes the call of the first animal; or, If the light intensity of the surrounding environment is less than a light threshold, it is determined whether the first animal exists in the surrounding environment based on infrared imaging of the resident area, the audio and the second model.

5. The method according to claim 1, wherein: The step of determining and sending a first ultrasonic signal for driving away the first animal comprises: Determine a second parameter of the first ultrasonic signal, the second parameter comprising at least one of the following: transmission direction, frequency, and transmission energy; The first ultrasonic signal is sent according to the second parameter.

6. The method according to claim 5, wherein: The determining the second parameter of the first ultrasonic signal comprises: Determine a sending direction of the first ultrasonic signal based on the location of the stayable area and / or the sound positioning information of the audio indication; or, Determining the type of the first animal based on the positioning information of the vehicle, the time period during which the first ultrasonic signal needs to be sent, and a second corresponding relationship, wherein the second corresponding relationship is used to indicate the type of the first animal distributed at at least one location in at least one of the time periods, and the time period during which the first ultrasonic signal needs to be sent belongs to the time period included in the second corresponding relationship; determining the frequency of the first ultrasonic signal based on the type of the first animal and a third correspondence, wherein the third correspondence is used to indicate the frequency of the ultrasonic signal whose reliability exceeds a first threshold when driving away different types of the first animals; or, Determine the distance between the stayable area and the vehicle based on imaging parameters of a visual sensor that captures the image and the area of ​​the stayable area in the image; The transmission energy of the first ultrasonic signal is determined based on the distance, the signal-to-noise ratio of the first ultrasonic signal, the noise energy of the audio, and the energy consumption of the first ultrasonic signal per unit distance.

7. The method according to claim 6, wherein: The transmission energy includes transmission power, and the transmission power of the first ultrasonic signal is determined by the following formula: P = (Q + N + D) + 20 * log10 (L / 1); Among them, P represents the transmission power of the first ultrasonic signal, L represents the distance between the stayable area and the vehicle, Q represents the signal-to-noise ratio of the first ultrasonic signal, N represents the noise energy of the audio, and D represents the energy consumption of the first ultrasonic signal per unit distance.

8. The method according to any one of claims 1 to 7, wherein: Also includes: After determining that the first animal exists in the stayable area, determining a target location where the first animal exists based on the positioning information of the vehicle; When the vehicle travels to the vicinity of the target location, first prompt information is displayed, where the first prompt information indicates that the first animal exists at the target location.

9. The method according to any one of claims 1 to 7, wherein: Also includes: If the clarity of the image does not meet the clarity requirement and / or the volume of the audio is greater than the volume threshold, the type of the first animal is determined based on the positioning information of the vehicle, the time period in which the second ultrasonic signal needs to be sent, and a fifth corresponding relationship, the fifth corresponding relationship is used to indicate the type of the first animal distributed at at least one location in at least one of the time periods, and the time period in which the second ultrasonic signal needs to be sent belongs to the time period included in the fifth corresponding relationship; determining the frequency of the second ultrasonic signal based on the type of the first animal and a sixth corresponding relationship, wherein the sixth corresponding relationship is used to indicate the frequency of the ultrasonic signal whose reliability exceeds a third threshold when driving away different types of the first animal; Based on the battery life of the vehicle, determining a third parameter of the second ultrasonic signal, the third parameter including at least one of the following: transmission energy, transmission cycle, and single transmission duration of each transmission cycle; The second ultrasonic signal is transmitted according to the frequency of the second ultrasonic signal and the third parameter.

10. The method according to claim 9, wherein: Also includes: Before determining the third parameter of the second ultrasonic signal, determining a minimum drive-away signal-to-noise ratio and a maximum drive-away signal-to-noise ratio of the second ultrasonic signal for driving away the first animal, wherein a first number is less than a second number, the first number is the number of types of the first animal driven away when the second ultrasonic signal corresponding to the minimum drive-away signal-to-noise ratio is sent, and the second number is the number of types of the first animal driven away when the second ultrasonic signal corresponding to the maximum drive-away signal-to-noise ratio is sent; The third parameter includes the transmission energy, which includes the transmission power. The third parameter of the second ultrasonic signal is determined based on the battery life of the vehicle, including: The transmit power is determined based on the range to which the battery life power belongs. The higher the range, the greater the transmit power. The transmit power is greater than or equal to the minimum drive-away signal-to-noise ratio and less than or equal to the maximum drive-away signal-to-noise ratio.

11. The method according to claim 9, wherein: Also includes: Before sending the second ultrasonic signal corresponding to the third parameter, detecting whether the surrounding environment includes a target odor based on an odor sensor, the target odor originating from the first animal; If the surrounding environment includes the target odor, the second ultrasonic signal is sent according to the third parameter.

12. The method according to any one of claims 1 to 7, wherein: Also includes: Determining a second animal that can fly to a fender of the vehicle based on the positioning information of the vehicle and the time period in which the vehicle is located; determining a parameter of the third ultrasonic signal based on a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate a corresponding relationship between the parameter of the ultrasonic signal whose reliability exceeds a second threshold and the second animal when driving away the second animal; While the vehicle is in a driving state, the third ultrasonic signal is sent in the direction of the baffle based on the parameters of the third ultrasonic signal.

13. An animal repelling device for a vehicle, comprising: An area determination module, configured to determine whether there is an area where the first animal can stay in the surrounding environment based on an image of the surrounding environment of the vehicle; an animal determination module, configured to determine whether the first animal exists in the stayable area based on the audio of the surrounding environment if the area determination module determines that the stayable area exists; The signal determination module is used to determine and send a first ultrasonic signal for driving away the first animal if the animal determination module determines that the first animal exists.

14. A computer-readable storage medium storing a computer program, wherein the computer program is used to execute the animal repelling method applied to a vehicle according to any one of claims 1 to 12.

15. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the animal repelling method applied to a vehicle as described in any one of claims 1 to 12.

Citation Information

Cited By

  • Multi-mode line iron tower bird repelling system based on image analysis and motion perception

    CN121730274A