System and method for intelligently controlling vehicle lighting to mitigate insect presence

Abstract

The present disclosure provides a system and method for intelligently controlling vehicle lighting to mitigate insect presence. Systems and methods are provided for intelligently controlling a vehicle lamp to mitigate insect presence. A vehicle may capture image data using one or more of its sensors. The image data may be image data of an interior cabin of the vehicle and / or an exterior environment of the vehicle. The image data may be processed using segmentation and classification algorithms to determine the presence of insects in or around the vehicle. The vehicle may additionally determine the presence of a user in or around the vehicle. The vehicle may also determine the location of the insect and the user. Based on the location of the user and the insect, the vehicle may light appropriate lights of the vehicle in order to move the insect away from the user's location, thereby enhancing the user experience and mitigating troubles caused by the presence of the insect.

Description

Technical Field

[0001] This disclosure relates to the field of intelligently controlling vehicle lighting. Specifically, embodiments of this disclosure relate to controlling interior and exterior vehicle lights to mitigate problems caused by the presence of insects / bugs in or around the vehicle. Background Technology

[0002] The presence of insects in or around a vehicle can be a significant source of annoyance for users. These tiny pests can irritate the driver, causing discomfort. Additionally, insects can damage the vehicle's interior, leaving stains or causing unpleasant odors. For passengers, especially those with insect phobias, the experience can be particularly distressing, turning a simple drive into an uncomfortable situation. Furthermore, encountering insects near a vehicle can present several problems for users attempting to enter or exit the vehicle. Seeing insects like bees, wasps, or spiders can trigger anxiety, leading to hesitation or hasty movement. For those with allergies, the presence of needle-like insects can cause health problems. Additionally, insects may enter the vehicle during entry or exit, causing further discomfort.

[0003] Traditionally, people use insect repellent sprays or air fresheners to repel pests. In some cases, users can install insect / bug screens to allow ventilation while keeping insects out. Another common way to mitigate insect problems is to avoid parking vehicles near areas with high insect activity (such as gardens or garbage bins) and / or check vehicles for insects before entering or leaving them. However, these methods are not comprehensive or robust enough to guarantee the complete absence of insects or a minimal number of insects near the vehicle. Summary of the Invention

[0004] This disclosure describes a system and method for modifying the default operation of a vehicle's one-touch window lowering / raising feature based on specific conditions detected near the vehicle.

[0005] Embodiments of this disclosure provide a vehicle including one or more processors, one or more memory devices storing instructions and coupled to the one or more processors, and one or more sensors coupled to the one or more processors. The one or more processors are configured to execute the instructions to: capture image data using the one or more sensors; generate foreground image data and background image data using the image data; perform morphological operations on the image data to remove noise from the image data; perform feature extraction on the foreground image data and the background image data to identify one or more insects depicted in the image data; determine a first position of the insect relative to the vehicle; and operate a set of lights on the vehicle based on the position of the insect.

[0006] In another embodiment, a system is provided comprising a first vehicle and a second vehicle. Each of the first and second vehicles includes one or more processors, one or more memory devices storing instructions and coupled to the one or more processors, and one or more sensors coupled to the one or more processors. The first and second vehicles are configured to determine a first position of the first vehicle and a second position of the second vehicle. The system also determines the presence of an insect near the first vehicle and the presence of a first group of users near the first vehicle. The system then sends a first message from the first vehicle to the second vehicle, and the second vehicle, based on the first message, illuminates one or more external lights to induce the insect to migrate toward the second vehicle.

[0007] In another instance, a method performed by a vehicle is provided. The method includes: the vehicle capturing an image using its image sensor; generating foreground image data and background image data using the image; and performing morphological operations on the image to remove noise from the image. The method further includes: the vehicle performing feature extraction on the foreground image data and background image data to identify one or more insects depicted in the image; determining a first position of the insect relative to the vehicle; and operating a set of lights based on the position of the insect.

[0008] These and other advantages of this disclosure are provided in detail herein. Attached Figure Description

[0009] Specific embodiments are illustrated with reference to the accompanying drawings. The same reference numerals may be used to indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the drawings, and some elements and / or components may not be present in various embodiments. Elements and / or components in the drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms can be used interchangeably depending on the context.

[0010] Figure 1 An environment in which embodiments of the present disclosure may be implemented is shown.

[0011] Figure 2 A block diagram of a vehicle according to one or more embodiments of the present disclosure is shown.

[0012] Figure 3 A flowchart is shown of a process for mitigating the presence of insects in and around a vehicle according to one or more embodiments of the present disclosure.

[0013] Figure 4 The process for detecting the presence of insects based on images captured by a vehicle is shown.

[0014] Figure 5A A process for intelligently operating vehicle lights to mitigate the presence of insects, according to one or more embodiments of the present disclosure, is illustrated.

[0015] Figure 5B A process for mitigating the presence of insects in or around a vehicle, according to one or more embodiments of the present disclosure, is illustrated.

[0016] Figure 6 A process for mitigating the presence of insects according to one or more embodiments of the present disclosure is shown.

[0017] Figure 7 A block diagram of an example control server according to one or more embodiments of the present disclosure is depicted. Detailed Implementation

[0018] The present disclosure will be described more fully below with reference to the accompanying drawings, which illustrate exemplary embodiments of the present disclosure and are not intended to be limiting.

[0019] Figure 1 An environment 100 in which embodiments of the present disclosure may be implemented is shown. Vehicles 102 and / or 114 may be any passenger or commercial vehicle, such as cars, trucks, tankers, buses, etc. Environment 100 may also include a control server 104. Control server 104 may be part of a cloud-based computing infrastructure and may be associated with and / or include a Telematics Service Delivery Network (SDN) that provides digital data services to vehicles 102 and / or 114. The two vehicles 102 and 114 may communicate directly with each other (e.g., using vehicle-to-vehicle (V2V) communication) without any intermediary entity or via server 104 and network 108. References below Figure 7 Provide details of control server 104.

[0020] Environment 100 may also include a user device 112. User device 112 may be a mobile phone, tablet, personal computer, smart key fob, etc. User device 112 may be associated with a user 110 of vehicle 102. User 110 may be the driver of vehicle 102 or a passenger in vehicle 102. User device 112 may receive information from vehicle 102 and / or control server 104. User device 112 may have a dedicated application installed thereon, which can interface with vehicle 102 to download and display various types of vehicle-generated information and other control data. In one embodiment, vehicle 102 may communicate directly with user device 112 to send and receive data without network 108 and / or server 104.

[0021] Environment 100 may also include network 108. Network 108 illustrates an example communication infrastructure in which connected devices discussed in various embodiments of this disclosure may communicate. Network 108 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols such as Transmission Control Protocol / Internet Protocol (TCP / IP). Low Energy (BLE), Wi-Fi based on the IEEE 802.11 standard, Ultra Wideband (UWB), and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High Speed ​​Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and 5G are just a few examples.

[0022] Vehicle 102 may include multiple units, including but not limited to an automotive computer, a vehicle control unit (VCU), and a detection unit. See below for reference. Figure 2 Details of vehicle 102 are provided.

[0023] Figure 2 A block diagram of a vehicle 102 or 114 in which embodiments of the present disclosure may be implemented is shown. Vehicle 102 or 114 may include multiple units, including but not limited to an automotive computer 208, a vehicle control unit (VCU) 210, and an infotainment unit 238. VCU 210 may include multiple electronic control units (ECUs) 214 configured to communicate with the automotive computer 208.

[0024] In some embodiments, a user device, such as a mobile phone or a laptop computer, may be configured to connect to the vehicle computer 208. The user device may communicate via one or more wireless connections, and / or via the Near Field Communication (NFC) protocol. Protocols, Wi-Fi, Ultra-Wideband (UWB), and other possible data connectivity and sharing technologies can be used to directly connect to vehicle 102.

[0025] According to this disclosure, the vehicle computer 208 can be installed anywhere in the vehicle 102. The vehicle computer 208 may be or include an electronic vehicle controller having one or more processors 202, one or more memory devices 204, and one or more transceivers 206.

[0026] Processor 202 may be configured to communicate with one or more memory devices (e.g., memory 204 and / or memory 205) configured to communicate with a corresponding computing system. Figure 2The processor 202 may communicate with one or more external databases (not shown in the diagram). The processor 202 may utilize the memory 204 to store programs and / or data in code form to perform operations according to this disclosure. The memory 204 may be a non-transitory computer-readable storage medium or memory storing vehicle control program code. The memory 204 may include any or a combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.) and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.). In some embodiments, the memory 204 may include modules 245 that may implement various embodiments of this disclosure. Modules 245 may include instructions that can be executed by the processor 202 to implement various embodiments of this disclosure.

[0027] The vehicle computer 208 may also include a transceiver 206. The transceiver 206 may be configured to receive information / input from one or more external devices or systems (e.g., user device 208, external server, etc.). Furthermore, the transceiver 206 may transmit notifications, requests, signals, etc., to external devices or systems. Additionally, the transceiver 206 may be configured to receive information / input from vehicle components (such as vehicle sensing system 232, one or more ECUs 214, etc.). Furthermore, the transceiver 206 may transmit signals (e.g., command signals) or notifications to vehicle components such as BCM 220, infotainment system 238, etc.

[0028] In some embodiments, VCU 210 may share a power and / or communication bus with vehicle computer 208 and may be configured and / or programmed to coordinate data between vehicle systems, connected servers, etc. VCU 210 may include or communicate with any combination of ECUs 214, such as BCM 220, Engine Control Module (ECM) 222, Transmission Control Module (TCM) 224, Telematics Control Unit (TCU) 226, Driver Assist Technology (DAT) Controller 228, etc. VCU 210 may also include and / or communicate with a Vehicle Sensing System (VPS) 230, which may connect to and / or control one or more vehicle sensing systems 232. The vehicle sensing system 232 may include one or more vehicle sensors, including but not limited to radio detection and ranging (LiDAR or “radar”) sensors configured to use radio waves to detect and locate objects inside and outside the vehicle 102, seating area latch sensors, seating area sensors, light detection and ranging (“LiDAR”) sensors, door sensors, proximity sensors, temperature sensors, wheel sensors, one or more ambient weather or temperature sensors, interior and exterior cameras, steering wheel sensors, etc. Sensors as part of the vehicle sensing system 232 may be coupled to the vehicle 102 at one or more locations in one or more ways. For example, various sensors of the vehicle sensing system 232 may be integrated into various subsystems of the vehicle 102 (such as doors, mirrors, roof, etc.) or attached to the vehicle 102 using suitable mounting mechanisms. In some embodiments, various sensors of the vehicle sensing system 232 may be located at the front, rear, sides, top, bottom, and underside of the vehicle 102. The location of the sensors may depend on their function. For example, sensors monitoring the area beneath the vehicle can be attached to the underside of vehicle 102, while sensors monitoring areas on either side of vehicle 102 can be mounted or integrated into the doors of vehicle 102. Vehicle sensing system 232 may also include one or more road noise sensors, such as accelerometers attached to various mechanical components and / or systems of vehicle 102. Those skilled in the art will recognize that sensors can be attached to the vehicle in various different ways and locations besides those mentioned above.

[0029] In some embodiments, VCU 210 can control vehicle operation aspects and implement one or more instruction sets received from server 104, user device 112, or from one or more instruction sets stored in memory 204.

[0030] TCU 226 can be configured and / or programmed to provide vehicle connectivity to wireless computing systems on and outside the vehicle 102, and may include a navigation (NAV) receiver 234 for receiving and processing GPS signals. Module (BLEM) 236, Wi-Fi transceiver, UWB transceiver and / or may be configured for use in vehicle 102 with other systems (e.g., vehicle key fob). Figure 2 Other wireless transceivers (not shown in the image), external servers, user devices, etc., and wireless communication (including cellular communication) between the computer and the module. Figure 2 (Not shown in the image). TCU 226 can communicate with ECU 214 via a bus. In some respects, TCU 226 can be configured (e.g., via NAV receiver 234) to determine the real-time geographical location of the vehicle.

[0031] ECU 214 can control various aspects of vehicle operation and communication using inputs from the human driver, inputs from the vehicle computer 208, and / or wireless signal inputs received from other connected devices (such as server 206, etc.) via a wireless connection.

[0032] The BCM 220 typically integrates sensors, vehicle performance indicators, and variable reactors associated with vehicle systems. It may also include processor-based power distribution circuitry that controls functions associated with the vehicle body, such as lights, windows, safety devices, cameras, audio systems, speakers, wipers, door locks and entry controls, and various comfort controls. The BCM 220 can also operate as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 (Not shown in the image) Interaction.

[0033] The DAT controller 228 and / or the autonomous driving system 240 can provide Level 1 to Level 5 automated driving and driver assistance functionality, which may include features such as active parking assist, vehicle reversing assist, and / or adaptive cruise control. The DAT controller 228 can also provide various aspects of user and environmental inputs that can be used for user authentication.

[0034] In some embodiments, the vehicle computer 208 may be connected to the infotainment system 238 (or the vehicle human-machine interface (HMI)). The infotainment system 238 may include a touchscreen interface portion and may include voice recognition features, and the ability to identify a user's biometrics based on facial recognition, voice recognition, fingerprint recognition, or other biometric identification methods. In other aspects, the infotainment system 238 may also be configured to receive user commands via the touchscreen interface portion and / or output or display notifications, navigation maps, etc., on the touchscreen interface portion.

[0035] The computing system architecture of the automotive computer 208 and / or VCU 210 can omit certain computing modules. This should be easily understood. Figure 2The computing environment depicted herein is an example of possible implementations according to this disclosure and should therefore not be considered limiting or exclusive.

[0036] In addition to the components mentioned above, vehicle 102 may also have numerous mechanical systems and subsystems. A chassis or frame may form the backbone of vehicle 102 and support the body and other components of vehicle 102. Vehicle 102 may include an engine that converts fuel into mechanical power to propel the vehicle forward. The engine includes various components such as engine block, pistons, valves, and spark plugs. Vehicle 102 also includes a transmission system. The transmission system transmits power from the engine to the wheels. It includes a clutch, gearbox, drive shaft, differential, and other components. The transmission adjusts power output to suit the vehicle's speed and load. Vehicle 102 may also include a suspension system. The suspension system absorbs shocks and maintains contact between the tires and the road, providing a smooth ride. It includes components such as springs, shock absorbers, and linkages. Vehicle 102 also includes a vehicle stopping system that allows the driver to decelerate or stop vehicle 102. It includes components such as pedals, master cylinders, lines, and bushings or shoes. Vehicle 102 also includes a steering system that allows the driver to guide the vehicle. The steering system includes components such as a steering wheel, steering column, rack and pinion, and tie rods. Vehicle 102 also includes an exhaust system for removing and filtering exhaust gases produced by the engine. It includes an exhaust manifold, catalytic converter, muffler, and exhaust tailpipe, among other components. Vehicle 102 also includes a cooling system to prevent engine overheating. It includes components such as a radiator, water pump, thermostat, and coolant. Vehicle 102 also includes a cooling system for storing fuel and supplying fuel to the engine. It includes a fuel tank, fuel pump, fuel filter, and fuel injectors. The electrical system of vehicle 102 powers the vehicle's electrical components. It includes a battery, alternator, starter motor, and wiring. The heating, ventilation, and air conditioning (HVAC) system controls the temperature inside vehicle 102. It includes a heater core, blower motor, and air conditioning compressor. In some embodiments, the vehicle may be an electric vehicle (EV) or a hybrid vehicle, and in either case, some of the aforementioned components will be replaced by an electric motor and battery. All the mechanical components working together ensure optimal vehicle operation.

[0037] Vehicles 102 / 114 may also have several lighting devices, such as LEDs, incandescent light emitters, ultraviolet light emitters, etc. These lighting devices may be integrated into several interior and / or exterior areas of the vehicle, such as cluster lights, dome lights, taillights, center console lighting, ambient lighting, headlights, parking lights, and other exterior lights.

[0038] The presence of insects near a vehicle can affect users in several ways. For drivers, seeing insects like bees, wasps, or spiders can immediately trigger anxiety, leading to hesitation or hasty movement when entering or leaving the vehicle. For those with allergies, the presence of insects can cause health problems, potentially triggering allergic reactions. Additionally, insects may enter the vehicle when users get in and out, causing further discomfort and annoyance. Passengers, especially those with insect phobias, may experience significant stress and discomfort, turning a simple journey into an unpleasant experience. Furthermore, insects can damage the vehicle's interior, leaving stains or causing unpleasant odors. The constant need to check for and deal with insects can also lead to frustration and anxiety, thus detracting from the overall driving experience.

[0039] Conventional methods for mitigating the presence of insects in and around vehicles (such as using insect repellent sprays and air fresheners, keeping the vehicle clean, and choosing parking spaces away from known insect activity) are insufficient to effectively address the insect problem. A more robust and comprehensive approach is needed to manage the presence of insects / bugs in and around vehicles. Embodiments of this disclosure provide methods and systems for mitigating the presence of insects in and around vehicles, thereby enhancing user experience and comfort.

[0040] The use of certain colored lights to repel or attract insects is known. Insects are attracted to ultraviolet (UV) light and shorter wavelengths such as blue and violet. Yellow or amber light is less attractive to insects because it emits longer wavelengths that are less visible to them. These lights can be used in and around vehicles to create a more comfortable, insect-free environment. LED lights that can be customized to emit specific wavelengths are particularly useful in this regard. By selecting LED lights that emit yellow or warm white light, users can significantly reduce the number of insects attracted to their surroundings. Additionally, using insect-repellent lights can minimize insect-related annoyance or allergic reactions. However, there is currently no solution that would allow vehicles to intelligently control the operation of such lights to effectively mitigate the presence of insects. Most current solutions are manually controlled by the user, which is often not very effective at stopping insects.

[0041] Figure 3A summary flowchart of a process 300 for mitigating the presence of insects in and around a vehicle according to one or more embodiments of the present disclosure is shown. At step 302, the vehicle may determine and / or receive various types of data 310, 312, 314, 316, 318, and / or 320, and use this data to determine the presence of insects in and / or around the vehicle. The vehicle may determine the time of day information 310. For example, the presence of insects may be more pronounced at dusk / nighttime compared to midday, or some types of insects may be more active during the day (e.g., daytime insects such as butterflies, bees, dragonflies, etc.), while other types of insects may be more active at night (e.g., nocturnal insects such as moths, beetles, certain species of mosquitoes, etc.). Therefore, the time of day can help determine which types of insects may be present near the vehicle. Temperature and / or humidity data 312 can also provide valuable information for determining the likelihood of the type and quantity of insects present near the vehicle. For example, temperature fluctuations throughout the day can affect insect activity. Cooler temperatures may be more suitable for some insects, while others thrive in warmer environments. Similarly, humidity levels can also affect the presence of insects. Some insects prefer higher humidity levels, while others are more active in dry conditions. Recent weather event data 314 can also indicate the likelihood of insect presence. For example, if the area has recently experienced rainfall, insect activity is more likely to be at a higher level compared to a prolonged period of dryness in the area. Current vehicle location data 316 can inform the vehicle of general insect activity in the area. For example, if the vehicle is currently in a tropical environment, there may be an increased insect presence, as tropical environments are historically known to attract more insects. Data 318 captured using various sensors on the vehicle can be processed to determine the presence of any insects in and around the vehicle. (See below for reference.) Figure 4 The interpretation is based on the details of determining the presence of insects using image data captured by the vehicle. In addition to visual image data, the vehicle may use other types of data such as infrared sensor data, acoustic sensor data, optical sensor data, radar and lidar data, thermal infrared imaging data, and / or chemiluminescent tags to detect and track insect movement. In some cases, a user (e.g., via the vehicle's HMI system) can provide input 320, which informs the vehicle of the presence of insects in or around the vehicle. For example, user input can be textual, verbal, or nonverbal, such as gestures. In some cases, the vehicle may perform step 308 solely based on user input data 320, without performing any other steps in process 300.

[0042] Once the vehicle has determined the presence of an insect in or around the vehicle, it can determine the insect's location at step 304. The insect's location can be determined at a higher level, such as whether it is inside or outside the vehicle. In other cases, the determination of the insect's location may be more precise, such as the front left or rear of the vehicle. The same data used to detect the presence of the insect at step 302 can be used to determine the insect's location. Once the insect's location data is determined, the vehicle can determine the location of the vehicle's user at step 306. Various types of data can be used to determine the user's location, including images captured by one or more of the vehicle's sensors, the geographic location of the user device 112, Wi-Fi triangulation data associated with the user device, the location of a key fob associated with the vehicle, Bluetooth data, etc. It should be noted that the user can be located inside or outside the vehicle. User location determination step 306 can determine the user's precise location and whether the user is inside or outside the vehicle. This is important because mitigation techniques deployed by the vehicle will be based in part on the user's location. Once the insect's location and the user's location are determined, the vehicle can employ one or more mitigation techniques based on this information at step 308. One mitigation technique could be operating the vehicle's interior and / or exterior lights to attract or repel insects. In one embodiment, the vehicle may operate its interior and / or exterior lights in a manner that draws insects away from the user.

[0043] In some embodiments, the vehicle can automatically perform process 300 without any user intervention. In other embodiments, the vehicle can receive input from a user of the vehicle. For example, a user of the vehicle can interact with the vehicle's HMI system and select a "bug-free" mode or trigger the vehicle to perform some other similar feature of process 300. In other embodiments, the user can provide verbal or gestural input to the vehicle, and the vehicle can then perform process 300 based on that input. In other cases, the vehicle can determine whether to perform process 300 based on the vehicle's motion state. For example, performing insect mitigation when the vehicle is parked or otherwise stationary may be beneficial. At a certain speed or above, an insect mitigation process may not be necessary because insects are uncommon near the vehicle when it is traveling at speeds above a certain level.

[0044] In some embodiments, where the vehicle is used as part of an outdoor activity (such as camping or a picnic trip), the vehicle can determine that insects may pose a problem due to the nature and location of the activity. In this case, the vehicle can automatically configure itself to emit light with wavelengths that are least attractive to various insects. Therefore, if the vehicle's users turn on any of the vehicle's lights, the emitted light will have minimal attraction to insects. In some embodiments, based on the vehicle's current location, the vehicle can receive or determine data about the most common insects found in that geographic area and determine the most suitable light wavelength to emit based on the type of insect. Therefore, the vehicle can customize its light emission based on the types of insects found in any particular geographic area.

[0045] Figure 4 A process 400 for detecting the presence of insects based on images captured by a vehicle is shown. The process 400 can be performed by vehicle 102 / 114, or by server 104 in conjunction with vehicle 102 / 114.

[0046] At step 402, the vehicle may use one or more image sensors of the vehicle sensing system 232 to capture one or more images of the vehicle's interior compartment and / or the vehicle's external environment. At step 404, the captured images are converted to grayscale. Additionally, a noise filter such as Gaussian blur may be applied to the images to reduce noise and enhance image quality. At step 406, the images may be globally or adaptively thresholded to separate the foreground (e.g., a potential insect) from the background. For example, if global thresholding is used, the vehicle may compute a histogram of the grayscale image. The histogram represents the frequency of each intensity level in the image. The probability distribution for each intensity level can then be computed by dividing the histogram values ​​by the total number of pixels in the image. Then, for each possible threshold, the probabilities of the two categories (background and foreground) are computed, and then the means of the two categories are calculated. The within-group variance for each threshold is then computed. Once completed, the vehicle can find the threshold(t) that minimizes the within-group variance. This threshold is the optimal value for best separating the foreground and background. An optimal threshold is used to binarize the image, setting all pixels below the threshold to one value (e.g., 0) and all pixels above the threshold to another value (e.g., 255). This effectively segments the image and prepares it for further processing.

[0047] Unlike global thresholding, which uses a single threshold for the entire image, adaptive thresholding computes thresholds for smaller regions of the image, allowing for more accurate segmentation. For example, it computes a threshold for each pixel based on the pixel values ​​in its local neighborhood. This helps handle variations in lighting and shadows within different parts of the image. Common methods for adaptive thresholding include mean adaptive thresholding or Gaussian adaptive thresholding.

[0048] At step 408, the image data may undergo one or more morphological operations, such as erosion or dilation. Erosion is the process of removing pixels from the boundaries of objects. The basic idea is to erode the boundaries of foreground objects. It is useful for removing small white noise, separating two connected objects, and reducing the size of objects. This operation causes the boundaries of objects to shrink, making the objects smaller and removing small, irrelevant details. Dilation is the opposite of erosion. It adds pixels to the boundaries of objects in the image. This operation is useful for joining broken parts of objects, filling holes, and increasing the size of objects. This operation causes the boundaries of objects to expand, making the objects larger and filling holes and gaps. These morphological operations help refine segmented regions.

[0049] At step 410, edge detection and region-based image segmentation are then performed on the image data to identify regions of interest within the image. Edge detection helps identify and extract the boundaries and contours of potential insects in the image. In the example, the Canney edge detector and / or contour edge detection algorithms can be used. The watershed algorithm can be used to perform region-based image segmentation. At step 412, feature extraction can be performed on the image data to identify insects in the regions of interest. Feature extraction may include extracting shape features (e.g., area, perimeter, and aspect ratio) and texture features to distinguish insect bodies from other objects in the regions of interest. Once the insect bodies are identified, at step 414, the image data can be classified using one or more machine learning models to identify the type and approximate number of insects in the regions of interest. For example, trained models such as Support Vector Machines (SVM), Convolutional Neural Networks (CNN), or other deep learning models, such as the faster R-CNN, can be used. Once the type and approximate number of insects are identified, appropriate mitigation techniques can be used.

[0050] Mitigation techniques for minimizing the presence of insects in and around a vehicle can include different techniques based on the location of the insects, the location of the user, and / or the location of the vehicle. The location of the insects can be broadly categorized as inside or outside the vehicle. Similarly, the location of the vehicle's user or occupant can also be broadly categorized as inside or outside the vehicle.

[0051] In one embodiment, the insects may be located inside the vehicle, and the user may also be located inside the vehicle. In this case, the vehicle may automatically turn off its interior lights and turn on one or more exterior lights (e.g., turn signals, taillights, door lights, etc.). The vehicle's exterior lights may emit light with wavelengths between 400 nm and 500 nm and / or light in the ultraviolet wavelength / spectrum. Additionally, the vehicle may open one or more windows to allow the insects to leave the vehicle. In one embodiment, the vehicle may manipulate the color of the exterior lights to a color attractive to insects. This causes the insects to be attracted to the exterior lights. Once all or most of the insects have left the vehicle, the user can close the windows and doors, leaving the vehicle essentially insect-free. In another embodiment, instead of turning off the vehicle's interior lights, the vehicle may manipulate the interior lights to emit light at wavelengths that insects do not prefer (e.g., light with wavelengths above 600 nm). This will create a "push-pull" effect on the insects, causing them to be pushed or driven out of the vehicle by the interior lights and pulled or attracted to them by the exterior lights. In this case, if the vehicle is in motion during this operation, the interior lights can be manipulated in a manner that does not interfere with the vehicle driver. In some embodiments, the vehicle's interior insect-repellent lights may only illuminate when the vehicle is stationary.

[0052] In another embodiment, the vehicle can determine that the insect is inside the vehicle while the user is outside the vehicle. Figure 5A A process 500 for intelligently operating vehicle lights to mitigate the presence of insects, according to an embodiment of this disclosure, is illustrated. Process 500 may be performed solely by the vehicle (e.g., vehicle 102) and / or in conjunction with server 104. At step 502, the vehicle may determine the presence of insects inside the vehicle (e.g., using any of the techniques disclosed above). At step 504, the vehicle may also determine the presence of a user in the vehicle's external environment. In this case, a user possibly standing next to the vehicle may intend to enter the vehicle. It would be beneficial if insects located inside the vehicle were driven out, allowing the user to enter. The vehicle may also determine the user's position relative to the vehicle. For example, at step 506, it is determined whether the user is near the driver's side door or one of the rear passenger doors. Based on the user's position, at step 508, the vehicle may then activate one or more of the appropriate exterior lights of the vehicle. For example, the vehicle may activate the exterior light furthest from the user's position. In one embodiment, if the vehicle determines that the user is near the driver's side door, the vehicle may activate one or more taillights to emit light that attracts insects to them. At step 510, this may cause the insects to move toward the vehicle's taillights, thus clearing the vehicle's interior. The user can then enter the vehicle without worrying about the insects inside.

[0053] Figure 5BThis is a flowchart of a process 550 for mitigating the presence of insects in or around a vehicle according to an embodiment of this disclosure. Process 550 may be performed by the vehicle alone (e.g., vehicle 102) and / or in conjunction with server 104. At step 512, the vehicle may determine the presence of insects outside the vehicle. At step 514, the vehicle may also determine the presence of one or more users inside the vehicle. In this case, the user may intend to leave the vehicle and may want to prevent insects from entering the vehicle. At step 516, the vehicle may detect the opening of one or more doors of the vehicle. Based on this, the vehicle may infer that the user may want to leave the vehicle. Typically, when a door is opened, the vehicle's interior lights (e.g., dome lights) are illuminated to guide the user out of the vehicle. However, in this case, at step 518, the vehicle may keep the interior lights off to avoid attracting insects to travel inside the vehicle. In another embodiment, the vehicle may illuminate the interior lights with insect-repelling light to prevent insects from entering the vehicle. At step 520, the vehicle may turn on one or more exterior lights of the vehicle to attract insects to the exterior lights. This will cause insects to move toward the outside lights, and now users can leave the vehicle without worrying about insects getting inside.

[0054] In some embodiments, two or more vehicles may communicate with each other to mitigate the presence of insects and enhance the user experience for users leaving and / or entering the vehicle. Figure 6 A process 600 for mitigating the presence of insects according to yet another embodiment of the present disclosure is shown. Process 600 may be performed by two or more vehicles communicating with each other (e.g., using V-2-V communication and / or via server 104).

[0055] For example, consider two vehicles located near each other, such as in a parking lot. The first vehicle is associated with one or more users in a first group, and the second vehicle is associated with one or more users in a second group. Further consider that the first group of users intends to leave or enter the first vehicle. Similarly, the second group of users intends to enter or leave the second vehicle. At step 602, the first vehicle may determine the presence of insects in or around the first vehicle (e.g., using any of the techniques described above). At step 604, the second vehicle may also detect the presence of insects in or around the second vehicle. At step 606, the first vehicle may detect the presence of a first group of users inside or around the first vehicle intending to leave, or the presence of a first group of users around the first vehicle intending to enter. In either of these cases, it may be necessary to mitigate the presence of insects inside and / or outside the first vehicle so that the first group of users can enter or leave. At step 608, the second vehicle may detect the presence of a second group of users in or around the second vehicle, although this is not necessary for the operation of the basic embodiment.

[0056] At step 610, the first vehicle can determine that the first group of users intends to leave or enter the first vehicle. In one embodiment, operation of the first vehicle's doors can be used to determine the intention of the first group of users. After the first vehicle determines that the first group of users intends to enter or leave the first vehicle, at step 612, the first vehicle can send a message to the second vehicle, providing the second vehicle with this information and information about the presence of insects in or around the first vehicle. After the second vehicle receives this information from the first vehicle, the second vehicle can turn on one or more of its external lights at step 614. The second vehicle can manipulate its external lights to emit light with wavelengths that attract insects. At step 616, this will cause insects present in or around the first vehicle to migrate toward the second vehicle, thereby reducing or eliminating the presence of insects in or around the first vehicle. The first group of users can now enter or leave the first vehicle without worrying about insects entering or remaining inside the first vehicle.

[0057] At step 618, the first vehicle can detect the entry or exit of the first group of users. At step 620, the first vehicle can determine that it is safe after the first group of users has entered or left. For example, the doors of the first vehicle are closed, and all windows or other panels of the first vehicle are closed, preventing insects from entering the first vehicle. In some embodiments, the first vehicle can detect that the first group of users has entered the first vehicle and send a second message to the second vehicle based on this. The second vehicle can then turn off its exterior lights. At step 622, the second vehicle can determine that the second group of users intends to enter or leave the second vehicle. Since the second vehicle has detected the presence of insects at step 604, it may be beneficial to get rid of those insects before the second group of users enters or leaves the second vehicle. To achieve this, at step 624, the second vehicle can send a message to the first vehicle that the second group of users intends to enter or leave the second vehicle. Upon receiving this message and confirming that the first vehicle is safe, the first vehicle can turn on one or more of its exterior lights at step 626 in a manner that attracts insects from the second vehicle to the first vehicle. At step 628, this may cause the insects to migrate from the second vehicle to the first vehicle. Once the insects have migrated from the second vehicle to the first vehicle, the second group of users can now enter or leave the second vehicle without worrying about the insects. Since the first vehicle is safe, it is impossible for insects to enter it. In this way, two or more vehicles can cooperate to divert insects from a particular vehicle, allowing users of another vehicle to enter or leave without having to confront the insects. It should be noted that in the above scenario, the second vehicle may not necessarily also have users wanting to enter or leave it. The second vehicle can simply assist the first vehicle in attracting insects, enabling the first group of users to enter or leave the first vehicle.

[0058] Figure 7An example control server 700 (e.g., according to one or more example embodiments of the present disclosure) is described, capable of performing any of one or more technologies (e.g., methods) or performing the methods described above in conjunction with vehicle 102. Figure 1 A block diagram of the control server 104. In other embodiments, server 700 may act as a standalone device or may be connected to other servers (e.g., networked). In a networked deployment, server 700 may operate as a server machine, a client machine, or both in a server-client network environment. In the example, server 700 may act as a peer-to-peer (P2P) (or other distributed) network environment. Server 700 may be a personal computer (PC), tablet PC, set-top box (STB), personal digital assistant (PDA), mobile phone, smart keychain, wearable computing device, network device, network router, switch, or bridge, or any machine capable of executing instructions (continuously or otherwise) specifying actions to be taken by the server (such as a base station). Furthermore, while only a single server is described, the term "server" should also be considered as including any collection of servers that individually or jointly execute a set (or more sets) of instructions for performing any one or more of the methodologies discussed herein, such as those configured for cloud computing, Software as a Service (SaaS), or other computer clusters.

[0059] The examples described herein may include logic or components, modules, or mechanisms, or may operate on logic or components, modules, or mechanisms. A module is a tangible entity (e.g., hardware) capable of performing a specified operation during operation. A module includes hardware. In the examples, the hardware may be specifically configured to perform a specific operation (e.g., hardwired). In another example, the hardware may include a configurable execution unit (e.g., a transistor, circuit, etc.) and a computer-readable medium containing instructions that configure the execution unit to perform a specific task when in operation. The configuration may occur under the guidance of the execution unit or loading mechanism. Thus, when the device is in operation, the execution unit is communicatively coupled to the computer-readable medium. In this example, the execution unit may be a member of more than one module. For example, under operation, the execution unit may be configured at one point in time to implement a first module via a first set of instructions, and at a second point in time to reconfigure the execution unit to implement a second module via a second set of instructions.

[0060] Server (e.g., computer system) 700 may include a hardware processor 702 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), a hardware processor core, or any combination thereof), main memory 704, and static memory 706, some or all of which may communicate with each other via interconnect (e.g., bus) 708. Server 700 may also include a graphics display device 710, an alphanumeric input device 712 (e.g., a keyboard), and a user interface (UI) navigation device 714 (e.g., a mouse). In this example, the graphics display device 710, the alphanumeric input device 712, and the UI navigation device 714 may be a touchscreen display. Server 700 may additionally include a storage device (e.g., a drive unit) 716, a network interface device / transceiver 720 coupled to an antenna, and one or more sensors 728, such as a global positioning system (GPS) sensor, a compass, an accelerometer, or other sensors. Server 700 may include output controller 734, such as serial (e.g., Universal Serial Bus (USB)), parallel, or other wired or wireless (e.g., infrared (IR), near field communication (NFC), etc.) connections, to communicate with or control one or more peripheral devices (e.g., printers, card readers, etc.).

[0061] Storage device 716 may include machine-readable medium 722 on which one or more sets of data structures or instructions (e.g., software) embodying or being utilized by any or more of the techniques or functions described herein are stored. The instructions may also reside wholly or at least partially within main memory 704, static memory 706, or hardware processor 702 during execution of the instructions by server 700. In this example, one or any combination of hardware processor 702, main memory 704, static memory 706, or storage device 716 may constitute the machine-readable medium.

[0062] Although machine-readable medium 722 is shown as a single medium, the term "machine-readable medium" can include a single medium or multiple media (e.g., a centralized or distributed database, and / or associated caches and servers) configured to store one or more instructions.

[0063] Various embodiments may be implemented wholly or partially in software and / or firmware. This software and / or firmware may take the form of instructions contained in or on a non-transitory computer-readable storage medium. Those instructions may then be read and executed by one or more processors to perform the operations described herein. The instructions may be in any suitable form, such as, but not limited to, source code, compiled code, interpreted code, executable code, static code, dynamic code, etc. Such computer-readable medium may include any tangible non-transitory medium for storing information in a form readable by one or more computers, such as, but not limited to, read-only memory (ROM); random access memory (RAM); disk storage media; optical storage media; flash memory, etc.

[0064] The term "machine-readable medium" can include any medium having the following properties: capable of storing, encoding, or transporting instructions executable by server 700; and causing server 700 to perform any or more of the technologies disclosed herein; or capable of storing, encoding, or transporting data structures used by or associated with such instructions. Examples of non-limiting machine-readable media can include solid-state memory as well as optical and magnetic media. In examples, mass-capacity machine-readable media includes machine-readable media having a plurality of particles having rest masses. Specific examples of mass-capacity machine-readable media can include non-volatile memory, such as semiconductor memory devices (e.g., electrically programmable read-only memory (EPROM) or electrically erasable programmable read-only memory (EEPROM)) and flash memory devices; magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.

[0065] The instructions can be further transmitted or received over a communication network via a transmission medium using any of a variety of transport protocols (e.g., Frame Relay, Internet Protocol (IP), Transmission Control Protocol (TCP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), etc.) through the network interface device / transceiver 720. Example communication networks may include local area networks (LANs), wide area networks (WANs), packet data networks (e.g., the Internet), mobile phone networks (e.g., cellular networks), conventional telephone (POTS) networks, and wireless data networks (e.g., networks called wireless communication networks). The Institute of Electrical and Electronics Engineers (IEEE) 802.11 series of standards, known as The IEEE 802.16 series of standards, the IEEE 802.15.4 series of standards, and peer-to-peer (P2P) networks are examples of such standards. In the example, the network interface device / transceiver 720 may include one or more physical sockets (e.g., Ethernet sockets, coaxial sockets, or telephone sockets) or one or more antennas for connection to a communication network. In the example, the network interface device / transceiver 720 may include multiple antennas for wireless communication using at least one of the following: Single-Input Multiple-Output (SIMO) technology, Multiple-Input Multiple-Output (MIMO) technology, or Multiple-Input Single-Output (MISO) technology. The term "transmission medium" should be considered to include any intangible medium capable of storing, encoding, or transmitting instructions for execution by server 700 and comprising digital or analog communication signals, or other intangible media used to facilitate communication of such software. The operations and processes described and shown above may be implemented or performed in any suitable order as needed in various embodiments. Additionally, in some embodiments, at least a portion of the operations may be performed in parallel. Furthermore, in some embodiments, fewer or more operations than described may be performed.

[0066] It should be noted that the vehicle implements and / or performs the operations described herein in accordance with the owner's manual and safety guidelines. Additionally, any actions taken by the vehicle owner / driver based on recommendations or notices provided by the vehicle should comply with all rules specific to the vehicle's location and operation (e.g., federal, state, national, city, etc.). Recommendations or notices provided by the vehicle should be considered as advice and followed only in accordance with any rules specific to the vehicle's location and operation. In the foregoing disclosure, reference has been made to the accompanying drawings, which form a part of the foregoing disclosure, illustrating specific embodiments in which the present disclosure may be practiced. It should be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present disclosure. References to “an embodiment,” “embodiment,” “example embodiment,” etc., in this specification indicate that the described embodiment may include a particular feature, structure, or characteristic, but each embodiment may not necessarily include said particular feature, structure, or characteristic. Furthermore, such phrases do not necessarily refer to the same embodiment. Moreover, when features, structures, or characteristics are described in connection with embodiments, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments, whether explicitly described or not.

[0067] Additionally, where appropriate, the functions described herein may be performed by one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application-specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As those skilled in the art will appreciate, components may be referred to by different names. This document is not intended to distinguish between components with different names but identical functions.

[0068] It should also be understood that the word “example” as used herein is intended to be non-exclusive and non-restrictive in nature. More specifically, the word “example” as used herein refers to one of several examples, and it should be understood that there is no undue emphasis or preference for any particular example described.

[0069] Computer-readable media (also known as processor-readable media) include any non-transitory (e.g., tangible) medium that contributes to providing data (e.g., instructions) that can be read by a computer (e.g., by the computer's processor). Such media can take many forms, including but not limited to non-volatile and volatile media. Computing devices may include computer-executable instructions, which can be executed by one or more computing devices (such as those listed above) and stored on a computer-readable medium.

[0070] Regarding the processes, systems, methods, heuristics, etc., described herein, it should be understood that although the steps of such processes, etc., are described as occurring in a certain ordered order, such processes can be practiced by performing the described steps in a different order than that described herein. It should also be understood that some steps may be performed simultaneously, other steps may be added, or some steps described herein may be omitted. In other words, the description of processes herein is provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.

[0071] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Many embodiments and applications beyond the examples provided will become apparent upon reading the above description. The scope should not be determined by reference to the above description, but rather by reference to the appended claims and the full scope of their equivalents. It is anticipated and expected that the techniques discussed herein will evolve in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In conclusion, it should be understood that modifications and changes are possible with this application.

[0072] Unless explicitly indicated otherwise herein, all terms used in the claims are intended to be given their ordinary meaning as understood by one skilled in the art as described herein. Specifically, unless the claims explicitly limit the recitation to the contrary, the use of singular articles such as “a,” “the,” or “the” should be interpreted as one or more of the elements indicated by the recitation. Unless otherwise specifically stated or otherwise understood in the context of use, conditional language such as, in particular, “can,” “may,” “may,” or “may” is generally intended to express that some embodiments may include certain features, elements, and / or steps, while other embodiments may not include certain features, elements, and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element, and / or step in any way.

[0073] According to an embodiment, to operate the group of lights, the one or more processors are further configured to execute the instructions to: determine a first group of lights, the first group of lights (i) being disposed on one or more outer surfaces of the vehicle and (ii) being located furthest from the second position; and turn on the first group of lights.

[0074] According to an embodiment, the first location is inside the vehicle, and the one or more processors are further configured to execute the instructions to: determine the presence of one or more users inside the vehicle; and illuminate the lighting devices inside the vehicle, wherein the lighting devices emit light with a wavelength greater than 600 nm and are part of the set of lights.

[0075] According to an embodiment, the insect's first location is in the external environment of the vehicle, and it is to operate the set of lights. The one or more processors are also configured to execute the instructions to operate the first set of lights, which are disposed on one or more external surfaces of the vehicle.

[0076] According to an embodiment, the insect's first location is inside the vehicle, and it is to operate the set of lights. The one or more processors are also configured to execute the instructions to operate the first set of lights, which are located inside the vehicle.

[0077] According to an embodiment, the set of lamps emits light with a wavelength between 400nm and 500nm or above 600nm.

Claims

1. A method comprising: Images are captured by the vehicle using its image sensor; The vehicle uses the image to generate foreground image data and background image data; The vehicle performs morphological operations on the image to remove noise from the image; The vehicle performs feature extraction on the foreground image data and the background image data to identify one or more insects depicted in the image; The first position of the insect relative to the vehicle is determined by the vehicle; as well as The vehicle operates a set of lights based on the insect's first position.

2. The method of claim 1, wherein the first location of the insect is in the external environment of the vehicle, and operating the set of lights includes operating a first set of lights disposed on one or more external surfaces of the vehicle by the vehicle.

3. The method of claim 1, wherein the first location of the insect is inside the vehicle, and operating the set of lights includes the vehicle operating the first set of lights disposed inside the vehicle.

4. The method of claim 1, further comprising: The presence of one or more users near the vehicle is determined by the vehicle. as well as The second position of the one or more users relative to the vehicle is determined by the vehicle; Operating the set of lights also includes operating the set of lights based on the second location of the one or more users.

5. The method of claim 4, wherein operating the group of lights based on the second location of the one or more users, further comprising: Identify the first set of lights that is disposed on one or more outer surfaces of the vehicle and is located furthest from the second position; as well as Turn on the first set of lights.

6. The method of claim 5, wherein the first group of lamps emits light with a wavelength between 400 nm and 500 nm.

7. The method of claim 1, wherein the first location is inside the vehicle, the method further comprising: The presence of one or more users inside the vehicle is determined by the vehicle. The vehicle illuminates the interior lighting device, which is part of the set of lights and emits light with a wavelength greater than 600 nm.

8. A system comprising: A first vehicle, the first vehicle having a first group of one or more processors, a first group of one or more memory devices storing instructions and coupled to the first group of one or more processors, and a first group of one or more sensors coupled to the first group of one or more processors; and The second vehicle has a second set of one or more processors, a second set of one or more memory devices storing instructions and coupled to the second set of one or more processors, and a second set of one or more sensors coupled to the second set of one or more processors; The system described therein is capable of operating to: The first position of the first vehicle is determined by the first vehicle; The second vehicle determines the second position of the second vehicle; The presence of insects near the first vehicle is determined by the first vehicle; The presence of a first group of users near the first vehicle is determined by the first vehicle; The first vehicle sends a first message to the second vehicle; as well as The second vehicle illuminates one or more external lights based on the first message to induce the insects to migrate toward the second vehicle.

9. The system of claim 8, wherein the first vehicle is further configured to: It has been determined that the first group of users has entered the first vehicle; and Send a second message to the second vehicle to turn off the one or more external lights.

10. The system of claim 9, wherein the first message and the second message are transmitted via a vehicle-to-vehicle communication protocol without any intermediary entity.

11. The system of claim 8, wherein the one or more external lamps emit light with wavelengths between 400 nm and 500 nm or light in the ultraviolet spectrum.

12. The system of claim 8, wherein the first vehicle is further configured to: It has been determined that the first group of users has entered the first vehicle; It was determined that the first vehicle was safe; Receive a second message from the second vehicle; and Based on the second message and the fact that the first vehicle is safe, turn on one or more exterior lights of the first vehicle.

13. The system of claim 12, wherein the second message is generated by the second vehicle based on the second vehicle detecting the presence of a second group of users and one or more insects near the second vehicle.

14. A vehicle comprising: One or more processors; One or more memory devices, the one or more memory devices storing instructions and being coupled to the one or more processors; and One or more sensors, said one or more sensors being coupled to said one or more processors, said one or more processors being configured to execute said instructions to: Image data is captured using the one or more sensors; The image data is used to generate foreground image data and background image data; Perform morphological operations on the image data to remove noise from the image data; Feature extraction is performed on the foreground image data and the background image data to identify one or more insects depicted in the image data; Determine the first position of the insect relative to the vehicle; as well as The vehicle's lights are operated based on the insect's first position.

15. The vehicle of claim 14, wherein the one or more processors are further configured to execute the instructions to: Determine the presence of one or more users near the vehicle; Determine the second position of the one or more users relative to the vehicle; and The group of lights is further operated based on the second location of the one or more users.

Images