Undercarriage living body monitoring method, vehicle, storage medium, and program product

Abstract

The embodiment of the present application provides a vehicle bottom living body monitoring method, a vehicle, a storage medium and a program product, relates to the technical field of vehicle control, and the method comprises the steps of: when the vehicle is started, acquiring multimedia data of a vehicle peripheral area collected by an image acquisition unit during vehicle parking; determining whether a living body stays in a vehicle bottom area according to the multimedia data; if the living body stays in the vehicle bottom area, acquiring temperature data of the vehicle bottom area collected by a temperature acquisition unit, and determining whether the living body stays in the vehicle bottom area according to the temperature data. The present application can enable a user to determine whether the living body stays in the vehicle bottom in time, reduce the possibility of causing damage to the living body during vehicle movement, and improve the vehicle use safety.

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and more particularly to a method for monitoring living organisms under a vehicle, a vehicle, a storage medium, and a program product. Background Technology

[0002] During routine parking, live organisms may enter and remain under the vehicle, especially after prolonged parking, where they may seek shelter. If the user does not notice these organisms when starting the vehicle, they could be harmed.

[0003] In existing technologies, users typically manually inspect the area around the vehicle before starting it to check for any unusual activity. However, manual inspection is susceptible to factors such as the scope of observation, the angle of observation, and the user's attention, making it difficult to detect living organisms located under the vehicle in a timely manner. Summary of the Invention

[0004] This invention provides a method, vehicle, storage medium, and program product for monitoring living organisms under vehicles, enabling users to promptly determine whether living organisms exist under the vehicle, reducing the possibility of harm to living organisms during vehicle movement, and improving vehicle safety.

[0005] In a first aspect, the vehicle provided in this embodiment of the invention includes a control unit, an image acquisition unit, and a temperature acquisition unit. The image acquisition unit is disposed around the periphery of the vehicle, and the temperature acquisition unit is disposed at the bottom of the vehicle. The image acquisition unit and the temperature acquisition unit are electrically connected to the control unit. The vehicle underside live organism monitoring method provided in this embodiment of the invention is applied to the control unit. It includes: when the vehicle is started, acquiring multimedia data of the vehicle periphery area collected by the image acquisition unit during vehicle parking; determining whether there is a risk of live organisms remaining in the vehicle underside area based on the multimedia data; if there is a risk of live organisms remaining in the vehicle underside area, acquiring temperature data of the vehicle underside area collected by the temperature acquisition unit, and determining whether there are live organisms in the vehicle underside area based on the temperature data.

[0006] Secondly, the vehicle provided in this embodiment of the invention includes a control unit, an image acquisition unit, and a temperature acquisition unit. The image acquisition unit is disposed around the periphery of the vehicle, and the temperature acquisition unit is disposed at the bottom of the vehicle. The image acquisition unit and the temperature acquisition unit are electrically connected to the control unit. The vehicle undercarriage live organism monitoring device provided in this embodiment of the invention includes: an acquisition module, used to acquire multimedia data of the vehicle periphery area collected by the image acquisition unit during vehicle parking when the vehicle is started; a first determination module, used to determine whether there is a risk of live organisms remaining in the vehicle undercarriage area based on the multimedia data; and a second determination module, used to acquire temperature data of the vehicle undercarriage area collected by the temperature acquisition unit if there is a risk of live organisms remaining in the vehicle undercarriage area, and determine whether there are live organisms in the vehicle undercarriage area based on the temperature data.

[0007] Thirdly, the vehicle provided in the embodiments of the present invention includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the vehicle under-vehicle live biological monitoring method as described in any embodiment of the present invention.

[0008] Fourthly, the computer-readable storage medium provided in the embodiments of the present invention stores a computer program thereon, which, when executed by a processor, implements the vehicle under-body live biological monitoring method as described in any embodiment of the present invention.

[0009] Fifthly, the computer program product provided in the embodiments of the present invention includes a computer program that, when executed by a processor, implements the vehicle under-body live biological monitoring method as described in any embodiment of the present invention.

[0010] In this embodiment of the invention, when the vehicle is started, multimedia data of the vehicle's outer perimeter area collected by the image acquisition unit during vehicle parking is acquired, and the presence of any living organisms at the bottom of the vehicle is determined based on the multimedia data. After determining that there is a risk of living organisms at the bottom of the vehicle, temperature data of the vehicle's bottom area collected by the temperature acquisition unit is acquired, and the presence of any living organisms at the bottom of the vehicle is further determined based on the temperature data. This allows the control unit to combine the multimedia data of the vehicle's outer perimeter area collected during parking with the temperature data when the vehicle is started to judge the presence of living organisms at the bottom of the vehicle, improving the reliability of the judgment results. This enables users to promptly determine whether there are any living organisms at the bottom of the vehicle, reducing the possibility of harm to living organisms during vehicle movement and improving vehicle safety. Attached Figure Description

[0011] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a schematic flowchart of a method for monitoring live organisms under a vehicle provided in an embodiment of the present invention; Figure 2 This is another schematic diagram of the process for monitoring live organisms under a vehicle provided in this embodiment of the invention; Figure 3 This is a schematic diagram of a vehicle under-car live biological monitoring device provided in an embodiment of the present invention; Figure 4 This is a structural schematic diagram of a vehicle provided in an embodiment of the present invention. Detailed Implementation

[0013] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0014] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0015] Figure 1This is a schematic flowchart of a vehicle undercarriage live organism monitoring method provided in this embodiment of the invention. This method is applicable to scenarios where the presence of live organisms in the undercarriage area of ​​a vehicle needs to be determined during vehicle startup. The method can be executed by a vehicle undercarriage live organism monitoring device provided in this embodiment, which can be implemented using software and / or hardware. In one specific embodiment, the device can be integrated into the vehicle. The following embodiment illustrates the integration of the vehicle undercarriage live organism monitoring device into a vehicle.

[0016] The vehicle in this embodiment includes a control unit, an image acquisition unit, and a temperature acquisition unit. The image acquisition unit is located on the periphery of the vehicle, and the temperature acquisition unit is located at the bottom of the vehicle. The image acquisition unit and the temperature acquisition unit are electrically connected to the control unit. (See reference...) Figure 1 The vehicle under-vehicle live biological monitoring method of this embodiment may include the following steps: Step 101: When the vehicle is started, acquire multimedia data of the vehicle's peripheral area collected by the image acquisition unit during the vehicle's parking period.

[0017] An image acquisition unit refers to a device used to collect image information of the area surrounding the vehicle, such as a camera installed on the exterior of the vehicle. The image acquisition unit can collect image information of the area around the vehicle in real time or according to a preset acquisition cycle. Parking period refers to the time during which the vehicle is stationary and not being driven. During this period, living organisms in the vehicle's surrounding environment may approach the vehicle or enter the area under the vehicle. The vehicle's surrounding area refers to a certain spatial area outside the vehicle, including the area around the vehicle close to the body, used to cover the activity range of living organisms that may approach or enter the area under the vehicle. Multimedia data refers to data collected by the image acquisition unit to characterize the vehicle's surrounding environment, including video data or image data.

[0018] Specifically, when the vehicle is parked, the control unit controls the image acquisition unit to continuously collect multimedia data of the area surrounding the vehicle and stores the collected data. When the vehicle is detected to be starting, the control unit retrieves the multimedia data collected by the image acquisition unit during the vehicle's parking period. In this way, environmental information of the area surrounding the vehicle can be obtained before the vehicle starts, allowing for assessment of any potential risk of living organisms remaining in the area under the vehicle based on changes in the environment before starting.

[0019] Step 102: Based on multimedia data, determine whether there is a risk of live organisms remaining in the area under the vehicle.

[0020] Live organisms refer to individuals with vital characteristics, such as cats and dogs, that may enter the undercarriage area of ​​a vehicle. The undercarriage area refers to the space beneath the vehicle chassis, including the areas between various components of the vehicle and between the vehicle and the ground where live organisms can enter or remain. The risk of live organisms remaining refers to the possibility that a live organism may enter and remain in the undercarriage area of ​​a vehicle.

[0021] Specifically, the control unit uses multimedia data collected around the vehicle during parking to determine whether any living organisms approach the vehicle and whether they might remain in the underside of the vehicle based on their activity. If it is determined that a living organism might enter the underside of the vehicle, a risk of a living organism remaining there is identified. If it is determined that a living organism is unlikely to enter the underside of the vehicle, a risk of a living organism remaining there is identified.

[0022] Step 103: If there is a risk of living organisms remaining under the vehicle, the temperature data of the area under the vehicle collected by the temperature acquisition unit is obtained, and the presence of living organisms in the area under the vehicle is determined based on the temperature data.

[0023] A temperature acquisition unit is a device used to collect temperature information about the underside of a vehicle. Examples include temperature sensors and temperature sensor arrays. Temperature acquisition units can be placed at different locations on the underside of the vehicle to collect temperature data for corresponding areas. Temperature data refers to the data collected by the temperature acquisition unit that characterizes the temperature state of the underside of the vehicle, and can include temperature values ​​corresponding to different locations on the underside of the vehicle.

[0024] Specifically, when a risk of live organisms remaining in the vehicle's underside is determined, the temperature acquisition unit begins collecting temperature data for that area. Since live organisms typically exhibit temperature characteristics distinct from the environment under the vehicle, the control unit compares the temperature data with a preset normal temperature range for the vehicle's underside. If the temperature data deviates from this range, it indicates a temperature change at the vehicle's underside, thus confirming the presence of live organisms. This method allows for further detection of the vehicle's underside based on temperature data, improving the accuracy of live organism detection beyond image-based assessments. Furthermore, collecting temperature data only when a risk of live organism presence is confirmed reduces unnecessary work by the temperature acquisition unit and lowers system power consumption.

[0025] In this embodiment, when the vehicle is started, multimedia data of the vehicle's outer perimeter area collected by the image acquisition unit during vehicle parking is acquired. Based on the multimedia data, it is determined whether there is a risk of live organisms remaining in the vehicle's underside. After determining that there is a risk of live organisms remaining in the vehicle's underside, temperature data of the vehicle's underside area collected by the temperature acquisition unit is acquired. Based on the temperature data, it is further determined whether there are live organisms in the vehicle's underside. This allows the control unit to combine the multimedia data of the vehicle's outer perimeter area collected during parking and the temperature data when the vehicle is started to judge the presence of live organisms in the vehicle's underside, improving the reliability of the judgment results. This enables users to promptly determine whether there are live organisms in the vehicle's underside, reducing the possibility of harm to live organisms during vehicle movement and improving vehicle safety.

[0026] The vehicle in this embodiment includes a control unit, an image acquisition unit, and a temperature acquisition unit. The image acquisition unit is located on the periphery of the vehicle, and the temperature acquisition unit is located on the bottom of the vehicle. The image acquisition unit and the temperature acquisition unit are electrically connected to the control unit. There are multiple image acquisition units, with one image acquisition unit corresponding to one image acquisition area, and all image acquisition areas at least cover the periphery of the vehicle. There are multiple temperature acquisition units, with one temperature acquisition unit corresponding to one temperature acquisition area, and all temperature acquisition areas at least cover the bottom of the vehicle. Figure 2 This is another schematic diagram of the process for monitoring live organisms under vehicles provided in this embodiment of the invention, as shown below. Figure 2 As shown, the vehicle under-vehicle live organism monitoring method of this embodiment may include: Step 201: When the vehicle is started, acquire multimedia data of the vehicle's peripheral area collected by the image acquisition unit during the vehicle's parking period, wherein the multimedia data is video data or image data.

[0027] Video data refers to video data acquired by the image acquisition unit during a period of time while the vehicle is parked. Image data refers to data composed of multiple images acquired by the image acquisition unit during the same period. Specifically, the multimedia data acquired by the image acquisition unit of the vehicle's peripheral area can include video data or image data. When the image acquisition unit continuously acquires environmental information about the vehicle's peripheral area, the acquired multimedia data can be video data; when the image acquisition unit acquires environmental information about the vehicle's peripheral area at preset time intervals or preset times, the acquired multimedia data can be image data.

[0028] In this embodiment, multiple image acquisition units can be spaced apart along the circumferential direction of the vehicle to form an image acquisition area surrounding the vehicle, thereby enabling all-round monitoring of the area around the vehicle.

[0029] In one implementation, after the user starts the vehicle, the vehicle's power system is in the starting state, but the vehicle is still in the parking gear and has not yet entered a driving state, so it will not move immediately. Therefore, the control unit can use this stage after the vehicle is started but before it enters a driving state to perform live organism detection on the area under the vehicle, thereby determining whether there are any live organisms under the vehicle before the vehicle is driven, reducing the risk of live organisms being harmed by driving directly after starting the vehicle.

[0030] Optionally, the image acquisition unit is activated in response to the user's parking operation.

[0031] Parking operation refers to the user's operation of controlling the vehicle to enter a parked state, such as the user performing operations such as parking, turning off the engine, or shutting off the vehicle's power system, so that the vehicle stops moving and enters a parking state.

[0032] Specifically, after the user parks the vehicle in the target location and performs the parking operation, the control unit activates the image acquisition unit located around the vehicle, enabling it to collect environmental information about the area surrounding the vehicle and store the acquired multimedia data. This method automatically activates the image acquisition unit after the vehicle enters the parking state, requiring no additional user intervention. This ensures that environmental information about the area surrounding the vehicle is acquired while the vehicle is parked, providing a data foundation for subsequent live organism detection.

[0033] Step 202: For multimedia data that is video data, select several video frames from the video data based on preset rules, and input the several video frames into the image analysis model to determine whether there are living organisms in the several video frames.

[0034] Preset rules refer to pre-defined video frame selection conditions used to select video frames for analysis from multiple video frames contained in the video data. For example, several video frames can be selected from the video data according to a preset time interval or a preset sampling frequency. A video frame refers to a single image in the video data. Each video frame corresponds to a point in time during the video acquisition process and is used to characterize the environmental state of the vehicle's surrounding area at that point in time. An image analysis model refers to a model used to analyze and process image data. It can extract and identify features from the input video frames to determine whether the video frame contains a target object. In this embodiment, the image analysis model can be implemented using existing image recognition models, and this application does not limit its specific structure and implementation method.

[0035] Specifically, when the multimedia data acquired by the image acquisition unit is video data, since the video data includes multiple video frames acquired continuously in chronological order, the control unit can select several representative video frames from the video data according to preset rules and input the selected video frames into the image analysis model. The image analysis model analyzes the input video frames to identify whether there are living organisms in each video frame. Among them, the method of selecting several video frames from the video data based on preset rules can include at least one of the following: (1) Selecting video frames from the video data according to preset time intervals, thereby reducing the number of video frames that need to be processed, and reducing the data processing volume of the image analysis model while ensuring that information on changes in the environment of the vehicle's surrounding area can be obtained; (2) Selecting a preset number of video frames evenly from the video data, thereby controlling the number of video frames input into the image analysis model and improving data processing efficiency; (3) Since video frames within a preset time period before vehicle startup are more likely to reflect the activity of living organisms in the vehicle's surrounding area before vehicle startup, video frames within a preset time period before vehicle startup are selected from the video data, thereby improving the targeting of the risk assessment of the presence of living organisms. (4) Compare adjacent video frames in the video data. When there is a large image change between adjacent video frames, select the corresponding video frame. This will give priority to selecting video frames containing information about changes in the vehicle's outer area, thereby improving the detection effect of live biological activities.

[0036] Step 203: For multimedia data that is image data, input the image data into the image analysis model to determine whether there are living organisms in the image data.

[0037] Specifically, when the multimedia data is image data, the control unit inputs the image data into the image analysis model, which then analyzes and processes each image in the image data to determine whether there is a living organism in each image.

[0038] Step 204: If a living organism is present in several video frames or image data, determine the last location where the living organism appeared.

[0039] Specifically, the image analysis model sequentially analyzes several input video frames or images to identify the presence of living organisms in each frame or image. When multiple living organisms are detected, the image analysis model can distinguish between them, allowing the control unit to process each organism separately. Since the video frames or image data are arranged in chronological order of acquisition, the control unit can determine the last video frame or image in which each living organism appeared based on the analysis results of the image analysis model, and then determine the last location of each living organism based on its position within that video frame or image.

[0040] For example, if a living organism is identified in multiple video frames or multiple images, the control unit will collect the video frame or image in which the living organism was identified the latest time, determine it as the video frame or image in which the living organism last appeared, and determine the last location of the living organism based on the location of the living organism in the video frame or image.

[0041] Step 205: Determine whether there is a risk of live organisms remaining in the underside of the vehicle based on the last location where the live organism was last seen.

[0042] Specifically, the control unit determines the distance between the living organism and the vehicle based on its last known location. If this distance is less than or equal to a preset distance (e.g., 0.5 meters), it indicates that the organism was relatively close to the vehicle, and there is a possibility that it entered the undercarriage area. Therefore, a risk of the organism remaining in the undercarriage area is identified. If the distance is greater than the preset distance, it indicates that the organism was relatively far from the vehicle, and the likelihood of it entering the undercarriage area is low. Therefore, no risk of the organism remaining in the undercarriage area is identified. In this way, the possibility of the organism entering the undercarriage area can be predicted based on its activity position in the vehicle's periphery. The temperature acquisition unit is only activated for further detection when there is a risk of retention, thus avoiding invalid detection by the temperature acquisition unit.

[0043] Step 206: If there is a risk of living organisms remaining under the vehicle, the temperature data of the area under the vehicle collected by the temperature acquisition unit is obtained, and the presence of living organisms in the area under the vehicle is determined based on the temperature data.

[0044] Optionally, determining whether there are living organisms under the vehicle based on temperature data includes: judging whether the temperature data collected by each temperature acquisition unit is within the preset temperature range corresponding to each temperature acquisition unit, wherein the preset temperature range corresponding to each temperature acquisition unit is the normal temperature range of the temperature acquisition area corresponding to each temperature acquisition unit when the vehicle is started; if the temperature data collected by each temperature acquisition unit is within the preset temperature range corresponding to each temperature acquisition unit, then it is determined that there are no living organisms under the vehicle; if the temperature data collected by at least one temperature acquisition unit is not within the preset temperature range corresponding to that temperature acquisition unit, then a target temperature acquisition unit is identified, and the presence of living organisms under the vehicle is determined based on the temperature data collected by the target temperature acquisition unit, wherein the distance between the temperature acquisition area corresponding to the target temperature acquisition unit and the temperature acquisition area corresponding to that temperature acquisition unit is less than or equal to a preset distance.

[0045] The preset temperature range refers to a pre-determined temperature range that characterizes the normal temperature state of the corresponding temperature acquisition area. This preset temperature range can be determined based on historical temperature data collected when the vehicle is started and there are no living organisms under the vehicle. It is used to determine whether the temperature in the corresponding temperature acquisition area is abnormal. The target temperature acquisition unit refers to the temperature acquisition unit corresponding to other temperature acquisition areas that are relatively close to the current temperature acquisition area. It is used to further detect temperature changes around the current area.

[0046] Specifically, the control unit determines whether the temperature data collected by each temperature acquisition unit is within its corresponding preset temperature range. Each temperature acquisition unit corresponds to a temperature acquisition area; therefore, different temperature acquisition units can correspond to different preset temperature ranges. When the temperature data collected by all temperature acquisition units is within its corresponding preset temperature range, it indicates that the temperature in all areas under the vehicle has not changed abnormally, and no temperature change caused by living organisms has been detected. Therefore, it is determined that there are no living organisms under the vehicle. When the temperature data collected by at least one temperature acquisition unit is not within its corresponding preset temperature range, it indicates that at least one temperature acquisition area has a temperature change different from the normal state. In this case, the control unit designates the temperature acquisition area whose distance from the temperature acquisition area with the temperature change is less than or equal to a preset distance as the target temperature acquisition area, identifies the temperature acquisition unit corresponding to the target temperature acquisition area as the target temperature acquisition unit, and acquires the temperature data collected by the target temperature acquisition unit. Furthermore, the control unit combines the temperature data collected by the target temperature acquisition unit to determine whether there are living organisms under the vehicle.

[0047] For example, assume temperature acquisition units are A, B, C, D, and E, and their corresponding temperature acquisition areas are a, b, c, d, and e, respectively. The distances between temperature acquisition area a and temperature acquisition areas b, c, d, and e are 28cm, 50cm, 70cm, and 30cm, respectively, with a preset distance of 30cm. If the temperature data acquired by A is not within the preset temperature range corresponding to A, and since the distance between a and b is less than the preset distance (28cm is less than 30cm) and the distance between a and e is less than the preset distance (30cm equals 30cm), then temperature acquisition areas b and e are designated as target temperature acquisition areas, and their corresponding temperature acquisition units B and E are designated as target temperature acquisition units. Based on the temperature data acquired by the target temperature acquisition units B and E, it is determined whether there are living organisms under the vehicle.

[0048] Optionally, there are multiple target temperature acquisition units. Based on the temperature data collected by the target temperature acquisition units, it is determined whether there are living organisms under the vehicle, including: determining whether the temperature data collected by each target temperature acquisition unit is within the preset temperature range corresponding to each target temperature acquisition unit; if the temperature data collected by each target temperature acquisition unit is not within the preset temperature range corresponding to each target temperature acquisition unit, it is determined that there are no living organisms under the vehicle; if the temperature data collected by at least one target temperature acquisition unit is within the preset temperature range corresponding to that target temperature acquisition unit, it is determined that there are living organisms under the vehicle.

[0049] Specifically, when the control unit detects an abnormal temperature in a certain temperature acquisition area, it acquires temperature data from multiple target temperature acquisition units surrounding the abnormal area to further determine whether the abnormal temperature is caused by a living organism. If the temperature data from all target temperature acquisition units is outside the corresponding preset temperature range, it indicates that the abnormal temperature change exists not only in the specific temperature acquisition area but also in multiple surrounding temperature acquisition areas. In this case, the abnormal temperature is more likely caused by changes in the overall environment under the vehicle (e.g., changes in ambient temperature, changes in vehicle component temperature, etc.) rather than localized temperature changes caused by a living organism, thus confirming that there is no living organism under the vehicle. If the temperature data from at least one target temperature acquisition unit is within the corresponding preset temperature range, it indicates that the temperature in some surrounding areas is normal, while the abnormal temperature is concentrated in a localized area. Since living organisms typically only affect the temperature near their location and do not cause simultaneous temperature changes in all surrounding areas, this situation is more consistent with the characteristics of a living organism causing localized temperature anomalies, and the control unit confirms that there is a living organism under the vehicle.

[0050] Continuing the previous example, if the temperature data collected by target temperature acquisition unit B is not within the preset temperature range corresponding to target temperature acquisition unit B, and the temperature data collected by target temperature acquisition unit E is not within the preset temperature range corresponding to target temperature acquisition unit E, it indicates that there are abnormal temperatures in both temperature acquisition areas b and e. This suggests that the abnormal temperature may be caused by changes in the overall environment under the vehicle, and therefore the control unit determines that there are no living organisms under the vehicle. If the temperature data collected by target temperature acquisition unit B is not within the preset temperature range corresponding to target temperature acquisition unit B, while the temperature data collected by target temperature acquisition unit E is within the preset temperature range corresponding to target temperature acquisition unit E, it indicates that the abnormal temperature is concentrated in a local area, and therefore the control unit determines that there are living organisms under the vehicle.

[0051] Step 207: After confirming the presence of a living organism at the bottom of the vehicle, a prompt message is displayed on the vehicle's center console. The prompt message is used to inform the user of the location of the living organism in the area at the bottom of the vehicle.

[0052] The center console refers to the display area or device located in the vehicle's cockpit used to display vehicle status information and provide interactive information to the user. Alert information refers to information used to inform the user of the detection results under the vehicle. Alert information can include text, images, location markers, etc., to remind the user of the presence of a living organism under the vehicle and its corresponding location.

[0053] Specifically, since each temperature acquisition unit corresponds to a different temperature acquisition area on the bottom of the vehicle, when a living organism is identified in the temperature acquisition area corresponding to a certain temperature acquisition unit, that temperature acquisition area can represent the location of the living organism on the bottom of the vehicle. Therefore, after determining that a living organism exists in the bottom area of ​​the vehicle, the control unit can determine the approximate location of the living organism in the bottom area of ​​the vehicle based on the temperature acquisition area corresponding to the temperature acquisition unit where the living organism is identified, and generate a prompt message to inform the user of the location of the living organism in the bottom area of ​​the vehicle.

[0054] In this embodiment, when the vehicle is started, multimedia data of the vehicle's outer perimeter area collected by the image acquisition unit during vehicle parking is acquired. Based on the multimedia data, it is determined whether there is a risk of live organisms remaining in the vehicle's underside. After determining that there is a risk of live organisms remaining in the vehicle's underside, temperature data of the vehicle's underside area collected by the temperature acquisition unit is acquired. Based on the temperature data, it is further determined whether there are live organisms in the vehicle's underside. This allows the control unit to combine the multimedia data of the vehicle's outer perimeter area collected during parking and the temperature data when the vehicle is started to judge the presence of live organisms in the vehicle's underside, improving the reliability of the judgment results. When it is determined that there are live organisms in the vehicle's underside, the user can be notified of the location of the live organisms in the vehicle's underside, thereby enabling the user to promptly determine whether there are live organisms in the vehicle's underside, reducing the possibility of harm to live organisms during vehicle movement, and improving vehicle safety.

[0055] The vehicle in this embodiment includes a control unit, an image acquisition unit, and a temperature acquisition unit. The image acquisition unit is located on the periphery of the vehicle, and the temperature acquisition unit is located at the bottom of the vehicle. The image acquisition unit and the temperature acquisition unit are electrically connected to the control unit. Figure 3 This is a schematic diagram of a vehicle under-car live biological monitoring device provided in an embodiment of the present invention, as shown below. Figure 3 As shown, the device includes: The acquisition module 301 is used to acquire multimedia data of the vehicle's peripheral area collected by the image acquisition unit during vehicle parking when the vehicle is started. The first determining module 302 is used to determine, based on multimedia data, whether there is a risk of live organisms remaining in the bottom area of ​​the vehicle; The second determining module 303 is used to acquire temperature data of the vehicle bottom area collected by the temperature acquisition unit if there is a risk of live organisms remaining at the bottom of the vehicle, and to determine whether there are live organisms in the vehicle bottom area based on the temperature data.

[0056] In one embodiment, there are multiple image acquisition units, one image acquisition unit corresponds to one image acquisition area, and all image acquisition areas at least cover the outer area of ​​the vehicle. There are multiple temperature acquisition units, and each temperature acquisition unit corresponds to a temperature acquisition area. All temperature acquisition areas must cover at least the bottom area of ​​the vehicle.

[0057] In one embodiment, the multimedia data is video data or image data; the first determining module 302 is specifically used for: For multimedia data that is video data, several video frames are selected from the video data based on preset rules, and the several video frames are input into the image analysis model to determine whether there are living organisms in the several video frames; For multimedia data that is image data, the image data is input into the image analysis model to determine whether there are living organisms in the image data; If a living organism is present in several video frames or image data, then determine the last location where the living organism appeared; Based on the last known location of the living organism, determine whether there is a risk of living organisms remaining in the underside of the vehicle.

[0058] In one embodiment, the second determining module 303 determines whether there are living organisms under the vehicle based on temperature data, including: Determine whether the temperature data collected by each temperature acquisition unit is within the preset temperature range corresponding to each temperature acquisition unit. The preset temperature range corresponding to each temperature acquisition unit is the normal temperature range of the temperature acquisition area corresponding to each temperature acquisition unit when the vehicle is started. If the temperature data collected by each temperature acquisition unit is within the preset temperature range corresponding to each temperature acquisition unit, it is determined that there are no living organisms under the vehicle. If the temperature data collected by at least one temperature acquisition unit is not within the preset temperature range corresponding to that temperature acquisition unit, then a target temperature acquisition unit is determined, and based on the temperature data collected by the target temperature acquisition unit, it is determined whether there is a living organism at the bottom of the vehicle. The distance between the temperature acquisition area corresponding to the target temperature acquisition unit and the temperature acquisition area corresponding to that temperature acquisition unit is less than or equal to a preset distance.

[0059] In one embodiment, there are multiple target temperature acquisition units. Based on the temperature data acquired by the target temperature acquisition units, it is determined whether there are living organisms under the vehicle, including: Determine whether the temperature data collected by each target temperature acquisition unit is within the preset temperature range corresponding to each target temperature acquisition unit; If the temperature data collected by each target temperature acquisition unit is not within the preset temperature range corresponding to each target temperature acquisition unit, it is determined that there are no living organisms under the vehicle. If at least one target temperature acquisition unit collects temperature data within the preset temperature range corresponding to that target temperature acquisition unit, then it is determined that there is a living organism at the bottom of the vehicle.

[0060] In one embodiment, the under-vehicle live organism monitoring device further includes a notification module for: Once a living organism is confirmed to be present under the vehicle, a notification message is displayed on the vehicle's center console, indicating the location of the living organism in the area under the vehicle.

[0061] In one embodiment, the under-vehicle live organism monitoring device further includes a start-up module for: The image acquisition unit is activated in response to the user's parking action.

[0062] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional modules is merely an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the functional modules described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0063] The device of this invention acquires multimedia data of the vehicle's periphery collected by an image acquisition unit during vehicle parking when the vehicle is started, and determines whether there is a risk of live organisms remaining in the vehicle's underside based on the multimedia data. After determining that there is a risk of live organisms remaining in the vehicle's underside, it acquires temperature data of the vehicle's underside collected by a temperature acquisition unit, and further determines whether there are live organisms in the vehicle's underside based on the temperature data. This allows the control unit to combine the multimedia data of the vehicle's periphery collected during parking and the temperature data when the vehicle is started to judge the presence of live organisms in the vehicle's underside, improving the reliability of the judgment results. This enables users to promptly determine whether there are live organisms in the vehicle's underside, reducing the possibility of harm to live organisms during vehicle movement and improving vehicle safety.

[0064] The following is for reference. Figure 4 It shows a schematic diagram of the structure of a computer system 400 suitable for implementing embodiments of the present invention in a vehicle. Figure 4The vehicle shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.

[0065] like Figure 4 As shown, the computer system 400 includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 402 or programs loaded from storage section 408 into random access memory (RAM) 403. The RAM 403 also stores various programs and data required for the operation of the computer system 400. The CPU 401, ROM 402, and RAM 403 are interconnected via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0066] The following components are connected to I / O interface 405: input section 406 including keyboard, mouse, etc.; output section 407 including cathode ray tube, liquid crystal display, etc., and speakers, etc.; storage section 408 including hard disk, etc.; and communication section 409 including network interface card, such as modem, etc. Communication section 409 performs communication processing via a network such as the Internet. Drive 410 is also connected to I / O interface 405 as needed. Removable media 411, such as disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 410 as needed so that computer programs read from them can be installed into storage section 408 as needed.

[0067] In particular, according to the embodiments disclosed in this invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 409, and / or installed from removable medium 411. When the computer program is executed by central processing unit (CPU) 401, it performs the functions defined above in the system of this invention.

[0068] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical fiber, a portable compact disk read-only memory, an optical storage device, a magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, etc., or any suitable combination thereof.

[0069] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0070] The modules and / or units described in the embodiments of the present invention can be implemented in software or hardware. The described modules and / or units can also be housed in a processor; for example, a processor can be described as including a data acquisition module, a first determination module, and a second determination module. The names of these modules do not necessarily limit the functionality of the module itself.

[0071] In another aspect, the present invention also provides a computer-readable medium, which may be included in the vehicle described in the above embodiments; or it may exist independently and not installed in the vehicle. The computer-readable medium carries one or more programs that, when executed by the vehicle, cause the vehicle to include: When the vehicle is started, multimedia data of the vehicle's outer perimeter area collected by the image acquisition unit during the vehicle's parking period is acquired; based on the multimedia data, it is determined whether there is a risk of live organisms remaining in the vehicle's underside area; if there is a risk of live organisms remaining in the vehicle's underside area, temperature data of the vehicle's underside area collected by the temperature acquisition unit is acquired, and based on the temperature data, it is determined whether there are live organisms in the vehicle's underside area.

[0072] The technical solution of this invention acquires multimedia data of the vehicle's periphery collected by an image acquisition unit during vehicle parking when the vehicle is started, and determines whether there is a risk of live organisms remaining in the vehicle's underside based on the multimedia data. After determining that there is a risk of live organisms remaining in the vehicle's underside, the temperature data of the vehicle's underside collected by a temperature acquisition unit is acquired, and the presence of live organisms in the vehicle's underside is further determined based on the temperature data. This allows the control unit to combine the multimedia data of the vehicle's periphery collected during parking and the temperature data when the vehicle is started to judge the presence of live organisms in the vehicle's underside, improving the reliability of the judgment results. This enables users to promptly determine whether there are live organisms in the vehicle's underside, reducing the possibility of harm to live organisms during vehicle movement and improving vehicle safety.

[0073] This invention also provides a computer program product, including a computer program that, when executed by a processor, implements the vehicle under-body live biological monitoring method provided in any embodiment of this invention.

[0074] In the implementation of a computer program product, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​as well as conventional procedural programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including local area networks (LANs) or wide area networks (WANs), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0075] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0076] It should be noted that the collection, use, storage, sharing, and transfer of user personal information involved in the technical solution of this invention all comply with the provisions of relevant laws and regulations, and require notification to the user and obtaining the user's consent or authorization. Where applicable, user personal information has undergone de-identification and / or anonymization and / or encryption technical processing. In addition, a corresponding operation entry is provided for the user to choose to agree to or reject the automated decision result; if the user chooses to reject, the process proceeds to the expert decision-making process.

[0077] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for monitoring live organisms under a vehicle, characterized in that, The vehicle includes a control unit, an image acquisition unit, and a temperature acquisition unit. The image acquisition unit is located on the periphery of the vehicle, and the temperature acquisition unit is located on the bottom of the vehicle. The image acquisition unit and the temperature acquisition unit are electrically connected to the control unit. The method is applied to the control unit, including: When the vehicle is started, the multimedia data of the vehicle's peripheral area collected by the image acquisition unit during the vehicle's parking period is acquired; Based on the multimedia data, determine whether there is a risk of live organisms remaining in the underside area of ​​the vehicle; If there is a risk of living organisms remaining under the vehicle, the temperature data of the area under the vehicle collected by the temperature acquisition unit is obtained, and the presence of living organisms in the area under the vehicle is determined based on the temperature data.

2. The method according to claim 1, characterized in that, There are multiple image acquisition units, and each image acquisition unit corresponds to an image acquisition area. All image acquisition areas at least cover the outer area of ​​the vehicle. There are multiple temperature acquisition units, and each temperature acquisition unit corresponds to a temperature acquisition area. All temperature acquisition areas at least cover the bottom area of ​​the vehicle.

3. The method according to claim 1, characterized in that, The multimedia data is video data or image data; determining whether there is a risk of live organisms remaining in the underside of the vehicle based on the multimedia data includes: In the case where the multimedia data is video data, several video frames are selected from the video data based on preset rules, and the several video frames are input into an image analysis model to determine whether there are living organisms in the several video frames; If the multimedia data is image data, the image data is input into an image analysis model to determine whether there are living organisms in the image data; If a living organism is present in several video frames or image data, then determine the last location where the living organism appeared. Based on the last known location of the live organism, determine whether there is a risk of live organisms remaining in the underside of the vehicle.

4. The method according to claim 2, characterized in that, The step of determining whether there are living organisms under the vehicle based on the temperature data includes: Determine whether the temperature data collected by each temperature acquisition unit is within the preset temperature range corresponding to each temperature acquisition unit, wherein the preset temperature range corresponding to each temperature acquisition unit is the normal temperature range of the temperature acquisition area corresponding to each temperature acquisition unit when the vehicle is started. If the temperature data collected by each temperature acquisition unit is within the preset temperature range corresponding to each temperature acquisition unit, then it is determined that there are no living organisms at the bottom of the vehicle. If the temperature data collected by at least one temperature acquisition unit is not within the preset temperature range corresponding to that temperature acquisition unit, then a target temperature acquisition unit is determined, and based on the temperature data collected by the target temperature acquisition unit, it is determined whether there is a living organism at the bottom of the vehicle. The distance between the temperature acquisition area corresponding to the target temperature acquisition unit and the temperature acquisition area corresponding to that temperature acquisition unit is less than or equal to a preset distance.

5. The method according to claim 2, characterized in that, The target temperature acquisition unit has multiple units, and the step of determining whether there are living organisms under the vehicle based on the temperature data acquired by the target temperature acquisition unit includes: Determine whether the temperature data collected by each target temperature acquisition unit is within the preset temperature range corresponding to each target temperature acquisition unit; If the temperature data collected by each target temperature acquisition unit is not within the preset temperature range corresponding to each target temperature acquisition unit, it is determined that there are no living organisms at the bottom of the vehicle. If at least one target temperature acquisition unit collects temperature data within the preset temperature range corresponding to that target temperature acquisition unit, then it is determined that there is a living organism at the bottom of the vehicle.

6. The method according to claim 5, characterized in that, The method further includes: Once a living organism is confirmed to be present under the vehicle, a notification message is displayed on the vehicle's center console, indicating the location of the living organism in the area under the vehicle.

7. The method according to claim 1, characterized in that, The method further includes: The image acquisition unit is activated in response to the user's parking action.

8. A vehicle comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method for monitoring living organisms under a vehicle as described in any one of claims 1 to 7.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method for monitoring living organisms under a vehicle as described in any one of claims 1 to 7.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the method for monitoring living organisms under a vehicle as described in any one of claims 1 to 7.

Images