Vehicle door and window state monitoring and early warning method and system

Abstract

The invention discloses a vehicle door and window state monitoring and early warning method and system, and belongs to the technical field of vehicle monitoring. The method comprises the steps that when doors and windows are not closed and a vehicle locking signal is received, the parking environment of a vehicle is graded, and an environment risk index is determined; historical behavior data of a vehicle owner is obtained, behavior modeling is carried out, a parking duration level is determined, screening is carried out in a preset parking duration level table, and a duration risk index is determined; acquiring weather information, and determining a weather risk index based on a screening result of the weather information in a preset weather condition grading table; determining a comprehensive risk value according to the environment risk index, the duration risk index and the weather risk index; and according to the comprehensive risk value, determining an early warning level and pushing early warning information to the user side in a corresponding early warning form. More flexible, accurate and humanized prompts can be provided according to different scenes, user responses and personalized requirements; the problem of low interaction efficiency in the prior art is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle monitoring, and in particular to a vehicle door and window status monitoring and early warning method and system. Background Art

[0002] The statements in this section merely mention background art related to the present invention and do not necessarily constitute prior art.

[0003] With the development of intelligent vehicles, vehicle safety systems are receiving increasing attention. However, the power windows of some models are inoperable after the engine is turned off. If the driver inadvertently leaves the windows open, traditional vehicle locking systems only ensure the doors are locked but cannot detect whether the doors or windows are fully closed, potentially leading to theft of property or rainwater infiltration.

[0004] When a vehicle detects a door or window is not closed, it primarily alerts the owner through the following methods: First, a buzzer alarm sounds when an anomaly is detected after the key is left in the vehicle or the ignition is turned off, but this can be easily overlooked in noisy environments. Second, a dashboard icon displays a red warning icon or text, requiring the driver to actively check the instrument panel and providing poor visibility at night. These solutions rely on the user's presence, passive interaction, and poor environmental adaptability, resulting in significant limitations. They are unable to continuously monitor status changes (such as a window being pried open) after the vehicle is locked and promptly notify the owner. Summary of the Invention

[0005] In order to address the shortcomings of the existing technology, the present invention provides a vehicle door and window status monitoring and early warning method, system, electronic equipment, computer-readable storage medium and computer program product, which combines multiple factors to determine the comprehensive risk value to adjust the early warning level, and pushes it in multiple early warning forms to improve interaction efficiency.

[0006] In a first aspect, the present invention provides a vehicle door and window status monitoring and early warning method; A vehicle door and window status monitoring and early warning method, comprising: Obtain the vehicle's door and window status information. If the door and window status information indicates that the door and window are not closed and the vehicle lock signal is received, execute the door and window monitoring graded warning strategy. The door and window monitoring graded warning strategy includes: Classify the parking environment of vehicles and determine the environmental risk index; Obtain the owner's historical behavior data and conduct behavioral modeling to determine the parking time level; determine the parking time risk index based on the screening results of the parking time level in the preset parking time classification table; Obtain weather information and determine a weather risk index based on the results of filtering the weather information in a preset weather condition classification table; The comprehensive risk value is determined based on the environmental risk index, duration risk index and weather risk index; based on the comprehensive risk value, the warning level is determined and the warning information is pushed to the user end in the corresponding warning form.

[0007] In some embodiments, the grading of the vehicle's parking environment and determining the environmental risk index specifically includes: determining the vehicle's address information through GPS or Bluetooth technology, and determining the environmental risk index based on the screening result of the address information in a preset parking environment grading table.

[0008] In some implementations, the historical behavior data of the vehicle owner is subjected to behavioral modeling to determine the parking duration level. Specifically, the historical behavior data of the vehicle owner is processed using a trained LSTM network to obtain the parking duration level.

[0009] In some embodiments, in response to a sensor abnormality signal, the vehicle door and window status information is generated by processing a captured vehicle interior environment image using a lightweight target detection model. In some embodiments, the warning level is determined based on the comprehensive risk value as follows: if the comprehensive risk value is not greater than a preset first threshold, the warning level is Level I; if the comprehensive risk value is greater than the preset first threshold and less than or equal to a preset second threshold, the warning level is Level II; if the comprehensive risk value is greater than the preset second threshold and less than or equal to a preset third threshold, the warning level is Level III.

[0010] In some embodiments, if the warning level is level I, the corresponding warning form is pushing a warning message within the APP; if the warning level is level II, the corresponding warning form is SMS push; if the warning level is level III, the corresponding warning form is pushing a voice warning message within the APP through the user's phone; if the warning level is level IV, the corresponding warning form is expedited pushing of a voice warning message within the APP through the user's phone and a reserved phone.

[0011] In a second aspect, the present invention provides a vehicle door and window status monitoring and warning system; A vehicle door and window status monitoring and early warning system, comprising: Vehicle door and window status detection module, used to monitor the vehicle's door and window status information; IoV communication module, used to transmit door and window status information to the cloud server; The cloud server is used to obtain the vehicle's door and window status information. If the door and window status information indicates that the door and window are not closed and the vehicle lock signal is received, the door and window monitoring graded warning strategy is implemented; Among them, the door and window monitoring graded warning strategy includes: The parking environment of the vehicle is graded to determine the environmental risk index; the historical behavior data of the vehicle owner is obtained and behavioral modeling is performed to determine the parking time level; based on the screening results of the parking time level in the preset parking time classification table, the time risk index is determined; weather information is obtained, and based on the screening results of the weather information in the preset weather condition classification table, the weather risk index is determined; based on the environmental risk index, the time risk index and the weather risk index, the comprehensive risk value is determined; based on the comprehensive risk value, the warning level is determined and the warning information is pushed to the user end in the corresponding warning form.

[0012] In a third aspect, the present invention provides an electronic device; An electronic device includes a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the above-mentioned vehicle door and window status monitoring and early warning method.

[0013] In a fourth aspect, the present invention provides a computer-readable storage medium; A computer-readable storage medium stores a computer program / instruction, which, when executed by a processor, implements the steps of the above-mentioned vehicle door and window status monitoring and early warning method.

[0014] In a fifth aspect, the present invention provides a computer program product; A computer program product includes a computer program / instruction, which, when executed by a processor, implements the steps of the above-mentioned vehicle door and window status monitoring and early warning method.

[0015] Compared with the prior art, the present invention has the following beneficial effects: 1. The technical solution provided by the present invention triggers the door and window status detection when the vehicle is locked, and determines the comprehensive risk value based on environmental factors, parking duration, weather and other factors to adjust the warning level, and pushes warnings in the corresponding warning form to improve the user experience.

[0016] 2. The technical solution provided by the present invention utilizes sensors and cameras as redundant backups to improve the reliability of vehicle door and window status detection.

[0017] 3. The technical solution provided by this invention significantly improves the owner's response efficiency to the vehicle's safety status through deep collaboration between the Internet of Vehicles and mobile terminals, through real-time detection and telephone warnings. It also supports remote control of closing doors and windows and updating status. It combines the ALM language model for dynamic voice broadcast and intelligently processes voice prompt information, enabling it to provide more flexible, accurate, and personalized prompts based on different scenarios, user reactions, and personalized needs, thereby improving the user experience. The remote control function eliminates the need for the owner to return to the vehicle for processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0019] Figure 1 A schematic diagram of the execution flow of the door and window monitoring hierarchical warning strategy provided by an embodiment of the present invention; Figure 2 A schematic diagram of the framework of a vehicle door and window status monitoring and warning system provided by an embodiment of the present invention; Figure 3 This is a logical diagram of a vehicle door and window status monitoring and warning system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0020] It should be noted that the following detailed descriptions are exemplary and intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used in the present invention have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0021] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0022] In the absence of conflict, the embodiments of the present invention and the features thereof may be combined with each other.

[0023] Example 1 The interaction efficiency between the existing vehicle door and window switch status monitoring and warning and the vehicle owner is low, and the warning effect needs to be improved; therefore, the present application provides a vehicle door and window status monitoring and warning method, which uses different warning methods to provide graded warnings when there are open doors and windows and the vehicle owner intends to lock the doors, taking into account the parking environment, parking time and weather.

[0024] Next, combine Figure 1 , a vehicle door and window status monitoring and early warning method disclosed in this embodiment is described in detail. The vehicle door and window status monitoring and early warning method is deployed on a cloud server and includes the following steps: Step 1: Get the vehicle's door and window status information. If the door and window status information indicates that the vehicle's doors and windows are not closed and the vehicle lock signal is received, proceed to step 2.

[0025] In this embodiment, the door and window status information is collected in response to the driver's departure signal through the Hall sensor and pressure sensor integrated inside the vehicle. When the door and window status information is abnormal, the door and window status information is transmitted to the cloud server through the vehicle network communication module. Among them, the pressure sensor determines whether the doors and windows are completely closed by obtaining the pressure at the doors and windows.

[0026] When the Hall sensor detects a change in the magnetic field, it will output a corresponding electrical signal, which is used to determine whether the doors and windows are open and the degree to which they are open.

[0027] For example, the status of each window collected by the sensor can be expressed as: 0x00-fully closed, 0x01-not closed, 0x02-not fully closed (closing degree <98%), generating a CAN data frame (ID 0x201, data bit 0x0F indicates that the four windows are not closed); the door status: 0x00-fully closed, 0x01-not closed, generating a CAN data frame (ID 0x202, data bit 0x0F indicates that the four doors are not closed).

[0028] Here, when it is detected that the vehicle is stalled, the current gear of the vehicle is P gear, the duration of P gear is greater than the preset time threshold, and the weight monitored by the pressure sensor on the driver's seat is less than the set weight threshold, a driver departure signal is generated; after the driver departure signal is generated, the monitoring of the vehicle door and window status is triggered.

[0029] Here, the time threshold may be 10 minutes, and the weight threshold is usually set to 15 kg.

[0030] Furthermore, in order to continue to monitor the status of vehicle doors and windows when the sensor is malfunctioning, in the vehicle terminal, in response to the sensor abnormality signal, the collected interior environment image is processed by a lightweight target detection model to generate the vehicle's door and window status information. The interior environment image is collected by the in-vehicle camera.

[0031] In this embodiment, the lightweight target detection model can be a trained yolov8 model, the input is the interior environment image, and the output is the door and window status information of the vehicle; the yolov8 model is trained by constructing a training set by a large number of interior environment images marked with door and window status information until the preset number of training times is reached.

[0032] Step 2: Push warning information to the car owner's mobile phone APP terminal based on the door and window monitoring graded warning strategy; specifically including: S101. Classify the parking environment of the vehicle and determine the environmental risk index.

[0033] Furthermore, the address information of the vehicle is determined, the parking environment is determined based on the address information, and the environmental risk index is determined according to the screening result of the parking environment in a preset parking environment classification table.

[0034] In this embodiment, the vehicle's address information can be determined through GPS and / or Bluetooth technology, and the parking environment can be determined based on keywords in the address information; the parking environment classification table is shown in the following table.

[0035]

[0036] S102: Obtain the historical behavior data of the vehicle owner and perform behavior modeling to determine the parking time level; and determine the parking time risk index based on the screening result of the parking time level in the preset parking time classification table.

[0037] In this embodiment, the trained LSTM network is used to process the historical behavior data of the car owner to obtain the parking time grade. The parking time grade table is as follows:

[0038] S103: Acquire weather information, and determine a weather risk index based on a screening result of the weather information in a preset weather condition classification table.

[0039] In this embodiment, the weather condition classification table is as follows:

[0040] S104. Determine a comprehensive risk value based on the environmental risk index, the duration risk index, and the weather risk index; determine a warning level based on the comprehensive risk value, and push warning information to the user end in a corresponding warning form.

[0041] For example, the comprehensive risk value R is expressed as: R = α × (A × environmental risk index + B × weather risk index + C × duration risk index); Where α is the security level coefficient of the parking area, A, B, and C are weight coefficients, and their specific values ​​can be the corresponding risk index / 100.

[0042] Public security level coefficient The determination process includes: Get the camera density of the parking area and the maximum camera density in the city where the parking area is located ; The public security level coefficient is calculated based on the camera density of the parking area and the maximum camera density of the city where the parking area is located. The calculation formula for the public security level coefficient is:

[0043] Among them, the density of parking area cameras is obtained through the urban grid management platform and the maximum camera density in the city where the parking area is located .

[0044] Furthermore, if the comprehensive risk value is not greater than the preset first threshold, the warning level is Level I, and the corresponding warning form is pushing a warning message within the APP; if the comprehensive risk value is greater than the preset first threshold and less than or equal to the preset second threshold, the warning level is Level II, and the corresponding warning form is SMS push; if the comprehensive risk value is greater than the preset second threshold and less than or equal to the preset third threshold, the warning level is Level III, and the corresponding warning form is pushing a voice warning message through the user's phone within the APP; if the comprehensive risk value is greater than the preset third threshold, the warning level is Level IV, and the corresponding warning form is expedited pushing of a voice warning message through the user's phone and the reserved phone within the APP.

[0045] For example, the warning level determination criteria and their corresponding warning forms are shown in the following table:

[0046] Phone trigger: After the APP receives the alarm, it calls the car owner's phone number bound to the APP through the system phone API; Voice notification: The ALM language model is used for intelligent analysis to generate personalized voice prompts. Prompts are generated based on current weather conditions, time period, and area (shopping mall, outdoor), and then played as an intelligent voice reminder after the call is connected. For example, if the car windows are not closed and it is about to rain, it will remind the driver, "The probability of rain is expected to be 80% in 1 hour. Do you need to close the windows?" User interaction: After the voice message ends, the APP interface displays the "Remote Shutdown" button (requires vehicle support) and the "I Have Processed" option.

[0047] Furthermore, after the user receives the warning, he clicks "remote close" through the APP. The APP sends a remote close command to the cloud. The on-board communication module triggers the body control module to close the doors and windows through the CAN bus. The remote close command: CAN ID: 0x301, data: 0x01 (close all doors and windows), 0x02 (close specified doors and windows).

[0048] The Body Control Module (BCM) is an electronic control unit (ECU) that manages vehicle functions such as lighting, windows, door locks, and seat controls.

[0049] After the body control module performs the closing operation, it re-checks the status of the doors and windows and uploads the latest status information to the cloud to ensure that the app interface is updated with the latest status. Finally, the monitoring and warning process ends and the system waits for the next lock command to be triggered.

[0050] Example 2 This embodiment discloses a vehicle door and window status monitoring and warning system, including a door and window status detection module, a vehicle network communication module, and a cloud server. The door and window status detection module is deployed on a vehicle terminal to monitor the vehicle's door and window status information. The vehicle network communication module is used to transmit the door and window status information to the cloud server. The cloud server is used to obtain the vehicle's door and window status information. If the door and window status information indicates that the door and window are not closed and a vehicle lock signal is received, a door and window monitoring graded warning strategy is executed. The door and window monitoring graded warning strategy includes: The parking environment of the vehicle is graded to determine the environmental risk index; the historical behavior data of the vehicle owner is obtained and behavioral modeling is performed to determine the parking time level; based on the screening results of the parking time level in the preset parking time classification table, the time risk index is determined; weather information is obtained, and based on the screening results of the weather information in the preset weather condition classification table, the weather risk index is determined; based on the environmental risk index, the time risk index and the weather risk index, the comprehensive risk value is determined; based on the comprehensive risk value, the warning level is determined and the warning information is pushed to the user end in the corresponding warning form.

[0051] Furthermore, the door and window status detection module deploys a lightweight object detection model. This model uses in-vehicle cameras to monitor the door and window status, as well as the interior environment, in real time. Furthermore, physical sensors integrated into the vehicle, such as Hall sensors and pressure sensors, collect real-time information on the status of each door and window. This serves as a redundant check, improving the reliability of the multimodal sensor fusion solution. If a door or window is detected as partially closed, the detection module sends an abnormality signal to the connected vehicle communication module.

[0052] The Internet of Vehicles communication module receives abnormal signals sent by the sensor module, converts them into data packets, and transmits them to the cloud server through the mobile communication network; at the same time, the module is also responsible for receiving instructions or data sent by the cloud server, such as remote locking and unlocking of the vehicle.

[0053] The cloud server is responsible for parsing the data uploaded by the Internet of Vehicles communication module, and making a final graded judgment based on various information such as abnormal door and window status and vehicle parking environment, to determine the driver's intention, whether the vehicle is temporarily locked, etc., and generate an alarm event and push it to the APP; at the same time, it receives remote control commands sent by the APP and forwards them to the Internet of Vehicles communication module for execution.

[0054] The smart mobile terminal app, installed on the owner's smartphone, receives information about the vehicle's doors and windows from a cloud server. It provides one-touch emergency phone alerts and remote control capabilities. When the app receives abnormal status information, it automatically triggers a phone call and plays a voice alert, immediately sending a warning notification to the owner. A "remote close" button is also provided for remote control of the vehicle's doors and windows. The app also offers features such as vehicle status query and history review.

[0055] The inventive concept of this embodiment is the same as that of the first embodiment, and its specific implementation details are not repeated in this embodiment.

[0056] Example 3 A third embodiment of the present invention provides an electronic device, including a memory and a processor, and computer instructions stored in the memory and running on the processor. When the computer instructions are run by the processor, the steps of the above-mentioned vehicle door and window status monitoring and early warning method are completed.

[0057] Example 4 A fourth embodiment of the present invention provides a computer-readable storage medium for storing computer instructions. When the computer instructions are executed by a processor, the steps of the above-mentioned vehicle door and window status monitoring and early warning method are completed.

[0058] Example 5 A fifth embodiment of the present invention provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of the above-mentioned vehicle door and window status monitoring and early warning method.

[0059] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0060] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1The function specified in one or more boxes.

[0061] These computer program instructions can also be loaded onto a computer or other programmable data processing device, and a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide the functions for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0062] The descriptions of the various embodiments in the above embodiments have different focuses. For parts not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0063] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention shall be included within the scope of protection of the present invention.

Claims

1. A vehicle door and window status monitoring and early warning method, characterized in that: include: Obtain the vehicle's door and window status information. If the door and window status information indicates that the door and window are not closed and the vehicle lock signal is received, execute the door and window monitoring graded warning strategy. The door and window monitoring graded warning strategy includes: Classify the parking environment of vehicles and determine the environmental risk index; Obtain the owner's historical behavior data and conduct behavioral modeling to determine the parking time level; determine the parking time risk index based on the screening results of the parking time level in the preset parking time classification table; Obtain weather information and determine a weather risk index based on the results of filtering the weather information in a preset weather condition classification table; The comprehensive risk value is determined based on the environmental risk index, duration risk index and weather risk index; based on the comprehensive risk value, the warning level is determined and the warning information is pushed to the user end in the corresponding warning form.

2. The vehicle door and window status monitoring and early warning method according to claim 1, characterized in that: The grading of the parking environment of the vehicle and determining the environmental risk index specifically includes: determining the address information of the vehicle through GPS or Bluetooth technology, and determining the environmental risk index based on the screening result of the address information in a preset parking environment grading table.

3. The vehicle door and window status monitoring and early warning method according to claim 1, characterized in that: Car owners’ historical behavior data is modeled and the parking duration level is determined as follows: the car owners’ historical behavior data is processed using the trained LSTM network to obtain the parking duration level.

4. The vehicle door and window status monitoring and early warning method according to claim 1, characterized in that: In response to the sensor abnormality signal, the vehicle door and window status information is generated by processing the collected vehicle interior environment image through a lightweight target detection model.

5. The vehicle door and window status monitoring and early warning method according to claim 1, characterized in that: The warning level is determined according to the comprehensive risk value as follows: if the comprehensive risk value is not greater than a preset first threshold, the warning level is Level I; if the comprehensive risk value is greater than the preset first threshold and less than or equal to a preset second threshold, the warning level is Level II; If the comprehensive risk value is greater than the preset second threshold and less than or equal to the preset third threshold, the warning level is Level III.

6. The vehicle door and window status monitoring and early warning method according to claim 5, characterized in that: If the warning level is Level I, the corresponding warning form is to push a warning message in the APP; The warning level is Level II, and the corresponding warning form is SMS push; the warning level is Level III, and the corresponding warning form is voice warning message push through the user's phone within the APP; the warning level is Level IV, and the corresponding warning form is expedited voice warning message push through the user's phone and reserved phone within the APP.

7. A vehicle door and window status monitoring and warning system, characterized in that: include: Vehicle door and window status detection module, used to monitor the vehicle's door and window status information; IoV communication module, used to transmit door and window status information to the cloud server; The cloud server is used to obtain the vehicle's door and window status information. If the door and window status information indicates that the door and window are not closed and the vehicle lock signal is received, the door and window monitoring graded warning strategy is implemented; Among them, the door and window monitoring graded warning strategy includes: The parking environment of the vehicle is graded to determine the environmental risk index; the historical behavior data of the vehicle owner is obtained and behavioral modeling is performed to determine the parking time level; based on the screening results of the parking time level in the preset parking time classification table, the time risk index is determined; weather information is obtained, and based on the screening results of the weather information in the preset weather condition classification table, the weather risk index is determined; based on the environmental risk index, the time risk index and the weather risk index, the comprehensive risk value is determined; based on the comprehensive risk value, the warning level is determined and the warning information is pushed to the user end in the corresponding warning form.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the vehicle door and window status monitoring and early warning method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instruction is executed by a processor, the steps of the vehicle door and window status monitoring and early warning method according to any one of claims 1 to 6 are implemented.

10. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the steps of the vehicle door and window status monitoring and early warning method according to any one of claims 1 to 6 are implemented.

Images