Vehicle parking security method, vehicle, electronic equipment and program product

Abstract

The invention provides a vehicle parking security method, a vehicle, electronic equipment and a program product, and relates to the technical field of intelligent driving. The method comprises the following steps: when a vehicle is in a parking security mode, acquiring vehicle surrounding environment data through a millimeter-wave radar of the vehicle to obtain radar security data, and acquiring the vehicle surrounding environment data in real time through an all-round camera of the vehicle to obtain image security data; according to the radar security and protection data and the image security and protection data, risk indication information around the vehicle and corresponding expelling operation are determined; wherein the risk indication information is used for indicating whether a risk exists around the vehicle and indicating risk description information; and protecting the vehicle based on the risk indication information and the expelling operation. The method and the device are used for improving the parking safety.

Description

Technical Field

[0001] The present disclosure relates to the technical field of vehicles, and particularly to a vehicle parking security method, a vehicle, an electronic device, and a program product. Background Art

[0002] With the popularization of automobiles, vehicle safety issues have become increasingly prominent. There are various potential safety risks during vehicle camping. Traditional parking security systems often have certain limitations, such as insufficient detection capabilities in complex environments and high false alarm rates.

[0003] Therefore, it is necessary to seek a more accurate and reliable vehicle parking security solution. Summary of the Invention

[0004] In view of this, embodiments of the present disclosure provide a vehicle parking security method, a vehicle, an electronic device, and a program product to improve parking safety.

[0005] In a first aspect, the present disclosure provides a vehicle parking security method, including:

[0006] When the vehicle is in the parking security mode, collecting environmental data around the vehicle through the millimeter-wave radar of the vehicle to obtain radar security data, and collecting environmental data around the vehicle in real time through the surround view camera of the vehicle to obtain image security data;

[0007] According to the radar security data and the image security data, determining risk indication information around the vehicle and corresponding evacuation operations; wherein, the risk indication information is used to indicate whether there is a risk around the vehicle and risk description information;

[0008] Protecting the vehicle based on the risk indication information and the evacuation operations.

[0009] In a second aspect, the present disclosure provides a vehicle configured to execute the vehicle parking security method described in the first aspect.

[0010] In a third aspect, the present disclosure provides an electronic device, including:

[0011] At least one processor; and

[0012] A memory communicatively connected to the at least one processor; wherein,

[0013] The memory stores at least one computer program executable by the at least one processor, and the at least one computer program is executed by the at least one processor so that the at least one processor can execute the vehicle parking security method described in the first aspect.

[0014] Fourthly, the present disclosure provides a computer program product, which includes a computer program that, when running on a processor, implements the vehicle parking security method described in the first aspect.

[0015] In the embodiments provided by the present disclosure, when the vehicle is in the parking security mode, the millimeter-wave radar of the vehicle is used to collect the environmental data around the vehicle to obtain radar security data, and the surround-view camera of the vehicle is used to collect the environmental data around the vehicle in real time to obtain image security data; according to the radar security data and the image security data, the risk indication information around the vehicle and the corresponding eviction operation are determined; wherein, the risk indication information is used to indicate whether there is a risk around the vehicle and the risk description information; the vehicle is protected based on the risk indication information and the eviction operation. By combining the millimeter-wave radar and the surround-view camera to monitor the environmental data around the vehicle, the comprehensiveness and accuracy of the monitoring data are improved, thereby providing data guarantee for the parking safety and improving the parking safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.

[0017] Figure 1 It shows a schematic flowchart of the vehicle parking security method in the embodiments of the present disclosure;

[0018] Figure 2 It shows a schematic flowchart of an example of the vehicle parking security method in the embodiments of the present disclosure;

[0019] Figure 3 It shows a schematic diagram of the functional hardware of the vehicle in the embodiments of the present disclosure;

[0020] Figure 4A It shows a block diagram of the vehicle parking security device in the embodiments of the present disclosure;

[0021] Figure 4B It shows an exemplary block diagram of the vehicle parking security device in the embodiments of the present disclosure;

[0022] Figure 5 It shows a schematic diagram of the structure of an electronic device in the embodiments of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0023] Next, the technical solutions in the embodiments of the present disclosure will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present disclosure.

[0024] Without conflict, the embodiments of the present disclosure and the features in the embodiments may be combined with each other.

[0025] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0026] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. As used herein, the singular forms "a" and "the" are also intended to include the plural forms unless the context clearly indicates otherwise. It will also be understood that when the terms "include" and / or "consist of" are used in this specification, the specified features, wholes, steps, operations, elements, and / or components are present, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their groups. "Connection" or "connected" and other similar terms are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

[0027] Unless otherwise defined, the meanings of all terms (including technical and scientific terms) used herein are the same as those commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in common dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted as having an idealized or overly formal meaning unless clearly defined herein.

[0028] Exemplary Method

[0029] An embodiment of the present disclosure provides a vehicle parking security method, which can be applied to the main controller of a vehicle or other terminals capable of communicating with the vehicle and / or sensors installed on the vehicle.

[0030] The vehicle parking security method provided by the embodiment of the present disclosure, as Figure 1 shown, mainly includes the following steps:

[0031] Step 101, when the vehicle is in the parking security mode, collect the surrounding environment data of the vehicle through the millimeter-wave radar of the vehicle to obtain radar security data, and collect the surrounding environment data of the vehicle in real time through the panoramic camera of the vehicle to obtain image security data.

[0032] In some embodiments, the millimeter-wave radar of the vehicle includes millimeter-wave radars respectively disposed at the front and four corners of the vehicle. Radar security data is obtained through continuous scanning of the millimeter-wave radar. The radar security data includes the real-time distance between the target and the vehicle, the height information of the target, the direction and speed of the target relative to the vehicle, and other data. The height information of the target can be used to preliminarily determine whether the target is a person or an animal.

[0033] In some embodiments, the parking security mode is pre-configured in the vehicle's controller or in the APP for controlling the vehicle on the mobile terminal. Before starting the parking security mode, various parameters of the parking security mode are configured so that it can operate according to the configured parameters after the parking security mode is started.

[0034] Specifically, before collecting the vehicle surrounding environment data through the millimeter-wave radar of the vehicle to obtain the radar security data, the method further includes: in response to the user's configuration operation on the parking security mode, determining the configuration parameters of the parking security mode.

[0035] Among them, the configuration parameters include at least one of the following:

[0036] The monitoring ranges of the millimeter-wave radar and the surround-view camera, and the monitoring ranges include at least one of a short-range monitoring range, a medium-range monitoring range, and a long-range monitoring range;

[0037] The risk indication information and the evacuation operation corresponding to the risk indication information;

[0038] The information interaction method, and the information interaction method includes in-vehicle information interaction or out-of-vehicle information interaction. When in-vehicle information interaction is performed, the vehicle's central control screen is used for alarm display, and when out-of-vehicle information interaction is performed, the user's mobile terminal is used for alarm display.

[0039] Exemplarily, the short-range monitoring range is the range within 5 meters (m) around the vehicle; the medium-range monitoring range is the range from 5m to 30m around the vehicle; the long-range monitoring range is the range from 30m to 50m or from 30m to 60m around the vehicle. It should be noted that the specific values here are only examples and can be configured as other values according to needs, and are not limited here. The monitoring ranges of the parking security mode can be configured as the short-range monitoring range, the medium-range monitoring range, and the long-range monitoring range. The threat in the short-range monitoring range is higher than that in the medium-range monitoring range, and the threat in the medium-range monitoring range is higher than that in the long-range monitoring range. When configuring the monitoring ranges of the parking security mode through the human-machine interaction interface, the monitoring ranges can be graphically displayed and different monitoring ranges can be distinguished by colors (for example, three colors of red, yellow, and blue are used to distinguish different monitoring ranges) to facilitate user configuration.

[0040] Exemplarily, the risk indication information is used to describe the existing threat intrusion situation, and corresponding repelling operations are respectively configured for different risk indication information. The repelling operation can be one or more of various methods such as the flashing light frequency, the horn sounding duration, the notification type (vibration / ringtone) of the user's mobile terminal, etc.

[0041] Exemplarily, the configuration of the information interaction method is mainly used to display the alarm information to the user during or before the execution of the repelling operation, so that the user can view and timely understand the vehicle surrounding environment and dangerous situations. The alarm information may include the risk indication information and the corresponding repelling operation. For example, the central control screen displays the intrusion object's orientation, the distance from the vehicle, speed, height, accompanied by in-vehicle voice playback (can be turned off); or the external lights display "The vehicle is under monitoring, do not approach." (The text can be customized).

[0042] It should be noted that in addition, the configuration parameters may also include other parameters related to parking security, which will not be listed one by one here.

[0043] In some embodiments, after obtaining each configuration parameter of the parking security mode configured by the user, the check rules preset can be used to check each configuration parameter of the parking security mode to ensure that there are no conflicts or errors in each configuration parameter of the parking security mode, and after officially starting the parking security mode, activate the millimeter-wave radar and the surround view camera.

[0044] Step 102, determine the risk indication information around the vehicle and the corresponding repelling operation according to the radar security data and the image security data; wherein, the risk indication information is used to indicate whether there is a risk around the vehicle and the risk description information.

[0045] In some embodiments, the determining the risk indication information around the vehicle and the corresponding repelling operation according to the radar security data and the image security data includes: inputting the radar security data and the image security data into the garrison large model to obtain the risk indication information output by the garrison large model and the repelling operation corresponding to the risk indication information; wherein, the garrison large model is obtained by pre-training a preset large model.

[0046] The preset large model can be any existing large model, which is not limited here.

[0047] The garrison big model is the core processing unit of the whole method. The radar security data and the image security data are input into the garrison big model. The garrison big model integrates the radar security data and the image security data with the configuration parameters of the parking security mode for processing, analysis and decision-making, determines whether the environment in which the vehicle is located is dangerous or has potential risks, and generates corresponding risk indication information and corresponding expulsion operations, and sends them to the functional modules that perform the expulsion operations for execution.

[0048] The garrison big model can be configured on the vehicle side or in the cloud. When the garrison big model is configured on the cloud, the vehicle side sends the radar security data and image security data to the cloud, which are then input into the garrison big model, and the risk indication information output by the garrison big model and the expulsion operation corresponding to the risk indication information are sent to the vehicle side for subsequent processing.

[0049] In some embodiments, the process of obtaining the garrison large model includes: acquiring vehicle parking security sample data, the vehicle parking security sample data including radar sample data, image sample data, and risk indication information and expulsion operations corresponding to the radar sample data and image sample data; training a preset large model based on the parking security sample data to obtain the garrison large model.

[0050] In some embodiments, the inputting of the radar security data and the image security data into the garrison big model to obtain the risk indication information output by the garrison big model and the expulsion operation corresponding to the risk indication information includes: inputting the radar security data and the image security data into the garrison big model; extracting features of each target around the vehicle from the radar security data and the image security data through the garrison big model, matching the features of the target with features of each object in the whitelist, and outputting the risk indication information and the expulsion operation corresponding to the risk indication information according to the matching result; wherein, the features of the target include the physical features and behavior pattern features of the target, and the features of the object include the physical features and behavior pattern features of the object.

[0051] Among them, objects in the whitelist are allowed to approach the vehicle or camping site and are allowed to move freely around the vehicle.

[0052] In some embodiments, the process of obtaining the whitelist includes: obtaining the identity of the object and the features of the object, binding the features of the object with the identity of the object and saving them to the whitelist; wherein the features of the object include the features obtained by scanning the object with the millimeter wave radar of the vehicle. The features of the object include the appearance features and behavior pattern features of the object.

[0053] Exemplarily, the process of establishing a whitelist includes: obtaining the names of user devices searched through the vehicle's WiFi, Bluetooth and other mobile communication methods, adding these user device names as the identity of the corresponding objects to the whitelist, and at the same time, starting the millimeter-wave radar to scan the features of each object, establishing the correspondence between the features and the identity of each object and saving them in the whitelist; for objects without user devices, such as pets, infants, etc., obtaining the identity of the object input by the user through the human-computer interaction interface, and scanning the features of the object through the millimeter-wave radar, and saving the identity of the object and the features of the object in the whitelist. The features of the objects saved in the whitelist include appearance features such as the height of the object, and behavioral pattern features such as movement habits. The setting of the whitelist can avoid mistakenly identifying users, pets, etc. as intruders and alarming from the source.

[0054] Exemplarily, the vehicle's millimeter-wave radars scan the vehicle's surroundings at high frequencies, and the vehicle's surround-view cameras monitor the vehicle's surroundings. The stationed large model identifies the targets (including pedestrians, animals, moving objects, etc.) detected by the millimeter-wave radar and surround-view camera, and accurately locates them. Each target is given a unique ID and the features of each target are extracted, including the target's position, height, speed, and appearance features, etc., to establish a foundation for subsequent continuous tracking of the target. Based on the real-time ranging capability of the millimeter-wave radar and the visual tracking capability of the surround-view camera, the stationed large model continuously extracts the target's features to track the target's trajectory and monitor the target's speed changes and direction deviations. For example, for targets close to the vehicle, the target's trajectory is updated in real time to detect the distance between the target and the vehicle in real time.

[0055] Exemplarily, before the garrison large model determines the risk indication information around the vehicle and the corresponding expulsion operation based on the extracted target features, the extracted target features are filtered to reduce the possibility of misidentification. This includes filtering at least one of the following features: targets with discontinuous motion trajectories that appear and disappear from time to time, such as targets that reappear after being blocked; targets with frequent changes in motion direction and irregular swings, such as tents blown by the wind, swaying branches, etc. In addition, other features that may interfere with risk identification can also be filtered, which are not listed here one by one.

[0056] For example, the garrison model analyzes the target movement trajectory (e.g., random movement or continuous approach to the vehicle), behavior pattern (e.g., wandering or accelerating toward the vehicle) and other features based on the target dynamic data included in the radar security data and the target appearance features and motion features included in the image security data, thereby identifying threats and outputting risk indication information and corresponding expulsion operations. For example, if the target "fast and straight approaching the vehicle" is judged as a high threat and "slowly passing by" is a low threat, the threat level classification result is output to provide a decision basis for subsequent responses.

[0057] In some embodiments, the output of the risk indication information and the evacuation operation corresponding to the risk indication information according to the matching result includes: when the matching result indicates that there is a target that does not match the object in the whitelist, obtaining the distance value between the unmatched target and the vehicle; determining the distance interval to which the distance value belongs, and obtaining the evacuation operation configured corresponding to the distance interval.

[0058] Exemplarily, if the distance value between the unmatched target and the vehicle belongs to the long-distance monitoring range, for example, within 30m - 50m, drive the searchlight on the top of the vehicle to irradiate for evacuation; if the distance value between the unmatched target and the vehicle belongs to the relatively long-distance segment of the medium-distance monitoring range, for example, within 10m - 30m, drive the vehicle's hazard lights to flash for a first set duration for evacuation, for example, the hazard lights flash at a high frequency for 15s; if the distance value between the unmatched target and the vehicle belongs to the relatively short-distance segment of the medium-distance monitoring range, for example, within 5m - 10m, drive the external lights of the vehicle to light up for a second set duration for evacuation, and the second set duration is greater than the first set duration, for example, light up for 30s; if the distance value between the unmatched target and the vehicle belongs to the short-distance monitoring range, for example, within 5m, drive the vehicle's lights to flash and sound the horn for a second set duration for evacuation, for example, sound a short horn for 30s. The specific values here are only examples and can be configured as other values according to needs, and are not limited here.

[0059] Step 103, protect the vehicle based on the risk indication information and the evacuation operation.

[0060] In some embodiments, after protecting the vehicle according to the evacuation operation, the method further includes: obtaining the movement trajectory of the unmatched target, determining the threat escalation of the unmatched target according to the movement trajectory of the unmatched target, obtaining the evacuation operation corresponding to the threat escalation, and protecting the vehicle according to the evacuation operation corresponding to the threat escalation.

[0061] Exemplarily, the recognition and processing process of the continuous intrusion scenario of the target is as follows: after the first evacuation operation on the unmatched target, continuously monitor the movement trajectory of the unmatched target. If the unmatched target does not move away under the deterrence of the evacuation operation, it can be determined that the threat of the unmatched target has escalated, and enter the advanced prevention process. At this time, the unmatched target is marked as high risk, and a stronger evacuation operation is triggered. For example, the vehicle flashes and sounds the horn for 30s, etc.

[0062] The recognition and processing process for a target far from the scene is as follows: After the first eviction operation on the mismatched target, continuously monitor the movement trajectory of the mismatched target. If the mismatched target changes its movement direction under the eviction operation and moves away from the vehicle (the distance between the target detected by the millimeter-wave radar and the vehicle continues to increase), it can be determined that there is a threat contact with the matched target, and the eviction operation (such as stopping flashing lights, sounding the horn, etc.) is stopped, and the basic monitoring state is restored. In this basic monitoring state, the millimeter-wave radar remains in the scanning state, and continuously executes the loop process of "target recognition - tracking - risk assessment" to ensure environmental safety.

[0063] In some embodiments, protecting the vehicle based on the risk indication information and the eviction operation includes: generating an alarm message for preliminary warning, and sending the alarm message to the vehicle console interface or the display interface of the user's mobile terminal for display; wherein, the alarm message includes the risk indication information and the eviction operation. Further, a control instruction for the vehicle can also be generated and executed according to the operation of the user based on the alarm message, and the control instruction is used to control the vehicle to perform the eviction operation or not perform the eviction operation.

[0064] Exemplarily, for continuous intrusion of a target, while the vehicle executes the eviction operation corresponding to the threat escalation, the panoramic camera is activated to take full-angle photos covering the perspectives around the vehicle to record the complete intrusion process of the target, and the complete intrusion process is carried in the alarm message and provided to the vehicle console interface or the display interface of the user's mobile terminal for display. The video of the complete intrusion process can be saved as evidence.

[0065] In addition, based on the video of the target intrusion process, the classification of the target can be further analyzed and determined, and the classification of the target is carried in the alarm message and provided to the user for viewing.

[0066] The user can switch and view the pictures taken by different panoramic cameras through the vehicle console interface or the display interface of the mobile terminal.

[0067] Exemplarily, if the user judges the alarm message and determines it is a false alarm, the vehicle console interface or the display interface of the user's mobile terminal can be operated to generate a control instruction for the vehicle, and the control instruction is used to not perform the eviction operation and ignore the risk indication information, that is, the user manually closes this alarm; if it is judged that there is indeed an intrusion risk, the user can select further protection measures, such as locking the vehicle, contacting security personnel, etc., to achieve the full-link protection of "monitoring - warning - intervention".

[0068] In an exemplary embodiment, as Figure 2 shown is the flowchart of a specific example of vehicle parking security, which mainly includes:

[0069] Step 201, when the user arrives at the destination, turn on the parking security mode and set the monitoring, alarm, and camping modes;

[0070] Step 202, after the monitoring range and alarm mode are set and the parking security mode is turned on, the millimeter-wave radar scans the surroundings and assigns IDs to the identified targets;

[0071] Step 203, continuously track and predict the dynamics of the targets based on the millimeter-wave radar and the surround-view camera, and use the defense model to evaluate the threat level;

[0072] Step 204, when a target approaches, the in-vehicle camping central control screen lights up to display the alarm information (the out-of-vehicle camping mobile phone sends a notification reminder), and perform the lighting, flashing lights, and honking according to the settings;

[0073] Step 205, if the target ID does not move away from the vehicle under the threat of lights or sound and continues to invade the vehicle, the vehicle flashes lights and honks to drive away the target, and collects the invasion video through the surround-view camera and displays the video on the vehicle console or mobile phone;

[0074] Step 206, the user views the video and alarm information in the vehicle or on the mobile phone APP and takes necessary measures according to the situation;

[0075] Step 207, if the target ID moves away from the vehicle under the threat of lights or sound, the vehicle stops flashing lights and honking, the millimeter-wave radar continues to scan the surroundings, and continues to identify the targets and assign IDs.

[0076] In the embodiments provided by the present disclosure, when the vehicle is in the parking security mode, the millimeter-wave radar of the vehicle is used to collect the surrounding environment data of the vehicle to obtain radar security data, and the surround-view camera of the vehicle is used to collect the surrounding environment data of the vehicle in real time to obtain image security data; according to the radar security data and the image security data, determine the risk indication information around the vehicle and the corresponding driving-away operations; wherein, the risk indication information is used to indicate whether there is a risk around the vehicle and the risk description information; protect the vehicle based on the risk indication information and the driving-away operations. By combining the millimeter-wave radar and the surround-view camera to monitor the surrounding environment data of the vehicle, the comprehensiveness and accuracy of the monitoring data are improved, thereby providing data guarantee for the parking safety and improving the parking safety.

[0077] It can be understood that the above-mentioned various method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. For the sake of brevity, the present disclosure will not elaborate. Those skilled in the art can understand that in the above-mentioned methods of the specific implementation manner, the specific execution order of each step should be determined according to its function and possible internal logic, and the execution order between steps is not limited to being implemented according to the step numbers.

[0078] Exemplary vehicle

[0079] Embodiments of the present disclosure provide a vehicle configured to perform the vehicle parking security method described above.

[0080] In an exemplary embodiment, as Figure 3 shown is a schematic diagram of the functional hardware for the vehicle to implement the vehicle parking security method described above. The vehicle mainly includes an intelligent driving domain controller, an intelligent cockpit domain controller, and a body domain controller.

[0081] A software program for implementing the vehicle defense security method described above is embedded in the intelligent driving domain controller or the intelligent cockpit domain controller to identify risks and drive them away.

[0082] The intelligent driving domain controller is connected to the front millimeter-wave radar and four corner millimeter-wave radars through CANFD; the intelligent driving domain controller is connected to the surround-view camera or the intelligent cockpit domain controller is connected to the surround-view camera (ISP module) through GMSL. The intelligent cockpit domain controller is also connected to the module that honks when a suspicious target is recognized (AUD) and the module that can view videos (CSD).

[0083] The intelligent cockpit domain controller is also connected to the TSP background service module through the TBOX communication module. When the user needs to view a video and clicks on the mobile phone APP to request the vehicle to desensitize the video, the vehicle transmits the desensitized video to the TSP background service module for storage, and the mobile phone APP views the video by accessing the TSP background service module.

[0084] The intelligent driving domain controller is connected to the body domain controller through CANFD; when the intelligent cockpit domain controller obtains a danger instruction issued after analysis by the defense large model, it sends a flash light request to the body domain controller; the body domain controller controls the vehicle lighting module such as HCML (Head Control Module Left) and HCMR (Head Control Module Right) to flash lights to scare away intruders.

[0085] Exemplary device

[0086] Figure 4A The block diagram of a vehicle parking security device provided by an embodiment of the present disclosure. The vehicle parking security device mainly includes:

[0087] An acquisition module 301, configured to, when the vehicle is in the vehicle parking security mode, collect vehicle surrounding environment data through the millimeter-wave radar of the vehicle to obtain radar security data, and collect vehicle surrounding environment data in real time through the surround-view camera of the vehicle to obtain image security data;

[0088] A processing module 302, configured to determine risk indication information around the vehicle and corresponding driving-away operations according to the radar security data and the image security data; wherein, the risk indication information is used to indicate whether there is a risk around the vehicle and risk description information.

[0089] A protection module 303, configured to protect the vehicle based on the risk indication information and the driving-away operations.

[0090] In an exemplary embodiment, as Figure 4B shown is an exemplary structure of a vehicle parking security device. In this exemplary structure, the acquisition module includes Module 1: a millimeter-wave radar sensing module, and includes a camera acquisition module 3. The millimeter-wave radar sensing module is configured to acquire environmental data around the vehicle to obtain radar security data, and the camera acquisition module is configured to acquire environmental data around the vehicle to obtain image security data; the processing module includes Module 4: a vehicle-end large model processing module, Module 2: a user-defined danger module. The user-defined danger module is configured to obtain configuration parameters of the user for the parking security mode and input the configuration parameters into the vehicle-end large model processing module. The vehicle-end large model processing module is configured to input the radar security data, the image security data, and the configuration parameters of the parking security mode into a defense large model and output risk indication information and corresponding driving-away operations; the protection module includes Module 5: a vehicle display module, Module 6: an alarm module, and includes Module 7: a mobile phone APP module. The vehicle display module is configured to display alarm information such as risk indication information and corresponding driving-away operations through a vehicle central control screen. The alarm module is configured to control lights and / or sounds for driving-away operations. The mobile phone APP module is configured to display alarm information such as risk indication information and corresponding driving-away operations through the user's mobile phone.

[0091] Exemplary electronic device

[0092] Figure 5 This is a block diagram of an electronic device provided by an embodiment of the present disclosure.

[0093] Referring to Figure 5 , an embodiment of the present disclosure provides an electronic device, which includes: at least one processor 501; at least one memory 502, and one or more I / O interfaces 503 connected between the processor 501 and the memory 502; wherein, the memory 502 stores one or more computer programs executable by at least one processor 501, and the one or more computer programs are executed by at least one processor 501 so that at least one processor 501 can execute the above-mentioned vehicle parking security method.

[0094] Each module in the above electronic device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.

[0095] Exemplary computer program product and storage medium

[0096] An embodiment of the present disclosure also provides a computer program product, including a computer program, which implements the above vehicle parking security method when running on a processor.

[0097] The computer program can be stored in a readable storage medium or in the cloud of the computer device; the processor of the computer device reads the computer program from the readable storage medium or the cloud.

[0098] Among them, the above computer program product can be specifically implemented in a manner of hardware, software, or a combination thereof. In an optional embodiment, the computer program product is specifically embodied as a computer storage medium. In another optional embodiment, the computer program product is specifically embodied as a software product, such as a Software Development Kit (SDK), etc.

[0099] Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, and appropriate combinations thereof. In the hardware implementation, the division of the functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component can have multiple functions, or a function or step can be executed by several physical components in cooperation. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or be implemented as hardware, or be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable storage medium, which can include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium).

[0100] As is known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information such as computer-readable program instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technologies, portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by a computer. Additionally, as is known to those of ordinary skill in the art, communication media typically embodies computer-readable program instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media.

[0101] The computer-readable program instructions described herein can be downloaded to each computing / processing device from a computer-readable storage medium or can be downloaded to an external computer or external storage device through a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.

[0102] The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine - related instructions, microcode, firmware instructions, state - setting data, or source code or object code written in any combination of one or more programming languages, including object - oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer - readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand - alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, by using the state information of the computer - readable program instructions to customize an electronic circuit, such as a programmable logic circuit, a field - programmable gate array (FPGA), or a programmable logic array (PLA), the electronic circuit can execute the computer - readable program instructions to implement various aspects of the present disclosure.

[0103] The computer program product described herein may be implemented specifically in the form of hardware, software, or a combination thereof. In an alternative embodiment, the computer program product is specifically embodied as a computer storage medium. In another alternative embodiment, the computer program product is specifically embodied as a software product, such as a Software Development Kit (SDK), etc.

[0104] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and the combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer - readable program instructions.

[0105] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, when executed by the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in one or more boxes of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, a programmable data processing apparatus, and / or other devices to operate in a particular manner, so that the computer-readable medium storing the instructions comprises a manufacture that includes instructions for implementing various aspects of the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0106] The computer-readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device, such that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0107] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a segment of a program, or a portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the boxes may occur in a different order than noted in the figures. For example, two consecutive boxes may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified function or act, or by a combination of dedicated hardware and computer instructions.

[0108] The foregoing is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent replacements, etc. made within the spirit and principle of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

1. A vehicle parking security method, characterized in that: include: When the vehicle is in the parking security mode, the vehicle's millimeter-wave radar collects vehicle surrounding environment data to obtain radar security data, and the vehicle's surround-view camera collects vehicle surrounding environment data in real time to obtain image security data; Determine risk indication information around the vehicle and corresponding expulsion operations according to the radar security data and the image security data; wherein the risk indication information is used to indicate whether there is a risk around the vehicle and risk description information; The vehicle is protected based on the risk indication information and the drive-away operation.

2. The method according to claim 1, characterized in that Before acquiring the vehicle surrounding environment data by the vehicle's millimeter-wave radar to obtain the radar security data, the method further includes: In response to a user's configuration operation on the parking security mode, a configuration parameter of the parking security mode is determined, wherein the configuration parameter includes at least one of the following: The monitoring range of the millimeter-wave radar and the surround-view camera, the monitoring range comprising at least one of a short-range monitoring range, a medium-range monitoring range, and a long-range monitoring range; The risk indication information and the expulsion operation corresponding to the risk indication information; The information interaction mode includes in-vehicle information interaction and out-vehicle information interaction. The in-vehicle information interaction uses the vehicle's central control screen for alarm display, and the out-vehicle information interaction uses the user's mobile terminal for alarm display.

3. The method according to claim 1, characterized in that The determining, according to the radar security data and the image security data, risk indication information around the vehicle and a corresponding driving away operation includes: The radar security data and the image security data are input into the garrison big model to obtain the risk indication information output by the garrison big model and the expulsion operation corresponding to the risk indication information; wherein the garrison big model is obtained by pre-training a preset big model.

4. The method according to claim 3, characterized in that The process of obtaining the large garrison model includes: Acquiring vehicle parking security sample data, the vehicle parking security sample data including radar sample data, image sample data, and risk indication information and drive-away operations corresponding to the radar sample data and the image sample data; The preset large model is trained based on the parking security sample data to obtain the parking security large model.

5. The method according to claim 3, characterized in that: The step of inputting the radar security data and the image security data into the garrison large model, obtaining the risk indication information output by the garrison large model and the expulsion operation corresponding to the risk indication information, includes: Inputting the radar security data and the image security data into the garrison big model; Extracting features of each target around the vehicle from the radar security data and the image security data through the garrison big model, matching the features of the target with features of each object in the whitelist, and outputting risk indication information and an expulsion operation corresponding to the risk indication information according to the matching result; The characteristics of the target include the physical characteristics and behavior pattern characteristics of the target, and the characteristics of the object include the physical characteristics and behavior pattern characteristics of the object.

6. The method according to claim 5, characterized in that The process of obtaining the whitelist includes: The identity of the object and the features of the object are obtained, and the features of the object are bound to the identity of the object and saved in the whitelist; wherein the features of the object include the features obtained by scanning the object with the millimeter wave radar of the vehicle.

7. The method according to claim 5, characterized in that The outputting risk indication information and the expulsion operation corresponding to the risk indication information according to the matching result includes: When the matching result is that the risk indication information indicates that there is a target that does not match the object in the whitelist, obtaining a distance value between the unmatched target and the vehicle; Determine the distance interval to which the distance value belongs, and obtain the drive-away operation configured corresponding to the distance interval.

8. The method according to claim 7, characterized in that After protecting the vehicle according to the driving-away operation, the method further includes: Acquire a movement trajectory of the unmatched target, determine a threat upgrade of the unmatched target according to the movement trajectory of the unmatched target, acquire a drive-away operation corresponding to the threat upgrade, and protect the vehicle according to the drive-away operation corresponding to the threat upgrade.

9. A vehicle, characterized in that: The vehicle is configured to execute the vehicle parking security method according to any one of claims 1 to 8.

10. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores at least one computer program executable by the at least one processor, and the at least one computer program is executed by the at least one processor so that the at least one processor can execute the vehicle parking security method according to any one of claims 1 to 8.

11. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed in a processor, the vehicle parking security method according to any one of claims 1 to 8 is implemented.

Images