Vehicle control method and device, electronic equipment, storage medium and vehicle

By turning on the image acquisition device and inertia measurement unit only when the risk monitoring is turned on in electric vehicles, data is acquired and risk monitoring and alarm is performed, the problem of large power consumption in Sentinel mode is solved, and the battery life and user rate are improved.

CN119659522APending Publication Date: 2025-03-21BEIJING CO WHEELS TECH CO LTD
View PDF 0 Cites 3 Cited by

Patent Information

Application Number
CN202311212376.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-19
Publication Date
2025-03-21

AI Technical Summary

Technical Problem

The sentinel mode of existing electric vehicles has increased power consumption, which affects battery life, resulting in a lower user usage rate.

Method used

By monitoring the risk monitoring switch of the vehicle, the image acquisition device and the inertia measurement unit are only turned on when it is turned on, multimedia data and motion data are obtained, and the target risk event level is determined based on these data and preset risk event trigger conditions, and alarms are made according to the alarm strategy corresponding to the level.

Benefits of technology

The energy consumption of the image acquisition device and the inertial measurement unit is saved, the impact on the vehicle's endurance is reduced, and the user usage rate is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119659522A_ABST
    Figure CN119659522A_ABST
Patent Text Reader

Abstract

The invention relates to a vehicle control method and device, electronic equipment, a storage medium and a vehicle, and the method comprises the steps: responding to monitoring that a risk monitoring switch of the vehicle is turned on, and controlling an image collection device and an inertial measurement unit of the vehicle to be turned on; acquiring multimedia data acquired by the image acquisition device and motion data acquired by the inertial measurement unit; based on the multimedia data, the motion data and a preset risk event triggering condition, determining a target risk event level currently satisfied by the vehicle; and controlling the vehicle to give an alarm based on a target alarm strategy corresponding to the target risk event level. By adopting the technical scheme, as only the image acquisition device and the inertial measurement unit are started to work, more energy consumption can be saved, so that the influence on the cruising ability of the vehicle is reduced, and the utilization rate of a user is favorably improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, and in particular to a vehicle control method, device, electronic equipment, storage medium and vehicle. Background Art

[0002] In real life, when a driver parks and leaves the vehicle, it is often scratched or collided. However, due to the lack of relevant information, the rights of the car owner cannot be protected.

[0003] At present, some electric vehicles are equipped with a sentry mode, which uses cameras installed around the vehicle to monitor whether the vehicle is under security threats and sound an alarm when threatened.

[0004] However, since the implementation of the sentinel mode will increase the vehicle's power consumption and affect the endurance of the electric vehicle, the user usage rate of the sentinel mode is relatively low. Summary of the invention

[0005] In order to solve the above technical problems or at least partially solve the above technical problems, at least one embodiment of the present disclosure provides a vehicle control method, device, electronic device, storage medium and vehicle.

[0006] In a first aspect, the present disclosure provides a vehicle control method, comprising:

[0007] In response to detecting that a risk monitoring switch of the vehicle is turned on, controlling an image acquisition device and an inertial measurement unit of the vehicle to turn on;

[0008] Acquiring multimedia data collected by the image acquisition device and motion data collected by the inertial measurement unit;

[0009] Determining a target risk event level currently met by the vehicle based on the multimedia data, the motion data and a preset risk event trigger condition;

[0010] Based on the target warning strategy corresponding to the target risk event level, the vehicle is controlled to issue an alarm.

[0011] In a second aspect, the present disclosure provides a vehicle control device, comprising:

[0012] The first control module is used to control the image acquisition device and the inertial measurement unit of the vehicle to turn on in response to detecting that the risk monitoring switch of the vehicle is turned on.

[0013] A data acquisition module, used to acquire the multimedia data acquired by the image acquisition device and the motion data acquired by the inertial measurement unit;

[0014] A determination module, configured to determine a target risk event level currently satisfied by the vehicle based on the multimedia data, the motion data and a preset risk event trigger condition;

[0015] The second control module is used to control the vehicle to issue an alarm based on the target alarm strategy corresponding to the target risk event level.

[0016] In a third aspect, the present disclosure provides an electronic device, including: a processor and a memory;

[0017] The processor is used to execute any vehicle control method provided by the embodiments of the present disclosure by calling the program or instruction stored in the memory.

[0018] In a fourth aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores a program or instruction, wherein the program or instruction enables a computer to execute any of the vehicle control methods provided in the embodiments of the present disclosure.

[0019] In a fifth aspect, the present disclosure provides a vehicle, comprising a vehicle control device or an electronic device or a computer-readable storage medium provided in an embodiment of the present disclosure.

[0020] In a sixth aspect, the present disclosure provides a computer program product, which is used to execute any of the vehicle control methods provided by the embodiments of the present disclosure.

[0021] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has at least the following advantages:

[0022] In the disclosed embodiment, in response to detecting that the risk monitoring switch of the vehicle is turned on, the image acquisition device and the inertial measurement unit of the vehicle are controlled to be turned on, and the multimedia data collected by the image acquisition device and the motion data collected by the inertial measurement unit are obtained, and then based on the multimedia data, the motion data and the preset risk event triggering conditions, the target risk event level currently met by the vehicle is determined, and based on the target warning strategy corresponding to the target risk event level, the vehicle is controlled to issue an alarm. With the above technical solution, when the risk monitoring switch is turned on, only the image acquisition device and the inertial measurement unit are turned on to obtain the data required for monitoring, and then risk monitoring and alarming are performed based on the collected data. Since only the image acquisition device and the inertial measurement unit are turned on to work, a lot of energy consumption can be saved, thereby reducing the impact on the vehicle's endurance, which helps to improve user usage. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0024] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0025] Figure 1 A schematic flow chart of a vehicle control method provided by an embodiment of the present disclosure;

[0026] Figure 2 A schematic flow chart of a vehicle control method provided by another embodiment of the present disclosure;

[0027] Figure 3 A schematic diagram of a working process of a vehicle control method provided in a specific embodiment of the present disclosure;

[0028] Figure 4 A schematic diagram of the structure of a vehicle control device provided in one embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] In order to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, the present disclosure is further described in detail below in conjunction with the accompanying drawings and embodiments. It is understandable that the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments, and the specific embodiments described herein are only used to explain the present disclosure, rather than to limit the present disclosure. In the absence of conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in the field belong to the scope of protection of the present disclosure.

[0030] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0031] Figure 1 This is a flow chart of a vehicle control method provided in an embodiment of the present disclosure. The vehicle control method can be executed by a vehicle control device provided in an embodiment of the present disclosure. The vehicle control device can be implemented using software and / or hardware and can be integrated on a vehicle.

[0032] like Figure 1 As shown, the vehicle control method provided by the embodiment of the present disclosure may include the following steps:

[0033] Step 101 : in response to detecting that a risk monitoring switch of a vehicle is turned on, controlling an image acquisition device and an inertial measurement unit of the vehicle to be turned on.

[0034] Among them, the risk monitoring switch may include an automatic switch and a temporary switch. The risk monitoring switch is used to turn on the sentry mode of the vehicle. When the risk monitoring switch is turned on, it is determined that the sentry mode of the vehicle is turned on, and the vehicle enters the sentry monitoring state.

[0035] For example, when it is detected that the user locks the vehicle, that is, when it is detected that the vehicle enters a locked state, the automatic switch can be automatically triggered to turn on, so that the vehicle enters a sentinel monitoring state.

[0036] Exemplarily, when it is detected that the user switches the temporary switch from the off state to the on state, the risk monitoring is turned on and the vehicle enters the sentinel monitoring state.

[0037] In the disclosed embodiment, when it is detected that the risk monitoring switch of the vehicle is turned on, the image acquisition device of the vehicle can be started for visual monitoring to monitor the environmental conditions such as pedestrians and vehicles around the vehicle, and the inertial measurement unit (IMU) can be started for motion monitoring to monitor the vibration of the vehicle.

[0038] The image acquisition device may be, but is not limited to, a 360-degree surround view camera, a camera assembly installed at different positions of the vehicle, and the like.

[0039] In an optional implementation of the present disclosure, in order to ensure the normal operation of the sentinel mode, in addition to setting the risk monitoring switch on, other prerequisites may be set, such as the vehicle's image acquisition device and IMU are fault-free, the vehicle battery has a power level greater than a preset power level or the vehicle is in a charging state, the vehicle's onboard head unit (HU) is in a normal working state, the vehicle is not in a mode such as car cleaning, towing, lifting, camping, discharging, etc., the vehicle has no geo-fence settings, etc. When the battery power is less than the preset power level, the vehicle's sentinel mode is automatically updated from the on state to the off state.

[0040] Step 102: Acquire multimedia data collected by the image acquisition device and motion data collected by the inertial measurement unit.

[0041] In the disclosed embodiments, the image acquisition device may acquire multimedia data at a preset sampling rate (e.g., 30 Hz), and the multimedia data may be, for example, images, videos, etc. The IMU may monitor motion data at a preset frequency (e.g., 500 Hz), and the motion data may be, for example, vibration amplitude data corresponding to the three directions of the X-axis, Y-axis, and Z-axis in the vehicle coordinate system collected by the IMU, where the X-axis data corresponds to the front and rear vibration of the vehicle, the Y-axis data corresponds to the left and right vibration of the vehicle, and the Z-axis data corresponds to the up and down vibration of the vehicle.

[0042] Exemplarily, the data collected in real time by the image acquisition device can be cached in a local cache, and data of a preset duration can be obtained from the local cache as multimedia data. For example, the latest 30 seconds of data can be obtained from the local cache as multimedia data for monitoring risk events.

[0043] Exemplarily, the motion data recently collected by the IMU may be obtained for monitoring risk events, for example, the data collected by the IMU within the last 10 seconds (from the current moment) may be obtained as motion data.

[0044] Step 103: Determine a target risk event level currently met by the vehicle based on the multimedia data, the motion data and a preset risk event trigger condition.

[0045] Among them, the risk event trigger conditions can be set according to actual needs. Different risk event levels correspond to different risk event trigger conditions. For example, the condition that the vibration amplitude in the motion data is greater than the preset amplitude threshold can be set as a high-risk event trigger condition, and the condition that the pedestrian approaches the vehicle and stays for a longer time than the preset time threshold but the vibration amplitude of the vehicle is not greater than the preset amplitude threshold can be set as a low-risk event trigger condition.

[0046] In the disclosed embodiment, after acquiring the multimedia data and the motion data, analysis can be performed based on the multimedia data and the motion data to determine whether the vehicle meets the preset risk event triggering conditions, and if so, further determine the target risk event level that the vehicle currently meets. Different risk event levels correspond to different alarm strategies, wherein the higher the risk event level, the more alarm modes there are, and the more power the alarm consumes. By setting different alarm strategies for different risk event levels, power consumption can also be reduced to a certain extent.

[0047] In practical applications, the motion data can be analyzed first, and based on the motion data, it can be determined whether the vibration amplitude of the vehicle is greater than the preset amplitude threshold. If so, the target risk event level that the vehicle meets is determined to be high risk. Otherwise, it can be further determined based on the multimedia data whether there are pedestrians approaching the vehicle, and when someone approaches the vehicle, the length of time the person stays near the vehicle is obtained. If the length of stay is greater than the preset length threshold, the target risk event level that the vehicle meets is determined to be low risk. In this way, it is possible to avoid unnecessary waste of processing resources caused by processing multimedia data and motion data at the same time, save processing resources, and reduce power consumption to a certain extent.

[0048] Step 104: Based on the target warning strategy corresponding to the target risk event level, control the vehicle to issue an alarm.

[0049] In the disclosed embodiment, after the target risk event level is determined, the vehicle can be controlled to issue an alarm based on the target alarm strategy corresponding to the target risk event level. For example, when the target risk event level is low risk, the vehicle is controlled to issue an alarm based on the alarm strategy corresponding to the low risk event, and when the target risk event level is high risk, the vehicle is controlled to issue an alarm based on the alarm strategy corresponding to the high risk event.

[0050] In actual applications, the vehicle's central domain controller XCU can be controlled to issue an alarm, such as controlling the XCU to light up the lights, lighting up the central control display screen to play an alarm animation, etc.

[0051] The vehicle control method of the disclosed embodiment, in response to detecting that the risk monitoring switch of the vehicle is turned on, controls the image acquisition device and the inertial measurement unit of the vehicle to turn on, and obtains the multimedia data collected by the image acquisition device and the motion data collected by the inertial measurement unit, and then determines the target risk event level currently met by the vehicle based on the multimedia data, motion data and preset risk event trigger conditions, and controls the vehicle to issue an alarm based on the target alarm strategy corresponding to the target risk event level. With the above technical solution, when the risk monitoring switch is turned on, only the image acquisition device and the inertial measurement unit are turned on to obtain the data required for monitoring, and then risk monitoring and alarm are performed based on the collected data. Since only the image acquisition device and the inertial measurement unit are turned on to work, a lot of energy consumption can be saved, thereby reducing the impact on the vehicle's endurance, which helps to improve user usage.

[0052] In an optional embodiment of the present disclosure, Figure 2 As shown, in Figure 1 Based on the illustrated embodiment, step 103 may include the following sub-steps:

[0053] Step 201 , analyzing the multimedia data to obtain persons within a preset range around the vehicle and the length of stay of the persons.

[0054] Among them, the preset range can be set according to actual needs. For example, the preset range can be set to a rectangular area whose distance to the vehicle's door, front and rear is not greater than the preset distance, or the preset range can be set to a circle center area with the center of the vehicle as the center and a preset length as the radius, and so on.

[0055] In the embodiments of the present disclosure, the acquired multimedia data may be analyzed, for example, the target detection technology may be used to detect whether there is a person close to the vehicle in the multimedia data, and the target tracking technology may be used to determine the length of time the person stays within a preset range. It is understandable that the person close to the vehicle may be a pedestrian, a cyclist, etc.

[0056] Step 202: Obtain, from the motion data, the maximum vibration amplitude among the vibration amplitudes generated by the vehicle in the three directions of the X-axis, the Y-axis, and the Z-axis in the vehicle coordinate system.

[0057] In the disclosed embodiment, the acquired motion data includes the vibration amplitudes generated by the vehicle in the three directions of X-axis, Y-axis and Z-axis in the vehicle coordinate system. These vibration amplitudes can be compared and the maximum vibration amplitude can be determined therefrom.

[0058] It should be noted that in the embodiment of the present disclosure, the execution order of step 201 and step 202 is not specific, and the two can be executed simultaneously or in sequence. This embodiment only uses the execution of step 202 after step 201 as an example to explain the present disclosure, and it cannot be used as a limitation of the present disclosure.

[0059] Step 203, determining the target risk event level by using the correspondence between the stay time of the personnel and the maximum vibration amplitude and a preset threshold.

[0060] In the disclosed embodiment, after determining the length of time that pedestrians around the vehicle stay near the vehicle and the maximum vibration amplitude in the motion data, the determined length of time and the maximum vibration amplitude can be compared with the corresponding preset thresholds to determine whether the length of time that the people stay and the maximum vibration amplitude of the vehicle reach the preset thresholds, and then determine the target risk event level that the vehicle currently meets based on the judgment result.

[0061] In an optional implementation of the present disclosure, when the length of stay of the person obtained based on the multimedia data is greater than the preset length threshold, and the maximum vibration amplitude obtained based on the motion data is not greater than the preset amplitude threshold, it is determined that the target risk event level currently met by the vehicle is the first level. When the maximum vibration amplitude obtained based on the motion data is greater than the preset amplitude threshold, it is determined that the target risk event level currently met by the vehicle is the second level.

[0062] Among them, the preset duration threshold and the preset amplitude threshold can be set according to actual needs, and the present disclosure does not limit their specific values.

[0063] Among them, the second level is higher than the first level, the second level can be high risk, and the first level can be low risk.

[0064] In the disclosed embodiment, after determining the length of time that people around the vehicle stay near the vehicle and the maximum vibration amplitude in the motion data, the determined length of stay can be compared with a preset length threshold, and the maximum vibration amplitude can be compared with a preset amplitude threshold. If the length of time that the people stay is greater than the preset length threshold, and the maximum vibration amplitude is not greater than the preset amplitude threshold, it is determined that the target risk event level currently met by the vehicle is the first level; if the maximum vibration amplitude is greater than the preset amplitude threshold, there is no need to consider whether there are people around the vehicle, and it can be directly determined that the target risk event level currently met by the vehicle is the second level.

[0065] The vehicle control method of the disclosed embodiment analyzes multimedia data to obtain persons within a preset range around the vehicle and their length of stay, and obtains the maximum vibration amplitude among the vibration amplitudes generated by the vehicle in the three directions of X-axis, Y-axis and Z-axis in the vehicle coordinate system from the motion data, and then determines the target risk event level using the correspondence between the length of stay of the persons and the maximum vibration amplitude and the preset threshold. Thus, by combining the multimedia data collected by the image acquisition device and the motion data collected by the IMU to determine the risk event level met by the vehicle, the accuracy of the risk event level can be improved, which in turn helps to improve the recall rate of users in high-risk events.

[0066] Furthermore, in the disclosed embodiment, different alarm strategies can be set for different risk event levels. Specifically, the first alarm strategy corresponding to the first level can be pre-set to include playing an alarm animation through the central control display screen, and the second alarm strategy corresponding to the second level can include lighting up the alarm, playing an alarm animation through the central control display screen, and pushing a prompt message to the user. In other words, for high-risk events, there are more alarm methods than for low-risk events. Both low-risk and high-risk events will light up the central control display screen to play a preset alarm animation, while only high-risk events will trigger the alarm method of lighting up the alarm and pushing a prompt message to the user. By setting different alarm strategies for different risk event levels, energy consumption can be reduced to a certain extent and user utilization can be improved.

[0067] Therefore, in an optional embodiment of the present disclosure, when the determined target risk event level is the first level, controlling the vehicle to issue an alarm based on the target alarm strategy corresponding to the target risk event level may include: obtaining a first alarm strategy corresponding to the first level, obtaining a first alarm animation corresponding to the first alarm strategy, and then controlling the vehicle to display the first alarm animation through the central control display screen.

[0068] In an optional embodiment of the present disclosure, when the determined target risk event level is the second level, controlling the vehicle to issue an alarm based on the target alarm strategy corresponding to the target risk event level may include: obtaining a second alarm strategy corresponding to the second level, obtaining a second alarm animation corresponding to the second alarm strategy and a preset risk warning message, and then controlling the vehicle to turn on the warning light, and displaying the second alarm animation through the central control display screen, and sending a risk warning message to the user according to the preset message push rules.

[0069] The second warning animation may be the same as or different from the first warning animation and may be set according to actual needs, and the present disclosure does not impose any restrictions on this.

[0070] In the disclosed embodiment, when the target risk event level currently met by the vehicle is the second level, that is, when a high-risk warning event is triggered, an alarm can be issued by turning on the warning light, displaying the second warning animation through the central control display screen, and pushing a preset risk warning message to the user, wherein the warning light can be a star ring light, a headlight and / or a taillight, and the warning light can be turned on in a manner such as being constantly on, flashing, etc.

[0071] In addition, the preset message push rules can be to push risk warning messages to the vehicle APP installed on the mobile terminal held by the user, send risk warning messages by SMS, call the user's phone to voice broadcast the risk warning messages, etc. Among them, when prompting the user by pushing risk warning messages to the vehicle APP installed on the mobile terminal held by the user, the risk warning message can be first transmitted to the cloud server through the network, and then the cloud server sends the risk warning message to the vehicle APP installed on the mobile terminal held by the user. By pushing risk warning messages to users, users can be notified in time when the vehicle is threatened by high risks, so that users can check the vehicle status in time to ensure vehicle safety.

[0072] In an optional embodiment of the present disclosure, video data collected by the image acquisition device after the alarm is started can also be obtained, and when it is monitored that the vehicle is connected to an external storage device, the collected video data and the aforementioned multimedia data are stored in the external storage device, so that the user can view the multimedia data and risk warning video that triggered the risk event in the driving recorder or other electronic devices after getting on the vehicle.

[0073] The external storage device may be, for example, a USB flash drive, a driving recorder, or other devices.

[0074] Exemplarily, after the vehicle starts to perform the alarm action, the image acquisition device can collect a video of a preset duration as video data, or collect a video from the start of the alarm action to the end of the alarm action as video data. Since the alarm action has been started when the video data is collected, the collected video data can reflect whether the specific operation of this alarm is to play the alarm animation, or to turn on the alarm light while playing the alarm animation, so that when the user watches the video data, the risk event level corresponding to this alarm can be determined according to the alarm action recorded in the video data. Since multimedia data is used as a basis for determining whether a risk event is triggered, after the alarm is started, the multimedia data is stored in an external storage device for the user to view later, so that the user can know the cause of this alarm, whether it is an alarm triggered by a suspicious person approaching or an alarm triggered by a vehicle being hit. Therefore, in the embodiment of the present disclosure, by storing the video data collected by the image acquisition device after the alarm is started and the multimedia data used to determine the risk event in the external storage device, the data source and basis are provided for the user to understand the specific cause of the risk event and the alarm operation.

[0075] In an optional implementation of the present disclosure, when the vehicle detects that the alarm event is lifted or the vehicle is unlocked, the image acquisition device can be controlled to stop data acquisition, and the central control display screen can be determined whether to turn off according to whether the vehicle is unlocked. Usually, the vehicle is unlocked when the user gets on the vehicle, so, for example, after the vehicle is unlocked, it can be considered that the user is on the vehicle at this time, and the central control display screen can be turned off to end the alarm operation and turn off the sentry mode.

[0076] Figure 3 A schematic diagram of a working process of a vehicle control method provided by a specific embodiment of the present disclosure. The vehicle control method provided by the embodiment of the present disclosure can be configured as follows: Figure 3 The sentinel algorithm in Figure 3 The Sentinel application in the system is executed to implement the Sentinel monitoring and alarm of the vehicle. Figure 3As shown, the user can use the voice assistant to turn on the automatic switch or temporary switch through voice commands to enable the Sentry application to turn on the Sentry mode. After the vehicle enters the Sentry mode, the 360-degree surround camera controlled by the HU will be activated for visual monitoring, and the IMU sensor on the HU will be controlled to monitor the sensor at a specified frequency (for example, 500Hz), and the algorithm module will be turned on to run, and the Sentry mode working status will be sent to the XCU part, so that the entire vehicle is in the Sentry mode and the vehicle power supply (including the battery and the power battery) is kept in working condition. The Sentinel application obtains multimedia data collected by the surround-view camera and motion data collected by the IMU sensor. Based on the multimedia data and motion data, the Sentinel algorithm is called to determine whether there is a person, how close the person is to the car, and in which direction of the car body, etc. The behavior of the person photographed around the car body, and whether the vibration amplitude generated by the IMU in the X, Y, and Z axes in the vehicle coordinate system reaches the expected possible vibration that causes damage to the car, that is, whether the vibration amplitude in a certain direction is greater than the preset amplitude threshold. Then, based on the judgment results of the two parts, it is determined whether a risk event is triggered and whether the triggered event is high risk or low risk, and the corresponding target risk event level is told to the Sentinel application through the channel established when the algorithm is turned on. The Sentinel application determines the corresponding target warning strategy based on the target risk event level, and controls the central control display screen to play the preset warning animation based on the target warning strategy. When the target risk event level is high risk, it also controls the XCU to turn on the lights for warning, and provides a network to transmit the risk warning message to the cloud according to the specified rules. The cloud pushes the risk warning message to the user APP (that is, the vehicle APP installed on the terminal device held by the user) so that the user can check the vehicle status in time. After the alarm starts, the Sentinel application can also save the 30-second video (i.e. multimedia data) cached in the memory and the video data collected by the 360-degree surround camera after the alarm action starts to a USB flash drive, so that the user can view the relevant data of the risk event in the driving recorder after getting in the car.

[0077] The vehicle control scheme disclosed in the present invention determines the risk events that occur in the vehicle by combining visual data and IMU data, which improves the accuracy of determining risk events and the recall rate of high-risk events compared to the scheme that relies on only a single data for judgment. In addition, in sentinel mode, this scheme only needs to turn on the image acquisition device and IMU to work most of the time, and does not rely on the full self-driving system (Full Self-Driving, FSD) to work, thereby saving a lot of energy consumption. In addition, the light warning operation is triggered only when a high-risk alarm is triggered, and a risk warning message is sent to the user, which also reduces energy consumption to a certain extent. In other words, this scheme reduces power consumption by controlling the high-voltage time and wake-up strategy on the entire vehicle, thereby improving user utilization.

[0078] In order to implement the above embodiments, the present disclosure also provides a vehicle control device.

[0079] Figure 4 This is a schematic diagram of the structure of a vehicle control device provided in one embodiment of the present disclosure. The device can be implemented using software and / or hardware and can be applied to a vehicle.

[0080] like Figure 4 As shown, the vehicle control device 40 provided in the embodiment of the present disclosure may include: a first control module 401, a data acquisition module 402, a determination module 403 and a second control module 404, wherein:

[0081] The first control module 401 is used to control the image acquisition device and the inertial measurement unit of the vehicle to turn on in response to detecting that the risk monitoring switch of the vehicle is turned on.

[0082] A data acquisition module 402 is used to acquire multimedia data acquired by the image acquisition device and motion data acquired by the inertial measurement unit;

[0083] A determination module 403, configured to determine a target risk event level currently met by the vehicle based on the multimedia data, the motion data and a preset risk event trigger condition;

[0084] The second control module 404 is used to control the vehicle to issue an alarm based on the target alarm strategy corresponding to the target risk event level.

[0085] Optionally, the determining module 403 is further configured to:

[0086] Analyze the multimedia data to obtain persons within a preset range around the vehicle and the length of stay of the persons;

[0087] Obtaining the maximum vibration amplitude among the vibration amplitudes generated by the vehicle in the three directions of the X-axis, the Y-axis, and the Z-axis in the vehicle coordinate system from the motion data;

[0088] The target risk event level is determined by using the correspondence between the length of stay of the personnel and the maximum vibration amplitude and a preset threshold.

[0089] Optionally, the determining module 403 is further configured to:

[0090] When the stay time of the person is greater than the preset time threshold and the maximum vibration amplitude is not greater than the preset amplitude threshold, determining that the target risk event level currently met by the vehicle is the first level;

[0091] When the maximum vibration amplitude is greater than the preset amplitude threshold, it is determined that the target risk event level currently satisfied by the vehicle is the second level.

[0092] Optionally, the second control module 404 is further configured to:

[0093] Acquire a first warning strategy corresponding to the first level, the first warning strategy comprising playing a warning animation through a central control display screen;

[0094] Obtaining a first alarm animation corresponding to the first alarm strategy;

[0095] Control the vehicle to display the first warning animation through the central control display screen.

[0096] Optionally, the second control module 404 is further configured to:

[0097] Acquire a second warning strategy corresponding to the second level, the second warning strategy including lighting a warning light, playing a warning animation through a central control display screen, and pushing a prompt message to a user;

[0098] Obtaining a second warning animation and a preset risk warning message corresponding to the second warning strategy;

[0099] Controlling the vehicle to turn on a warning light, and displaying the second warning animation through the central control display screen;

[0100] According to the preset message push rules, the risk warning message is sent to the user.

[0101] Optionally, the vehicle control device 40 further includes:

[0102] An acquisition module, used for acquiring video data acquired by the image acquisition device after the alarm starts;

[0103] The storage module is used for storing the video data and the multimedia data in the external storage device in response to detecting that the vehicle is connected to the external storage device.

[0104] The vehicle control device provided in the embodiments of the present disclosure and which can be configured on a vehicle can execute any vehicle control method provided in the embodiments of the present disclosure and which is applied to a vehicle, and has the corresponding functional modules and beneficial effects of the execution method. For the contents not fully described in the embodiments of the present disclosure, reference can be made to the description in any method embodiment of the present disclosure.

[0105] The disclosed embodiment also provides an electronic device, including a processor and a memory; the processor calls the program or instructions stored in the memory to execute the steps of each embodiment of the vehicle control method as described in any of the aforementioned embodiments. To avoid repeated description, they will not be repeated here.

[0106] The embodiments of the present disclosure also provide a computer-readable storage medium, which is non-transitory and stores programs or instructions. The programs or instructions enable a computer to execute the steps of each embodiment of the vehicle control method as described in any of the aforementioned embodiments. To avoid repeated description, they will not be repeated here.

[0107] An embodiment of the present disclosure also provides a vehicle, comprising the vehicle control device or electronic device or computer-readable storage medium provided by the above-mentioned embodiment of the present disclosure.

[0108] The embodiments of the present disclosure also provide a computer program product, which is used to execute the steps of each embodiment of the vehicle control method as described in any of the aforementioned embodiments.

[0109] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0110] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A vehicle control method, characterized in that: The method comprises: In response to detecting that a risk monitoring switch of the vehicle is turned on, controlling an image acquisition device and an inertial measurement unit of the vehicle to turn on; Acquiring multimedia data collected by the image acquisition device and motion data collected by the inertial measurement unit; Determining a target risk event level currently met by the vehicle based on the multimedia data, the motion data and a preset risk event trigger condition; Based on the target warning strategy corresponding to the target risk event level, the vehicle is controlled to issue an alarm.

2. The method according to claim 1, characterized in that The determining, based on the multimedia data, the motion data and a preset risk event trigger condition, a target risk event level currently satisfied by the vehicle includes: Analyze the multimedia data to obtain the persons within a preset range around the vehicle and the length of stay of the persons; obtain the maximum vibration amplitude among the vibration amplitudes generated by the vehicle in the three directions of the X-axis, the Y-axis, and the Z-axis in the vehicle coordinate system from the motion data; The target risk event level is determined by using the correspondence between the length of stay of the personnel and the maximum vibration amplitude and a preset threshold.

3. The method according to claim 2, characterized in that The method further comprises: When the stay time of the person is greater than the preset time threshold and the maximum vibration amplitude is not greater than the preset amplitude threshold, determining that the target risk event level currently met by the vehicle is the first level; When the maximum vibration amplitude is greater than the preset amplitude threshold, it is determined that the target risk event level currently satisfied by the vehicle is the second level.

4. The method according to claim 3, characterized in that The target warning strategy corresponding to the target risk event level, controlling the vehicle to issue an alarm, includes: Acquire a first warning strategy corresponding to the first level, the first warning strategy comprising playing a warning animation through a central control display screen; Obtaining a first alarm animation corresponding to the first alarm strategy; Control the vehicle to display the first warning animation through the central control display screen.

5. The method according to claim 3, characterized in that: The target warning strategy corresponding to the target risk event level, controlling the vehicle to issue an alarm, includes: Acquire a second warning strategy corresponding to the second level, the second warning strategy including lighting a warning light, playing a warning animation through a central control display screen, and pushing a prompt message to a user; Obtaining a second warning animation and a preset risk warning message corresponding to the second warning strategy; Controlling the vehicle to turn on a warning light, and displaying the second warning animation through the central control display screen; According to the preset message push rules, the risk warning message is sent to the user.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquire the video data collected by the image acquisition device after the alarm starts; In response to detecting that the vehicle is connected to an external storage device, the video data and the multimedia data are stored in the external storage device.

7. A vehicle control device, characterized in that: The device comprises: The first control module is used to control the image acquisition device and the inertial measurement unit of the vehicle to turn on in response to detecting that the risk monitoring switch of the vehicle is turned on. A data acquisition module, used to acquire the multimedia data acquired by the image acquisition device and the motion data acquired by the inertial measurement unit; A determination module, configured to determine a target risk event level currently satisfied by the vehicle based on the multimedia data, the motion data and a preset risk event trigger condition; The second control module is used to control the vehicle to issue an alarm based on the target alarm strategy corresponding to the target risk event level.

8. An electronic device, characterized in that: include: Processor and memory; The processor is used to execute the vehicle control method as described in any one of claims 1 to 6 by calling the program or instruction stored in the memory.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program or an instruction that causes a computer to execute the vehicle control method according to any one of claims 1 to 6.

10. A vehicle, characterized in that: Includes the vehicle control device as claimed in claim 7, the electronic device as claimed in claim 8, or the computer-readable storage medium as claimed in claim 9.

Citation Information

Cited By

  • Vehicle anti-theft method, device and equipment

    CN120462319A

  • Vehicle monitoring method and related equipment

    CN120498912A

  • Low-power-consumption monitoring detection method and circuit

    CN121989862A