Method for monitoring a vehicle, monitoring device for a vehicle, vehicle and storage medium

Abstract

The application provides a monitoring method of a vehicle, a monitoring device of the vehicle, the vehicle and a storage medium, and relates to the technical field of vehicles. The method comprises the following steps: if it is detected that there is an external collection device in a parking area of the vehicle, acquiring a collection area of the external collection device in the parking area and a current state of the external collection device; determining a target camera that needs to be turned on in the vehicle based on the collection area and the current state; and performing abnormal monitoring on the vehicle based on first image data and / or second image data; wherein the first image data is image data corresponding to the collection area, and the second image data is image data of the vehicle collected by the target camera. The application can reduce power consumption generated when the camera collects image data when the vehicle is in a sentinel mode.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and more specifically, to a vehicle monitoring method, a vehicle monitoring device, a vehicle, and a storage medium in the field of vehicle technology. Background Technology

[0002] To ensure vehicle safety when unattended, a sentry mode can be installed on the vehicle to monitor its surroundings and status. Visual algorithms and vibration detection are used to analyze video data collected by surround-view cameras. If phenomena such as broken windows, collisions, or movement are detected (collectively referred to as "abnormal situations"), the system can issue warnings by sounding the horn, flashing lights, or playing a warning audio message. Furthermore, information about abnormal vehicle conditions is sent to the user's terminal, allowing the user to be promptly informed and react accordingly, greatly improving vehicle safety.

[0003] In addition, when the vehicle sentry mode is activated, it can also save the video data collected by the surround-view camera, which can provide users with corresponding evidence in case of vehicle damage or loss of property, making it easier for users to hold the responsible party accountable.

[0004] In related technologies, when the sentry mode on a vehicle is activated, multiple surround-view cameras are needed to simultaneously collect video data of the vehicle's surroundings in real time, which can easily generate significant power consumption.

[0005] Therefore, reducing the power consumption generated when the camera collects image data is an urgent problem to be solved when the vehicle is in sentry mode. Summary of the Invention

[0006] This application provides a vehicle monitoring method, a vehicle monitoring device, a vehicle, and a storage medium. The method can reduce the power consumption generated when the camera acquires image data when the vehicle is in sentry mode.

[0007] Firstly, a method for monitoring vehicles is provided, the method comprising:

[0008] If an external acquisition device is detected in the parking area of ​​the vehicle, the acquisition area of ​​the external acquisition device in the parking area and the current status of the external acquisition device are obtained; based on the acquisition area and the current status, the target camera in the vehicle that needs to be turned on is determined; based on the first image data and / or the second image data, the vehicle is monitored for abnormalities; wherein, the first image data is the image data corresponding to the acquisition area, and the second image data is the image data of the vehicle acquired by the target camera.

[0009] In this embodiment, the target cameras that need to be activated in the vehicle can be determined based on the acquisition area of ​​the external acquisition device in the vehicle's parking area and the current state of the external acquisition device. That is, the cameras that need to be activated are determined by analyzing the acquisition area and current state of the external acquisition device. Thus, the cameras in the vehicle may not need to be activated, or may only be partially activated. Furthermore, when using the first image data acquired by the external acquisition device to monitor the vehicle for anomalies, image data captured by the target cameras in the vehicle is not required for anomaly monitoring. Therefore, it can be concluded that the cameras in the vehicle do not need to be activated, meaning all cameras in the vehicle are turned off, thus avoiding power consumption from all cameras in the vehicle due to image data acquisition. Alternatively, when using the first image data acquired by the external acquisition device and the second image data acquired by the target cameras in the vehicle to jointly monitor the vehicle for anomalies, it can be concluded that cameras whose image data is the same as the first image data are in a turned-off state, while cameras whose image data is different from the first image data are in a turned-on state. That is, the cameras in the vehicle are partially turned on and partially turned off, thus avoiding power consumption from the turned-off cameras due to image data acquisition. Therefore, when the vehicle is in sentry mode, the power consumption generated by the cameras when acquiring image data can be reduced.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, the above-mentioned determination of the target camera in the vehicle that needs to be turned on based on the collection area and the current state includes:

[0011] If the current state is working, acquire the first image data collected by the external acquisition device within the acquisition area; if the first image data includes omnidirectional image data of the vehicle, determine that the target camera in the vehicle does not need to be turned on; the above-mentioned abnormal monitoring of the vehicle based on the first image data and / or the second image data includes: detecting whether there is an abnormal situation in the vehicle based on the first image data; if an abnormal situation is detected in the vehicle, outputting the first alarm information.

[0012] In this embodiment, since the external acquisition device is in working condition, that is, the external acquisition device can normally acquire and send the first image data to the vehicle, and the first image data acquired by the external acquisition device includes the image data of the vehicle from all directions, it is not necessary for the vehicle to turn on any camera to acquire the second image data. That is, all cameras in the vehicle are turned off, thereby avoiding the power consumption of all cameras in the vehicle due to acquiring image data.

[0013] Furthermore, the system can detect whether there are any abnormalities in the vehicle using the first image data, and when an abnormality is detected, it can output a first alarm message so that the vehicle owner can be informed of the abnormality in the vehicle in a timely manner, and to warn pedestrians around the vehicle.

[0014] Combining the first aspect and the above implementation methods, in some implementation methods of the first aspect, the above method of determining the target camera that needs to be turned on in the vehicle based on the collection area and the current state includes:

[0015] If the current state is working, acquire the first image data collected by the external acquisition device within the acquisition area; if the first image data includes image data of part of the vehicle's orientation, determine the camera in the vehicle that captures the remaining orientation of the vehicle as the target camera; the above-mentioned abnormal monitoring of the vehicle based on the first image data and / or the second image data includes: detecting whether there is an abnormal situation in the vehicle based on the partial orientation image data and the second image data; if an abnormal situation is detected in the vehicle, output a second alarm message.

[0016] In this embodiment, since the external acquisition device is in working condition, that is, the external acquisition device can normally acquire and send the first image data to the vehicle, and the first image data acquired by the external acquisition device includes image data of part of the vehicle's orientation, but does not include image data of the vehicle's full orientation, it is indicated that the vehicle needs to turn on the cameras in the remaining orientation to acquire image data in the remaining orientation, that is, the cameras in the vehicle are partially turned on and partially turned off, thereby avoiding the power consumption of the partially turned-off cameras due to acquiring image data.

[0017] Furthermore, the system can detect whether there are any abnormalities in the vehicle by using the first and second image data, and when an abnormality is detected, it can output a second alarm message so that the vehicle owner can be informed of the abnormality in the vehicle in a timely manner, and to warn pedestrians around the vehicle.

[0018] Combining the first aspect and the above-described implementation methods, in some implementation methods of the first aspect, the above-described detection of whether a vehicle has an anomaly based on partial orientation image data and second image data includes:

[0019] The image data from a partial location is combined with the second image data to obtain a full-view image of the vehicle; the full-view image data of the vehicle is then used to identify whether there are any abnormalities in the vehicle.

[0020] In this embodiment of the application, since the image data of a partial position in the first image data and the second image data can be combined to obtain the all-round image data of the vehicle, when detecting whether there is an abnormality in the vehicle, the omission caused by the independence between the image data of a partial position and the second image data can be avoided, thereby improving the accuracy of detecting whether there is an abnormality in the vehicle.

[0021] Combining the first aspect and the above implementation methods, in some implementation methods of the first aspect, the above method of determining the target camera that needs to be turned on in the vehicle based on the collection area and the current state includes:

[0022] If the current state is not in operation, the target camera is determined to be a 360-degree camera of the vehicle; the above-mentioned abnormal monitoring of the vehicle based on the first image data and / or the second image data includes: detecting whether there is an abnormal situation in the vehicle based on the second image data; if an abnormal situation is detected in the vehicle, outputting a third alarm message.

[0023] In this embodiment, since the external acquisition device is in a non-working state, that is, the external acquisition device cannot acquire and send the first image data to the vehicle, all the cameras configured in the vehicle need to be turned on to acquire image data (i.e., the second image data), and the sentry mode is executed through the second image data, thereby ensuring the normal execution of the sentry mode.

[0024] Furthermore, the second image data can be used to detect whether there are any abnormalities in the vehicle, and when an abnormality is detected, a third alarm message can be output so that the vehicle owner can be informed of the abnormality in a timely manner, and pedestrians around the vehicle can be alerted.

[0025] In conjunction with the first aspect and the above implementation methods, in some implementations of the first aspect, the method further includes:

[0026] Obtain the image storage status from the external acquisition device; if the image storage status is the first status, store the second image data; if the image storage status is the second status, store the first image data and the second image data; wherein the first status and the second status are different.

[0027] In this embodiment, when the image storage state in the external acquisition device is in the first state, that is, when the storage function is normal, the vehicle can store the second image data instead of the first image data acquired by the external acquisition device. This ensures that the vehicle owner can obtain comprehensive image data of the vehicle later while saving the vehicle's data storage space.

[0028] Alternatively, since the image storage state in the external acquisition device is in the second state, i.e. when the storage function is abnormal, in order to ensure that the vehicle owner can obtain the vehicle's comprehensive image data later, the vehicle can store the first image data and the second image data simultaneously, thereby ensuring the integrity of the vehicle's comprehensive image data.

[0029] In conjunction with the first aspect and the above implementation methods, in some implementations of the first aspect, the method further includes:

[0030] The system receives the parking location and driving route from an external data acquisition device; it then controls the vehicle to drive to the parking location and park according to the driving route. The parking location is determined by the external data acquisition device based on the data acquisition area and the available space within that area. The driving route is determined by the external data acquisition device based on the navigation path between the vehicle's current location and the available space.

[0031] In this embodiment, the external acquisition device can send the determined parking location and driving route to the vehicle, enabling the vehicle to drive to the parking location and park accordingly. Since the parking location is within the acquisition area of ​​the external acquisition device, after the vehicle parks, its entire or most of its position can be within the acquisition area of ​​the external acquisition device. This allows the vehicle's camera to operate in sentry mode without needing to be turned on or only partially turned on, reducing the power consumption generated when the camera acquires image data.

[0032] Secondly, a vehicle monitoring device is provided, comprising: an acquisition module for acquiring the acquisition area of ​​the external acquisition device in the parking area and the current state of the external acquisition device if an external acquisition device is detected in the parking area of ​​the vehicle; a determination module for determining a target camera in the vehicle that needs to be turned on based on the acquisition area and the current state; and a monitoring module for performing abnormal monitoring of the vehicle based on first image data and / or second image data; wherein the first image data is image data corresponding to the acquisition area, and the second image data is image data of the vehicle acquired by the target camera.

[0033] Thirdly, a vehicle is provided, including a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, causing the vehicle to perform the methods of the first aspect or any possible implementation thereof.

[0034] Fourthly, a computer program product is provided, comprising: computer program code, which, when run on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0035] Fifthly, a computer-readable storage medium is provided that stores computer program code, which, when executed on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation thereof. Attached Figure Description

[0036] Figure 1 This is a schematic diagram of the vehicle sentry mode provided in the embodiments of this application.

[0037] Figure 2 This is a schematic diagram of a system for a vehicle to execute sentry mode, provided in an embodiment of this application.

[0038] Figure 3 This is a schematic diagram of another vehicle executing sentry mode provided in an embodiment of this application.

[0039] Figure 4 This is a flowchart illustrating a vehicle monitoring method provided in an embodiment of this application.

[0040] Figure 5 This is a flowchart illustrating another vehicle monitoring method provided in this application embodiment.

[0041] Figure 6 This is a schematic diagram of the vehicle monitoring device provided in the embodiments of this application.

[0042] Figure 7 This is a schematic diagram of the vehicle structure provided in the embodiments of this application. Detailed Implementation

[0043] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0044] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0045] Figure 1 This is a schematic diagram of the vehicle sentry mode provided in the embodiments of this application.

[0046] For example, such as Figure 1 As shown in (a) in the figure, Figure 1 (a) includes vehicle 110 and vehicle key 120. The user can activate the sentry mode in vehicle 110 by triggering the sentry mode button in vehicle key 120; or the user can activate the sentry mode by the corresponding button in the vehicle, which is not limited in this application.

[0047] like Figure 1 As shown in (b) in the figure, Figure 1The vehicle 110 in (b) is equipped with a first camera 111, a second camera 112, a third camera 113, and a fourth camera 114. The first camera 111 can be used to capture video of the front of the vehicle 110, the second camera 112 and the third camera 113 can capture video of the left and right sides of the vehicle 110, and the fourth camera 114 can capture video of the rear of the vehicle 110, and the captured video can also include the current video of the vehicle 110 itself.

[0048] Optionally, the types of the first camera 111, the second camera 112, the third camera 113, and the fourth camera 114 include, but are not limited to, surround-view cameras.

[0049] It should be understood that, in addition to vehicle 110 Figure 1 In addition to the first camera 111, the second camera 112, the third camera 113 and the fourth camera 114 shown in (b), a front-view camera, a rear-view camera and a side-view camera can also be installed.

[0050] For example, when vehicle 110 receives a command from a user to activate sentry mode via vehicle key 120, it controls... Figure 1 The first camera 111, the second camera 112, the third camera 113 and the fourth camera 114 shown in (b) are all turned on to obtain a panoramic image of the vehicle and its surroundings, and to execute the sentry mode using the panoramic image.

[0051] The following was passed Figure 2 The specific process of executing Sentry Mode on vehicle 110 is illustrated by example: Figure 2 This is a schematic diagram of a system for a vehicle to execute sentry mode, provided in an embodiment of this application.

[0052] For example, such as Figure 2As shown, system 200 includes: a surround view camera, a user terminal 10, a Telematics Service Provider (TSP) platform 20, a Telematics Box (T-BOX) 30, a Central Electronic Module (CEM) 40, an intelligent driving controller 50, a DVR (Digital Video Recorder) controller 60, a vehicle infotainment system controller 70, and a vehicle body management controller 80. Specifically, the connections within system 200 are as follows: user terminal 10 is connected to TSP 20; TSP 20 is connected to T-BOX 30; T-BOX 30 is connected to CEM 40; CEM 40 is connected to intelligent driving controller 50, DVR controller 60, vehicle infotainment controller 70, and vehicle body management controller 80; the surround-view camera is connected to intelligent driving controller 50 via a Low Voltage Differential Signaling (LVDS) interface; and intelligent driving controller 50 is connected to DVR controller 60 and vehicle infotainment controller 70. Through these connections, the various modules in system 200 can communicate with each other. For example, user terminal 10 is connected to TSP 20, meaning information can be transmitted between user terminal 10 and TSP 20.

[0053] Surround view cameras can be like Figure 1 As shown in (b), including but not limited to a first camera 111, a second camera 112, a third camera 113 and a fourth camera 114, for acquiring image data (e.g., video data and image data) of the vehicle itself and its surrounding environment, providing image data for the vehicle to perform sentry mode; and the number of the surround-view cameras may be greater than or equal to four.

[0054] User terminal 10 can be used to send sentry mode setting information triggered by the user on itself, i.e., a sentry mode activation signal, and send this activation signal to TSP 20 via wireless network communication or Bluetooth communication. Alternatively, the user can also send sentry mode setting information to TSP 20 by triggering the sentry mode control button on the vehicle key. It can also receive sentry mode related information forwarded by TSP 20, i.e., the working status of sentry mode, alarm information, and alarm video, etc.

[0055] TSP 20 can be used to forward sentinel mode setting information to T-BOX 30 after receiving it from user terminal 10, and to forward received sentinel mode related information to user terminal 10.

[0056] The T-BOX 30 can be used to forward received Sentinel Mode setting information to the CEM 40, and to receive Sentinel Mode related information from the CEM 40.

[0057] CEM 40 can receive sentry mode setting information via a gateway (GW) and send wake-up signals to the intelligent driving controller 50, DVR controller 60, vehicle infotainment controller 70, and vehicle body management controller 80 based on the received sentry mode setting information. This causes the intelligent driving controller 50, DVR controller 60, vehicle infotainment controller 70, and vehicle body management controller 80 to enter a working state and execute the relevant functions of the vehicle's sentry mode. Additionally, the wake-up signal can be used to control the surround-view camera to be turned on.

[0058] The intelligent driving controller 50 can be activated upon receiving a wake-up signal from the CEM 40 and receive image data from the surround-view camera via the LVDS interface. It then sends the received image data directly to the vehicle controller 70 in a single surround-view format and provides feedback on sentry mode information to the CEM 40. The intelligent driving controller 50 includes a panoramic image processing module 51, which processes the received image data to obtain 360° panoramic image data of the vehicle's surroundings and itself, and then sends the obtained 360° panoramic image data to the DVR controller 60.

[0059] Optionally, image processing includes one or more of the following: stitching, cropping, distortion, compression, dehazing, and anti-reflection of image data.

[0060] The DVR controller 60 can be put into working state after receiving a wake-up signal sent by the CEM 40, so as to receive 360° panoramic image data sent by the intelligent driving controller 50, and store the 360° panoramic image data through its own memory card 61, thereby saving the 360° panoramic image data.

[0061] The vehicle controller 70 can be put into operation after receiving a wake-up signal from the CEM 40, so that the vehicle controller 70 can perform image desensitization and image algorithm detection on the received surround view single view, detect whether there are any abnormalities in the surround view single view, and send a warning message to the CEM 40 when an abnormality is detected in the surround view single view, so that the CEM 40 can send a warning message to the user terminal 10 based on the warning message, and feed back the abnormality of the vehicle to the user, or control the vehicle body management controller 80 to issue a warning message to pedestrians around the vehicle based on the warning message.

[0062] Optionally, the abnormal situation of the vehicle can be fed back to the user by sending a warning message to the user terminal 10, such as through SMS reminders or voice calls, so that the user can control the vehicle or call the alarm according to the abnormal situation, thereby improving the safety factor of the vehicle.

[0063] It should be noted that the vehicle controller 70 performs image desensitization and image algorithm detection on the image data. It can use any algorithm and processing method in the prior art to process the image data, such as depth recognition algorithm. This application embodiment does not limit this.

[0064] Optionally, image algorithm detection can include visual algorithms and vibration detection. Visual algorithms can analyze image data to determine if there are any anomalies; vibration detection can detect whether the vehicle is shaking, and if the vehicle is shaking, it indicates that there is an anomaly.

[0065] The vehicle body management controller 80 can be used to control the vehicle to issue warning information to pedestrians around the vehicle, such as controlling the vehicle to honk its horn, and / or controlling the vehicle lights to flash, and / or controlling the voice module in the vehicle to issue voice warning information (e.g., please stay away from the vehicle), and / or projecting warning information on the vehicle windows (e.g., the vehicle is under monitoring, please do not damage the vehicle), etc.

[0066] It should be understood that the user terminal 10 may be an electronic device such as a smartphone, tablet computer, or PDA, which has the function of sending a signal to the vehicle to activate the sentry mode.

[0067] refer to Figure 2 After receiving the signal to activate Sentry Mode, the CEM 40 activates multiple surround-view cameras on the vehicle to obtain panoramic image data. When the vehicle is in Sentry Mode, the multiple surround-view cameras on the vehicle need to be continuously activated to collect video data around the vehicle, which can easily generate significant power consumption.

[0068] To address the issue of high power consumption when the camera captures image data while the vehicle is in sentry mode, this application provides a vehicle monitoring method, a vehicle monitoring device, a vehicle, and a storage medium.

[0069] The following is combined Figures 3 to 5 The vehicle monitoring method provided in the embodiments of this application will be described in detail.

[0070] Figure 3 This is a schematic diagram of another vehicle executing sentry mode provided in an embodiment of this application.

[0071] For example, such as Figure 3 As shown, system 300 includes: a surround-view camera, user terminal 10, TSP 20, T-BOX 30 and CEM 40, intelligent driving controller 50, vehicle infotainment controller 70, vehicle body management controller 80 and parking communication facility 90. The connection method between the surround-view camera, user terminal 10, TSP 20, T-BOX 30, CEM 40, vehicle infotainment controller 70 and vehicle body management controller 80 is the same as in system 200, i.e., user terminal 10 is connected to TSP 20, TSP 20 is connected to T-BOX 30, T-BOX 30 is connected to CEM 40, and CEM 40 is connected to both vehicle infotainment controller 70 and vehicle body management controller 80. Furthermore, the functions performed by the surround-view camera, user terminal 10, TSP 20, T-BOX 30, CEM 40 and vehicle body management controller 80 in sentry mode are also the same as those performed in system 200.

[0072] For example, by comparing system 300 with system 200, it can be seen that system 300 reduces the DVR controller 60 and the memory card 61 in the DVR controller 60 compared to system 200, while adding the memory card 71 in the vehicle controller 70. After receiving the surround view single view sent by the intelligent driving controller 50 and processing the image data collected by the surround view camera through the panoramic image processing module 51 to obtain 360° panoramic image data of the vehicle's surroundings and itself, the vehicle controller 70 can process the surround view single view and / or 360° panoramic image data, and store the surround view single view and / or 360° panoramic image data through the memory card 71.

[0073] In addition, compared with system 200, system 300 adds parking lot communication facility 90, which can be used to send the current status of the image acquisition device in the parking lot, the acquisition area and the image data acquired by the image acquisition device to T-BOX 30 via V2X link.

[0074] It should be noted that the communication methods between the parking lot communication facility 90 and the T-BOX 30 may include, but are not limited to, one or more of V2X links, Bluetooth communication and wireless network communication.

[0075] Figure 4 This is a flowchart illustrating a vehicle monitoring method provided in an embodiment of this application. The method can be... Figure 1 The vehicle in question is to be executed by 110, or... Figure 3 The body controller 40 in the middle is executed.

[0076] For example, such as Figure 4 As shown, the method 400 includes the following implementation process:

[0077] S410: If an external acquisition device is detected in the parking area of ​​the vehicle, obtain the acquisition area of ​​the external acquisition device in the parking area and the current status of the external acquisition device.

[0078] Optionally, the external acquisition device may refer to one or more cameras installed in the parking area of ​​the vehicle. Furthermore, the acquisition area may refer to the area covered by the image data acquired by the external acquisition device.

[0079] Optionally, the current status of the external acquisition device can include a working state and a non-working state; wherein, the non-working state may include, but is not limited to, the current status of the external acquisition device being in a closed state or a fault state, that is, the external acquisition device cannot normally acquire and send image data; while the current status of the external acquisition device being in a working state indicates that the external acquisition device can normally acquire image data and send the acquired image data to the vehicle.

[0080] For example, if an external data acquisition device is detected in the vehicle's current parking area, the vehicle can receive the data acquisition area in the parking area and its current state (e.g., normal or abnormal state) sent by the external data acquisition device.

[0081] Optionally, prior to S410, it can also: receive parking location and driving route sent by external acquisition equipment; control the vehicle to drive to the parking location according to the driving route and park.

[0082] The parking location is determined by the external data acquisition device based on the data acquisition area and the vacant areas within the data acquisition area. For example, in data acquisition area 1, data acquisition area 2 and data acquisition area 3, all areas in data acquisition area 1 and data acquisition area 3 include vehicles that have completed parking; while data acquisition area 2 includes vacant parking spaces that have not been parked, so the vacant parking spaces can be determined as vacant areas, that is, the parking locations of vehicles.

[0083] Furthermore, the driving route is determined by the external acquisition device based on the navigation path between the vehicle's current location and the available area. That is, the control unit in the external acquisition device can provide the vehicle with a navigation path based on the vehicle's current location (e.g., location A) and the available parking spaces in acquisition area 2, so that the vehicle can use the navigation path as the driving route to the available area.

[0084] Optionally, when the collection area 2 includes multiple vacant parking spaces that are not occupied, multiple navigation paths can be obtained. Then, the control unit in the external collection device selects the navigation path that is closest to the vehicle from among these multiple navigation paths as the vehicle's driving route, so that the vehicle can complete parking as soon as possible.

[0085] For example, after a vehicle enters the parking lot, it can be accessed through methods such as... Figure 3 The V2X link shown indicates whether an external data acquisition device exists in the parking lot, i.e., whether the parking lot has the capability to collect image data. Upon detecting the presence of an external data acquisition device, the vehicle can be controlled to send an access request to that device. After receiving permission from the external data acquisition device, the vehicle establishes a connection with it via the V2X link to begin data communication.

[0086] Furthermore, after determining the vehicle's parking position based on the acquisition area of ​​the external acquisition device and the empty area within that acquisition area, and determining the vehicle's driving route based on the navigation path between the vehicle's current position and the empty area, the control unit in the external acquisition device can send the parking position and driving route to the vehicle. This allows the vehicle to drive to the parking position and park according to the driving route after receiving the parking position and driving route, so that after the vehicle completes parking, the entire or most of the vehicle's position is within the acquisition area of ​​the external acquisition device.

[0087] In this embodiment, the external acquisition device can send the determined parking location and driving route to the vehicle, enabling the vehicle to drive to the parking location and park accordingly. Since the parking location is within the acquisition area of ​​the external acquisition device, after the vehicle parks, its entire or most of its position can be within the acquisition area of ​​the external acquisition device. This allows the vehicle's camera to operate in sentry mode without needing to be turned on or only partially turned on, reducing the power consumption generated when the camera acquires image data.

[0088] S420 determines the target cameras in the vehicle that need to be turned on based on the data collection area and the current status.

[0089] Optionally, the target camera can represent a surround-view camera in the vehicle, such as... Figure 1 One or more of the first camera 111, the second camera 112, the third camera 113 and the fourth camera 114 shown in (b) of the diagram.

[0090] For example, based on the acquired data from the external acquisition device in the parking area (acquisition area 2) and the working or non-working status of the external acquisition device, the cameras in the vehicle that need to be turned on can be determined, such as... Figure 1 One or more of the first camera 111, the second camera 112, the third camera 113 and the fourth camera 114 shown in (b) of the diagram.

[0091] S430 performs anomaly monitoring on the vehicle based on the first image data and / or the second image data.

[0092] The first image data consists of images captured by an external acquisition device in the acquisition area, while the second image data consists of images of the vehicle captured by a target camera inside the vehicle. Furthermore, the coverage areas of the first and second image data differ; that is, the first and second image data do not share the same coverage area.

[0093] For example, anomaly monitoring of a vehicle can be performed based on image data collected by an external acquisition device in the acquisition area and / or image data collected by the vehicle's target camera, i.e., the vehicle can be put into sentry mode.

[0094] In one possible implementation, the determination of the target camera in the vehicle that needs to be turned on based on the acquisition area and the current state includes: if the current state of the external acquisition device is working, acquiring the first image data acquired by the external acquisition device in the acquisition area; if the first image data includes omnidirectional image data of the vehicle, determining that the target camera in the vehicle does not need to be turned on; the above-mentioned abnormal monitoring of the vehicle based on the first image data and / or the second image data includes: detecting whether there is an abnormal situation in the vehicle based on the first image data; if an abnormal situation is detected in the vehicle, outputting the first alarm information.

[0095] Optionally, the first alarm information includes, but is not limited to, the time and location of the detected abnormal situation in the vehicle, video related to the abnormal situation, horn sounding, and flashing lights, or one or more of these.

[0096] For example, if the current status of the external acquisition device is determined to be operational, meaning the external acquisition device can normally acquire image data and send the acquired image data to the vehicle, the system can receive the first image data acquired within the acquisition area sent by the external acquisition device. Furthermore, upon receiving this first image data, it can be compared with preset image data (i.e., omnidirectional image data of the vehicle, also known as "360° panoramic image data"). If the comparison shows that the first image data includes omnidirectional image data of the vehicle, it indicates that the external acquisition device can acquire omnidirectional image data of the vehicle. Therefore, it can be determined that the vehicle does not need to activate any camera to acquire image data. Figure 1 As shown in (b), the first camera 111, the second camera 112, the third camera 113 and the fourth camera 114 in the vehicle 110 are all in the off state, and the first image data collected by the external acquisition device can be used to execute the sentry mode on the vehicle.

[0097] Furthermore, based on the first image data collected by the external acquisition device, it can detect whether there are any abnormalities in the vehicle. When an abnormality is detected, it can send the time and location of the abnormality to the vehicle owner, as well as videos related to the abnormality. It can also control the vehicle to honk its horn and / or flash its lights to warn the person who caused the abnormality.

[0098] Optionally, since the first image data acquired by the external acquisition device can include omnidirectional image data of the vehicle, after acquiring the first image data, the external acquisition device can identify whether there are any anomalies in the first image data through its control unit. If an anomaly is identified, the vehicle causing the anomaly is determined based on the vehicle's identification information (e.g., license plate number) or the vehicle's parking area, and a first alarm message is sent to the vehicle causing the anomaly via a V2X link. This allows the vehicle to send the first alarm message to the owner, or, upon receiving the first alarm message, to warn the person responsible for the vehicle's anomaly. In other words, the image acquisition and analysis functions of the vehicle in sentry mode can be completed by the external acquisition device. The vehicle only needs to send a warning message to the owner, or control the vehicle to sound its horn and / or flash its lights to warn the person responsible for the vehicle's anomaly.

[0099] Optionally, when the external acquisition device detects an anomaly in the first image data, it identifies the vehicle with the anomaly based on the vehicle's identification information (e.g., license plate number) or the vehicle's parking area, and directly sends the first alarm information to the vehicle owner. In other words, all processes of the vehicle executing the sentry mode can be completed by the external acquisition device, thereby minimizing the power consumption generated by the vehicle executing the sentry mode.

[0100] In this embodiment, since the external acquisition device is in working condition, that is, the external acquisition device can normally acquire and send the first image data to the vehicle, and the first image data acquired by the external acquisition device includes the image data of the vehicle from all directions, it is not necessary for the vehicle to turn on any camera to acquire the second image data. That is, all cameras in the vehicle are turned off, thereby avoiding the power consumption of all cameras in the vehicle due to acquiring image data.

[0101] Furthermore, the system can detect whether there are any abnormalities in the vehicle using the first image data, and when an abnormality is detected, it can output a first alarm message so that the vehicle owner can be informed of the abnormality in the vehicle in a timely manner, and to warn pedestrians around the vehicle.

[0102] In one possible implementation, the determination of the target camera to be activated in the vehicle based on the acquisition area and the current state includes: if the external acquisition device is currently in a working state, acquiring first image data acquired by the external acquisition device within the acquisition area; if the first image data includes image data of a portion of the vehicle's orientation, determining the camera in the vehicle that captures the remaining orientation of the vehicle as the target camera; the above-mentioned abnormal monitoring of the vehicle based on the first image data and / or the second image data includes: detecting whether there is an abnormal situation in the vehicle based on the partial orientation image data and the second image data; if an abnormal situation is detected in the vehicle, outputting a second alarm message.

[0103] Optionally, the second alarm information includes, but is not limited to, the time and location of the detected abnormal situation of the vehicle, video related to the abnormal situation, horn sounding, and flashing lights, or one or more of these; and the second alarm information may be the same as or different from the first alarm information; wherein, the second alarm information is obtained by detecting abnormalities in the first image data and the second image data and when an abnormal situation exists, while the first alarm information is obtained by detecting abnormalities in the first image data and when an abnormal situation exists.

[0104] For example, if the current state of the external acquisition device is detected as working, meaning the external acquisition device can normally acquire image data and send the acquired image data to the vehicle, the system can receive the first image data acquired within the acquisition area sent by the external acquisition device. Furthermore, upon receiving the first image data, it can be compared with preset image data. If the comparison reveals that the first image data includes image data from a portion of the vehicle's orientation (i.e., the first image data does not include image data from the remaining orientation of the vehicle), the camera in the vehicle that needs to acquire the image data from the remaining orientation is identified as the target camera (which can be called the "remaining orientation camera"). The remaining orientation camera is then controlled to be turned on, while the camera in the vehicle that acquires image data from a portion of the orientation is controlled to be turned off. This reduces the power consumption generated when the camera acquires image data while obtaining a comprehensive image of the vehicle using the partial orientation image data and the second image data.

[0105] like Figure 1As shown in (b), the first image data acquired by the external acquisition device includes image data acquired by the first camera 111 and the second camera 112, but does not include image data acquired by the third camera 113 and the fourth camera 114. In order to obtain omnidirectional image data of the vehicle while reducing the power consumption generated when the cameras acquire image data, the first camera 111 and the second camera 112 can be controlled to be in a closed state, and the third camera 113 and the fourth camera 114 can be controlled to be in a closed state. In other words, the first image data acquired by the external acquisition device can be used to replace the image data acquired by the first camera 111 and the second camera 112.

[0106] Furthermore, based on partial image data from the first image data collected by external acquisition devices and second image data collected by cameras in the remaining areas of the vehicle, it is possible to detect whether there are any abnormalities in the vehicle. When an abnormality is detected, the time and location of the abnormality can be sent to the vehicle owner, along with videos related to the abnormality. The vehicle can also be controlled to sound its horn and / or flash its lights to warn the person responsible for the abnormality.

[0107] In this embodiment, since the external acquisition device is in working condition, that is, the external acquisition device can normally acquire and send the first image data to the vehicle, and the first image data acquired by the external acquisition device includes image data of part of the vehicle's orientation, but does not include image data of the vehicle's full orientation, it is indicated that the vehicle needs to turn on the cameras in the remaining orientation to acquire image data in the remaining orientation, that is, the cameras in the vehicle are partially turned on and partially turned off, thereby avoiding the power consumption of the partially turned-off cameras due to acquiring image data.

[0108] Furthermore, the system can detect whether there are any abnormalities in the vehicle by using the first and second image data, and when an abnormality is detected, it can output a second alarm message so that the vehicle owner can be informed of the abnormality in the vehicle in a timely manner, and to warn pedestrians around the vehicle.

[0109] Optionally, the above-mentioned detection of whether there is an abnormality in the vehicle based on partial-position image data and second image data includes: combining the partial-position image data and second image data to obtain omnidirectional image data of the vehicle; and identifying whether there is an abnormality in the vehicle based on the omnidirectional image data of the vehicle.

[0110] For example, partial image data from the first image data acquired by an external acquisition device and second image data acquired by cameras in the remaining positions of the vehicle can be combined to obtain omnidirectional image data of the vehicle; and intelligent recognition can be performed on the omnidirectional image data of the vehicle to detect whether there are any abnormalities in the vehicle.

[0111] It should be noted that the methods for combining partial image data and second image data include, but are not limited to, one or more of the following: stitching, cropping, distortion, compression, defogging, and anti-reflection.

[0112] In this embodiment of the application, since the image data of a partial position in the first image data and the second image data can be combined to obtain the all-round image data of the vehicle, when detecting whether there is an abnormality in the vehicle, the omission caused by the independence between the image data of a partial position and the second image data can be avoided, thereby improving the accuracy of detecting whether there is an abnormality in the vehicle.

[0113] In one possible implementation, the above-mentioned determination of the target camera that needs to be turned on in the vehicle based on the acquisition area and the current state includes: if the current state is a non-working state, determining the target camera as a 360-degree camera of the vehicle; the above-mentioned abnormal monitoring of the vehicle based on the first image data and / or the second image data includes: detecting whether there is an abnormal situation in the vehicle based on the second image data; if an abnormal situation is detected in the vehicle, outputting a third alarm message.

[0114] Optionally, the third alarm information includes, but is not limited to, the time and location of the detection of an abnormal situation in the vehicle, video related to the abnormal situation, horn sounding, and flashing lights. That is, the third alarm information may be the same as or different from the first alarm information. The third alarm information is obtained by performing anomaly detection on the second image data and when an abnormal situation exists.

[0115] For example, if the current status of the external acquisition device is found to be non-working, meaning the external acquisition device cannot normally acquire and send image data, then the image data for monitoring the vehicle can only be acquired through the cameras installed on the vehicle itself. Therefore, it is determined that all the vehicle's cameras in all directions need to be activated to acquire omnidirectional image data of the vehicle. Figure 1 As shown in (b), the first camera 111, the second camera 112, the third camera 113 and the fourth camera 114 in the vehicle 110 are all in the open state.

[0116] Furthermore, the system can collect second image data using cameras installed on the vehicle itself to detect any abnormalities. When an abnormality is detected, the system can send the owner the time and location of the abnormality, as well as related videos. It can also control the vehicle to sound its horn and / or flash its lights to warn those responsible for the abnormality.

[0117] In this embodiment, since the external acquisition device is in a non-working state, that is, the external acquisition device cannot acquire and send the first image data to the vehicle, all the cameras configured in the vehicle need to be turned on to acquire image data (i.e., the second image data), and the sentry mode is executed through the second image data, thereby ensuring the normal execution of the sentry mode.

[0118] Furthermore, the second image data can be used to detect whether there are any abnormalities in the vehicle, and when an abnormality is detected, a third alarm message can be output so that the vehicle owner can be informed of the abnormality in a timely manner, and pedestrians around the vehicle can be alerted.

[0119] The above content describes three methods for determining the target camera that needs to be activated in a vehicle based on the acquisition area of ​​the external acquisition device in the parking area and the current status of the external acquisition device, as well as the corresponding alarm information for abnormal vehicle situations for each of the three methods. This can be further explained in Table 1:

[0120] Table 1

[0121]

[0122] As shown in Table 1, when the external acquisition device is in a normal state and the first image data acquired by the external acquisition device includes omnidirectional image data of the vehicle, it can be confirmed that the target camera in the vehicle does not need to be turned on, and when an abnormal situation is detected in the vehicle based on the first image data, the first alarm information is output.

[0123] Furthermore, when the external acquisition device is in a normal state and the first image data acquired by the external acquisition device includes image data of part of the vehicle's orientation, it can be determined that the target camera to be turned on is the camera in the vehicle that acquires image data of the remaining orientation (i.e., the second image data). When an abnormal situation is detected in the vehicle based on the image data of part of the orientation and the second image data, a second alarm message is output.

[0124] Furthermore, when the external acquisition device is in an abnormal state, the target camera that needs to be turned on in the vehicle can be determined to be the vehicle's all-around camera to obtain second image data. Based on the second image data, when an abnormal situation is detected in the vehicle, a third alarm message is output.

[0125] exist Figure 4In method 400, the target cameras that need to be turned on in the vehicle can be determined based on the acquisition area of ​​the external acquisition device in the parking area of ​​the vehicle and the current state of the external acquisition device; that is, the cameras that need to be turned on in the vehicle are determined by analyzing the acquisition area and current state of the external acquisition device. Thus, the cameras in the vehicle may not need to be turned on, or may only be partially turned on. Furthermore, when using the first image data acquired by the external acquisition device to monitor the vehicle for anomalies, image data captured by the target cameras in the vehicle is not needed for anomaly monitoring. Therefore, it can be concluded that the cameras in the vehicle do not need to be turned on, i.e., all the cameras in the vehicle are turned off, thus avoiding power consumption from all the cameras in the vehicle due to image data acquisition. Alternatively, when using the first image data acquired by the external acquisition device and the second image data acquired by the target cameras in the vehicle to jointly monitor the vehicle for anomalies, it can be concluded that the cameras in the vehicle whose image data is the same as the first image data are in a turned-off state, while the cameras in the vehicle whose image data is different from the first image data are in a turned-on state. That is, the cameras in the vehicle are partially turned on and partially turned off, thus avoiding power consumption from the turned-off cameras due to image data acquisition. Therefore, when the vehicle is in sentry mode, the power consumption generated by the cameras when acquiring image data can be reduced.

[0126] Furthermore, when using the second image data collected by the target camera in the vehicle to monitor the vehicle for anomalies, all cameras in the vehicle need to be turned on to collect image data for monitoring the vehicle for anomalies, thereby ensuring the normal execution of Sentry Mode.

[0127] Optionally, the above-mentioned vehicle monitoring method may further include: acquiring the image storage status in an external acquisition device; if the image storage status is a first status, storing second image data; if the image storage status is a second status, storing both the first image data and the second image data; wherein the first status and the second status are different.

[0128] The first state can indicate that the image storage is in a working state, meaning that the external acquisition device can normally store the image data it has acquired; the second state can indicate that the image storage is in a non-working state, meaning that the image storage function of the external acquisition device is faulty or turned off, and it cannot store the image data it has acquired.

[0129] For example, if the image storage status of the external acquisition device is obtained as working, meaning the external acquisition device can normally store the image data it has acquired, the storage unit in the vehicle (such as...) Figure 3The memory card in the vehicle controller shown only needs to store image data captured by the camera in the vehicle. It does not need to store image data captured by external acquisition devices. Image data captured by external acquisition devices can be stored in its own storage unit. This makes it convenient for the car owner to obtain a comprehensive image of the vehicle by combining the image data stored in the vehicle's storage unit and the image data stored in the storage unit of the external acquisition device when they need to view the comprehensive image data of the vehicle.

[0130] For example, if the image storage status of the acquired external acquisition device is in a non-working state, that is, the external acquisition device cannot store the image data it has acquired, in order to facilitate the car owner to view the comprehensive image data of the vehicle later, the storage unit in the vehicle needs to store not only the image data acquired by the camera in the vehicle, but also the image data acquired by the external acquisition device, so as to ensure the integrity of the comprehensive image data of the vehicle.

[0131] In this embodiment, when the image storage state in the external acquisition device is in the first state, that is, when the storage function is normal, the vehicle can store the second image data instead of the first image data acquired by the external acquisition device. This ensures that the vehicle owner can obtain comprehensive image data of the vehicle later while saving the vehicle's data storage space.

[0132] Alternatively, since the image storage state in the external acquisition device is in the second state, i.e. when the storage function is abnormal, in order to ensure that the vehicle owner can obtain the vehicle's comprehensive image data later, the vehicle can store the first image data and the second image data simultaneously, thereby ensuring the integrity of the vehicle's comprehensive image data.

[0133] Figure 5 This is a flowchart illustrating another vehicle monitoring method provided in this application embodiment.

[0134] For example, such as Figure 5 As shown, the method 500 includes the following implementation process:

[0135] S501 receives parking location and driving route sent by external data acquisition equipment.

[0136] For example, after a vehicle establishes a connection with the external data acquisition device via a V2X link, it can receive the parking location and driving route sent by the external data acquisition device.

[0137] S502 controls the vehicle to travel along the driving route to the parking position and stop.

[0138] For example, after receiving the parking location and driving route sent by an external data acquisition device, the vehicle's cruise parking function can be automatically triggered to control the vehicle to drive to the parking location according to the driving route and park.

[0139] Alternatively, the system can display the parking location and driving route sent by the external data acquisition device to the user, allowing the user to drive the vehicle to the parking location according to the driving route.

[0140] S503, if an external acquisition device is detected in the parking area of ​​the vehicle, obtain the acquisition area of ​​the external acquisition device in the parking area and the current status of the external acquisition device.

[0141] For example, if an external data acquisition device is detected in the vehicle's current parking area, the vehicle can receive the data acquisition area and its current status sent by the external data acquisition device.

[0142] Optionally, it can periodically receive the current status of itself from external acquisition devices to facilitate real-time monitoring of the current status of external acquisition devices.

[0143] S504, determine whether the current status of the external data acquisition device is working. If yes, proceed to S505; otherwise, proceed to S512.

[0144] For example, based on the received current status of the external acquisition device, it can be determined whether the current status of the external acquisition device is working. If it is determined that the current status of the external acquisition device is working, S505 can be executed.

[0145] S505: Acquire the first image data collected by the external acquisition device within the acquisition area.

[0146] For example, if it is determined that the current state of the external acquisition device is working, that is, the external acquisition device can normally acquire image data and send the acquired image data to the vehicle, and can receive the first image data acquired by itself in the acquisition area sent by the external acquisition device.

[0147] S506, if the first image data includes omnidirectional image data of the vehicle, determine that the target camera in the vehicle does not need to be turned on.

[0148] For example, the first image data in S505 can be compared with the preset image data. If the comparison shows that the first image data includes image data of the vehicle from all directions, it means that the external acquisition device can acquire image data of the vehicle from all directions. Then it can be determined that the vehicle does not need to turn on any camera to acquire image data of the vehicle, and the sentry mode can be executed according to the image data of the vehicle from all directions acquired by the external acquisition device.

[0149] S507, based on the first image data, detect whether there is any abnormality in the vehicle. If yes, proceed to S508; otherwise, proceed to S505.

[0150] For example, based on the first image data collected by the external acquisition device, it is possible to detect whether there is an abnormality in the vehicle, and when an abnormality is detected, S508 is executed.

[0151] S508 outputs the first alarm message.

[0152] For example, when an abnormal situation is detected in the vehicle, a first alarm message can be output.

[0153] For example, if no abnormality is detected in the vehicle, S505 can be executed again to acquire the first image data collected by the external acquisition device in the acquisition area.

[0154] S509, if the first image data includes image data of part of the vehicle's orientation, determine the camera in the vehicle that captures the remaining orientation of the vehicle as the target camera.

[0155] For example, the first image data in S505 can be compared with the preset image data. If the comparison shows that the first image data includes image data of part of the vehicle's orientation, that is, the first image data does not include image data of the remaining orientation of the vehicle, the camera in the vehicle that needs to be activated to collect image data of the remaining orientation is determined to be the target camera, that is, the camera of the remaining orientation.

[0156] S510: Based on the first image data and the second image data, detect whether there is any abnormality in the vehicle. If yes, proceed to S511; otherwise, proceed to S505.

[0157] For example, based on the partial image data from the first image data collected by the external acquisition device and the second image data collected by the camera in the remaining position in the vehicle, it is possible to detect whether there is an abnormal situation in the vehicle, and when an abnormal situation is detected, S511 is executed.

[0158] S511 outputs the second alarm message.

[0159] For example, when an abnormal situation is detected in the vehicle, a second alarm message is output.

[0160] For example, if no abnormality is detected in the vehicle, S505 can be executed again to acquire the first image data collected by the external acquisition device in the acquisition area.

[0161] It should be noted that S506, S507 and S508, and S509, S510 and S511 can be executed simultaneously or sequentially, and this application embodiment does not limit this.

[0162] S512, identifies the target camera as a 360-degree camera on the vehicle.

[0163] For example, in S504, if it is determined that the current state of the external acquisition device is non-working, that is, the external acquisition device cannot normally acquire and send image data, and the image data for monitoring the vehicle can only be acquired by the camera installed on the vehicle itself, then it is determined that all the cameras in the vehicle's omnidirectional range are cameras that need to be turned on.

[0164] It should be noted that S505 and S512 can be executed simultaneously or sequentially, and this application embodiment does not limit this.

[0165] The S513 acquires second image data through a 360-degree camera.

[0166] For example, after determining that all the cameras in the vehicle's omnidirectional range are cameras that need to be turned on, omnidirectional image data, i.e., second image data, can be collected using the vehicle's omnidirectional cameras.

[0167] S514, based on the second image data, detect whether there is any abnormality in the vehicle. If yes, proceed to S515; otherwise, proceed to S513.

[0168] For example, second image data can be collected from the camera installed on the vehicle itself to detect whether there is an abnormal situation in the vehicle, and when an abnormal situation is detected, S515 is executed.

[0169] S515 outputs the third alarm message.

[0170] For example, when an abnormal situation is detected in the vehicle, a third alarm message is output.

[0171] For example, if no abnormality is detected in the vehicle, S513 can continue to be executed to collect second image data again through the all-around camera.

[0172] It should be noted that, Figure 5 All steps are in Figure 4 The corresponding embodiments are described in detail, and will not be repeated here.

[0173] It should be understood that the above examples are provided to help those skilled in the art understand the embodiments of this application, and are not intended to limit the embodiments of this application to the specific values ​​or scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of this application.

[0174] The above text combined Figures 1 to 5 The vehicle monitoring method provided in the embodiments of this application has been described in detail; the following will be combined with Figure 6 and Figure 7 The apparatus embodiments of this application are described in detail below. It should be understood that the apparatus in the embodiments of this application can perform the various methods described in the foregoing embodiments of this application, that is, the specific working processes of the various products described below can be referred to the corresponding processes in the foregoing method embodiments.

[0175] Figure 6 This is a schematic diagram of the vehicle monitoring device provided in the embodiments of this application.

[0176] For example, such as Figure 6 As shown, the device 600 includes:

[0177] Acquisition module 610: If an external acquisition device is detected in the parking area of ​​a vehicle, it is used to acquire the acquisition area of ​​the external acquisition device in the parking area and the current status of the external acquisition device.

[0178] Module 620: Used to determine the target camera in the vehicle that needs to be turned on based on the acquisition area and the current state;

[0179] Monitoring module 630: used to monitor vehicles for anomalies based on first image data and / or second image data; wherein, the first image data is the image data corresponding to the acquisition area, and the second image data is the image data of the vehicle acquired by the target camera.

[0180] In one possible implementation, the determining module 620 is specifically used to: if the current state is a working state, acquire the first image data collected by the external acquisition device in the acquisition area; if the first image data includes omnidirectional image data of the vehicle, determine that the target camera in the vehicle does not need to be turned on; the monitoring module 630 is specifically used to: detect whether there is an abnormal situation in the vehicle based on the first image data; if an abnormal situation is detected in the vehicle, output the first alarm information.

[0181] In one possible implementation, the determining module 620 is specifically used to: if the current state is working, acquire the first image data acquired by the external acquisition device in the acquisition area; if the first image data includes image data of part of the vehicle's orientation, determine the camera in the vehicle that acquires the remaining orientation of the vehicle as the target camera; the monitoring module 630 is specifically used to: detect whether there is an abnormal situation in the vehicle based on the image data of part of the orientation and the second image data; if an abnormal situation in the vehicle is detected, output a second alarm message.

[0182] In one possible implementation, the monitoring module 630 is specifically used to: combine partial image data and second image data to obtain all-around image data of the vehicle; and identify the all-around image data of the vehicle to determine whether there is any abnormality in the vehicle.

[0183] In one possible implementation, the determining module 620 is specifically used to: determine the target camera as a 360-degree camera of the vehicle if the current state is a non-working state; the monitoring module 630 is specifically used to: detect whether there is an abnormal situation in the vehicle based on the second image data; if an abnormal situation is detected in the vehicle, output a third alarm message.

[0184] Optionally, the device 600 further includes a storage module for acquiring the image storage status in an external acquisition device; if the image storage status is a first status, storing the second image data; if the image storage status is a second status, storing the first image data and the second image data; wherein the first status and the second status are different.

[0185] Optionally, the device 600 further includes a control module for receiving parking location and driving route sent by an external acquisition device; controlling the vehicle to drive to the parking location and park according to the driving route; wherein the parking location is determined by the external acquisition device based on the acquisition area and the empty area within the acquisition area; the driving route is determined by the external acquisition device based on the navigation path between the vehicle's current location and the empty area.

[0186] It should be noted that the aforementioned device 600 is embodied in the form of a functional module. The term "module" here can be implemented in software and / or hardware, without specific limitations.

[0187] For example, a "module" can be a software program, hardware circuit, or a combination of both that implements the above functions. Hardware circuits may include application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors) and memory for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components that support the described functions.

[0188] Therefore, the modules of the various examples described in the embodiments of this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0189] Figure 7 This is a schematic diagram of the vehicle structure provided in the embodiments of this application.

[0190] For example, such as Figure 7 As shown, the vehicle 700 includes a memory 710 and a processor 720. The memory 710 stores executable program code 7101, and the processor 720 is used to call and execute the executable program code 7101 to perform a vehicle monitoring method. The vehicle 700 may include, but is not limited to, [other types of vehicles]. Figure 1 Vehicle 110 is shown in (a) of the diagram.

[0191] This application can divide the vehicle into functional modules based on the above method example. For example, each module can correspond to a separate function module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0192] When each functional module is divided according to its corresponding function, the vehicle may include: an acquisition module, a determination module, and a monitoring module, etc. It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here.

[0193] The vehicle provided in this application is used to execute the vehicle monitoring method described above, and thus can achieve the same effect as the above implementation method.

[0194] When using integrated units, the vehicle may include a processing module and a storage module. The processing module is used to control and manage the vehicle's actions. The storage module supports the vehicle in executing program code and data.

[0195] The processing module may be a processor or a controller, which can implement or execute various exemplary logic blocks, modules, and circuits as disclosed in this application. The processor may also be a combination of functions that implement computing capabilities, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc., and the storage module may be a memory.

[0196] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the methods described in the foregoing embodiments. The computer-readable storage medium may include, but is not limited to, any type of disk, including floppy disks, optical disks, DVDs (Digital Video Discs), CD-ROMs (Compact Disc Read-Only Memory), microdrives, magneto-optical disks, ROMs (Read-Only Memory), RAMs (Random Access Memory), EPROMs (Erasable Programmable Read-Only Memory), EEPROMs (Electrically Erasable Programmable Read Only Memory), DRAMs (Dynamic Random Access Memory), VRAMs (Video Random Access Memory), flash memory devices, magnetic cards or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.

[0197] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement a vehicle monitoring method as described in the above embodiments.

[0198] In addition, the vehicle provided in the embodiments of this application may specifically be a chip, component or module. The vehicle may include a connected processor and a memory. The memory is used to store instructions. When the vehicle is running, the processor may call and execute the instructions to make the chip execute a vehicle monitoring method in the above embodiments.

[0199] The vehicle, computer-readable storage medium, computer program product or chip provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0200] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0201] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0202] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A monitoring method of a vehicle, characterized by, The method includes: If an external data acquisition device is detected in the parking area of ​​the vehicle, the data acquisition area of ​​the external data acquisition device in the parking area and the current status of the external data acquisition device are obtained; Based on the acquisition area and the current state, determine the target camera in the vehicle that needs to be turned on; Based on the first image data and / or the second image data, the vehicle is monitored for anomalies; wherein the first image data is the image data corresponding to the acquisition area, and the second image data is the image data of the vehicle acquired by the target camera.

2. The method of claim 1, wherein, The step of determining the target camera in the vehicle that needs to be activated based on the acquisition area and the current state includes: If the current state is a working state, acquire the first image data acquired by the external acquisition device within the acquisition area; If the first image data includes omnidirectional image data of the vehicle, it is determined that the target camera does not need to be turned on in the vehicle; The anomaly monitoring of the vehicle based on the first image data and / or the second image data includes: Based on the first image data, detect whether there is any abnormality in the vehicle; If the abnormal situation is detected in the vehicle, the first alarm message is output.

3. The method of claim 1, wherein, The step of determining the target camera in the vehicle that needs to be activated based on the acquisition area and the current state includes: If the current state is a working state, acquire the first image data acquired by the external acquisition device within the acquisition area; If the first image data includes image data of part of the vehicle's orientation, then the camera in the vehicle that captures the remaining orientation of the vehicle is identified as the target camera. The anomaly monitoring of the vehicle based on the first image data and / or the second image data includes: Based on the image data from the partial orientation and the second image data, detect whether there is any abnormality in the vehicle; If the abnormal situation is detected in the vehicle, a second alarm message is output.

4. The method of claim 3, wherein, The method of detecting whether the vehicle has any abnormalities based on the partial orientation image data and the second image data includes: The image data of the partial orientation and the second image data are combined to obtain the all-around image data of the vehicle; The vehicle's omnidirectional image data is analyzed to determine whether the vehicle exhibits the aforementioned anomaly.

5. The method of claim 1, wherein, The step of determining the target camera in the vehicle that needs to be activated based on the acquisition area and the current state includes: If the current state is a non-working state, the target camera is determined to be an all-around camera of the vehicle; The anomaly monitoring of the vehicle based on the first image data and / or the second image data includes: Based on the second image data, detect whether there is any abnormality in the vehicle; If the abnormal situation is detected in the vehicle, a third alarm message is output.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Obtain the image storage status in the external acquisition device; If the image storage state is the first state, then the second image data is stored; If the image storage state is the second state, the first image data and the second image data are stored; wherein the first state is different from the second state.

7. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Receive parking location and driving route sent by the external acquisition device; Control the vehicle to travel along the driving route to the parking location and park it; The parking location is determined by the external data acquisition device based on the data acquisition area and the available space within the data acquisition area; The driving route is determined by the external data acquisition device based on the navigation path between the vehicle's current location and the available area.

8. A monitoring device for a vehicle, characterized by The device includes: The acquisition module is used to acquire the acquisition area of ​​the external acquisition device in the parking area and the current status of the external acquisition device if an external acquisition device is detected in the parking area of ​​the vehicle. The determination module is used to determine the target camera that needs to be turned on in the vehicle based on the acquisition area and the current state; The monitoring module is used to monitor the vehicle for anomalies based on first image data and / or second image data; wherein the first image data is image data corresponding to the acquisition area, and the second image data is image data of the vehicle acquired by the target camera.

9. A vehicle characterized by comprising: The vehicles include: Memory, used to store executable program code; A processor for calling and running the executable program code from the memory, causing the vehicle to perform the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed, implements the method as described in any one of claims 1 to 7.

Images