Vehicle monitoring methods, systems and storage media

Abstract

The application discloses a vehicle monitoring method, system and storage medium, the method comprises the following steps: after the sentry mode is activated, VDC listens to the data information of HAD image identification and radar induction; when it is monitored that there is illegal personnel within the set distance of the vehicle, and the illegal personnel stays close to the vehicle body for more than a set time length, the VDC triggers a first-level alarm of the sentry mode; when it is monitored that the illegal personnel scratches, smashes, drags the vehicle, or the vehicle door is illegally opened, the VDC triggers a second-level alarm of the sentry mode; the VDC actively pulls the HAD video data stream through the CSC, records and intercepts the stream data of each camera, forms a video file, and uploads the video file to the video cloud. The vehicle monitoring method, system and storage medium provided by the application perfect the vehicle safety guarantee mechanism, so that the user can accurately control the vehicle.

Description

Technical Field

[0001] This application relates to the field of vehicle monitoring technology, and in particular to vehicle monitoring methods, vehicle monitoring systems and storage media. Background Technology

[0002] When a traditional vehicle is locked and parked in the parking gear, there are many uncertain safety factors, such as potential damage or theft of the vehicle in the surrounding area. The owner cannot receive an alarm response immediately, and the vehicle lacks a security mechanism.

[0003] With the rapid development of smart cockpits, the upgrade of infotainment systems such as cockpit domain controllers, central control displays, instrument panels, and AR-HUDs requires a complete, simple, and stable solution. Currently, the upgrade of each controller within the infotainment system is completed separately and can only be done offline, which brings great difficulties to after-sales upgrades and can no longer meet people's needs. Summary of the Invention

[0004] The purpose of this invention is to provide a vehicle monitoring method, system, and storage medium, which improves the vehicle security mechanism and allows users to precisely control the vehicle.

[0005] This invention provides the following solution:

[0006] According to one aspect of the present invention, a vehicle monitoring method is provided, applied to a vehicle monitoring system, the vehicle monitoring system comprising: a Vehicle Domain Controller (VDC), a Highly Automated Driving Domain Controller (HAD), an Intelligence Communicating Console (ICC) / Telematics Service Provider (TSP), and a Cockpit Space Center (CSC), the vehicle monitoring method comprising:

[0007] VDC monitors the image recognition information and radar sensing data information of HAD;

[0008] Based on the image recognition of the HAD, the VDC identifies people within the camera's field of view as unauthorized persons and identifies the state of contact between unauthorized persons and vehicles.

[0009] Based on the radar-sensed data, VDC sets the warning range according to the preset warning distance;

[0010] When the sentry mode is active, if the VDC detects an unauthorized person within the warning range and the person remains there for a period of time exceeding a preset time threshold, the VDC will trigger a level one alarm in the sentry mode.

[0011] The first-level alarm includes: flashing headlights and horn warning;

[0012] If the sentry mode is active, when the VDC detects that an unauthorized person is in contact with the vehicle, the VDC will trigger a level 2 alarm in the sentry mode.

[0013] The secondary alarm includes: VDC pulls HAD video data stream through CSC, records and captures data from each camera stream to form evidence video file of illegal infringement, and uploads the evidence video file to the video cloud.

[0014] Optionally, the VDC triggers a Level 1 alarm in Sentinel mode, including:

[0015] TSP retrieves pre-stored contact list databases;

[0016] The process of retrieving the pre-stored contact database includes locking the connection port of the user's mobile APP in the contact list according to the preset permission level, and pushing alarm control data to the mobile APP.

[0017] Based on the alarm control data, control the mobile phone screen to flash continuously at 4Hz for 20 seconds;

[0018] Once the mobile phone control screen finishes flashing at 4Hz for 20 seconds, the mobile phone will send a confirmation message indicating a Level 1 alarm status.

[0019] The TSP refreshes the alarm control data based on the confirmation information received regarding the Level 1 alarm status and the fact that the Level 1 alarm has not been cleared.

[0020] The refresh of the alarm control data includes controlling the phone screen to extend the continuous flashing time and changing the flashing frequency.

[0021] Optionally, the VDC triggering of the first-level alarm in sentry mode also includes:

[0022] If the VDC cannot detect any unauthorized personnel within the warning range and the VDC does not trigger the secondary alarm in sentry mode, then the VDC will deactivate the primary alarm in the current sentry mode.

[0023] Based on the VDC deactivating the Level 1 alarm status of the current sentry mode, a command is sent to the port linked to the user's mobile APP in the locked address book to stop pushing alarm control data to the mobile APP.

[0024] Optionally, in Sentinel Mode Level 2 Alarm mode, Level 2 alarm events are pushed to the driver via mobile APP and SMS reminders, and the hazard warning lights are activated for 60 seconds with a flashing frequency of 4Hz.

[0025] Optionally, VDC retrieves HAD video data streams through CSC, records and captures data from various camera streams to form evidence video files of illegal infringement, and uploads these evidence video files to the video cloud, including:

[0026] VDC will first notify CSC, and then CSC's Stream Monitor will actively pull HAD video stream data;

[0027] The Stream Processor completes the recording and extraction of data from various camera streams, forms video files, and generates corresponding integrity verification files.

[0028] The Stream Processor and Video Service use the FTP protocol to transfer files. The Stream Processor acts as an FTP client and connects to the FTP server of the Video Service in CSC. After the file transfer is complete, the Video Service will copy the file to UFS.

[0029] The Video Service checks if a USB drive is inserted or if the network connection is working. If a USB drive is inserted, the data is copied to the USB drive. If the network is connected, the data is uploaded to the video cloud. Once the upload to the USB drive or cloud is successful, the file in the UFS file system can be deleted.

[0030] Optional, also includes:

[0031] Information about the exception area is obtained from the navigation and stored in memory.

[0032] Optionally, vehicles in the exception area will not activate Sentry Mode.

[0033] According to two aspects of the present invention, a vehicle monitoring device is provided, the vehicle monitoring system comprising: a vehicle control domain controller (VDC), a highly automated driving domain controller (HAD), an intelligent communication terminal (ICC) / content service provider (TSP), and a cockpit domain controller (CSC);

[0034] The VDC is used to monitor the image recognition information of HAD and the data information sensed by radar.

[0035] The VDC is used to identify, based on the image recognition of the HAD, individuals within the camera's field of view as unauthorized persons and to identify situations where unauthorized persons are in contact with vehicles.

[0036] The VDC is used to set the warning range according to the radar-sensed data and a preset warning distance.

[0037] The VDC is used to trigger a level one alarm in sentry mode when it detects an unauthorized person within the detection range and the person stays there for a continuous period of time exceeding a preset time threshold, based on whether the sentry mode is active.

[0038] The first-level alarm includes: flashing headlights and horn warning;

[0039] The VDC is used to trigger a secondary alarm in the sentry mode when it detects that an unauthorized person is in contact with a vehicle, based on whether the sentry mode is active.

[0040] The secondary alarm includes: VDC pulls HAD video data stream through CSC, records and captures data from each camera stream to form evidence video file of illegal infringement, and uploads the evidence video file to the video cloud.

[0041] According to three aspects of the present invention, a vehicle is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0042] The memory stores a computer program that, when executed by the processor, causes the processor to perform the steps of the vehicle monitoring method.

[0043] According to four aspects of the present invention, a computer-readable storage medium is provided, comprising: storing a computer program executable by a vehicle, which, when run on the vehicle, causes the vehicle to perform the steps of the vehicle monitoring method.

[0044] The above solution achieves the following beneficial technical effects:

[0045] This invention implements a DVR-based sentry mode system that, when the vehicle is parked, possesses the ability to monitor the surrounding environment, record video, and trigger an alarm. Furthermore, users can receive alarm notifications and view vehicle monitoring video via their mobile phones.

[0046] This invention improves the vehicle safety mechanism, allowing users to precisely control the vehicle. Attached Figure Description

[0047] Figure 1 This is an overall architecture diagram of a vehicle monitoring system provided in one or more embodiments of the present invention.

[0048] Figure 2 This is a flowchart of a vehicle monitoring method provided in one or more embodiments of the present invention.

[0049] Figure 3 This is a flowchart of the first-level alarm triggering process in the vehicle monitoring method provided by one or more embodiments of the present invention.

[0050] Figure 4 This is a flowchart of the first-level alarm triggering process in the vehicle monitoring method provided by one or more embodiments of the present invention.

[0051] Figure 5 This is a flowchart of the secondary alarm triggering process in the vehicle monitoring method provided by one or more embodiments of the present invention.

[0052] Figure 6 This is a flowchart of the secondary alarm triggering process in the vehicle monitoring method provided by one or more embodiments of the present invention.

[0053] Figure 7 This is a flowchart of the sentry mode jurisdiction setting in the vehicle monitoring method provided by one or more embodiments of the present invention;

[0054] Figure 8 This is a flowchart of the video file upload operation in the vehicle monitoring method provided by one or more embodiments of the present invention.

[0055] Figure 9 This is a detailed architecture diagram of a vehicle monitoring system provided in one or more embodiments of the present invention. Detailed Implementation

[0056] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0057] Figure 1 This is an overall architecture diagram of the vehicle monitoring system used in one or more embodiments of the present invention. See also: Figure 1 The vehicle monitoring system includes: VDC, HAD, ICC / TSP, and CSC.

[0058] The Sentinel Mode system mainly involves the collaborative work of four parts: HAD, CSC, VDC, and ICC / TSP. CSC acquires video stream data and performs video display and storage functions. VDC, the main control module of Sentinel Mode, receives alarm signals, sends notifications, and ultimately communicates with the mobile phone via ICC / TSP.

[0059] See Figure 1 The four components, HAD, CSC, VDC, and ICC / TSP, are interconnected via Ethernet.

[0060] HAD incorporates an RTP / RTSP protocol stack, video encoding, overlay, and image stabilization and dehazing functions on top of the HAD hardware module.

[0061] In CSC, in addition to the hardware abstraction layer and Linux kernel, the system hardware also includes DVR services and DVR applications. The DVR services mainly include: a video decoding module, a Navi command module, an image rendering module, a disk storage module, and an RTSP protocol stack. Real-time recording and display is the most important DVR application.

[0062] In VDC, the system hardware is equipped with a sentinel mode master controller.

[0063] In addition to the remote control command processing module, the ICC / TSP is also equipped with a local data reporting module.

[0064] Figure 2 This is a flowchart of a vehicle monitoring method provided in one or more embodiments of the present invention. See also... Figure 2 The vehicle monitoring method includes the following steps:

[0065] S21, VDC monitors the image recognition information of HAD and the data information sensed by radar.

[0066] S22, based on the image recognition of the HAD, the VDC identifies the people within the camera's field of view as unauthorized persons and identifies the state of contact between the unauthorized persons and the vehicle.

[0067] S23, Based on the radar-sensed data, VDC sets the warning range according to the preset warning distance.

[0068] S24, As the sentry mode is active, when the VDC detects an unauthorized person within the warning range and the continuous stay time exceeds a preset time length threshold, the VDC triggers a level one alarm in the sentry mode; the level one alarm includes: flashing headlights and horn.

[0069] S25, based on the active state of the sentry mode, when the VDC detects that there is unauthorized personnel in contact with the vehicle, the VDC triggers the second-level alarm of the sentry mode; the second-level alarm includes: the VDC pulls the HAD video data stream through the CSC, records and captures the data from each camera stream to form an evidence video file of the illegal infringement, and uploads the evidence video file to the video cloud.

[0070] Sentry mode is activated when the following conditions are met simultaneously: all four doors of the vehicle / front and rear trunk doors are closed, the driver leaves and locks the vehicle, and the vehicle battery charge is greater than 15%. The VDC then monitors data information such as HAD image recognition and radar sensing.

[0071] When an unauthorized person is detected within 1 meter of the vehicle and remains near the vehicle for 30 seconds, the Sentry Mode Level 1 alarm is triggered. At this time, the Level 1 alarm event is pushed to the driver via the mobile app, and the hazard warning lights activate for 20 seconds, flashing at a frequency of 4Hz. If no unauthorized person is detected within the alarm range, the Level 1 alarm deactivates. If the unauthorized person engages in further serious behavior...

[0072] When unauthorized personnel are detected to have scratched / damaged / dragged the vehicle, or the vehicle door has been illegally opened, the Sentry Mode Level 2 alarm is triggered. At this time, the Level 2 alarm event is pushed to the driver via mobile APP and SMS reminder, and the hazard warning lights are activated for 60 seconds with a flashing frequency of 4Hz. In addition, the alarm video recording process is triggered.

[0073] VDC acquires video data streams via a pull method, records and extracts each video stream, and forms the final video file provided to the user. This video file is then uploaded to the video cloud via the network. Understandably, once the video file is uploaded to the video cloud, the user can view it on their mobile phone to understand what alarm events occurred around the vehicle.

[0074] Figure 3 This is a flowchart illustrating the triggering of a first-level alarm in a vehicle monitoring method provided by one or more embodiments of the present invention. See also... Figure 3 The VDC triggers a Level 1 alarm in Sentinel mode, including:

[0075] S31, TSP retrieves the pre-stored address book database. The retrieval of the pre-stored address book database includes locking the link port of the user's mobile APP in the address book according to the preset permission level, and pushing alarm control data to the mobile APP.

[0076] S32, based on the alarm control data, control the mobile phone screen to flash at 4Hz for 20 seconds.

[0077] S33: After the mobile phone control screen flashes continuously at 4Hz for 20 seconds, the mobile phone sends a confirmation message for the Level 1 alarm status.

[0078] S34, TSP refreshes the alarm control data based on the received confirmation information of the first-level alarm status and the current status of the first-level alarm not being cleared. The refresh of the alarm control data includes controlling the mobile phone screen to extend the continuous flashing time and change the flashing frequency.

[0079] In this embodiment, the network element that communicates directly with the mobile phone is the TSP (Traffic Provider Interface). It should be understood that this is merely an example. During a Level 1 alarm process, the network element that communicates with the mobile phone could also be the ICC (Internet Control Center).

[0080] The TSP first searches the pre-stored contact database to find the connection port of the vehicle owner's mobile app. Only after identifying the mobile app's connection port can alarm control data be pushed to the mobile app.

[0081] After the TSP completes the push of the alarm control data, the mobile phone screen that receives the alarm control data will flash at a frequency of 4Hz for 20 seconds at a set time interval of 20 seconds.

[0082] Once the flashing is complete, the phone sends a confirmation message to the TSP indicating a Level 1 alarm status.

[0083] After receiving such a confirmation message, the TSP first checks whether the current Level 1 alarm has been cleared. If the current Level 1 alarm has not been cleared, it refreshes the alarm control data. The refresh actions mentioned above include controlling the duration of the phone screen's flashing and changing the flashing frequency.

[0084] Figure 4 This is a flowchart illustrating the first-level alarm triggering process of a vehicle monitoring method provided in one or more embodiments of the present invention. See also... Figure 4 The VDC triggers a Level 1 alarm in Sentinel mode, including:

[0085] S41, TSP retrieves the pre-stored address book database. The retrieval of the pre-stored address book database includes locking the link port of the user's mobile APP in the address book according to the preset permission level, and pushing alarm control data to the mobile APP.

[0086] S42, based on the alarm control data, control the mobile phone screen to flash continuously at 4Hz for 20 seconds.

[0087] S43, after the mobile phone control screen flashes continuously at 4Hz for 20 seconds, the mobile phone sends a confirmation message of the first-level alarm status.

[0088] S44, TSP refreshes the alarm control data based on the received confirmation information of the first-level alarm status and the current status of the first-level alarm not being cleared. The refresh of the alarm control data includes controlling the mobile phone screen to extend the continuous flashing time and change the flashing frequency.

[0089] S45, when the VDC cannot detect any unauthorized personnel within the warning range and the VDC does not trigger the secondary alarm in sentry mode, the VDC will deactivate the primary alarm status of the current sentry mode.

[0090] S46, based on the VDC deactivating the first-level alarm status of the current sentry mode, send a command to the port linked to the user's mobile APP in the locked address book to stop pushing alarm control data to the mobile APP.

[0091] Depend on Figure 4 The difference between the illustrated embodiment and the foregoing embodiments of the present invention is that a release operation step is added to the operation steps of the first-level alarm.

[0092] Furthermore, clearing the alarm requires certain preconditions. These preconditions are: the VDC cannot detect any unauthorized personnel within the detection range, and the VDC has not triggered a level 2 alarm in sentry mode.

[0093] When the VDC detects that the conditions for clearing the Level 1 alarm have been met, the VDC will clear the Level 1 alarm status. Specifically, the VDC will send a command to the port connected to the user's mobile app in the locked address book to receive alarm control data pushed by the mobile app.

[0094] Figure 5 This is a flowchart of a secondary alarm triggering method in a vehicle monitoring method provided by one or more embodiments of the present invention. Figure 5 The VDC triggers a level 2 alarm in Sentinel mode, including:

[0095] S51, TSP retrieves the pre-stored address book database. The retrieval of the pre-stored address book database includes locking the link port of the user's mobile APP in the address book according to the preset permission level, and pushing alarm control data to the mobile APP.

[0096] S52, based on the alarm control data, control the mobile phone screen to flash at 4Hz for 60 seconds.

[0097] S53: After the mobile phone control screen flashes continuously at 4Hz for 60 seconds, the mobile phone sends a confirmation message for the second-level alarm status.

[0098] S54, TSP refreshes the alarm control data based on the received confirmation information of the secondary alarm status and the current status of the primary alarm not being cleared. The refresh of the alarm control data includes controlling the mobile phone screen to extend the continuous flashing time and change the flashing frequency.

[0099] Depend on Figure 5 The illustrated embodiment demonstrates the process of triggering a level-two alarm. See also Figure 5 Similar to the Level 1 alarm triggering process, TSP first searches the address book database to obtain the APP connection port of the car owner's mobile phone, and then pushes alarm control data to the mobile phone through the obtained APP connection port.

[0100] After receiving the alarm control data, the mobile device's screen flashes at 4Hz for 60 seconds. After the flashing is complete, a confirmation message for the Level 2 alarm status is sent to the TSP.

[0101] After receiving the aforementioned confirmation information, the TSP checks the status of the current Level 1 alarm, indicating it is not yet cleared, and refreshes the alarm control data. This refresh action includes controlling the duration of the screen flashing and changing the flashing frequency.

[0102] Figure 6 This is a flowchart illustrating the secondary alarm triggering method for vehicle monitoring provided in one or more embodiments of the present invention. See also... Figure 6 The VDC triggers a level 2 alarm in Sentinel mode, including:

[0103] S61, TSP retrieves the pre-stored address book database. The retrieval of the pre-stored address book database includes locking the link port of the user's mobile APP in the address book according to the preset permission level, and pushing alarm control data to the mobile APP.

[0104] S62, based on the alarm control data, control the mobile phone screen to flash at 4Hz for 60 seconds.

[0105] S63: After the mobile phone control screen flashes continuously at 4Hz for 60 seconds, the mobile phone sends a confirmation message for the second-level alarm status.

[0106] S64, TSP refreshes the alarm control data based on the received confirmation information of the secondary alarm status and the current status of the primary alarm not being cleared. The refresh of the alarm control data includes controlling the mobile phone screen to extend the continuous flashing time and change the flashing frequency.

[0107] S65, if the VDC does not detect any unauthorized personnel contacting the vehicle, then determine whether the VDC has detected unauthorized personnel within the warning range.

[0108] S66, if no unauthorized personnel are detected within the warning range, the VDC deactivates the level 2 alarm status of the current sentry mode and sends a command to the port linked to the user's mobile APP in the locked address book to stop pushing alarm control data to the mobile APP.

[0109] Depend on Figure 6 The difference between the illustrated embodiment and the foregoing embodiments of the present invention is that a release operation step is added to the operation steps of the secondary alarm.

[0110] Furthermore, clearing the alarm requires certain preconditions. These preconditions are: the VDC cannot detect any unauthorized personnel within the detection range, and the VDC has not triggered a level 2 alarm in sentry mode.

[0111] When the VDC detects that the conditions for clearing the level 2 alarm have been met, the VDC will clear the level 2 alarm status. Specifically, the VDC will send a command to the port connected to the user's mobile app in the locked address book to receive alarm control data pushed by the mobile app.

[0112] Figure 7 A flowchart illustrating the sentry mode jurisdiction setting in a vehicle monitoring method provided by one or more embodiments of the present invention is shown. See also Figure 7 The vehicle monitoring method includes the following steps:

[0113] S71, Obtain electronic map information, the electronic map information including the jurisdiction area authorized to enable sentry mode.

[0114] S72, obtain navigation location information.

[0115] S73, based on the navigation location information shown, including the vehicle's current parking location information, and based on the vehicle's current parking location information and the electronic map information, send an authorization request to enable sentry mode.

[0116] S74, upon receiving the authorization instruction to enable sentry mode, enables sentry mode, stores the geographic coordinates of the location, and marks the location with a tag indicating that sentry mode can be used.

[0117] S75, obtain the time information of receiving the instruction to revoke the authorization for enabling Sentinel Mode.

[0118] S76, based on the time information of receiving the instruction to revoke the authorization to enable sentry mode, add tag information indicating that sentry mode can be used. The tag information indicating that sentry mode can be used includes the time range information of the authorization to enable sentry mode.

[0119] It's important to note that Sentry Mode will not be activated in certain situations. The most prominent example is the Exception Zone. When the vehicle's location is within an Exception Zone, Sentry Mode will not be activated, and the user will not receive any alarm information.

[0120] Vehicles within the exception zone will not activate Sentry Mode to conserve energy. Drivers can view / update the exception zone in the vehicle settings page.

[0121] The vehicle settings page can redirect to the navigation page to complete the location selection. The vehicle settings and navigation communicate through data sync (cross-process service).

[0122] The VDC obtains exception area information from the navigation system and stores it. The navigation system and VDC communicate via an SOA interface. Additionally, upon receiving a vehicle account switch notification, the exception area information is updated based on the account, enabling personalized storage.

[0123] The mobile app supports viewing / updating exception areas and communicating with the vehicle's infotainment system via TSP.

[0124] Furthermore, the Sentry Mode can be turned on or off in the vehicle settings page.

[0125] On the vehicle settings page, the driver can view / update the Sentry Mode switch status. The vehicle settings communicate with the VDC via the SOA interface.

[0126] The VDC memory stores the on / off status of Sentinel Mode. Additionally, upon receiving a vehicle account switch notification, the on / off status will be updated based on the account information.

[0127] The mobile app supports viewing / updating the Sentry Mode switch status and communicating with the vehicle's infotainment system via TSP.

[0128] Figure 8 This is a flowchart of the video file upload operation in the vehicle monitoring method provided by one or more embodiments of the present invention. See also Figure 8 VDC actively pulls HAD video data streams through CSC, records and captures data from various camera streams to form video files, and uploads the video files to the video cloud, including the following steps:

[0129] In S81, VDC will first notify CSC, and then CSC's Stream Monitor will actively pull HAD video stream data.

[0130] The S82 Stream Processor records and captures data from various camera streams, creating video files and generating corresponding integrity verification files.

[0131] In S83, the Stream Processor and Video Service use the FTP protocol to transfer files. The Stream Processor acts as an FTP client and connects to the FTP server of the Video Service in CSC. After the file transfer is complete, the Video Service copies the file to UFS.

[0132] S84, Video Service checks if a USB drive is inserted or if the network connection is working. If a USB drive is inserted, it copies the data to the USB drive. If the network is connected, it uploads the data to the video cloud. Once the upload to the USB drive or cloud is successful, the file in UFS can be deleted.

[0133] Both the Stream Processor and the Video Service are internal components of CSC. They work together to record, trim, and ultimately upload video files.

[0134] like Figure 9 As shown, the present invention also provides a vehicle monitoring system, including: a vehicle control domain controller (VDC), a highly automated driving domain controller (HAD), an intelligent communication terminal (ICC) / content service provider (TSP), and a cockpit domain controller (CSC).

[0135] The VDC is used to monitor the image recognition information of HAD and the data information sensed by radar.

[0136] The VDC is used to identify unauthorized persons within the camera's field of view and to identify situations where unauthorized persons are in contact with vehicles based on the image recognition of the HAD.

[0137] The VDC is used to set the warning range according to the radar-sensed data and a preset warning distance.

[0138] The VDC is used to trigger a level one alarm in sentry mode when it detects an unauthorized person within the warning range and the person stays there for a continuous period of time exceeding a preset time threshold, based on whether the sentry mode is active.

[0139] The first-level alarm includes: flashing headlights and horn.

[0140] The VDC is used to trigger a level 2 alarm in sentry mode when it detects unauthorized personnel contacting a vehicle, based on whether the sentry mode is active.

[0141] The secondary alarm includes: VDC pulls HAD video data stream through CSC, records and captures data from each camera stream to form evidence video file of illegal infringement, and uploads the evidence video file to the video cloud.

[0142] It is worth noting that although only some basic functional modules are disclosed in the embodiments of this invention, it does not mean that the composition of this system is limited to the above-mentioned basic functional modules. On the contrary, what this embodiment intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. The fact that this embodiment only discloses a few basic functional modules should not be considered as the scope of protection of the claims of this invention being limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above device is described separately according to its functions as various units and modules. Of course, in implementing this invention, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0143] The present invention also provides a computer-readable storage medium storing a computer program executable by a vehicle, which, when run on the vehicle, causes the vehicle to perform the steps of a vehicle monitoring method.

[0144] Specifically, the computer storage medium in this embodiment of the invention can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0145] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

[0146] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A vehicle monitoring method, characterized in that, applicable to a vehicle monitoring system comprising a vehicle domain controller (VDC), a high automatic driving domain controller (HAD), a content service provider (TSP), and a cabin domain controller (CSC), the vehicle monitoring method comprising: the vehicle domain controller listens to image recognition information of the high automatic driving domain controller and radar-sensed data information; based on the image recognition of the high automatic driving domain controller, the vehicle domain controller identifies that a person within the camera field of view is an illegal person and identifies that the illegal person has contact with the vehicle; based on the radar-sensed data, the vehicle domain controller sets a warning range according to a preset warning distance; when the vehicle domain controller listens to an illegal person within the warning range and the continuous stay time is greater than a preset time length threshold while the sentry mode is in an activated state, the vehicle domain controller triggers a first-level alarm of the sentry mode; the first-level alarm includes flashing warning of vehicle lights and warning of a horn; when the vehicle domain controller listens to a state that an illegal person has contact with the vehicle while the sentry mode is in the activated state, the vehicle domain controller triggers a second-level alarm of the sentry mode; the second-level alarm includes that the vehicle domain controller pulls video data stream of the high automatic driving domain controller through the cabin domain controller, records and intercepts each camera stream data to form an illegal invasion evidence video file, and uploads the evidence video file to a video cloud; the first-level alarm of the sentry mode triggered by the vehicle domain controller includes: the content service provider searches a pre-stored address book database; the searching of the pre-stored address book database includes locking a link port of a user mobile phone APP in the address book according to a preset permission level, and pushing alarm control data to the mobile phone APP; based on the alarm control data, the mobile phone screen is controlled to flash at 4Hz for 20s; after the mobile phone control screen flashes at 4Hz for 20s, the mobile phone sends confirmation information of the first-level alarm state; the content service provider refreshes the alarm control data according to the received confirmation information of the first-level alarm state and the state that the current first-level alarm is not released; the refreshing of the alarm control data includes controlling the mobile phone screen to prolong the time of continuous flashing and changing the flashing frequency; the first-level alarm of the sentry mode triggered by the vehicle domain controller further includes: when the vehicle domain controller does not listen to an illegal person within the warning range and the vehicle domain controller does not trigger the second-level alarm of the sentry mode, the vehicle domain controller releases the alarm state of the current first-level alarm of the sentry mode; based on the vehicle domain controller releasing the alarm state of the current first-level alarm of the sentry mode, a command to end the mobile phone APP pushing of the alarm control data is sent to the port linked to the user mobile phone APP in the locked address book; the vehicle domain controller pulling video data stream of the high automatic driving domain controller through the cabin domain controller, recording and intercepting each camera stream data to form an illegal invasion evidence video file, and uploading the evidence video file to a video cloud includes: The vehicle control domain controller will first notify the cabin domain controller, and then the Stream Monitor of the cabin domain controller will actively pull the high automatic driving domain controller video stream data; The Stream Processor completes the recording and interception of each camera stream data, forms a video file, and generates a corresponding integrity check file; Stream Processor and Video Service transmit files using FTP protocol to transmit files, StreamProcessor as FTP Client end and Video Service FTP Server end in the cabin domain controller connection, after the file transmission is completed, Video Service will copy the file to UFS; Video Service checks whether there is a U disk inserted or a network connection is smooth, if there is a U disk inserted, it will be copied to the U disk, if the network is connected, it will be uploaded to the video cloud, after the U disk or the cloud end is uploaded successfully, the file of UFS can be deleted.

2. The method of claim 1, wherein the vehicle control domain controller triggers a secondary alarm of the sentinel mode, including: the content service provider retrieves a pre-stored address book database; the retrieval of the pre-stored address book database includes locking the link port of the user's mobile phone APP in the address book according to the pre-set permission level, and pushing alarm control data to the mobile phone APP; according to the alarm control data, control the mobile phone screen to flash at 4Hz for 60s; after the mobile phone control screen flashes at 4Hz for 60s, the mobile phone sends confirmation information of the secondary alarm state; the content service provider refreshes the alarm control data according to the received confirmation information of the secondary alarm state and the current state that the primary alarm is not released; the refresh of the alarm control data includes controlling the mobile phone screen to extend the duration of flashing and change the flashing frequency.

3. The method of claim 2, wherein the vehicle control domain controller triggers a secondary alarm of the sentinel mode, further including: when the vehicle control domain controller cannot listen to the state that the illegal personnel have contact with the vehicle, it is judged whether the vehicle control domain controller can listen to the illegal personnel in the warning range; if no illegal personnel are listened to in the warning range, the vehicle control domain controller releases the alarm state of the secondary alarm of the current sentinel mode, and sends a command to end the mobile phone APP push alarm control data to the port linked to the user's mobile phone APP in the locked address book.

4. The method of claim 1, further comprising: obtaining electronic map information; the electronic map information includes the jurisdiction range authorized to enable the sentinel mode; obtaining navigation location information; the navigation location information includes the current location information of the vehicle; according to the current location information of the vehicle and the electronic map information, send an authorization request to enable the sentinel mode; according to the received authorization instruction to enable the sentinel mode, enable the sentinel mode and store the current location information of the vehicle, and mark the label that the sentinel mode can be used. ​ 5. The method of claim 4, further comprising: acquiring time information of receiving the instruction of enabling the sentinel mode authorization recovery; adding tag information of marking the tag of using the sentinel mode according to the time information of receiving the instruction of enabling the sentinel mode authorization recovery; the adding of the tag information of marking the tag of using the sentinel mode comprises adding time range information of enabling the sentinel mode.

6. A vehicle monitoring system, comprising: a vehicle domain controller (VDC), a high automatic driving domain controller (HAD), a content service provider (TSP), and a cabin domain controller (CSC); the VDC is configured to listen to image recognition information of the HAD and radar sensing data information; the VDC is configured to identify illegal personnel in the camera view and identify the state of the illegal personnel contacting the vehicle according to the image recognition of the HAD; the VDC is configured to set a warning range according to the radar sensing data and a preset warning distance; the VDC is configured to trigger a first-level alarm of the sentinel mode when the VDC listens to illegal personnel in the warning range and the continuous stay time is greater than a preset time length threshold according to the sentinel mode being in an activated state; the first-level alarm comprises flashing warning of the vehicle lights and warning of the vehicle horn; the VDC is configured to trigger a second-level alarm of the sentinel mode when the VDC listens to the state of the illegal personnel contacting the vehicle according to the sentinel mode being in the activated state; the second-level alarm comprises the VDC pulling video data stream of the HAD through the CSC, recording and intercepting each camera stream data to form an illegal invasion evidence video file, and uploading the evidence video file to a video cloud; the system is configured to perform the steps of the method of any one of claims 1 to 5.

7. A computer readable storage medium, comprising: a computer program executable by a vehicle, when the computer program runs on the vehicle, causing the vehicle to perform the steps of the method of any one of claims 1 to 5. ​

Images