Guard mode emergency video storage method and system

Abstract

The invention discloses a sentry mode emergency video storage method and system, and relates to the technical field of automobile safety monitoring, and the method comprises the steps: monitoring the surrounding environment of a vehicle, recognizing potential risks, and carrying out the event recording; when problems occur in storage or communication, performing secure storage on the data through a first strategy; and when a risk event occurs, a user is notified, and operation is automatically recovered when conditions are allowed. According to the sentry mode emergency video storage method provided by the invention, the safety and reliability of the system are improved by detecting the risk event through the sensor, the continuous recording and efficient storage of the risk event are ensured through the video caching function, the storage management efficiency of the system is improved through the video priority management strategy, and the safety and reliability of the system are improved. Through a bottom time limiting mechanism, the system is prevented from overusing a built-in hard disk, the service life of equipment is prolonged, the economical efficiency and durability of the system are improved, and better effects are achieved in the aspects of safety, storage management efficiency and economical efficiency.

Description

Technical Field

[0001] The invention relates to the technical field of automobile safety monitoring, in particular to a sentinel mode emergency video storage method. Background Art

[0002] In the current automobile safety protection system, the sentinel mode is widely used in vehicle monitoring and protection. It mainly monitors the environment around the vehicle in real time through on-board cameras and sensors. Once abnormal events such as approach, scratch, collision, etc. are detected, the system will immediately trigger an alarm and record the video. However, the existing technology still has many shortcomings in practical applications. First, the main processing and storage tasks of the existing sentinel mode rely on the car computer (i.e., the on-board central control system). The car computer usually needs to rely on external storage media (such as USB flash drives) to store key risk event videos. However, this design that relies on external devices leads to some problems. For example, the owner may forget to insert the USB flash drive, or the USB flash drive may be damaged or lost, which will directly lead to the inability to store the video. In addition, although the built-in hard disk of the car computer can be used as a backup storage solution, due to its limited life, frequent writing may cause the hard disk to be scrapped prematurely, and the cost of repair or replacement is high, which brings inconvenience to users and even affects the overall performance and reputation of the vehicle.

[0003] Secondly, the sentinel mode in the prior art cannot provide continuous protection in the event of a communication failure or storage medium failure. For example, when the communication link (such as Ethernet or CAN bus) between the vehicle computer and the controller is interrupted, the system cannot continue to store risk events, resulting in the loss of potential key evidence. These problems are particularly serious in practical applications, especially when the vehicle is unattended for a long time, such as parking overnight or in remote areas. Current technology has not yet been able to provide sufficient backup solutions to deal with these sudden failures and further improve the reliability of the system. In addition, the existing sentinel mode usually relies on a single hardware architecture and storage mechanism, does not provide a multi-level fault response mechanism, and the system's redundant design is insufficient, resulting in the system being unable to provide sufficient backup measures when the storage medium or communication link fails. Summary of the invention

[0004] In view of the above-mentioned problems, the present invention is proposed.

[0005] Therefore, the technical problem solved by the present invention is: the existing sentinel mode video storage method has the problem that the storage medium depends on external devices and cannot work after the communication link is interrupted, and how to optimize how to ensure that video data is not lost when the vehicle computer fails or the storage medium fails.

[0006] To solve the above technical problems, the present invention provides the following technical solutions: a sentinel mode emergency video storage method, comprising monitoring the vehicle's surrounding environment to identify potential risks and record events; when problems occur in storage or communication, securely storing data through a first strategy; notifying the user when a risk event occurs, and automatically resuming operation when conditions permit.

[0007] As a preferred solution of the sentinel mode emergency video storage method described in the present invention, wherein: the monitoring of the vehicle surrounding environment to identify potential risks includes monitoring the environment around the vehicle through on-board sensors to identify various risk events.

[0008] As a preferred solution of the sentry mode emergency video storage method described in the present invention, the event recording includes immediately triggering the video cache when an event is detected, recording the video data before and after the event, and temporarily storing it in the memory.

[0009] As a preferred solution of the sentinel mode emergency video storage method described in the present invention, when problems occur in storage or communication, including when the first controller receives a USB flash drive failure signal and the Ethernet link is unavailable, it enters a fallback countdown and continues to work for the user for 12 hours. If it is not restored after 12 hours, the first controller ends the sentinel mode.

[0010] As a preferred solution of the sentinel mode emergency video storage method described in the present invention, wherein: the secure storage of data through the first strategy includes storing the data in the first controller or the vehicle computer's built-in hard disk if a problem occurs during the sentinel mode operation.

[0011] As a preferred solution of the sentinel mode emergency video storage method described in the present invention, wherein: the notifying the user when an abnormality occurs includes in the case of storage medium or communication failure, the sentinel mode sends a signal to the TBOX controller through the vehicle CAN network or Ethernet, and then the TBOX transmits the alarm information to the car company's self-built cloud platform, and promptly notifies the user of storage or communication failure through the mobile phone APP.

[0012] As a preferred solution of the sentry mode emergency video storage method described in the present invention, wherein: the automatic resumption of operation when conditions permit includes when the vehicle computer problem is solved and communication is restored, the first controller re-establishes connection with the vehicle computer and performs data synchronization.

[0013] Another object of the present invention is to provide a sentinel mode emergency video storage system, which can process data in normal or abnormal situations through a data storage module processing system, thereby solving the problem that the current sentinel mode relies on an external storage medium of the vehicle computer for video storage.

[0014] As a preferred solution of the sentry mode emergency video storage system described in the present invention, it includes: an identification and recording module, a data storage module, and a notification and recovery module; the identification and recording module is used to monitor the vehicle's surrounding environment to identify potential risks and record events; the data storage module is used to safely store data through a first strategy when problems occur in storage or communication; the notification and recovery module is used to notify the user when a risk event occurs, and automatically resume operation when conditions permit.

[0015] A computer device comprises a memory and a processor, wherein the memory stores a computer program, and wherein the processor executes the computer program to implement a step of a sentinel mode emergency video storage method.

[0016] A computer-readable storage medium stores a computer program, wherein the computer program implements the steps of a sentinel mode emergency video storage method when executed by a processor.

[0017] Beneficial effects of the present invention: The sentinel mode emergency video storage method provided by the present invention detects risk events through sensors, thereby increasing the security and reliability of the system; through the video caching function, it ensures the continuous recording and efficient storage of risk events, thereby improving the reliability and durability of the overall system; through the dual-subject storage mechanism, it improves the reliability and redundancy of the system; through the video priority management strategy, it improves the storage management efficiency of the system; through the bottom-up time limit mechanism, it prevents the system from overusing the built-in hard disk, thereby extending the service life of the equipment and improving the economy and durability of the system. The present invention achieves better results in terms of security, storage management efficiency and economy. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them:

[0019] Figure 1 This is an overall flow chart of the sentinel mode emergency video storage method provided by the first embodiment of the present invention.

[0020] Figure 2 This is an overall module diagram of a sentinel mode emergency video storage system provided in a second embodiment of the present invention. DETAILED DESCRIPTION

[0021] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0022] Example 1

[0023] Reference Figure 1 , as an embodiment of the present invention, provides a sentinel mode emergency video storage method, comprising:

[0024] S1: Monitor the vehicle's surroundings to identify potential risks and record events.

[0025] Furthermore, monitoring the vehicle's surroundings to identify potential risks includes monitoring the vehicle's surroundings through on-board sensors to identify various risk events.

[0026] It should be noted that the judgment of the severity of the event has nothing to do with whether the vehicle computer fails. The severity of risk events is divided into warning events and alarm events. Warning events refer to the existence of "danger" near the vehicle, but the behavior has not yet harmed the vehicle. Alarm events refer to the vehicle being harmed by "danger", such as the vehicle being hit, etc. The severity of alarm events is greater than that of warning events.

[0027] Furthermore, event recording includes immediately triggering video caching when an event is detected, recording video data before and after the event occurs, and temporarily storing the video data in a memory.

[0028] It should be noted that the video data is temporarily stored in the memory and continuously erased to avoid premature writing to the hard disk, ensuring that the system is always in an efficient real-time monitoring state. The goal of this process is to not write to the disk when the external memory of the vehicle computer (such as a USB flash drive) is available, so as to reduce the wear of the built-in hard disk.

[0029] Example 2

[0030] Reference Figure 1 , as an embodiment of the present invention, provides a sentinel mode emergency video storage method, comprising:

[0031] S2: When there is a problem with storage or communication, the data is securely stored using the first strategy.

[0032] Furthermore, when problems occur in storage or communication, including when the first controller receives a USB drive failure signal and the Ethernet link is unavailable, a fallback countdown begins, which continues to work for the user for 12 hours. If it is not restored after 12 hours, the first controller ends the sentinel mode.

[0033] It should be noted that after the backup plan ends and the Sentry mode is exited, the user cannot turn on Sentry again. The system can only provide a backup plan for the user once. The user already knows that there is a problem with the USB flash drive or the communication link, and the problem should be repaired as soon as possible. The backup plan state may frequently rewrite the controller or the built-in hard drive of the vehicle computer, and the user should try to avoid entering the backup plan. If a problem with the USB flash drive or the communication link occurs during the operation of the Sentry mode, the user will only be provided with a backup plan once.

[0034] It should also be noted that when entering the backup state, the controller will send a signal to the mobile phone APP to remind the owner. The car owner will basically check the phone once every 12 hours, so 12 hours is selected as the backup time. 6 hours is shorter, and 24 hours is longer, which affects the life of parts.

[0035] In the embodiment of the present application, the first controller uses a general 8G flash memory storage and communicates with the vehicle computer through CAN and Ethernet. CAN is used by the controller to wake up the vehicle computer and monitor the vehicle computer status (including the available and writable status of the USB flash drive and the Ethernet link status). Ethernet communication is used to transmit video. The vehicle computer and the controller are connected to KL30 for power supply. The power supplies are independent of each other. The on-board sensors are directly connected to the controller, and the power supply is controlled by the controller.

[0036] In an optional embodiment, the first controller may also be implemented in other ways, for example, the first controller is connected to a remote cloud storage server through an in-vehicle Wi-Fi or 4G / 5G network, and when the vehicle computer or the external USB flash drive fails, the video data is uploaded to the cloud for backup, the data security is ensured through encrypted transmission, and a larger storage space is provided for the vehicle owner;

[0037] Two different types of storage media are designed inside the controller. One high-speed memory is used for short-term video caching, and the other large-capacity but long-life memory is used for long-term storage, which effectively reduces the frequent erasing and writing of memory and prolongs the service life of storage devices.

[0038] The controller can synchronize data with the user's smartphone, tablet and other personal devices. When the storage device fails, it will automatically back up the data to the user's device through wireless technologies such as Bluetooth and Wi-Fi. The user can view and manage the backup video at any time through the mobile phone APP.

[0039] The controller integrates more efficient video compression algorithms (such as H.265 or H.266) to reduce the size of video files. When the storage medium is limited, compression technology can effectively save storage space and extend the backup time.

[0040] Through the capabilities of on-board edge computing, video data can be intelligently analyzed and processed, the most important parts can be screened out for storage, and video analysis can be performed in combination with AI algorithms to identify potential high-risk events, thereby reducing the storage of irrelevant data and optimizing storage strategies.

[0041] Furthermore, secure storage of data through the first strategy includes storing the data in the first controller or the vehicle computer's built-in hard disk if a problem occurs during sentinel mode operation.

[0042] It should be noted that during the operation of the sentinel mode, if the vehicle computer finds that the external USB flash drive is lost or data cannot be written to the USB flash drive, the vehicle computer will perform a backup storage of the risk event video and store it in the vehicle computer's built-in hard drive. During the operation of the sentinel mode, if the controller finds that the Ethernet link to the vehicle computer is interrupted, the controller will perform a backup storage of the risk event and store it in the controller's built-in hard drive.

[0043] In the embodiment of the present application, the first strategy is a backup video storage strategy, which stores a maximum of 6 videos. After the 6 videos are fully stored, if a warning event occurs again, the warning event videos (i.e., low-severity event videos) and videos that occurred earlier will be deleted first. After the 6 videos are fully stored, if an alarm event occurs again, the low-severity event videos and videos that occurred earlier will be deleted first. If there are no low-severity event videos, the earliest high-severity event video will be deleted.

[0044] In an optional embodiment, the first strategy may also be implemented in other ways, such as when the vehicle controller detects a storage or communication problem, immediately switching to a cellular network or a Wi-Fi network to upload the emergency video to the vehicle manufacturer's cloud platform;

[0045] Cloud storage provides users with more reliable storage backup and also supports access to and viewing of historical videos at any time. The system sets reasonable storage cycles and capacity limits to ensure effective use of cloud space.

[0046] In an optional embodiment, the first strategy can also be implemented in other ways, such as by configuring a network attached storage (NAS) in a home or company. The vehicle can automatically connect to the local network when in a garage or other fixed location and store the video data on the NAS device. This method is suitable for long-term parking scenarios and can avoid the problem of video data loss caused by storage medium failure.

[0047] S3: Notify users when a risk event occurs and automatically resume operations when conditions permit.

[0048] Furthermore, the user is notified when an anomaly occurs, including in the event of storage media or communication failure.

[0049] It should be noted that the sentry mode sends signals to the TBOX controller through the vehicle's CAN network or Ethernet, and then the TBOX transmits the alarm information to the car company's self-built cloud platform, and promptly notifies the user of storage or communication failures through the mobile phone APP.

[0050] Furthermore, automatically resuming operation when conditions permit includes when the vehicle computer problem is resolved and communication is restored, the first controller re-establishes connection with the vehicle computer and performs data synchronization.

[0051] It should be noted that users can obtain relevant information through their mobile phones so that they can take action to resolve storage media problems. The backup storage time is limited to 12 hours. If the problem is not resolved during this period, the sentinel mode will automatically shut down. The system is designed to only provide a backup once for each failure to prevent wear and tear on the hardware caused by frequent use of the backup mechanism. When the vehicle computer problem is resolved and communication is restored, the controller will reconnect with the vehicle computer and synchronize data to ensure that the subsequent Sentinel mode continues to operate normally and avoid the loss of video data.

[0052] Example 3

[0053] An embodiment of the present invention provides a sentinel mode emergency video storage method. In order to verify the beneficial effects of the present invention, scientific demonstration is carried out through economic benefit calculation and simulation experiments.

[0054] In order to verify the reliability of the method of the present invention, a simulation experiment was designed to test the system's video storage and risk event processing capabilities under different conditions. During the experiment, a smart car equipped with sentinel mode was used to carry out monitoring tests in actual scenarios. The vehicle was equipped with a variety of sensors (such as cameras, ultrasound, accelerometers, etc.) and on-board storage devices (built-in UFS memory and external USB flash drive). The test vehicle was parked in the monitoring area at night without anyone. The core purpose of the system is to test the video caching and storage when the sensor detects risk events of different degrees, as well as the backup storage effect when storage or communication fails.

[0055] The test preparation work includes system initialization, simulated triggering devices for risk events (such as simulated scratches, collisions, etc.), simulation of external USB flash drive failures, and disconnection and recovery of communication links (Ethernet and CAN bus). The experiment simulates a variety of potential risk events and multiple failure scenarios of storage and communication. When the sentinel mode detects two types of events, minor scratches and severe collisions, can it record and cache videos under normal working conditions and write them to external storage devices through the vehicle system?

[0056] In the scenario where the USB flash drive is unplugged or damaged, can the Sentry Mode Controller initiate the backup storage strategy to save the video of the risk event to the controller's built-in UFS storage? When the communication link with the vehicle computer is interrupted, can the Sentry Mode Controller continue to monitor and establish data synchronization with the vehicle computer after the communication is restored? Can the system's fault notification mechanism send timely notifications to users through the APP to remind users to deal with storage or communication failures?

[0057] A total of six different scenarios were designed for the experiment, covering the entire process from sensor triggering, normal storage, to external storage medium failure, communication link interruption, data backup storage and system recovery. Each scenario triggered events of different levels. The system prioritized storage and deletion based on the severity and time of occurrence of the event. The experiment recorded key data such as the storage time, backup storage times, video loss rate, and recovery time of each event to ensure the integrity and verifiability of the test data.

[0058] As shown in Table 1, in scenarios 1 and 2 of the present invention, the system can effectively record and cache videos under normal working conditions, and successfully write data to the external U disk storage medium, with a video loss rate of 0, which verifies the efficiency of the system in detecting and recording risk events of different levels; in scenario 3, when the U disk fails, the system immediately starts the backup storage strategy and stores the video in the built-in UFS storage device of the controller. When the external storage medium fails, the system can smoothly switch to the backup storage mode and ensure the integrity of the video recording. The video loss rate is 0, and the user receives the notification of storage medium failure in time through the APP, which shows that the present invention can effectively solve the storage risks brought by relying on external storage devices in the prior art and ensure the important video data. No loss; Scene 4 and Scene 5 verify the system's processing capability when the communication link is interrupted. Although the communication interruption leads to a 5% video loss rate (due to data transmission interruption), the system still saves most of the important video data through the backup storage mechanism and successfully synchronizes the data with the vehicle system after the communication is restored, which verifies the effectiveness and redundant design advantages of the present invention in dealing with communication link failures; Scene 6 shows that when the external storage medium returns to normal, the system can quickly restore the normal storage function and end the backup storage mode. There is no data loss after the system is restored, which reflects the system's self-repair ability after storage recovery, solves the problem of the prior art that the storage medium or communication cannot be automatically restored, and enhances the intelligence of the system and user experience.

[0059] Table 1 Experimental data table

[0060]

[0061] Example 4

[0062] Reference Figure 2 , as an embodiment of the present invention, provides a sentinel mode emergency video storage system, including: an identification and recording module, a data storage module, and a notification and recovery module.

[0063] The identification and recording module is used to monitor the vehicle's surrounding environment, identify potential risks, and record events; the data storage module is used to securely store data through a first strategy when storage or communication problems occur; the notification and recovery module is used to notify users when risk events occur and automatically resume operation when conditions permit.

[0064] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0065] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in conjunction with such instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in conjunction with such instruction execution systems, devices or apparatuses.

[0066] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering, or processing in another suitable manner as necessary, and then stored in a computer memory.

[0067] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc. It should be noted that the above embodiments are only used to illustrate the technical solution of the present invention and are not limited. Although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention, which should be included in the scope of the claims of the present invention.

[0068] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. Sentry mode emergency video storage method, characterized in that: include: Monitor the vehicle's surroundings to identify potential risks and record events; When there is a problem with storage or communication, data is securely stored through the first strategy; Notify users when risk events occur and automatically resume operations when conditions permit.

2. The sentinel mode emergency video storage method according to claim 1, characterized in that: The monitoring of the vehicle's surrounding environment to identify potential risks includes monitoring the vehicle's surrounding environment through vehicle-mounted sensors to identify various risk events.

3. The sentry mode emergency video storage method as claimed in claim 2, characterized in that: The event recording includes immediately triggering the video cache when an event is detected, recording the video data before and after the event occurs, and temporarily storing it in the memory.

4. The sentry mode emergency video storage method according to claim 3, characterized in that: When a problem occurs in storage or communication, including when the first controller receives a USB flash drive failure signal and the Ethernet link is unavailable, a fallback countdown begins, which continues to work for the user for 12 hours. If it is not restored after 12 hours, the first controller ends the sentinel mode.

5. The sentry mode emergency video storage method according to claim 4, characterized in that: The secure storage of data by the first strategy includes storing the data in the first controller or the vehicle computer's built-in hard disk if a problem occurs during the sentinel mode operation.

6. The sentry mode emergency video storage method according to claim 5, characterized in that: The above-mentioned notifying users when an abnormality occurs includes that in the event of storage medium or communication failure, the sentinel mode sends a signal to the TBOX controller through the vehicle CAN network or Ethernet, and TBOX then transmits the alarm information to the car company's self-built cloud platform, and promptly notifies users of storage or communication failures through the mobile phone APP.

7. The sentry mode emergency video storage method according to claim 6, characterized in that: The automatic resumption of operation when conditions permit includes the first controller re-establishing a connection with the vehicle computer and performing data synchronization when the vehicle computer problem is resolved and communication is restored.

8. A system using the sentinel mode emergency video storage method according to any one of claims 1 to 7, characterized in that: It includes an identification and recording module, a data storage module, and a notification and recovery module; The identification and recording module is used to monitor the vehicle's surrounding environment to identify potential risks and record events; The data storage module is used to store data securely using a first strategy when a storage or communication problem occurs; The notification recovery module is used to notify the user when a risk event occurs and automatically resume operation when conditions permit.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the sentinel mode emergency video storage method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the sentry mode emergency video storage method according to any one of claims 1 to 7 are implemented.

Images