A dual-system-based alarm delay time measurement method and system

Abstract

The application provides a kind of based on the alarm delay time measurement method and system of double system, the method comprises: obtaining multiple video data, each original video frame of each video data carries time stamp, the time stamp of each video data is based on the same clock source;The alarm video file obtained by the first system processing and the surround view alarm video file obtained by the second system processing are compared frame by frame, and the target surround view alarm video frame corresponding to each alarm video frame is determined;According to the difference between the time stamp of each alarm video frame and the time stamp of corresponding target surround view alarm video frame, the alarm delay time is determined.The application can be based on the time stamp overlaid externally, can be in without destroying the internal environment of first system and second system, realize the measurement to the alarm delay of double system, to be able to accurately determine the alarm delay of double system.

Description

Technical Field

[0001] This application belongs to the field of video technology, and in particular relates to a method and system for measuring alarm delay time based on a dual system. Background Technology

[0002] In the field of video surveillance, a dual-system approach is provided for alarm detection and alerting. One system is used for algorithmic alarm detection, sending alarm information to the other system upon alarm generation. The other system handles recording and interactive functions such as overlaying alarm information with corresponding icons.

[0003] However, in actual operation of the dual system, users intuitively feel that there is an alarm delay, but they cannot obtain relevant data to determine the occurrence of the alarm delay. Summary of the Invention

[0004] This application provides a method, system, electronic device, readable storage medium, and computer program product for measuring alarm delay time based on a dual system, which can solve the problem that the dual system cannot detect the occurrence of alarm delay.

[0005] In a first aspect, embodiments of this application provide a method for measuring alarm delay time based on a dual-system approach, including:

[0006] Acquire multiple video data streams, where each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source;

[0007] For each of the video data streams, when the first system performs algorithmic processing on each original video frame in the video data, if the original video frame generates alarm information, the alarm information is transmitted to the second system, and the alarm information is superimposed on the original video frame to obtain an alarm video frame, thereby obtaining the alarm video file corresponding to the video data.

[0008] When the second system performs surround view stitching on the original video frames of the video data from each channel, if the alarm information is received, an alarm icon is rendered on the target video frame according to the alarm information to obtain a surround view alarm video frame, thereby obtaining a surround view alarm video file. The target video frame is the original video frame that is in the surround view stitching process when the alarm information is received.

[0009] The alarm video file and the surround-view alarm video file are compared frame by frame to determine the target surround-view alarm video frame corresponding to each alarm video frame. The target surround-view alarm video frame is a video frame in the surround-view alarm video file that has a target alarm icon corresponding to the alarm information.

[0010] The alarm delay time is determined based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround alarm video frame.

[0011] In one embodiment, the distance between the alarm coordinates of the alarm video frame and the coordinates of the target alarm icon is less than a preset distance, the alarm level of the alarm video frame is the same as the level of the target alarm icon, the alarm type of the alarm video frame is the same as the type of the target alarm icon, and the alarm information includes the alarm coordinates, the alarm level, and the alarm type.

[0012] In one embodiment, the background environment and the category of the subject of interest in each of the video data streams are different, and the category of the subject of interest includes people, vehicles, and objects.

[0013] In one embodiment, when the format of the video data is different from the format of the data received by the first system and the second system, after acquiring the multiple video data, the method further includes:

[0014] The format of the multiple video data streams is converted to obtain the converted video data streams.

[0015] Secondly, embodiments of this application provide an alarm delay time measurement system based on a dual system, including: a video processing module, a first system, a second system, and a comparison module;

[0016] The video processing module is used to acquire multiple video data streams. Each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source.

[0017] The first system is used to process each original video frame in the video data according to the algorithm for each video data channel. If the original video frame generates alarm information, the alarm information is transmitted to the second system and the alarm information is superimposed on the original video frame to obtain an alarm video frame, so as to obtain the alarm video file corresponding to the video data.

[0018] The second system is used to render an alarm icon on the target video frame according to the alarm information when the original video frames of the video data of each channel are stitched together in a surround view, so as to obtain a surround view alarm video frame and obtain a surround view alarm video file. The target video frame is the original video frame that is in the surround view stitching process when the alarm information is received.

[0019] The comparison module is used to compare the alarm video file and the surround view alarm video file frame by frame to determine the target surround view alarm video frame corresponding to each alarm video frame. The target surround view alarm video frame is a video frame in the surround view alarm video file that has a target alarm icon corresponding to the alarm information.

[0020] It is also used to determine the alarm delay time based on the difference between the timestamp of each of the alarm video frames and the timestamp of the corresponding target surround alarm video frame.

[0021] In one embodiment, when the format of the video data is different from the format of the received data of the first system and the second system, the video processing module includes multiple video channel units and signal conversion units;

[0022] The video channel unit is used to acquire one channel of video data;

[0023] The signal conversion unit is used to convert the format of the multiple video data streams to obtain the converted video data streams.

[0024] In one embodiment, the first system includes an algorithm module and a first recording module;

[0025] The algorithm module is used to process each original video frame in the video data for each channel of the video data. If the original video frame generates alarm information, the alarm information is transmitted to the second system and the alarm information is superimposed on the original video frame to obtain an alarm video frame, so as to obtain the alarm video file corresponding to the video data.

[0026] The first recording module is used to encode the original video frames and the alarm video frames in each of the alarm video files, and obtain and store the encoded alarm video files.

[0027] In one embodiment, the second system includes a surround view splicing module and a second recording module;

[0028] The surround view stitching module is used to render an alarm icon on the target video frame according to the alarm information when the original video frames of each video data are stitched together in a surround view, so as to obtain a surround view alarm video frame and thus obtain a surround view alarm video file.

[0029] The second recording module is used to encode the surround alarm video frames and surround video frames in the surround alarm video file, obtain and store the encoded surround alarm video file, wherein the surround video frames are video frames generated by surround stitching of the video data from each channel and without rendering the alarm icon.

[0030] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method as described in any one of the first aspects above.

[0031] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method as described in any one of the first aspects above.

[0032] Fifthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to perform the method described in any one of the first aspects above.

[0033] The beneficial effects of the embodiments in this application compared with the prior art are:

[0034] This application embodiment acquires multiple video data streams, each original video frame in each stream carries a timestamp, and the timestamps of each stream are based on the same clock source, which can provide accurate data and provide a basis for determining whether an alarm delay occurs in the dual system.

[0035] By comparing the alarm video files and the surround-view alarm video files frame by frame, the target surround-view alarm video frame corresponding to each alarm video frame is determined. The target surround-view alarm video frame is the video frame in the surround-view alarm video file that has a target alarm icon corresponding to the alarm information. Based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround-view alarm video frame, the alarm delay time is determined. Based on the externally superimposed timestamp, the alarm delay of the two systems can be measured without damaging the internal environment of the first and second systems, so as to accurately determine the alarm delay of the two systems.

[0036] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0037] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0038] Figure 1 This is a first schematic diagram of a system provided in an embodiment of this application;

[0039] Figure 2 This is an example diagram of an original video frame provided in an embodiment of this application;

[0040] Figure 3 This is an example diagram of an alarm video frame provided in an embodiment of this application;

[0041] Figure 4 This is an example diagram of a surround-view alarm video frame provided in an embodiment of this application.

[0042] Figure 5 This is a second schematic diagram of a system provided in an embodiment of this application;

[0043] Figure 6 This is a flowchart illustrating an embodiment of the alarm delay time measurement method provided in this application;

[0044] Figure 7 This is a schematic diagram of video frame comparison provided in an embodiment of this application;

[0045] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0046] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, circuits, and methods are omitted so as not to obscure the description of this application with unnecessary detail.

[0047] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0048] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0049] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0050] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0051] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0052] Figure 1 This is a schematic diagram of a system provided in one embodiment of this application. For example... Figure 1 As shown, the system includes: a video processing module 10, a first system 20, a second system 30, and a comparison module 40;

[0053] The video processing module 10 is used to acquire multiple video data streams. Each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source.

[0054] In one possible implementation, when the format of the video data is the same as the format of the data received by the first system and the second system, the video processing module includes multiple video channel units, each used to acquire one channel of video data.

[0055] In the application, each video channel unit receives video footage captured by the camera device. After receiving the video footage, it uses the same clock source to overlay a timestamp onto each frame of the video footage, obtaining multiple video data streams. The timestamp values ​​can be accumulated.

[0056] Understandably, by overlaying a timestamp onto each frame of the video footage using the same clock source, the various video data streams are synchronized. After the first and second systems process the video data, this timestamp objectively reflects the status of both systems, providing reliable data for determining the alarm delay time.

[0057] The number of video channel units can be set according to the actual application scenario, the video materials can be customized according to user needs, and the timestamp of the clock source can be the timestamp on the computer.

[0058] In one possible implementation, to prevent timestamps from interfering with video data processing, timestamps are placed in the edge or corner areas of each frame of the video footage, and the font size of the timestamps is smaller than a preset size.

[0059] In one possible implementation, the content of the multiple video data streams differs. The camera devices connected to the video channel units are installed in different locations, capturing data from different areas and with different viewing angles, resulting in diverse background environments for the video data. The cameras also focus on different objects, thus creating different subjects of interest in the video data. This difference in the focus of the different cameras increases the types of alarms, allowing for better determination of alarm delays in the dual-system setup.

[0060] For example, cameras are installed in front of, behind, to the left, and to the right of a vehicle. The front-facing camera focuses primarily on pedestrians, the rear-facing camera focuses primarily on small vehicles (delivery vans, scooters, bicycles, etc.), the left-facing camera focuses primarily on large vehicles (trucks, vans, passenger cars, etc.), and the right-facing camera focuses primarily on objects (trees, snow buckets, etc.).

[0061] The first system 20 is used to process each original video frame in the video data using algorithms. If an alarm message is generated in the original video frame, the alarm message is transmitted to the second system, and the alarm message is superimposed on the original video frame to obtain an alarm video frame, thereby obtaining the alarm video file corresponding to the video data.

[0062] In the application, the first system receives video data in real time and performs target detection on each raw video frame. When a target is detected in a raw data frame, an alarm message is generated for that raw data frame. The alarm message is transmitted to the second system, which simultaneously overlays the alarm message onto the raw data frame to obtain an alarm video frame. If no target is detected in the raw data frame, no action is taken. The alarm video file includes the alarm video frame and the raw video frames.

[0063] Figure 2 This is an example diagram of an original video frame provided in an embodiment of this application. For example... Figure 2As shown, the number in the upper left corner of the original video is the timestamp, and the person in the middle is the target.

[0064] Specifically, the alarm information includes the alarm level, alarm coordinates, video channel number, and alarm category. Watermarks of the alarm frame, alarm level, alarm coordinates, video channel number, and alarm category are overlaid on the original data frame. The alarm level is distinguished by the color of the alarm frame. Figure 3 This is an example diagram of an alarm video frame provided in an embodiment of this application. For example... Figure 3 As shown, the alarm video frame is overlaid with the target's alarm coordinates (x, y), alarm frame, alarm frame color, and alarm category (person).

[0065] The second system 30 is used to render an alarm icon on the target video frame according to the alarm information when the original video frames of each video data are stitched together in a surround view, so as to obtain a surround view alarm video frame and obtain a surround view alarm video file. The target video frame is the original video frame that is in the surround view stitching process when the alarm information is received.

[0066] In the application, the second system receives video data in real time and stitches together the raw video frames from each video source according to the captured area. Specifically, there will be overlapping areas between the areas captured by adjacent camera devices. Based on the overlapping areas, the raw video frames with the same timestamp are merged, cropped, and distortion corrected to obtain a surround-view video frame. When an alarm message is received from the first system, an alarm icon is rendered on the currently stitched raw video frame according to the alarm message to obtain a surround-view alarm video frame. Figure 4 This is an example diagram of a surround-view alarm video frame provided in an embodiment of this application. Figure 4 As shown, based on the alarm information, an alarm icon (icon frame) is rendered on the pedestrian in the target video frame on the left, and an alarm icon (icon shadow) is rendered in the lower right corner of the target video frame on the right.

[0067] The comparison module 40 is used to compare the alarm video file and the surround alarm video file frame by frame to determine the target surround alarm video frame corresponding to each alarm video frame. The target surround alarm video frame is a video frame in the surround alarm video file that has a target alarm icon corresponding to the alarm information.

[0068] It is also used to determine the alarm delay time based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround alarm video frame.

[0069] In the application, the comparison module retrieves alarm video files from the first system and plays them back frame by frame. Then, it compares these frames with the surround-view alarm video files. When a video frame containing the target alarm icon corresponding to the alarm information is found, the target surround-view alarm video frame is obtained. Based on the difference between the timestamps of each alarm video frame and the corresponding timestamp of the target surround-view alarm video frame, the alarm delay time is determined, enabling a simple, accurate, and convenient determination of the alarm delay time.

[0070] In one possible implementation, for each alarm video frame, the time difference is determined based on the timestamp of the alarm video frame and the timestamp of the corresponding target surround alarm video frame. The alarm delay time is determined by averaging or weighted averaging multiple time differences to more accurately measure the alarm delay time.

[0071] This embodiment acquires multiple video data streams through a video processing module. Each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source, which can provide accurate data and provide a basis for determining whether alarm delays occur in the dual system.

[0072] The comparison module compares the alarm video files and the surround-view alarm video files frame by frame to determine the target surround-view alarm video frame corresponding to each alarm video frame. The target surround-view alarm video frame is the video frame in the surround-view alarm video file that has a target alarm icon corresponding to the alarm information. Based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround-view alarm video frame, the alarm delay time is determined. Based on the externally superimposed timestamp, the alarm delay of the two systems can be measured without damaging the internal environment of the first and second systems, so as to accurately determine the alarm delay of the two systems.

[0073] In one embodiment, the first system includes an algorithm module and a first recording module.

[0074] The algorithm module is used to process each original video frame in the video data for each channel. If an alarm message is generated in the original video frame, the alarm message is transmitted to the second system and superimposed on the original video frame to obtain an alarm video frame, thereby obtaining the alarm video file corresponding to the video data.

[0075] The first recording module is used to encode the original video frames and alarm video frames in each alarm video file, and obtain and store the encoded alarm video file.

[0076] In applications, the encoded alarm video files can be stored on a flash memory card or hard drive.

[0077] In this embodiment, the alarm video file is encoded by the first recording module and then stored. This allows the comparison module to obtain the encoded alarm video file from the first recording module, thus preventing frame loss during data transmission between the first system and the comparison module without affecting the first system environment.

[0078] In one embodiment, the second system includes a surround view splicing module and a second recording module;

[0079] The surround view stitching module is used to stitch together the original video frames of various video data in a surround view manner. If an alarm message is received, an alarm icon is rendered on the target video frame according to the alarm message to obtain a surround view alarm video frame, thereby obtaining a surround view alarm video file.

[0080] The second recording module is used to encode the surround view alarm video frames and surround view video frames in the surround view alarm video file, and to obtain and store the encoded surround view alarm video file.

[0081] In applications, when it is necessary to convert the format of the encoded surround-view alarm video file, the second recording module also has a format conversion function.

[0082] In one possible implementation, the second system further includes a surround view output module, which is used to obtain surround view alarm video files from the surround view splicing module and transmit the surround view alarm video files to the second recording module.

[0083] In the application, the surround view alarm video file is obtained from the surround view splicing module through the surround view output module and transmitted to the second recording module to ensure that the surround view alarm video file of the surround view splicing module is transmitted to the second recording module.

[0084] This embodiment encodes the surround-view alarm video frames in the surround-view alarm video file of the second recording module to obtain and store the encoded surround-view alarm video file, so that the comparison module can obtain the encoded alarm video file from the second recording module. Without affecting the second system environment, it can prevent frame loss when the second system and the comparison module transmit data.

[0085] Figure 5 This is a second schematic diagram of a system provided in one embodiment of this application. For example... Figure 5 As shown, when the format of the video data is different from the format of the received data of the first system and the second system, the video processing module 10 includes multiple video channel units 11 and signal conversion units 12.

[0086] Video channel unit 11 is used to acquire one channel of video data.

[0087] The signal conversion unit 12 is used to convert the format of multiple video data to obtain the converted video data.

[0088] When the video channel unit outputs video data in HDMI (High Definition Multimedia Interface) format, which differs from the AHD (Analog High Definition) format received by the first and second systems, the signal conversion unit converts the video data from HDMI to AHD to obtain converted video data, which is an AHD analog signal. This converted video data is then sent to the first and second systems for processing.

[0089] Since the converted video data is an AHD analog signal, the first system 20 includes an algorithm module 21 and a first recording module 22, as well as a first analog-to-digital conversion module 23. The first analog-to-digital conversion module 23 is used to convert each channel of converted video data into corresponding first digital data and transmit each channel of first digital data to the algorithm module.

[0090] Since the converted video data is an AHD analog signal, the second system 30 includes a surround view splicing module 31 and a second recording module 32, as well as a second analog-to-digital conversion module 33. The second analog-to-digital conversion module 33 is used to convert each channel of converted video data into corresponding second digital data and transmit each channel of second digital data to the surround view splicing module.

[0091] Corresponding to the system described in the above embodiments, only the parts related to the embodiments of this application are shown for ease of explanation.

[0092] Figure 6 This is a schematic flowchart of the first embodiment of the alarm delay time measurement method provided in this application. Figure 6 As shown, the method includes:

[0093] S11: Acquire multiple video data streams. Each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source.

[0094] S12: For each video data stream, when the first system processes each original video frame in the video data using an algorithm, if an alarm message is generated in the original video frame, the alarm message is transmitted to the second system, and the alarm message is superimposed on the original video frame to obtain an alarm video frame, thereby obtaining the alarm video file corresponding to the video data.

[0095] S13: When the second system performs surround view stitching on the original video frames of each video data channel, if an alarm message is received, an alarm icon is rendered on the target video frame according to the alarm message to obtain the surround view alarm video frame, thereby obtaining the surround view alarm video file. The target video frame is the original video frame that is in the surround view stitching process when the alarm message is received.

[0096] S14: Compare the alarm video file and the surround view alarm video file frame by frame to determine the target surround view alarm video frame corresponding to each alarm video frame. The target surround view alarm video frame is the video frame in the surround view alarm video file that has a target alarm icon corresponding to the alarm information.

[0097] In the application, alarm information includes alarm coordinates, alarm level, and alarm type. The alarm coordinates of the alarm video frame are compared with the coordinates of the alarm icon in the surround-view alarm video frame. The alarm level of the alarm video frame is compared with the level of the alarm icon in the surround-view alarm video frame; specifically, the color of the target alarm frame is compared with the color of the alarm icon. The alarm type of the alarm video frame is compared with the type of the alarm icon in the surround-view alarm video frame. When the alarm coordinates, alarm level, and alarm type of an alarm video frame all correspond to the coordinates, level, and type of the alarm icon in a particular surround-view alarm video frame, the target surround-view alarm video frame is obtained.

[0098] Understandably, the distance between the alarm coordinates of the alarm video frame and the coordinates of the target alarm icon is less than the preset distance, the alarm level of the alarm video frame is the same as the level of the target alarm icon, and the alarm type of the alarm video frame is the same as the type of the target alarm icon.

[0099] Figure 7 This is a schematic diagram of video frame comparison provided in an embodiment of this application. For example... Figure 7 As shown, the first row of video frames represents the surround-view alarm video file. Based on the camera being installed on the left, front, rear, and right sides of the vehicle, the following four rows represent the alarm video frames for the left, front, rear, and right sides, respectively. The left-side alarm video file (marked CH1) is compared frame-by-frame with the surround-view alarm video file. CH1 contains the alarm information from frame 100140 of the left-side alarm video file. A corresponding target surround-view alarm video frame (frame 100220) for the left-side alarm is found in the surround-view alarm video file. Similarly, the front-side alarm video file (marked CH2) is compared frame-by-frame with the surround-view alarm video file. CH2 contains the alarm information from frame 100180 of the front-side alarm video file. A corresponding target surround-view alarm video frame (frame 100260) for the front-side alarm is found in the surround-view alarm video file.

[0100] S15: Determine the alarm delay time based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround alarm video frame.

[0101] This embodiment acquires multiple video data streams, each original video frame in each stream carries a timestamp, and the timestamps of each stream are based on the same clock source, which can provide accurate data and provide a basis for determining whether an alarm delay occurs in the dual system.

[0102] By comparing the alarm video file and the surround-view alarm video file frame by frame, the target surround-view alarm video frame corresponding to each alarm video frame is determined. The target surround-view alarm video frame is a video frame in the surround-view alarm video file that has a target alarm icon corresponding to the alarm information. Based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround-view alarm video frame, the alarm delay time is determined. This allows for the measurement of the alarm delay of the two systems without damaging the internal environment of the first and second systems, so as to accurately determine the alarm delay status of the two systems.

[0103] In one embodiment, the background environment and the category of the subject of interest differ in each video stream, and the categories of the subject of interest include people, vehicles, and objects.

[0104] This embodiment can increase the types of alarms by using different background environments and categories of subjects of interest in each video stream, so as to better determine the alarm delay of the dual systems.

[0105] In one embodiment, when the format of the video data is different from the format of the data received by the first system and the second system, after acquiring multiple video data, the method further includes:

[0106] The format of multiple video data streams is converted to obtain the converted video data streams.

[0107] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0108] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 8 As shown, the electronic device 5 of this embodiment includes: at least one processor 50 ( Figure 8 (Only one is shown in the diagram), memory 51, and computer program 55 stored in said memory 51 and executable on said at least one processor 50, which, when executed, implements the steps in any of the above method embodiments.

[0109] The electronic device 5 can be a desktop computer, laptop, handheld computer, cloud server, or other computing device. The electronic device 5 may include, but is not limited to, a processor 50 and a memory 51. Those skilled in the art will understand that... Figure 8 This is merely an example of electronic device 5 and does not constitute a limitation on electronic device 5. It may include more or fewer components than shown in the figure, or combine certain components, or different components. For example, it may also include input / output devices, network access devices, etc.

[0110] The processor 50 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0111] In some embodiments, the memory 51 may be an internal storage unit of the electronic device 5, such as a hard disk or memory of the electronic device 5. In other embodiments, the memory 51 may be an external storage device of the electronic device 5, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the electronic device 5. Furthermore, the memory 51 may include both internal and external storage units of the electronic device 5. The memory 51 is used to store the operating system, applications, bootloader, data, and other programs, such as the program code of the computer program. The memory 51 can also be used to temporarily store data that has been output or will be output.

[0112] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0113] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0114] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, can implement the steps in the above-described method embodiments.

[0115] This application provides a computer program product that, when run on an electronic device, enables the electronic device to implement the steps described in the various method embodiments above.

[0116] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0117] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0118] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0119] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0120] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0121] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for measuring alarm delay time based on a dual-system approach, characterized in that, include: Acquire multiple video data streams, where each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source; For each of the video data streams, when the first system performs algorithmic processing on each original video frame in the video data, if the original video frame generates alarm information, the alarm information is transmitted to the second system, and the alarm information is superimposed on the original video frame to obtain an alarm video frame, thereby obtaining the alarm video file corresponding to the video data. When the second system performs surround view stitching on the original video frames of the video data from each channel, if the alarm information is received, an alarm icon is rendered on the target video frame according to the alarm information to obtain a surround view alarm video frame, thereby obtaining a surround view alarm video file. The target video frame is the original video frame that is in the surround view stitching process when the alarm information is received. The alarm video file and the surround-view alarm video file are compared frame by frame to determine the target surround-view alarm video frame corresponding to each alarm video frame. The target surround-view alarm video frame is a video frame in the surround-view alarm video file that has a target alarm icon corresponding to the alarm information of the alarm video frame. The alarm delay time is determined based on the difference between the timestamp of each alarm video frame and the timestamp of the corresponding target surround alarm video frame.

2. The method according to claim 1, characterized in that: The distance between the alarm coordinates of the alarm video frame and the coordinates of the corresponding target alarm icon is less than a preset distance; the alarm level of the alarm video frame is the same as the level of the corresponding target alarm icon; the alarm type of the alarm video frame is the same as the type of the corresponding target alarm icon; and the alarm information includes the alarm coordinates, the alarm level, and the alarm type.

3. The method according to claim 2, characterized in that, The background environment and the category of the subject of interest differ in each of the video data streams. The categories of the subject of interest include people, vehicles, and objects.

4. The method according to any one of claims 1 to 3, characterized in that, When the format of the video data is different from the format of the data received by the first system and the second system, after acquiring the multiple video data, the process further includes: The format of the multiple video data streams is converted to obtain the converted video data streams.

5. An alarm delay time measurement system based on a dual-system approach, characterized in that, include: The system comprises a video processing module, a first system, a second system, and a comparison module. The video processing module is used to acquire multiple video data streams. Each original video frame in each video data stream carries a timestamp, and the timestamps of each video data stream are based on the same clock source. The first system is used to process each original video frame in the video data according to the algorithm for each video data channel. If the original video frame generates alarm information, the alarm information is transmitted to the second system and the alarm information is superimposed on the original video frame to obtain an alarm video frame, so as to obtain the alarm video file corresponding to the video data. The second system is used to render an alarm icon on a target video frame according to the alarm information when the original video frames of the video data from each channel are stitched together in a surround view, thereby obtaining a surround view alarm video frame and a surround view alarm video file. The target video frame is the original video frame that is in the surround view stitching process when the alarm information is received. The comparison module is used to compare the alarm video file and the surround-view alarm video file frame by frame to determine the target surround-view alarm video frame corresponding to each alarm video frame. The target surround-view alarm video frame is a video frame in the surround-view alarm video file that has a target alarm icon corresponding to the alarm information of the alarm video frame. It is also used to determine the alarm delay time based on the difference between the timestamp of each of the alarm video frames and the timestamp of the corresponding target surround alarm video frame.

6. The system according to claim 5, characterized in that, When the format of the video data is different from the format of the data received by the first system and the second system, the video processing module includes multiple video channel units and signal conversion units; The video channel unit is used to acquire one channel of video data; The signal conversion unit is used to convert the format of the multiple video data streams to obtain the converted video data streams.

7. The system according to claim 5 or 6, characterized in that, The first system includes an algorithm module and a first recording module; The algorithm module is used to process each original video frame in the video data for each channel of the video data. If the original video frame generates alarm information, the alarm information is transmitted to the second system and the alarm information is superimposed on the original video frame to obtain an alarm video frame, so as to obtain the alarm video file corresponding to the video data. The first recording module is used to encode the original video frames and the alarm video frames in each of the alarm video files, and obtain and store the encoded alarm video files.

8. The system according to claim 7, characterized in that, The second system includes a surround view splicing module and a second recording module; The surround view stitching module is used to render an alarm icon on the target video frame according to the alarm information when the original video frames of each video data are stitched together in a surround view, so as to obtain a surround view alarm video frame and thus obtain a surround view alarm video file. The second recording module is used to encode the surround alarm video frames and surround video frames in the surround alarm video file, obtain and store the encoded surround alarm video file, wherein the surround video frames are video frames generated by surround stitching of the video data from each channel and without rendering the alarm icon.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method as described in any one of claims 1 to 4.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 4.

Images