Video linkage method, system and device based on large video and storage medium

Abstract

The invention relates to a video linkage method and system based on a large video and a storage medium, and the method comprises the steps: receiving the real-time data of a control subsystem, analyzing the control data corresponding to the control subsystem according to the real-time data, and if the control data meets a video linkage requirement, carrying out the video linkage according to the position of the control subsystem. And calling a video linkage interface, and calling the video data of the position of the control subsystem from the large video monitoring system. According to the method, real-time data of the control subsystem can be received, data linkage with the control subsystem is achieved, then the video point of the position where the control subsystem is located is called from the large video monitoring system, a channel with the large video monitoring system is opened, linkage control among multiple systems is achieved, the interaction efficiency is improved, and the interaction effect is good. And the emergency response capability can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer vision technology, and in particular to a video linkage method, system, device and storage medium based on big video. Background Art

[0002] In current smart buildings, there are barriers to data exchange between different control subsystems.

[0003] In order to improve the emergency response capability of smart buildings, a monitoring center is currently set up to monitor smart buildings. However, this method relies heavily on manual work, and the data between control subsystems cannot be communicated. There is still room for improvement in improving emergency response capabilities. Summary of the invention

[0004] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.

[0005] The main purpose of the embodiments of the present disclosure is to propose a video linkage method, system, device and storage medium based on big video, which can.

[0006] A first aspect of an embodiment of the present application provides a video linkage method based on big video, the method comprising:

[0007] Receive real-time data from control subsystems;

[0008] Analyze the control data corresponding to the control subsystem according to the real-time data;

[0009] If the control data meets the video linkage requirements, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system;

[0010] The corresponding video data is called out from the video point.

[0011] This application proposes a video linkage method based on big video, which has at least the following beneficial effects:

[0012] This embodiment includes receiving real-time data of the control subsystem, parsing the control data corresponding to the control subsystem according to the real-time data, and if the control data meets the video linkage requirements, calling the video linkage interface according to the location of the control subsystem, and calling the video data of the location of the control subsystem from the large video monitoring system. This embodiment can receive real-time data of the control subsystem, realize data linkage with the control subsystem, and then call the video point of the location of the control subsystem from the large video monitoring system, opening up the channel with the large video monitoring system. This embodiment realizes the linkage control between multiple systems, provides interaction efficiency, and can improve emergency response capabilities.

[0013] In some embodiments, if the control data meets the video linkage requirement, before calling the video linkage interface according to the location of the control subsystem and calling the video point of the location of the control subsystem from the large video monitoring system, the method includes:

[0014] Call the association relationship table between the video points and the control subsystem;

[0015] If the control data meets the video linkage requirement, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system, including:

[0016] If the video point corresponding to the control subsystem exists in the association table, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system.

[0017] In some embodiments, before receiving the real-time data of the control subsystem, the method includes:

[0018] Registering a video linkage control service with the large video monitoring system;

[0019] The calling of the video point of the location of the control subsystem includes:

[0020] According to the interface of the video linkage control service, the video point of the location of the control subsystem is called.

[0021] In some embodiments, after calling out corresponding video data from the video point, the method includes:

[0022] Performing target recognition and tracking on the video data based on a target tracking algorithm to obtain recognition and tracking results;

[0023] If the results of identification and tracking trigger the first alarm threshold, an audible and visual alarm signal is issued in the video data.

[0024] In some embodiments, after calling out the corresponding video data from the video point, the method includes:

[0025] Calling out audio data corresponding to the video data from the video point;

[0026] The audio data is played.

[0027] In some embodiments, after playing the audio data, the method further includes:

[0028] Recognize a speech result from the speech data based on a speech recognition algorithm;

[0029] The speech result is semantically analyzed to obtain a semantic analysis result. If the semantic analysis result triggers a second alarm threshold, an audible and visual alarm signal is issued in the video data.

[0030] In some embodiments, the control subsystem includes at least one of a customer service center system, a security inspection system, a floor system, and a fire protection system.

[0031] A second aspect of the embodiment of the present application proposes a video linkage system based on big video, the system comprising:

[0032] A data receiving module, used for receiving real-time data of the control subsystem;

[0033] A data analysis module, used for analyzing the real-time data to obtain control data corresponding to the control subsystem;

[0034] A video point confirmation module is used to call the video linkage interface according to the location of the control subsystem if the control data meets the video linkage requirements, and call the video point of the location of the control subsystem from the large video monitoring system;

[0035] The data calling module is used to call out the corresponding video data from the video point.

[0036] A third aspect of an embodiment of the present application proposes an electronic device, comprising at least one controller and a memory for communicating with the controller; the memory stores instructions that can be executed by the at least one controller, and the instructions are executed by the at least one controller so that the at least one controller executes the video linkage method based on large video as described above.

[0037] A fourth aspect of an embodiment of the present application proposes a computer-readable storage medium, on which a computer program is stored. When the computer program is executed, the video linkage method based on big video as described above is implemented.

[0038] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0040] Figure 1 is a schematic diagram of a video linkage method based on big video provided in an embodiment of the present application;

[0041] Figure 2 is a schematic diagram of a large video monitoring system provided in an embodiment of the present application;

[0042] Figure 3 is a schematic diagram of a video linkage system based on big video provided in an embodiment of the present application;

[0043] Figure 4 It is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0046] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0047] like Figure 1 The embodiment of the present application proposes a video linkage method based on big video, and the method comprises the following steps:

[0048] Step S110, receiving real-time data of the control subsystem;

[0049] Step S120, parsing the control data corresponding to the control subsystem according to the real-time data;

[0050] Step S130, if the control data meets the video linkage requirements, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system;

[0051] Step S140, calling out corresponding video data from the video point.

[0052] In some embodiments, the control subsystem includes, but is not limited to: a customer service center system, a security system, a floor system, and a fire protection system.

[0053] The security inspection system refers to a system that conducts security checks on people entering smart buildings, such as access control devices, face recognition devices, and security inspection machines.

[0054] The floor system refers to the control system corresponding to each floor including the stairwell, such as the system consisting of lighting, sound, air conditioning control and fire hydrants.

[0055] The customer service center system refers to the central system that provides communication services for customer service, such as customer service communication devices.

[0056] In step S110, real-time data of the control subsystem may be received, for example, real-time data recognized by a face recognition device in a security inspection system may be collected.

[0057] In some embodiments, real-time data of one control subsystem may be received at one time, or real-time data of multiple control subsystems may be received, and different real-time data may be processed in multiple threads.

[0058] In step S120, control data corresponding to the control subsystem is parsed according to the real-time data, for example, corresponding control data such as face recognition results are detected from real-time data recognized by a face recognition device.

[0059] In step S130, when the control data meets the video linkage requirements, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system.

[0060] like Figure 2 First, let's introduce the big video monitoring system, which includes:

[0061] Video service provider, video service platform, and video service request node:

[0062] The video service provider provides video data of multiple video points. The video service platform is used for the registration, request and termination of the video service request node. If the request node is successfully registered, the video service platform will feedback to the video service provider, and the video service provider and the request node will be associated. The video service request node can be a different computer device or a server. The request node directly requests the video server provider to call the corresponding video point.

[0063] In some implementations, before step S130, the following steps are included:

[0064] Step S210, calling the association relationship table between the video points and the control subsystems.

[0065] Step S130, if the control data meets the video linkage requirements, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system, including:

[0066] Step S1310, if there is a video point corresponding to the control subsystem in the association relationship table, then according to the location of the control subsystem, the video linkage interface is called to call the video point of the location of the control subsystem from the large video monitoring system.

[0067] In step S210, the association table is pre-set with the corresponding relationship between the video points and the control subsystem. For example, if the control subsystem is a floor system, the association table records the video points arranged at various locations on the floor.

[0068] The association relationship table is generated by the video service platform and stored internally by the requesting node.

[0069] It can also be generated by the requesting node itself.

[0070] In some implementations, before receiving the real-time data of the control subsystem in step S110, the method includes:

[0071] Step S310, registering the video linkage control service with the big video monitoring system;

[0072] The calling of the video point of the location of the control subsystem in step S130 includes:

[0073] Step S410: Call the video point at the location of the control subsystem according to the interface of the video linkage control service.

[0074] In some embodiments, the requesting node can register with the video service platform in the large video monitoring system. After registration, it can establish a connection with the video service provider, and then call the video point at the location of the control subsystem from the interface of the video service provider; it should be noted that the registration process is only required once. After registration, the requesting node is recorded in the video service platform and the video service provider. When the call is requested again, the relevant permissions for the corresponding video point in the request are given to the requesting node according to the record.

[0075] In step S140, after the corresponding video point is obtained, the corresponding video data can be directly obtained from the video point.

[0076] In some embodiments, after calling corresponding video data from the video point in step S140, the method includes:

[0077] Step S510, performing target recognition and tracking on the video data based on a target tracking algorithm to obtain recognition and tracking results;

[0078] Step S520: If the result of identification and tracking triggers the first alarm threshold, an audible and visual alarm signal is issued in the video data.

[0079] In this embodiment, the main process of target tracking (assuming that a dangerous person appears in the smart building) includes:

[0080] (1) First, extract images from video data and segment faces from backgrounds using color features (target segmentation);

[0081] (2) The segmented image may contain not only faces, but also some objects in the environment that are yellowish in color. In this case, all faces in the image can be accurately found through certain shape features to determine their position and range (target detection);

[0082] (3) Next, all faces in the image (database networking) need to be compared with the facial features of the target object (i.e., dangerous person) to find the best match, thereby determining the target object (target identification);

[0083] (4) In each subsequent frame, there is no need to detect the target object in the entire image like the first frame. Instead, a motion model can be established based on the motion trajectory of the target object. The position of the target object in the next frame can be predicted through the model, thereby improving the tracking efficiency (target tracking).

[0084] Target tracking algorithms include but are not limited to: TLD algorithm, target tracking algorithm based on motion behavior analysis, target tracking algorithm under visual navigation based on detection and tracking, and tracking based on active contours. Due to the large number of algorithms, we will not list them all here.

[0085] In some embodiments, after calling corresponding video data from the video point in step S140, the method includes:

[0086] Step S610, calling out audio data corresponding to the video data from the video point;

[0087] Step S620: playing the audio data.

[0088] Corresponding playback of audio data can provide more information to managers.

[0089] In some embodiments, after playing the audio data in step S620, the method further includes:

[0090] Step S710, identifying a speech result from the speech data based on a speech recognition algorithm;

[0091] Step S720, semantic analysis is performed on the speech result to obtain a semantic analysis result. If the semantic analysis result triggers a second alarm threshold, an audible and visual alarm signal is issued in the video data.

[0092] In some embodiments, the speech recognition algorithm mainly includes three aspects: feature extraction technology, pattern matching criteria and model training technology. In the feature extraction stage, the algorithm extracts speech-related features such as pitch, timbre and syllables from the input audio signal. Pattern matching compares these features with the pre-trained model to identify specific speech content or commands.

[0093] In some embodiments, the semantic analysis algorithm includes, but is not limited to, a deep learning model and semantic analysis technology in natural language processing. Since the deep learning model and semantic analysis technology in natural language processing are both existing technologies, they will not be described in detail here.

[0094] The video linkage method based on big video provided in this embodiment has at least the following beneficial effects:

[0095] This embodiment can receive real-time data from the control subsystem, realize data linkage with the control subsystem, and then call the video point of the location of the control subsystem from the large video monitoring system, opening up the channel with the large video monitoring system. This embodiment realizes the linkage control between multiple systems, provides interaction efficiency, and can improve emergency response capabilities.

[0096] Reference Figure 3 One embodiment of the present application provides a video linkage system based on big video, the system comprising:

[0097] The data receiving module 1100 is used to receive real-time data of the control subsystem;

[0098] The data analysis module 1200 is used to analyze the control data corresponding to the control subsystem according to the real-time data;

[0099] The video point confirmation module 1300 is used to call the video linkage interface according to the location of the control subsystem if the control data meets the video linkage requirements, and call the video point of the location of the control subsystem from the large video monitoring system;

[0100] The data calling module 1400 is used to call out corresponding video data from a video point.

[0101] It should be noted that the present embodiment of the video linkage system based on big video and the above-mentioned embodiment of the video linkage method based on big video are based on the same inventive concept, so the relevant contents of the above-mentioned embodiment of the video linkage method based on big video are also applicable to the present embodiment of the video linkage system based on big video, and will not be described in detail here.

[0102] The video linkage system based on big video provided in this embodiment has at least the following beneficial effects:

[0103] This embodiment can receive real-time data from the control subsystem, realize data linkage with the control subsystem, and then call the video point of the location of the control subsystem from the large video monitoring system, opening up the channel with the large video monitoring system. This embodiment realizes the linkage control between multiple systems, provides interaction efficiency, and can improve emergency response capabilities.

[0104] Reference Figure 4 The embodiment of the present application further provides an electronic device, the electronic device comprising:

[0105] at least one memory;

[0106] at least one processor;

[0107] at least one program;

[0108] The program is stored in the memory, and the processor executes at least one program to implement the above-mentioned video linkage method based on big video in the present disclosure.

[0109] The electronic device may be any intelligent terminal including a mobile phone, a tablet computer, a personal digital assistant (PDA), a vehicle-mounted computer, etc.

[0110] The electronic device according to the embodiment of the present application is described in detail below.

[0111] The processor 1600 may be implemented by a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0112] The memory 1700 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1700 can store an operating system and other applications. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the program code is stored in the memory 1700, and the processor 1600 calls and executes the video linkage method based on large video in the embodiment of the present application.

[0113] Input / output interface 1800, used to implement information input and output;

[0114] The communication interface 1900 is used to realize the communication interaction between the device and other devices. The communication can be realized through a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.);

[0115] Bus 2000 , which transmits information between various components of the device (e.g., processor 1600 , memory 1700 , input / output interface 1800 , and communication interface 1900 );

[0116] The processor 1600 , the memory 1700 , the input / output interface 1800 , and the communication interface 1900 are connected to each other in communication within the device via the bus 2000 .

[0117] An embodiment of the present application also provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to execute the above-mentioned video linkage method based on large video.

[0118] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0119] The embodiments described in this application are intended to more clearly illustrate the technical solutions of the embodiments of this application and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0120] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0121] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0122] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0123] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0124] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0125] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0126] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0127] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0128] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable an electronic device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store programs.

[0129] The above is a specific description of the preferred implementation of the embodiments of the present application, but the embodiments of the present application are not limited to the above-mentioned implementation methods. Technical personnel familiar with the field can also make various equivalent modifications or substitutions without violating the spirit of the embodiments of the present application. These equivalent modifications or substitutions are all included in the scope defined by the claims of the embodiments of the present application.

Claims

1. A video linkage method based on big video, characterized in that: The method comprises: Receive real-time data from control subsystems; Parsing the control data corresponding to the control subsystem according to the real-time data; If the control data meets the video linkage requirements, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system; The corresponding video data is called out from the video point.

2. The video linkage method based on big video according to claim 1, characterized in that: If the control data meets the video linkage requirement, before calling the video linkage interface according to the location of the control subsystem and calling the video point of the location of the control subsystem from the large video monitoring system, the method includes: Call the association relationship table between the video points and the control subsystem; If the control data meets the video linkage requirement, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system, including: If the video point corresponding to the control subsystem exists in the association table, the video linkage interface is called according to the location of the control subsystem, and the video point of the location of the control subsystem is called from the large video monitoring system.

3. The video linkage method based on big video according to claim 1, characterized in that: Before receiving the real-time data of the control subsystem, the method includes: Registering a video linkage control service with the large video monitoring system; The calling of the video point of the location of the control subsystem includes: According to the interface of the video linkage control service, the video point of the location of the control subsystem is called.

4. The video linkage method based on big video according to claim 3 is characterized in that: After calling out the corresponding video data from the video point, the method includes: Performing target recognition and tracking on the video data based on a target tracking algorithm to obtain recognition and tracking results; If the results of identification and tracking trigger the first alarm threshold, an audible and visual alarm signal is issued in the video data.

5. The video linkage method based on big video according to claim 4 is characterized in that: After calling out the corresponding video data from the video point, the method includes: Calling out audio data corresponding to the video data from the video point; The audio data is played.

6. The video linkage method based on big video according to claim 5, characterized in that: After playing the audio data, the method further includes: Recognizing a speech result from the speech data based on a speech recognition algorithm; The speech result is semantically analyzed to obtain a semantic analysis result. If the semantic analysis result triggers a second alarm threshold, an audible and visual alarm signal is issued in the video data.

7. The video linkage method based on big video according to claim 1, characterized in that: The control subsystem includes: at least one of a customer service center system, a security inspection system, a floor system and a fire protection system.

8. A video linkage system based on big video, characterized in that: The system comprises: A data receiving module, used for receiving real-time data of the control subsystem; A data analysis module, used for analyzing the real-time data to obtain control data corresponding to the control subsystem; A video point confirmation module is used to call the video linkage interface according to the location of the control subsystem if the control data meets the video linkage requirements, and call the video point of the location of the control subsystem from the large video monitoring system; The data calling module is used to call out the corresponding video data from the video point.

9. An electronic device, characterized in that: It includes at least one controller and a memory for communicating with the controller; the memory stores instructions that can be executed by the at least one controller, and the instructions are executed by at least one of the controllers to enable at least one of the controllers to execute the video linkage method based on big video as described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to execute the video linkage method based on big video as described in any one of claims 1 to 7.

Images