Unified processing system control method based on video equipment

Abstract

The invention provides a unified processing system control method based on video equipment. The system is provided with a video equipment ledger module, a video equipment control module, a voice recognition module and a WEB front-end display module. The control method comprises the following steps: identifying a manufacturer of the equipment when the standing book of the video equipment is recorded; corresponding parameter bodies are assembled in the video equipment control module according to different identifiers and respective interface requirements of manufacturers, so that an equipment control function is realized; keywords in the voice are analyzed in the voice recognition module, and then instruction contents in the keywords are assembled into a parameter body, so that control of the voice on equipment is realized; receiving real-time video stream data in the WEB front-end display module for displaying a current picture; when new equipment manufacturers are added in the later period, adjustment is only needed in the video equipment control module, other parts do not need to be adjusted, a strategy mode is adopted, request parameters of different manufacturers are distinguished, and the same system is compatible with the equipment operation functions of various different manufacturers.

Description

Technical Field

[0001] The present invention relates to the technical field of monitoring video equipment processing, in particular to a unified processing system control method based on video equipment. Background Art

[0002] In the current video surveillance market, the industry competition is fierce and the companies with large market share have originally developed surveillance equipment that is deeply engaged in specific business scenarios. Their interfaces and transmission parameters are different. As a result, when connecting video equipment from different manufacturers, special adaptation is required for different equipment. This is not conducive to the construction needs of the market, especially for some new and old reconstruction projects or equipment replacement projects. It is difficult to develop and maintain equipment systems. It is necessary to adapt to different manufacturers and make a system that is compatible with different manufacturers. It is very difficult and there are great technical barriers in providing unified external calls. In existing solutions, it is usually implemented through enterprise standards or unified upstream and downstream interfaces, but the implementation of many scenarios requires multi-step calls to achieve design requirements. However, there is no clear requirement standard for the implementation details, which will lead to differences in the implementation or parameter naming of major manufacturers, making other manufacturers lack versatility and flexibility when using similar products, and increasing the cost of development and maintenance. For this reason, the applicant has designed a unified processing system control method based on video equipment according to market demand, which can solve the problem of inconsistent interfaces and transmission parameters of equipment from different manufacturers, and provide a convenient solution for the construction and maintenance of monitoring systems compatible with equipment from different manufacturers. Summary of the invention

[0003] In order to solve the above technical problems, the present invention proposes a unified processing system control method based on video equipment, which identifies the manufacturer of the equipment when entering the video equipment ledger; assembles corresponding parameter bodies in the video equipment control module according to different identifications and the interface requirements of the manufacturers to realize the equipment control function; analyzes the keywords in the voice in the voice recognition module, and then assembles the instruction content into the parameter body to realize voice control of the equipment; receives real-time video stream data in the WEB front-end display module to display the current picture; when adding new equipment manufacturers at a later stage, only adjustments need to be made in the video equipment control module, and other parts do not need to be adjusted. The strategy mode is adopted to distinguish the request parameters of different manufacturers, so as to realize the compatibility of equipment operation functions of multiple different manufacturers in the same system.

[0004] To achieve the above object, the technical solution adopted by the present invention is:

[0005] The control method of a unified processing system based on video equipment is characterized in that: the unified processing system based on video equipment is provided with a video equipment account module, a video equipment control module, a voice recognition module and a WEB front-end display module, specifically:

[0006] Video equipment ledger module: used to record the basic data of NVR and camera, and add manufacturer logo on NVR;

[0007] Video device control module: used to formulate device control instructions and provide an interface for third-party calls;

[0008] Speech recognition module: used to analyze the voice recorded by the microphone to see whether it contains keywords such as the direction and angle of the camera, and then add the keywords to the instructions in the control module to control the direction of the video device. The speech recognition module uses acoustic modeling to model and recognize speech signals.

[0009] WEB front-end display module: pushes the real-time video stream to the front-end for video display;

[0010] The control method of the unified processing system based on video equipment is as follows: when entering the video equipment ledger, the manufacturer of the equipment is identified; in the video equipment control module, the corresponding parameter body is assembled according to different identifications and the respective interface requirements of the manufacturers to realize the equipment control function; in the voice recognition module, the keywords in the voice are analyzed, and then the instruction content therein is assembled into the parameter body to realize the voice control of the equipment; in the WEB front-end display module, real-time video stream data is received to display the current picture; when adding new equipment manufacturers at a later stage, only adjustments need to be made in the video equipment control module, and no adjustments need to be made to other parts. The strategy mode is adopted to distinguish the request parameters of different manufacturers, so as to realize the compatibility of equipment operation functions of multiple different manufacturers in the same system.

[0011] Furthermore, the specific steps of the operation process of the control method of the unified processing system based on the video device are as follows:

[0012] Step 1: The user fills in the record of the video equipment and identifies the manufacturer of the equipment;

[0013] Step 2: Control the camera on the operation interface. The camera sends the correct request and data according to the requirements of the corresponding manufacturer to realize the control of the video device;

[0014] Step 3: When the user controls the video device, the identification field in the ledger is used to splice the data into data that meets the manufacturer's requirements according to the parameter requirements of the manufacturer identified;

[0015] Step 4: According to the real-time results of the operation, the video stream is pushed to the WEB front end to display the real-time picture.

[0016] Furthermore, the workflow steps of the speech recognition module in the unified processing system and control method based on video devices are specifically as follows:

[0017] Step 1: The user fills in the record of the video equipment and identifies the manufacturer of the equipment;

[0018] Step 2: The microphone of the voice recognition module receives the audio content, converts the audio into command text, and splices the text into the requested command to realize the control of the video device;

[0019] Step 3: Under the control of the video device, push the video stream to the WEB front end to display the real-time picture.

[0020] Furthermore, the model update of the speech recognition module in the unified processing system and control method based on the video device is divided into an E step and an M step, specifically:

[0021] Step E:

[0022] Used to calculate the forward probability and backward probability at each moment, and calculate the state probability at each moment based on the observation sequence and the current model parameters;

[0023] Compute the forward probability using the current model parameters:

[0024] [\alpha_t(i)=P(O_1,O_2,\ldots,O_t,q_t=S_i|\lambda)]

[0025] Compute the backward probability using the current model parameters:

[0026] [\beta_t(i)=P(O_{t+1},O_{t+2},\ldots,O_T|q_t=S_i,\lambda)]

[0027] Use the forward probability and backward probability to calculate the probability of each state at each moment:

[0028] [\gamma_t(i)=P(q_t=S_i|O,\lambda)]

[0029] Calculate the probability of transitioning to the next state at each moment:

[0030] [\xi_t(i,j)=P(q_t=S_i,q_{t+1}=S_j|O,\lambda)]

[0031] M-step:

[0032] Used to update model parameters based on the calculated probability of each state at each moment;

[0033] According to the calculated probability of each state at each moment, update the state transfer matrix:

[0034] [a_{ij}=\frac{\sum_{t=1}^{T-1}\xi_t(i,j)}{\sum_{t=1}^{T-1}\gamma_t(i)}] Update the observation probability matrix according to the calculated probability of each state at each moment:

[0035] [b_j(k)=\frac{\sum_{t=1,O_t=v_k}^T\gamma_t(j)}{\sum_{t=1}^T\gamma_t(j)}] Update the initial state probability vector according to the calculated probability of each state at each moment:

[0036] [\pi_i=\gamma_1(i)]

[0037] Where: \lambda: represents model parameters, such as state transition probability matrix, observation probability matrix and initial state probability vector;

[0038] O: represents the observation sequence;

[0039] q_t=S_i:represents being in state S_i at time t;

[0040] The E and M steps are repeated until the model parameters converge or the stopping criteria are met.

[0041] The benefits of this application are:

[0042] 1. The unified processing system and control method based on video equipment can be compatible with video surveillance equipment from different manufacturers;

[0043] 2. The unified processing system and control method based on video equipment is conducive to the development and maintenance of monitoring equipment systems;

[0044] 3. Unified processing system and control method based on video equipment The speech recognition module combines recurrent neural network and long short-term memory network, and has high recognition accuracy;

[0045] 4. The unified processing system and control method based on video equipment are modularly set up to facilitate use and maintenance. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 It is a schematic diagram of the overall component connection and data flow of the present invention;

[0047] Figure 2 This is a schematic diagram of unified control of video equipment of the present invention;

[0048] Figure 3 This is a schematic diagram of the speech recognition process of the present invention;

[0049] Figure 4A schematic diagram of the code of the strategy mode of video control of the present invention;

[0050] Figure 5 A schematic diagram of a code for speech recognition of the present invention;

[0051] Figure 6 A schematic diagram of the technical data of the NVR and the camera recorded in the present invention;

[0052] Figure 7 This is a schematic diagram of the control and display of the Dahua camera in the present invention.

[0053] Figure 8 The figure is a schematic diagram of the control and display screenshot of the sea camera according to the present invention. DETAILED DESCRIPTION

[0054] The present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments:

[0055] like Figure 1-3 As shown, a unified processing system control method based on video equipment is shown, and the unified processing system based on video equipment is provided with a video equipment account module, a video equipment control module, a voice recognition module and a WEB front-end display module, specifically:

[0056] Video equipment ledger module: used to record the basic data of NVR and camera, and add manufacturer logo on NVR;

[0057] Video device control module: used to formulate device control instructions and provide an interface for third-party calls; the video control module is encapsulated for different manufacturers' operation controls, and then uses the fields in the ledger as identifiers and abstract strategy references to enable different objects to dynamically select different strategies, thereby achieving the correct operation process;

[0058] Speech recognition module: used to analyze the voice recorded by the microphone to see whether it contains keywords such as the direction and angle of the camera, and then add the keywords to the instructions in the control module to control the direction of the video device. The speech recognition module uses acoustic modeling to model and recognize speech signals. It combines recurrent neural networks and long short-term memory networks to post-process the speech recognition results with a language model to improve recognition accuracy. The model update is divided into E steps and M steps, specifically:

[0059] Step E:

[0060] Used to calculate the forward probability and backward probability at each moment, and calculate the state probability at each moment based on the observation sequence and the current model parameters;

[0061] Compute the forward probability using the current model parameters:

[0062] [\alpha_t(i)=P(O_1,O_2,\ldots,O_t,q_t=S_i|\lambda)]

[0063] Compute the backward probability using the current model parameters:

[0064] [\beta_t(i)=P(O_{t+1},O_{t+2},\ldots,O_T|q_t=S_i,\lambda)]

[0065] Use the forward probability and backward probability to calculate the probability of each state at each moment:

[0066] [\gamma_t(i)=P(q_t=S_i|O,\lambda)]

[0067] Calculate the probability of transitioning to the next state at each moment:

[0068] [\xi_t(i,j)=P(q_t=S_i,q_{t+1}=S_j|O,\lambda)]

[0069] M-step:

[0070] Used to update model parameters based on the calculated probability of each state at each moment;

[0071] According to the calculated probability of each state at each moment, update the state transfer matrix:

[0072] [a_{ij}=\frac{\sum_{t=1}^{T-1}\xi_t(i,j)}{\sum_{t=1}^{T-1}\gamma_t(i)}] Update the observation probability matrix according to the calculated probability of each state at each moment:

[0073] [b_j(k)=\frac{\sum_{t=1,O_t=v_k}^T\gamma_t(j)}{\sum_{t=1}^T\gamma_t(j)}] Update the initial state probability vector according to the calculated probability of each state at each moment:

[0074] [\pi_i=\gamma_1(i)]

[0075] Where: \lambda: represents model parameters, such as state transition probability matrix, observation probability matrix and initial state probability vector;

[0076] O: represents the observation sequence;

[0077] q_t=S_i:represents being in state S_i at time t;

[0078] Repeat the E and M steps until the model parameters converge or the stopping criteria are met; Figure 5 Shown is a partial code diagram for speech recognition;

[0079] WEB front-end display module: pushes the real-time video stream to the front-end for video display;

[0080] The control method of the unified processing system based on video equipment shown in the figure is to identify the manufacturer of the equipment when entering the video equipment ledger; assemble the corresponding parameter body in the video equipment control module according to different identifications and the interface requirements of the manufacturers to realize the equipment control function; analyze the keywords in the voice in the voice recognition module, and then assemble the command content into the parameter body to realize the voice control of the equipment; receive real-time video stream data in the WEB front-end display module to display the current picture; when adding new equipment manufacturers later, only the video equipment control module needs to be adjusted, and other parts do not need to be adjusted. The strategy mode is adopted, such as Figure 4 The code diagram of the strategy mode is shown to distinguish the request parameters of different manufacturers, so as to achieve compatibility with the equipment running functions of multiple different manufacturers in the same system.

[0081] The specific steps of the operation flow of the control method of the unified processing system based on the video device are as follows:

[0082] Step 1: The user fills in the video equipment record and identifies the manufacturer of the equipment; Figure 6 As shown;

[0083] Step 2: Control the camera on the operation interface. The camera sends the correct request and data according to the requirements of the corresponding manufacturer to realize the control of the video device; Figure 7 , Figure 8 As shown;

[0084] Step 3: When the user controls the video device, the identification field in the ledger is used to splice the data into data that meets the manufacturer's requirements according to the parameter requirements of the identified manufacturer; Figure 2 As shown;

[0085] Step 4: According to the real-time results of the operation, the video stream is pushed to the WEB front end to display the real-time picture.

[0086] The workflow steps of the speech recognition module in the unified processing system and control method based on the video device are as follows:

[0087] Step 1: The user fills in the record of the video equipment and identifies the manufacturer of the equipment;

[0088] Step 2: The microphone of the voice recognition module receives the audio content, converts the audio into command text, and splices the text into the requested command to realize the control of the video device; Figure 3 As shown;

[0089] Step 3: Under the control of the video device, push the video stream to the WEB front end to display the real-time picture.

[0090] The above description is only a preferred embodiment of the present invention and does not constitute any other form of limitation to the present invention. Any modification or equivalent change made based on the technical essence of the present invention still falls within the scope of protection required by the present invention.

Claims

1. A unified processing system control method based on video equipment, characterized in that: The unified processing system based on video devices is provided with a video device account module, a video device control module, a voice recognition module and a WEB front-end display module, specifically: a video device account module: used to record the basic data of the NVR and the camera, and add the manufacturer's logo on the NVR; Video device control module: used to formulate device control instructions and provide an interface for third-party calls; Speech recognition module: used to analyze the voice recorded by the microphone to see whether it contains keywords such as the direction and angle of the camera, and then add the keywords to the instructions in the control module to control the direction of the video device. The speech recognition module uses acoustic modeling to model and recognize speech signals. WEB front-end display module: pushes the real-time video stream to the front-end for video display; The control method of the unified processing system based on video equipment is as follows: when entering the video equipment ledger, the manufacturer of the equipment is identified; in the video equipment control module, the corresponding parameter body is assembled according to different identifications and the respective interface requirements of the manufacturers to realize the equipment control function; in the voice recognition module, the keywords in the voice are analyzed, and then the instruction content therein is assembled into the parameter body to realize the voice control of the equipment; in the WEB front-end display module, real-time video stream data is received to display the current picture; when adding new equipment manufacturers at a later stage, only adjustments need to be made in the video equipment control module, and no adjustments need to be made to other parts. The strategy mode is adopted to distinguish the request parameters of different manufacturers, so as to realize the compatibility of equipment operation functions of multiple different manufacturers in the same system.

2. The unified processing system control method based on video equipment according to claim 1, characterized in that: The specific steps of the operation process of the control method of the unified processing system based on video equipment are as follows: Step 1: The user fills in the record of the video equipment and identifies the manufacturer of the equipment; Step 2: Control the camera on the operation interface. The camera sends the correct request and data according to the requirements of the corresponding manufacturer to realize the control of the video device; Step 3: When the user controls the video device, the identification field in the ledger is used to splice the data into data that meets the manufacturer's requirements according to the parameter requirements of the manufacturer identified; Step 4: According to the real-time results of the operation, the video stream is pushed to the WEB front end to display the real-time picture.

3. The unified processing system control method based on video equipment according to claim 1, characterized in that: The workflow steps of the speech recognition module in the unified processing system and control method based on video equipment are specifically as follows: Step 1: The user fills in the record of the video equipment and identifies the manufacturer of the equipment; Step 2: The microphone of the voice recognition module receives the audio content, converts the audio into command text, and splices the text into the requested command to realize the control of the video device; Step 3: Under the control of the video device, push the video stream to the WEB front end to display the real-time picture.

4. The unified processing system control method based on video equipment according to claim 1, characterized in that: The model update of the speech recognition module in the unified processing system and control method based on video equipment is divided into E step and M step, specifically: E step: Used to calculate the forward probability and backward probability at each moment, and calculate the state probability at each moment based on the observation sequence and the current model parameters; Compute the forward probability using the current model parameters: [\alpha_t(i)=P(O_1,O_2,\ldots,O_t,q_t=S_i|\lambda)] Compute the backward probability using the current model parameters: [\beta_t(i)=P(O_{t+1},O_{t+2},\ldots,O_T|q_t=S_i,\lambda)] Use the forward probability and backward probability to calculate the probability of each state at each moment: [\gamma_t(i)=P(q_t=S_i|O,\lambda)] Calculate the probability of transitioning to the next state at each moment: [\xi_t(i,j)=P(q_t=S_i,q_{t+1}=S_j|O,\lambda)] M-step: Used to update model parameters based on the calculated probability of each state at each moment; According to the calculated probability of each state at each moment, update the state transfer matrix: [a_{ij}=\frac{\sum_{t=1}^{T-1}\xi_t(i,j)}{\sum_{t=1}^{T-1}\gamma_t(i)}] Update the observation probability matrix according to the calculated probability of each state at each moment: [b_j(k)=\frac{\sum_{t=1,O_t=v_k}^T\gamma_t(j)}{\sum_{t=1}^T\gamma_t(j)}] Update the initial state probability vector according to the calculated probability of each state at each moment: [\pi_i=\gamma_1(i)] Where: \lambda: represents model parameters, such as state transition probability matrix, observation probability matrix and initial state probability vector; O: represents observation sequence; q_t=S_i:represents being in state S_i at time t; The E and M steps are repeated until the model parameters converge or the stopping criteria are met.

Images