Communication method, electronic device and storage medium of video monitoring terminal
By using signaling protocol between the management platform and the video surveillance terminal to obtain internal status information and determine the communication interface, and sending algorithm model files, the problem of low communication management efficiency between different management platforms and video surveillance terminals is solved, and efficient Communication management.
Patent Information
- Application Number
- CN202411115293.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-08-14
AI Technical Summary
Communication management between different management platforms and different video surveillance terminals is inefficient, and the existing technology has failed to effectively solve this problem.
By using a preset signaling protocol between the management platform and the video surveillance terminal to obtain internal status information, determine the communication protocol interface, and send algorithm model files through the interface to realize communication, improving communication management efficiency.
It improves the communication management efficiency between different management platforms and different video surveillance terminals, simplifies the development process, and reduces the development cycle and cost.
Smart Images

Figure CN118646739B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of information technology, and in particular to a communication method, an electronic device and a storage medium of a video surveillance terminal. Background Art
[0002] Entering the intelligent era, video surveillance terminals will move from "seeing clearly" to "seeing deeply", "understanding", and "foreseeing" in a multi-dimensional intelligent perception perspective. However, due to the application limitations of traditional smart cameras caused by the binding of software and hardware, when the current point algorithm requirements change, they can only be solved by upgrading the hardware, which has high construction costs and long construction cycles. Therefore, more and more camera manufacturers choose to decouple algorithms from camera hardware, and flexibly load algorithms, control algorithm models, configure analysis tasks, and uniformly receive analysis results through remote management. At the same time, when the hardware computing power of the video surveillance terminal is sufficient, the continuous online iteration and autonomous learning of the camera front-end algorithm can achieve a one-time hardware investment and sustainable algorithm growth throughout the life cycle.
[0003] At present, the communication management of video surveillance terminals mainly focuses on the camera's OS framework, service interface, interface message body format, algorithm image encapsulation format, etc., and has made strict definitions and standards. For manufacturers who want to develop video surveillance terminals based on standards, such solutions need to modify their own system architecture, middleware, communication mode, etc. to adapt to the private service interface of such solutions, which makes development difficult; for platform callers, the management interface of such solutions needs to be developed based on private protocols, and the development work is difficult to have inheritance, and the development cycle is long. Therefore, the efficiency of communication management between different management platforms and different video surveillance terminals is low.
[0004] With regard to the problem of low efficiency of communication management between different management platforms and different video surveillance terminals in the related art, no effective solution has been proposed yet. Summary of the invention
[0005] In this embodiment, a communication method, an electronic device and a storage medium of a video surveillance terminal are provided to solve the problem of low efficiency of communication management between different management platforms and different video surveillance terminals in the related art.
[0006] In a first aspect, a communication method of a video surveillance terminal is provided in this embodiment, which is applied to a management platform, and the method includes:
[0007] According to a preset signaling protocol, obtaining internal state information of a video surveillance terminal; the video surveillance terminal supports the preset signaling protocol;
[0008] Determining a communication protocol interface for communicating with the video surveillance terminal according to the internal state information of the video surveillance terminal;
[0009] According to the communication protocol interface, an algorithm model file is sent to the video surveillance terminal to communicate with the video surveillance terminal.
[0010] In some of the embodiments, obtaining the internal state information of the video surveillance terminal according to a preset signaling protocol includes:
[0011] Initiating an internal status query request to the video surveillance terminal according to the interface of the preset signaling protocol;
[0012] Receive internal status information sent by the video surveillance terminal, where the internal status information includes computing resources and algorithm status within the video surveillance terminal.
[0013] In some embodiments, determining a communication protocol interface for communicating with the video surveillance terminal according to the internal state information of the video surveillance terminal includes:
[0014] According to the internal state information of the video surveillance terminal, performing resource evaluation on the video surveillance terminal to obtain a resource evaluation result;
[0015] The communication protocol interface is determined according to the resource evaluation result.
[0016] In some embodiments, sending the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal includes:
[0017] Receiving a first algorithm scheduling request initiated by the video surveillance terminal, and in response to the first algorithm scheduling request, acquiring a download address of a first algorithm model file in the first algorithm scheduling request; the algorithm model file includes the first algorithm model file;
[0018] Sending the first algorithm model file to the video surveillance terminal through the interface of the signaling protocol and according to the download address of the first algorithm model file;
[0019] Receive a download result notification of the first algorithm model file sent by the video surveillance terminal.
[0020] In some embodiments, after receiving the download result notification of the first algorithm model file sent by the video surveillance terminal, the method further includes:
[0021] receiving a second algorithm scheduling request initiated by the video surveillance terminal, and in response to the second algorithm scheduling request, obtaining a download address of a second algorithm model file in the second algorithm scheduling request; the algorithm model file includes the second algorithm model file;
[0022] Sending the first algorithm model file to the video surveillance terminal through the interface of the signaling protocol and according to the download address of the second algorithm model file;
[0023] Receive a download result notification of the second algorithm model file sent by the video surveillance terminal.
[0024] In some embodiments, the method further comprises:
[0025] The second algorithm model file is obtained according to the internal state information of the video surveillance terminal.
[0026] In some embodiments, the sending of the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal further includes:
[0027] Sending algorithm control instructions to the video surveillance terminal according to the interface of the signaling protocol;
[0028] In response to an algorithm loading completion signal of the video surveillance terminal, an algorithm loading result of the video surveillance terminal is obtained.
[0029] In a second aspect, a communication method is provided in this embodiment, which is applied to a management platform and a video surveillance terminal, wherein both the management platform and the video surveillance terminal support a preset signaling protocol; the method comprises:
[0030] The management platform initiates a status information query request to the video surveillance terminal according to the preset signaling protocol;
[0031] The video monitoring terminal sends internal status information to the management platform in response to the received status information query request;
[0032] The management platform determines the communication protocol interface for communicating with the video surveillance terminal according to the received internal state information of the video surveillance terminal, and sends the algorithm model file to the video surveillance terminal through the communication protocol interface;
[0033] The video monitoring terminal receives the algorithm model file sent by the management platform, downloads the algorithm model file, and communicates with the management platform.
[0034] In a third aspect, an electronic device is provided in this embodiment, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the communication method of the video surveillance terminal described in the first aspect above is implemented.
[0035] In a fourth aspect, in this embodiment, a storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the communication method of the video surveillance terminal described in the first aspect is implemented.
[0036] Compared with the related art, in this embodiment, a communication method, electronic device and storage medium of a video surveillance terminal are provided. The management platform obtains the internal status information of the video surveillance terminal through the signaling protocol supported by the video surveillance terminal, and determines the communication protocol interface for communication between the management platform and the video surveillance terminal according to the internal status information. Through the communication protocol interface, an algorithm model file is sent to the video surveillance terminal to communicate with the video surveillance terminal, thereby improving the communication management efficiency between different management platforms and different video surveillance terminals.
[0037] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0039] Figure 1 It is a hardware structure block diagram of a terminal of the communication method of the video monitoring terminal provided in an embodiment of the present application;
[0040] Figure 2 is a flow chart of a communication method of a video surveillance terminal provided in an embodiment of the present application;
[0041] Figure 3 is a flow chart of a communication method provided by an embodiment of the present application;
[0042] Figure 4 It is a schematic diagram of a device of a terminal definition algorithm implemented based on the SIP protocol in this specific embodiment;
[0043] Figure 5 It is a timing diagram of the terminal definition algorithm model method implemented based on the SIP protocol in this specific embodiment;
[0044] Figure 6 It is a structural block diagram of the communication device of the video monitoring terminal of this embodiment. DETAILED DESCRIPTION
[0045] In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments.
[0046] Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the general meaning understood by people with general skills in the technical field to which this application belongs. The words "one", "a", "the", "these" and the like in this application do not indicate a quantitative limitation, and they may be singular or plural. The terms "include", "comprise", "have" and any variants thereof involved in this application are intended to cover non-exclusive inclusions; for example, a process, method and system, product or device comprising a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in this application refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three relationships, for example, "A and / or B" may mean: A exists alone, A and B exist at the same time, and B exists alone. Generally, the character " / " indicates that the objects associated with each other are in an "or" relationship. The terms "first", "second", "third", etc. in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.
[0047] The method embodiment provided in this embodiment can be executed in a terminal, a computer or a similar computing device. For example, running on a terminal, Figure 1 1 is a hardware structure block diagram of a terminal of the communication method of the video monitoring terminal provided in the embodiment of the present application. Figure 1 As shown, the terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 and a memory 104 for storing data, wherein the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA. The above terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown.
[0048] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the communication method of the video surveillance terminal in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0049] The transmission device 106 is used to receive or send data via a network. The above network includes a wireless network provided by the communication provider of the terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.
[0050] Traditional smart cameras have application limitations due to the binding of software and hardware. When the current point algorithm requirements change, they can only be solved by upgrading the hardware, which has high construction costs and long construction cycles. Therefore, more and more camera manufacturers have launched their own software-defined camera solutions, decoupling the algorithm from the camera hardware, and flexibly loading the algorithm, controlling the algorithm model, configuring the analysis task, and uniformly receiving the analysis results through remote management. Currently, the representative solutions include the SDC solution and the Super Brain solution. Both solutions use private protocols for processing, but cannot adapt to the communication between different platforms and different terminal devices.
[0051] In this embodiment, a communication method for a video surveillance terminal is provided, and a service call framework is defined based on the SIP (Session Initiation Protocol) protocol architecture to realize platform remote algorithm loading and authorization, algorithm model control, algorithm task configuration, and analysis result reporting. Through the standardized service framework, on the one hand, on the basis of satisfying the complete decoupling of the algorithm and the camera device, the adaptation work of the platform caller is greatly simplified. On the other hand, since most current camera products support the national standard protocol implemented based on the SIP protocol architecture, they have good continuity and stability during the transformation process. The video surveillance terminal is a device for receiving, displaying and controlling the real-time or recorded video captured by the camera in the video surveillance system. These terminals can be dedicated hardware devices, such as a monitor combined with a control keyboard, or software applications running on a computer, tablet computer or smart phone, which are not specifically limited here. Figure 2 is a flow chart of a communication method of a video surveillance terminal provided in an embodiment of the present application, such as Figure 2 As shown, the process includes steps S210 to S230.
[0052] Step S210, obtaining internal state information of the video surveillance terminal according to a preset signaling protocol; the video surveillance terminal supports the preset signaling protocol.
[0053] Furthermore, according to the interface of the preset signaling protocol, an internal status query request is initiated to the video surveillance terminal; and internal status information sent by the video surveillance terminal is received, the internal status information including computing resources and algorithm status within the video surveillance terminal.
[0054] Among them, the management platform accesses the video surveillance terminal that supports the preset signaling protocol according to the preset signaling protocol, and obtains the internal status information of the video surveillance terminal; exemplarily, the internal status information includes computing power resources and algorithm status, specifically including device information, computing power resources, computing power status, algorithm loading status and algorithm running status.
[0055] Step S220: determining a communication protocol interface for communicating with the video surveillance terminal according to the internal state information of the video surveillance terminal.
[0056] Among them, the management platform provides a communication protocol interface based on the internal status information of the video surveillance terminal to facilitate communication with the video surveillance terminal. The communication protocol interface here can be customized according to the internal status information of the video surveillance terminal, and can be an algorithm loading interface, an algorithm model file control interface, an algorithm model control interface, an algorithm application task configuration interface, etc. In actual applications, the communication protocol interface is determined according to specific communication requirements.
[0057] Step S230: sending the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal.
[0058] Among them, the management platform sends the algorithm model file to the video surveillance terminal according to the determined communication protocol interface, so that the video surveillance terminal can download the algorithm model file, and the management platform can control the algorithm in the video surveillance terminal through the communication protocol interface.
[0059] Through the above steps, the management platform obtains the internal status information of the video surveillance terminal through the signaling protocol supported by the video surveillance terminal, and determines the communication protocol interface for communication between the management platform and the video surveillance terminal based on the internal status information. Through the communication protocol interface, the algorithm model file is sent to the video surveillance terminal to communicate with the video surveillance terminal. The communication protocol interface is determined through the internal status information of different video surveillance terminals, thereby improving the communication management efficiency between different management platforms and different video surveillance terminals.
[0060] In some of the embodiments, in step S220, a communication protocol interface for communicating with the video surveillance terminal is determined based on the internal status information of the video surveillance terminal, including: performing a resource evaluation on the video surveillance terminal based on the internal status information of the video surveillance terminal to obtain a resource evaluation result; and determining the communication protocol interface based on the resource evaluation result.
[0061] Among them, the management platform conducts resource evaluation on the video surveillance terminal according to the internal status information of the video surveillance terminal. Specifically, the resource evaluation includes authority identification and resource evaluation of the video surveillance terminal, that is, judging whether the video surveillance terminal has the authority to download relevant algorithms, whether the video surveillance terminal provides communication authority, whether similar algorithms are running in the video surveillance terminal, the remaining software resources and the hardware status of the video surveillance terminal, etc. Then, according to the resource evaluation results, the functions supported by the video surveillance terminal and the management platform for communication are determined, and the communication protocol interface is defined through the supported functions.
[0062] In some of the embodiments, in step S230, an algorithm model file is sent to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal, including steps S231 to S233.
[0063] Step S231, receiving a first algorithm scheduling request initiated by a video surveillance terminal, and in response to the first algorithm scheduling request, obtaining a download address of a first algorithm model file in the first algorithm scheduling request; the algorithm model file includes a first algorithm model file.
[0064] Among them, the management platform implements operations such as downloading or deleting the algorithm model file of the video surveillance terminal through the communication protocol interface. Specifically, the management platform sends an instruction of the first algorithm model file carrying the download address to the terminal device, and the terminal device initiates a first algorithm scheduling request according to the download address of the first algorithm model file; when the management platform receives the first algorithm scheduling request initiated by the video surveillance terminal, the management platform responds to the first algorithm scheduling request and obtains the download address of the first algorithm model file.
[0065] Step S232: sending the first algorithm model file to the video surveillance terminal through the interface of the signaling protocol and according to the download address of the first algorithm model file.
[0066] The management platform sends the algorithm package of the first algorithm model file to the video monitoring terminal through the interface of the signaling protocol and according to the download address of the first algorithm model file, so that the video monitoring terminal can download the first algorithm model file.
[0067] Step S233: receiving a download result notification of the first algorithm model file sent by the video surveillance terminal.
[0068] Furthermore, after receiving the download result notification of the first algorithm model file sent by the video surveillance terminal, it also includes: receiving a second algorithm scheduling request initiated by the video surveillance terminal, and obtaining the download address of the second algorithm model file in the second algorithm scheduling request in response to the second algorithm scheduling request; the algorithm model file includes the second algorithm model file; sending the first algorithm model file to the video surveillance terminal through the interface of the signaling protocol and according to the download address of the second algorithm model file; receiving the download result notification of the second algorithm model file sent by the video surveillance terminal.
[0069] Among them, when the video surveillance terminal completes downloading the first algorithm model file, the management platform sends the instruction of the second algorithm model file carrying the download address to the terminal device, and the terminal device initiates a second algorithm scheduling request according to the download address of the second algorithm model file; when the management platform receives the second algorithm scheduling request initiated by the video surveillance terminal, the management platform responds to the second algorithm scheduling request and obtains the download address of the first algorithm model file. And according to the download address of the second algorithm model file, the algorithm package of the second algorithm model file is sent to the video surveillance terminal, so that the video surveillance terminal can download the second algorithm model file. Specifically, the algorithm model file includes an algorithm package and an algorithm authorization file, etc.
[0070] Through the above steps, according to the algorithm scheduling request of the video surveillance terminal, the management platform sends the algorithm model file to the video surveillance terminal through the interface of the signaling protocol, which is conducive to sending the algorithm model file according to the actual resource situation of the video surveillance terminal, and is conducive to improving the communication efficiency between different management platforms and different video surveillance terminals.
[0071] In some of the embodiments, the management platform may also obtain the second algorithm model file according to the internal state information of the video surveillance terminal.
[0072] Among them, when the algorithm model file needs to apply for authorization from the algorithm manufacturer in real time, the management platform needs to query the internal status information of the video surveillance terminal, and then apply to the algorithm manufacturer for the algorithm model file based on the internal factory status information of the video surveillance terminal. Specifically, the internal factory status information includes the serial code information and chip information of the video surveillance terminal, which is not specifically limited here.
[0073] In some of the embodiments, the method for communicating between the management platform and the video surveillance terminal also includes: sending algorithm control instructions to the video surveillance terminal according to the interface of the signaling protocol; and obtaining the algorithm loading result of the video surveillance terminal in response to the algorithm loading completion signal of the video surveillance terminal.
[0074] When the video surveillance terminal obtains the algorithm model file and downloads it, it will send an algorithm loading completion signal to the management platform. The algorithm loading completion signal carries the algorithm loading result of the video surveillance terminal. When the management platform obtains the algorithm loading result, it controls the algorithm in the video surveillance terminal through the communication protocol interface.
[0075] This embodiment also provides a communication method. Figure 3 is a flow chart of a communication method provided in an embodiment of the present application, such as Figure 3 As shown, the process is applied to a management platform and a video surveillance terminal that both support a preset signaling protocol, and includes the following steps:
[0076] Step S310: The management platform initiates a status information query request to the video surveillance terminal according to a preset signaling protocol.
[0077] Step S320: the video monitoring terminal sends internal status information to the management platform in response to the received status information query request.
[0078] Step S330: The management platform determines the communication protocol interface for communicating with the video surveillance terminal according to the received internal status information of the video surveillance terminal, and sends the algorithm model file to the video surveillance terminal through the communication protocol interface.
[0079] Step S340: the video monitoring terminal receives the algorithm model file sent by the management platform, downloads the algorithm model file, and communicates with the management platform.
[0080] Through the above steps, the management platform initiates a status information query request to the video surveillance terminal through the signaling protocol supported by the video surveillance terminal; after receiving the status information query request, the video surveillance terminal sends the internal status information to the management platform. Afterwards, the management platform obtains the internal status information of the video surveillance terminal, and determines the communication protocol interface for the management platform to communicate with the video surveillance terminal based on the internal status information. Through the communication protocol interface, the algorithm model file is sent to the video surveillance terminal to communicate with the video surveillance terminal. In this embodiment, the management platform obtains the internal status information of different video surveillance terminals to determine the communication protocol interface, thereby improving the communication management efficiency between different management platforms and different video surveillance terminals.
[0081] The present embodiment is described and illustrated by means of specific examples below.
[0082] Figure 4 Schematic diagram of the device of the terminal definition algorithm implemented based on the SIP protocol in this specific embodiment. Figure 4 , including an algorithm platform 1 and a terminal device 2, wherein the algorithm platform 1 includes an algorithm scheduling module 11, an analysis module 12 and a SIP access module 13. In this embodiment, the terminal device 2 is specifically a video surveillance terminal. The algorithm scheduling module 11 is connected to the analysis module 12, the SIP access module 13 and the terminal device 2 respectively.
[0083] Figure 5 This is a timing diagram of the terminal definition algorithm model method implemented based on the SIP protocol in this specific embodiment. Figure 5 Before loading the algorithm on the terminal device, it is first necessary to query the internal status of the terminal before loading the terminal algorithm, that is, to query the terminal device information, terminal device computing resources, terminal device computing status, terminal device algorithm loading status, and terminal device algorithm running status through the command scheduling SIP access module interface. Exemplarily, the command here includes a Restful command, the interface of the SIP access module here is the interface of the signaling protocol in the aforementioned embodiment, and the SIP protocol is the preset signaling protocol in the aforementioned embodiment.
[0084] Afterwards, the SIP access module queries the terminal device information through SIP signaling; the SIP access module queries the terminal device computing resources through SIP signaling; the SIP access module queries the terminal device computing status through SIP signaling; the SIP access module queries the terminal device algorithm loading status through SIP signaling; the SIP access module queries the terminal device algorithm running status through SIP signaling. The SIP access module returns the internal status of the algorithm scheduling module before the terminal algorithm is loaded through the Restful interface, so that the algorithm scheduling platform can realize the authentication and resource evaluation before the algorithm is issued.
[0085] With the loading of the algorithm package and the authorization file, the loading of the algorithm model can be started remotely. The algorithm scheduling platform can realize the download or deletion of the algorithm package / algorithm authorization file inside the terminal device through a customized protocol interface. The terminal device should not retain invalid files that fail to download. If the algorithm model corresponding to the specified algorithm model file / algorithm model authorization file is being enabled, it should not be deleted. If the file needs to be deleted, the model needs to be stopped and then deleted. If the file name of the downloaded algorithm model file / algorithm model authorization file has the same name as the file downloaded in the device, an overwrite operation should be implemented. If the algorithm corresponding to this file is being enabled, it should not be overwritten. If the size of the downloaded algorithm model file / algorithm model authorization file exceeds the remaining space of the current device, the control response command should indicate that the operation failed. Exemplarily, the customized protocol interface here is the communication protocol interface in the aforementioned embodiment.
[0086] refer to Figure 5 , the specific process of algorithm package loading is as follows: the algorithm scheduling module schedules the interface of the SIP access platform through the Restful command to control the download of the algorithm package. At this time, the corresponding algorithm package has been managed in the analysis module. The analysis module here can be an AI analysis module, or any logic module that performs algorithm analysis and implements algorithm loading. The SIP access module sends the control (download) of the algorithm package of the terminal device through SIP signaling. The SIP signaling will contain the download address. The terminal device initiates the HTTPS POST command according to the download address and sends the command to the AI analysis module. The AI analysis module sends the algorithm package file to the terminal device through the HTTPS POST command response. After that, after the SIP access module sends the control (download) of the terminal algorithm package, the download status can be controlled at any time through the algorithm package download status query command. When the terminal device completes the download of the algorithm package, the terminal device reports the download result of the algorithm package to the SIP access module through the SIP notification signaling. The SIP access platform notifies the algorithm scheduling module through the Restful interface that the terminal device has completed the download of the algorithm package.
[0087] The specific process of downloading the algorithm authorization file is as follows: If the algorithm authorization file is to apply for authorization from the algorithm manufacturer in real time, the algorithm scheduling module will apply for the required algorithm authorization file from the algorithm manufacturer according to the terminal's serial code information and chip information after querying the internal status of the terminal device. The algorithm scheduling module uploads the algorithm authorization file to the AI analysis module through the Restful command. If the algorithm authorization file has been managed in the AI analysis module, this step is omitted. Afterwards, after the AI analysis module responds to the algorithm authorization upload command of the algorithm scheduling module, the algorithm scheduling module schedules the interface of the SIP access module through the Restful command to control the download of the algorithm authorization file. The SIP access module sends the download control of the algorithm authorization file of the terminal device through SIP signaling. The SIP signaling contains the download address. The terminal device initiates an HTTPS POST command to the AI analysis module based on the download address. The AI analysis module sends the algorithm authorization file to the terminal device through the HTTPS POST command response. When the terminal device completes the download of the algorithm authorization file, it reports the download result of the algorithm authorization file to the SIP access module through the SIP notification signaling. The SIP access module notifies the algorithm scheduling module through the Restful interface to complete the download of the algorithm authorization file.
[0088] The steps to enable the algorithm model are as follows: Figure 5 As shown, the algorithm scheduling module schedules the interface of the SIP access module through the Restful command to enable the algorithm module control; the SIP access module sends the control to enable the algorithm module through the SIP signaling. Afterwards, the terminal device loads the algorithm model. When the terminal device completes the loading of the algorithm model, it reports the algorithm model upgrade result to the SIP access module through the SIP notification signaling. The SIP access module notifies the algorithm scheduling module through the Restful interface to complete the algorithm model upgrade.
[0089] The algorithm scheduling module can enable and disable the algorithm model inside the terminal device through a customized protocol interface. If the terminal encounters an abnormal operation during the algorithm operation, the abnormal situation can be reported to the algorithm scheduling module through a customized protocol interface. In addition, the terminal device reports the results of the algorithm analysis and the alarm event to the client through the HTTPS protocol in a unified format for page display. The algorithm scheduling module can also retrieve the algorithm operation status log information of the terminal device through control or subscription, and upload it to the AI analysis module for caching. The maximum upper limit of the log file should be appropriately set. If the collected information exceeds the corresponding capacity, it should be implemented in a cyclic overwrite manner. The collected information should support the collection of abnormal information in an interrupt triggering manner, and should also support the collection of operation information in a cyclic triggering manner. The log file log information should at least contain the event timestamp, event type, and event description. The terminal manufacturer has the ability to parse the corresponding log and locate the problem of abnormal algorithm operation through the corresponding information. The subscription of the subscription command only supports all subscriptions and all unsubscriptions, and does not support subscription and unsubscription for a certain subscription rule. The reported log should merge all information of subscribing to multiple rules into a unified log file and report it regularly at the specified time interval.
[0090] Compared with the prior art, the main advantage of this embodiment is that the current terminal algorithm model management and control solutions in the industry are all based on non-standard protocols and are strongly bound to the management platform. If other platforms are connected, the workload of platform modification is large. According to the characteristics of the SIP protocol architecture, this embodiment proposes a set of comprehensive management and control frameworks, which cover algorithm model loading and authorization, algorithm model control, analysis task configuration, analysis result reporting, and abnormal situation reporting. It has good feasibility. At the same time, because it is implemented based on the labeled SIP protocol architecture, the national standard camera does not need to reconstruct the original national standard architecture in the implementation of the service interface, but only needs to supplement some calling framework interfaces. At the same time, this application can be widely used in a variety of intelligent terminal devices based on the national standard protocol, including: snapshot cameras, structured analysis cameras, smart NVRs, smart boxes, etc.
[0091] It should be noted that the steps shown in the above process or the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0092] In this embodiment, a communication device of a video surveillance terminal is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. The terms "module", "unit", "subunit" and the like used below can implement a combination of software and / or hardware of predetermined functions. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.
[0093] Figure 6 : is a structural block diagram of the communication device of the video monitoring terminal of this embodiment, such as Figure 6 As shown, the device includes: an acquisition module 10 and a processing module 20.
[0094] The acquisition module 10 is used to acquire the internal state information of the video surveillance terminal according to a preset signaling protocol; the video surveillance terminal supports the preset signaling protocol.
[0095] The processing module 20 is used to determine the communication protocol interface for communicating with the video surveillance terminal according to the internal state information of the video surveillance terminal; and is also used to send the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal.
[0096] It should be noted that the above modules can be functional modules or program modules, and can be implemented by software or hardware. For modules implemented by hardware, the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.
[0097] In this embodiment, an electronic device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.
[0098] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.
[0099] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:
[0100] S1, obtaining internal state information of the video surveillance terminal according to a preset signaling protocol; the video surveillance terminal supports the preset signaling protocol.
[0101] S2: Determine a communication protocol interface for communicating with the video surveillance terminal according to the internal state information of the video surveillance terminal.
[0102] S3, sending the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal.
[0103] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementation modes, and will not be repeated in this embodiment.
[0104] In addition, in combination with the communication method of the video surveillance terminal provided in the above embodiments, a storage medium may be provided in this embodiment to implement the communication method. The storage medium stores a computer program, and when the computer program is executed by the processor, any one of the communication methods of the video surveillance terminal in the above embodiments is implemented.
[0105] It should be understood that the specific embodiments described herein are only used to explain the application, rather than to limit it. Based on the embodiments provided in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the protection scope of this application.
[0106] Obviously, the drawings are only some examples or embodiments of the present application. For ordinary technicians in the field, the present application can also be applied to other similar situations based on these drawings without creative work. In addition, it is understandable that although the work done in this development process may be complicated and lengthy, for ordinary technicians in the field, certain changes in design, manufacturing or production based on the technical content disclosed in this application are only conventional technical means and should not be regarded as insufficient content disclosed in this application.
[0107] The term "embodiment" in this application refers to a specific feature, structure or characteristic described in conjunction with the embodiment that can be included in at least one embodiment of the present application. The appearance of this phrase in various locations in the specification does not necessarily mean the same embodiment, nor does it mean that it is mutually exclusive with other embodiments and is independent or optional. It is clearly or implicitly understood by those of ordinary skill in the art that the embodiments described in this application can be combined with other embodiments without conflict.
[0108] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of patent protection. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the scope of protection of the present application. Therefore, the scope of protection of the present application shall be subject to the attached claims.
Claims
1. A communication method for a video surveillance terminal, characterized in that: Applied to a management platform, the method includes: According to a preset signaling protocol, internal state information of the video surveillance terminal is obtained; the video surveillance terminal supports the preset signaling protocol; the preset signaling protocol includes the SIP protocol; Determining a communication protocol interface for communicating with the video surveillance terminal according to internal state information of the video surveillance terminal; the internal state information includes computing resources and algorithm state within the video surveillance terminal; According to the communication protocol interface, an algorithm model file is sent to the video surveillance terminal to communicate with the video surveillance terminal.
2. The communication method of the video surveillance terminal according to claim 1, characterized in that: The step of obtaining the internal status information of the video surveillance terminal according to the preset signaling protocol includes: Initiating an internal status query request to the video surveillance terminal according to the interface of the preset signaling protocol; Receive internal status information sent by the video surveillance terminal.
3. The communication method of the video surveillance terminal according to claim 1, characterized in that: The step of determining a communication protocol interface for communicating with the video surveillance terminal according to the internal state information of the video surveillance terminal comprises: According to the internal state information of the video surveillance terminal, performing resource evaluation on the video surveillance terminal to obtain a resource evaluation result; The communication protocol interface is determined according to the resource evaluation result.
4. The communication method of the video surveillance terminal according to claim 1, characterized in that: The sending of the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal includes: Receiving a first algorithm scheduling request initiated by the video surveillance terminal, and in response to the first algorithm scheduling request, acquiring a download address of a first algorithm model file in the first algorithm scheduling request; the algorithm model file includes the first algorithm model file; Sending the first algorithm model file to the video surveillance terminal through the interface of the signaling protocol and according to the download address of the first algorithm model file; Receive a download result notification of the first algorithm model file sent by the video surveillance terminal.
5. The communication method of the video surveillance terminal according to claim 4, characterized in that: After receiving the download result notification of the first algorithm model file sent by the video surveillance terminal, the method further includes: receiving a second algorithm scheduling request initiated by the video surveillance terminal, and in response to the second algorithm scheduling request, obtaining a download address of a second algorithm model file in the second algorithm scheduling request; the algorithm model file includes the second algorithm model file; Sending the second algorithm model file to the video surveillance terminal through the interface of the signaling protocol and according to the download address of the second algorithm model file; Receive a download result notification of the second algorithm model file sent by the video surveillance terminal.
6. The communication method of the video surveillance terminal according to claim 5, characterized in that: The method further comprises: The second algorithm model file is obtained according to the internal state information of the video surveillance terminal.
7. The communication method of the video surveillance terminal according to claim 5, characterized in that: The sending of the algorithm model file to the video surveillance terminal according to the communication protocol interface to communicate with the video surveillance terminal also includes: Sending algorithm control instructions to the video surveillance terminal according to the interface of the signaling protocol; In response to an algorithm loading completion signal of the video surveillance terminal, an algorithm loading result of the video surveillance terminal is obtained.
8. A communication method, characterized in that: Applied to a management platform and a video surveillance terminal, both of which support a preset signaling protocol; the method includes: The management platform initiates a status information query request to the video surveillance terminal according to the preset signaling protocol; the preset signaling protocol includes the SIP protocol; The video monitoring terminal sends internal status information to the management platform in response to the received status information query request; the internal status information includes computing resources and algorithm status within the video monitoring terminal; The management platform determines the communication protocol interface for communicating with the video surveillance terminal according to the received internal state information of the video surveillance terminal, and sends the algorithm model file to the video surveillance terminal through the communication protocol interface; The video monitoring terminal receives the algorithm model file sent by the management platform, downloads the algorithm model file, and communicates with the management platform.
9. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to execute the communication method of the video surveillance terminal according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the communication method of the video surveillance terminal according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Edge smart terminal equipment with video AI analysis and 5G communication functions
CN111131794A
Internet of Things video data processing system, intelligent retail system, method and device
CN113329205A
GB28181-based target tracking system
CN113596396A
AI algorithm computing power resource calling method and system of AI camera and AI camera
CN117156202A
Intelligent video monitoring method and system based on AI algorithm and 5G message
CN117615098A
