Non-national standard cascading method, system and computer program product

Abstract

The invention provides a non-national standard cascading method and system and a computer program product, and the method comprises the steps: building national standard cascading between a first system and a second system based on the information of the second system to be cascaded; identifying the type of the equipment in the first system, creating a national standard code for the non-national standard equipment in response to the type of the equipment in the first system being the non-national standard equipment, and identifying the national standard code of the national standard equipment in response to the type of the equipment in the first system being the national standard equipment; wherein the equipment corresponds to the national standard code; distributing a channel for the equipment in the first system, wherein the channel corresponds to the national standard code; and in response to an access instruction received by the first system from the second system to the channel, pushing a data stream of the channel from the first system to the second system. Through the method, non-national standard equipment can be cascaded into the system, and the reliability, the flexibility and the expandability of the system are improved.

Description

Technical Field

[0001] The present specification relates to the field of network communication technology, and in particular to a non-national standard cascading method, system and computer program product. Background Art

[0002] In order to make firefighting, disaster relief and rescue work more complete and safer, the MESH network can be used to communicate with the fire scene through video and voice to ensure the orderly and safe conduct of firefighting work, prevent the personal safety of firefighters from being threatened and excessive fire losses. The visual dispatch system is mainly used for the management and use of MESH equipment, and uses the real-time voice and video functions provided by the platform to command front-line firefighting and rescue work. The main functions of the visual dispatch system are: video preview and voice control of national standard cameras and individual soldiers. The visual dispatch system also has a cascading function, which synchronizes the equipment on the current dispatch system to the upper-level dispatch system, making it convenient for the upper-level unit to uniformly manage and dispatch subordinate units.

[0003] The existing national standard cascade configuration items are extremely complicated and only support national standard type cascades, but cannot support cascade communication of many non-national standard types of equipment. This limits the application scope of non-national standard equipment, especially the demand for the use of non-national standard equipment in special application scenarios such as firefighting and disaster relief. In addition, in special application scenarios such as firefighting and disaster relief, the quality of the communication network may be poor, and the use of national standard protocols may lead to poor communication quality between devices, thereby affecting the effective function of the visual dispatching system.

[0004] In view of the above problems, this specification provides a non-national standard cascading method, system and computer program product to improve the communication quality of the cascading system, expand the application scope of non-national standard equipment, and thus improve the system reliability, flexibility and scalability. Summary of the invention

[0005] One or more embodiments of the present specification provide a non-national standard cascading method, including: creating a national standard cascade between a first system and a second system based on information of a second system to be cascaded; identifying the type of a device in the first system, creating a national standard code for the non-national standard device in response to the type of the device in the first system being a non-national standard device, identifying the national standard code of the national standard device in response to the type of the device in the first system being a national standard device; allocating a channel to the device in the first system; and pushing the data stream of the channel from the first system to the second system in response to the first system receiving an access instruction to the channel from the second system. Wherein, the device corresponds to the national standard code, and the channel corresponds to the national standard code.

[0006] According to the method described in some embodiments of the present specification, the non-national standard cascading method also includes: maintaining the channel, including: storing the channel information in the corresponding first-level channel table according to the type of the channel, and the first-level channel table is associated with the first system; through the national standard protocol, synchronizing the channel information from the first system to the second system, and storing it in the second-level channel table, and the second-level channel table is associated with the second system.

[0007] According to the methods described in some embodiments of the present specification, the types of channels include national standard channels and non-national standard channels; the first-level channel table includes a first channel table and a second channel table; according to the type of the channel, the channel information is stored in the corresponding first-level channel table, including: in response to the type of the channel being a national standard channel, the channel information is stored in the first channel table, and in response to the type of the channel being a non-national standard channel, the channel information is stored in the second channel table.

[0008] According to the method described in some embodiments of the present specification, the non-national standard cascading method also includes: maintaining the channel, including synchronizing the status of the channel from the first system to the second system, including: for national standard equipment, receiving device status information transmitted by the national standard equipment through the national standard protocol; for non-national standard equipment, receiving device status information transmitted by the non-national standard equipment through the non-national standard protocol; according to the device status information, the first system updates the status of the channel corresponding to the device; in response to a change in the status of the channel, the first system synchronizes the status of the channel to the second system through the national standard protocol, so that the status of the channel stored in the second system is updated.

[0009] According to the method described in some embodiments of the present specification, the non-national standard cascading method also includes, before the first system receives an access instruction to the channel from the second system: the second system determines in the service interface whether there is a data stream of the accessed channel in the cache; in response to the existence of the data stream of the accessed channel in the cache, the second system obtains the data stream of the accessed channel in the cache; in response to the absence of the data stream of the accessed channel in the cache, the second system sends an access instruction to the channel to the first system through the national standard protocol.

[0010] According to the method described in some embodiments of the present specification, the data stream of a channel is pushed from a first system to a second system, including: according to the type of the accessed channel, using a protocol corresponding to the type of the channel, the first system obtains the data stream of the channel from a device corresponding to the channel; through the national standard protocol, the first system pushes the data stream of the channel to the second system.

[0011] According to the method described in some embodiments of the present specification, according to the type of the accessed channel, the first system obtains the data stream of the channel from the device corresponding to the channel using the protocol corresponding to the type of the channel, including: in response to the type of the accessed channel being a national standard channel, the operating server of the first system initiates an access instruction to the national standard device corresponding to the channel through the national standard protocol, and the media server of the first system receives the data stream transmitted by the national standard device; in response to the type of the accessed channel being a non-national standard channel, the operating server of the first system initiates an access instruction to the non-national standard device corresponding to the channel through the non-national standard protocol, and the media server of the first system receives the data stream transmitted by the non-national standard device.

[0012] According to the method described in some embodiments of the present specification, the first system pushes the data stream of the channel to the second system through the national standard protocol, including: the operating server of the first system sends a push command to the media server of the first system; in response to the push command, the media server of the first system sends the data stream to the media server of the second system.

[0013] One or more embodiments of the present specification also provide a non-national standard cascading system, including: a cascading module, used to create a national standard cascade between a first system and a second system based on information of a second system to be cascaded; a national standard code creation module, used to identify the type of equipment in the first system, create a national standard code for the non-national standard equipment in response to the type of equipment in the first system being a non-national standard equipment, and identify the national standard code of the national standard equipment in response to the type of equipment in the first system being a national standard equipment, wherein the equipment corresponds to the national standard code; a channel allocation module, used to allocate channels to equipment in the first system, and the channels correspond to the national standard codes; a streaming module, used to push the data stream of the channel from the first system to the second system in response to the first system receiving an access instruction to the channel from the second system.

[0014] One or more embodiments of the present specification also provide a computer program product, including computer instructions or a computer program, which, when at least part of the computer instructions or the computer program is executed by a processor, can implement the non-national standard cascading method in the present specification. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] This specification will be further described in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same numbers represent the same structure or operation.

[0016] Figure 1 It is a schematic diagram of an application scenario of a non-national standard cascade system shown in some embodiments of this specification.

[0017] Figure 2It is an exemplary module diagram of a non-national standard cascade system shown in some embodiments of this specification.

[0018] Figure 3 It is an exemplary flow chart of the non-national standard cascade method shown in some embodiments of this specification.

[0019] Figure 4 This is an exemplary flow chart of obtaining channel data flow according to some embodiments of this specification.

[0020] Figure 5 It is a schematic diagram of creating a non-national standard cascade according to some embodiments of this specification.

[0021] Figure 6 It is a schematic diagram of national standard channel status synchronization shown in some embodiments of this specification.

[0022] Figure 7 It is a schematic diagram of non-national standard channel status synchronization shown in some embodiments of this specification.

[0023] Figure 8 It is a schematic diagram of obtaining the data flow of the national standard channel according to some embodiments of this specification.

[0024] Fig. 9 It is a schematic diagram of obtaining the data stream of a non-national standard channel according to some embodiments of this specification. DETAILED DESCRIPTION

[0025] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0026] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0027] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0028] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0029] Figure 1 It is a schematic diagram of the application scenario of the non-national standard cascade system shown in some embodiments of this specification. In some embodiments, the non-national standard cascade system 100 can be applied to one or more fields. Exemplarily, it can be applied to the non-national standard cascade of the visual dispatching system in the fields of fire fighting, disaster relief and rescue. The non-national standard cascade system 100 can cascade non-national standard equipment into the system by implementing the method disclosed in this specification, and the non-national standard equipment communicates with the current system using the non-national standard protocol, and the current system communicates with the upper system through the national standard protocol, thereby realizing the upper system's access to the non-national standard equipment.

[0030] In some embodiments, the application scenario of the non-national standard cascade system 100 may include one or more systems (for example, the first system 110, the second system 120, etc.), one or more acquisition devices 130, etc. The first system 110 and the second system 120 may be visual dispatch systems in the fields of firefighting, disaster relief and rescue, respectively, but the scope of the system included in this specification is not limited thereto, and may also include systems applied to other fields. The first system 110 and the second system 120 may be two independent systems. The first system 110 and the second system 120 may be cascaded to form a cascade system. For example, the first system 110 may be cascaded as the parent node of the second system 120, that is, after cascading, the first system 110 is the upper system of the second system 120, and the second system 120 is the lower system of the first system 110. For another example, the second system 120 may be cascaded as the parent node of the first system 110, that is, after cascading, the second system 120 is the upper system of the first system 110, and the first system 110 is the lower system of the second system 120. Taking the visual scheduling system as an example, the first system 110 can be used as a scheduling sub-platform (system), and the second system 120 can be used as a scheduling parent platform (system) for cascading. After cascading, the upper-level system can access the data stream generated by the acquisition device in the lower-level system. This specification uses the second system 120 as the parent node of the first system 110 for cascading as an example, but the scope of this specification is not limited to this. In some embodiments, the non-national standard cascading system 100 can also include a third system ( Figure 1 (not shown), the third system may be at the same level as the first system 110 or the second system 120, or the third system may be a higher level or lower level system of the first system 110 or the second system 120. As such, this specification does not limit the number and level of the cascade systems in the non-national standard cascade system 100.

[0031] In some embodiments, each system in the non-national standard cascade system 100 (for example, the first system 110, the second system 120) may include one or more servers, for example, an operation server, a media server, etc. The operation server can control the operation of the system, communication with the acquisition device 130, etc. The media server can store, manage, and transmit the data stream collected by the acquisition device 130. The operation server can access the information and / or data stored in the media server. The server can be a single server or a server group. The server group can be centralized or distributed. The server can be local or remote. In some embodiments, the server can be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, etc., or any combination thereof. The server can be configured to perform the non-national standard cascade functions described in the specification. The server may include one or more processing devices ( Figure 1 (not shown), the processing device may include a central processing unit (CPU), an application specific integrated circuit (ASIC), an application specific instruction set processor (ASIP), a graphics processing unit (GPU), a physical processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction set computer (RISC), a microprocessor, etc., or any combination thereof.

[0032] The acquisition device 130 can collect data and generate a data stream. The acquisition device 130 may include a mobile phone, a camera, or any other signal collector. The data stream collected by the acquisition device 130 may include a picture stream, a video stream, or any other signal stream. The number of acquisition devices 130 can be one or more. The acquisition device 130 can be a national standard device or a non-national standard device (for example, a MESH device). National standard devices refer to devices that communicate with system servers using national standard protocols. Non-national standard devices refer to devices that communicate with system servers using non-national standard protocols. National standard protocols may include gb28181 protocols, etc., and non-national standard protocols may include websocket, webrtc protocols, etc. This specification does not impose any restrictions on this. Different non-national standard devices can use the same or different non-national standard protocols to communicate with the system server. Such as Figure 1 As shown, non-national standard protocol 1 and non-national standard protocol 2 may be the same or different.

[0033] The application scenarios of the non-national standard cascade system 100 may also include network ( Figure 1Not shown). The network can facilitate the exchange of information and / or data. The components in the application scenario of the non-national standard cascade system 100 can be connected in various ways. For example, the media server can be directly connected to the operation server or connected through a network. For another example, the operation server can be directly connected to the acquisition device 130 or connected through a network. For another example, the acquisition device 130 can be directly connected to the media server or connected through a network. One or more components of the non-national standard cascade system 100 (for example, the first system 110, the second system 120, the acquisition device 130) can send information and / or data to other components of the non-national standard cascade system 100 through the network. The network can be any form of wired or wireless network, or any combination thereof. As an example only, the network can include a cable network, a wired network, a fiber optic network, a telecommunications network, an internal network, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, etc. or any combination thereof. In some embodiments, the network may include one or more network access points. For example, the network may include a wired or wireless network access point, through which one or more components of the non-GB cascade system 100 may be connected to the network for communication.

[0034] The non-national standard cascade system 100 may further include a storage device ( Figure 1The storage device may store data, instructions and / or any other information. The storage device may store data obtained from the server or the acquisition device 130. The storage device may store data and / or instructions, and the processing device may execute or use the data and instructions to execute the exemplary method / system described in this specification. In some embodiments, the storage device may include a mass storage, a removable memory, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. Exemplary mass storage may include a disk, an optical disk, a solid-state disk, etc. Exemplary removable storage may include a flash drive, a floppy disk, an optical disk, a memory card, a compressed disk, a tape, etc. Exemplary volatile read-write memory may include a random access memory (RAM). Exemplary RAM may include dynamic random access memory (DRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), static random access memory (SRAM), thyristor random access memory (T-RAM), and zero capacitance random access memory (Z-RAM), etc. Exemplary ROMs may include mask read-only memory (MROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), compact disk read-only memory (CD-ROM), and digital versatile disk read-only memory, etc. In some embodiments, the storage device may be executed on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, etc., or any combination thereof.

[0035] It should be noted that the non-national standard cascade system 100 is provided only for the purpose of illustration and is not intended to limit the scope of the present application. For those of ordinary skill in the art, various changes and modifications can be made according to the description of the present application. However, these changes and modifications will not deviate from the scope of the present application.

[0036] Figure 2 2 is an exemplary module diagram of a non-national standard cascade system according to some embodiments of this specification. In some embodiments, the non-national standard cascade system 200 may include a cascade module 210, a national standard code creation module 220, a channel allocation module 230 and / or a streaming module 240. The various modules of the non-national standard cascade system 200 may be configured in a server (e.g., a server of the first system 110, a server of the second system 120). In some embodiments, the various modules of the non-national standard cascade system 200 may be configured in a terminal device (e.g., a terminal device of a visual scheduling system).

[0037] The cascade module 210 may be used to create a national standard cascade between the first system and the second system based on information of the second system to be cascaded.

[0038] The national standard code creation module 220 can be used to identify the type of equipment in the first system, and in response to the type of equipment in the first system being a non-national standard equipment, create a national standard code for the non-national standard equipment; in response to the type of equipment in the first system being a national standard equipment, identify the national standard code of the national standard equipment. The equipment corresponds to the national standard code. One equipment can correspond to one national standard code. One type of equipment can correspond to multiple national standard codes.

[0039] The channel allocation module 230 may be used to allocate channels to devices in the first system, wherein the channels correspond to national standard codes, and one channel may correspond to one national standard code.

[0040] The streaming module 240 may be configured to push the data stream of the channel from the first system to the second system in response to the first system receiving an access instruction to the channel from the second system.

[0041] For detailed description of the cascade module 210, the national standard code creation module 220, and the channel allocation module 230, please refer to Figure 3 , Figure 5 For a detailed description of the streaming module 240, please refer to Figure 4 , Figure 8 , Fig. 9 .

[0042] In some embodiments, the non-national standard cascade system 200 may further include a channel maintenance module ( Figure 2 (not shown) is used to maintain the information and / or status of the channel. For example, the channel maintenance module can store the channel information into the corresponding first-level channel table according to the type of channel, and the first-level channel table is associated with the first system; through the national standard protocol, the channel information is synchronized from the first system to the second system and stored in the second-level channel table, and the second-level channel table is associated with the second system. For another example, the channel maintenance module can synchronize the status of the channel from the first system to the second system, including: for national standard equipment, receiving the device status information transmitted by the national standard equipment through the national standard protocol; for non-national standard equipment, receiving the device status information transmitted by the non-national standard equipment through the non-national standard protocol; according to the device status information, the first system updates the status of the channel corresponding to the device; in response to the change of the channel status, the first system synchronizes the channel status to the second system through the national standard protocol, so that the channel status stored in the second system is updated. For a detailed description of the channel maintenance module, please refer to Figure 3 , Figure 5-7 .

[0043] It should be noted that the above description of the non-national standard cascade system 200 and its modules is only for the convenience of description and cannot limit the present specification to the scope of the embodiments. It is understandable that for those skilled in the art, after understanding the principle of the device, it is possible to arbitrarily combine the modules or form a sub-device to connect with other modules without deviating from this principle. In some embodiments, Figure 2 The modules disclosed in can be implemented on the same or different processing devices. In some embodiments, Figure 2 The modules disclosed in the specification may be different modules in a system, or one module may realize the functions of two or more modules. For example, each module may share a storage module, or each module may have its own storage module. Such variations are within the scope of protection of this specification.

[0044] Figure 3 It is an exemplary flow chart of the non-national standard cascading method shown in some embodiments of this specification. In some embodiments, process 300 can be executed by non-national standard cascading system 100 or non-national standard cascading system 200. For example, process 300 can be stored in a storage device in the form of a program or instruction, and when the non-national standard cascading system executes the instruction, process 300 can be implemented. The operational diagram of process 300 presented below is illustrative. In some embodiments, the process can be completed using one or more additional operations not described and / or one or more operations not discussed. In addition, Figure 3 The order in which the operations of process 300 are shown and described below is not limiting. Figure 3 As shown, process 300 may include one or more of the following steps.

[0045] Step 310 , creating a national standard cascade between the first system and the second system. Step 310 may be performed by the cascade module 210 .

[0046] In some embodiments, a national standard cascade between the first system and the second system can be created based on the information of the second system to be cascaded. The information of the second system may include the service national standard code, service national standard domain, service IP, service port, equipment national standard number, etc. of the second system. In some embodiments, a national standard cascade between the first system and the second system can also be created based on cascade-related parameters. Cascade-related parameters may include registration cycle, heartbeat cycle, signaling transmission method, etc. By creating a national standard cascade between the first system and the second system, SIP (Session Initiation Protocol) protocol communication can be established between the first system and the second system, and the second system becomes the upper-level system of the first system.

[0047] Step 320 , identifying the type of the device in the first system. Step 320 may be performed by the national standard code creation module 220 .

[0048] The device in the first system may be a collection device 130. The types of collection devices may include national standard devices and non-national standard devices. Furthermore, non-national standard devices may be further divided according to the type of their communication protocols, for example, non-national standard devices using the websocket protocol and non-national standard devices using the webrtc protocol. When the collection device 130 is connected to the first system, the server of the first system may automatically identify the type of the collection device 130. The type of the collection device 130 may be displayed in the user interaction interface of the first system for the user to view.

[0049] Step 330 , in response to the type of the device in the first system being a national standard device, identifying the national standard code of the national standard device. Step 330 may be performed by the national standard code creation module 220 .

[0050] Each device has a code. For a national standard device, its code is a national standard code. If the type of the device in the first system is a national standard device, the system can automatically identify the national standard code of the national standard device. The national standard code of the national standard device can be displayed in the user interaction interface of the first system for the user to view.

[0051] Step 340 , in response to the type of the device in the first system being a non-national standard device, creating a national standard code for the non-national standard device. Step 340 may be performed by the national standard code creation module 220 .

[0052] For non-national standard devices, their own coding is non-national standard coding, and their coding rules and / or forms are different from national standard coding. If the non-national standard coding continues to be used, the non-national standard device will not be recognized by its upper-level system (i.e., the second system), nor can the two communicate. Therefore, the first system can create a national standard code for the non-national standard device so that it can be recognized by the upper-level system to facilitate communication between the two. Specifically, the first system can generate a national standard code for the non-national standard device according to the coding rules and forms of the national standard code. One or more fields in the national standard code can be randomly generated or generated according to preset rules. The national standard code generated for the non-national standard device is a "pseudo" national standard code set by the first system so that the upper-level system can access the non-national standard device normally as a national standard device.

[0053] In some embodiments, the first system may automatically create a national standard code for the non-national standard device when the type of the device is identified as a non-national standard device. In some embodiments, the first system may display the non-national standard device to the user through a user interaction interface when the type of the device is identified as a non-national standard device, and the user may decide whether to add the non-national standard device to the national standard for management. If so, the first system creates a national standard code for the non-national standard device. The created national standard code may be displayed to the user through the user interaction interface, and then the user confirms to adopt the national standard code.

[0054] Step 350 , allocating channels to devices in the first system. Step 350 may be performed by the channel allocation module 230 .

[0055] A channel may refer to a channel for transmitting data streams between cascaded platforms, that is, a channel for transmitting data streams from a device to a first system, and then from the first system to a second system. In some embodiments, the first system may determine which devices to allocate channels to, and then allocate a channel to each of these devices. In some embodiments, the first system may display device information to a user through a user interaction interface, and the user may determine which devices to allocate channels to; after the user determines these devices, the first system allocates a channel to each of these devices. Each channel has basic information, such as channel name, channel status (e.g., online, offline, etc.), ID of the data stream in the channel, national standard code of the device corresponding to the channel, etc.

[0056] Step 360, maintaining the channel. Step 360 may be performed by a channel maintenance module. In some embodiments, maintaining the channel may include maintaining information and / or status of the channel.

[0057] Maintaining the information of the channel may include: storing the information of the channel in the corresponding first-level channel table according to the type of the channel; then synchronizing the information of the channel from the first system to the second system through the national standard protocol, and storing it in the second-level channel table. Among them, the first-level channel table is associated with the first system, and the second-level channel table is associated with the second system. In some embodiments, the types of channels may include national standard channels (corresponding to national standard equipment) and non-national standard channels (corresponding to non-national standard equipment). The first-level channel table may include a first channel table and a second channel table. According to the type of the channel, storing the information of the channel in the corresponding first-level channel table includes: in response to the type of the channel being a national standard channel, storing the information of the channel in the first channel table; in response to the type of the channel being a non-national standard channel, storing the information of the channel in the second channel table.

[0058] Maintaining the state of the channel may include synchronizing the state of the channel from the first system to the second system. Specifically, for national standard equipment, the first system receives the device state information (e.g., the online / offline state information of the device) transmitted by the national standard equipment through the national standard protocol; for non-national standard equipment, the first system receives the device state information (e.g., the online / offline state information of the device) transmitted by the non-national standard equipment through the non-national standard protocol; according to the device state information, the first system updates the state of the channel corresponding to the device; in response to the change in the state of the channel, the first system synchronizes the state of the channel to the second system through the national standard protocol, so that the state of the channel stored in the second system is updated.

[0059] An exemplary cascade and channel maintenance diagram is shown in Figure 5-7 shown. Figure 5 It is a schematic diagram of creating a non-national standard cascade according to some embodiments of this specification. Figure 6 It is a schematic diagram of national standard channel status synchronization shown in some embodiments of this specification. Figure 7 It is a schematic diagram of non-national standard channel status synchronization shown in some embodiments of this specification.

[0060] like Figure 5As shown, after the national standard cascade between the first system and the second system is created in step 310, the information of the upper-level system (e.g., the second system) of the first system can be stored in a data table (e.g., wvp_platform table). For the second system, the information of its lower-level system (e.g., the first system) can be stored in a data table (e.g., wvp_device table). The non-national standard cascade system 100 can determine the cascade relationship between different systems based on the information stored in the data table (e.g., wvp_platform table, wvp_device table). After allocating channels to the device in step 350, for the national standard channel, the information of the channel is stored in the first channel table (e.g., wvp_platform_gb_channel table); for the non-national standard channel, the information of the channel is stored in the second channel table (e.g., wvp_platform_gb_stream table). The wvp_platform_gb_channel table and the wvp_platform_gb_stream table are both first-level channel tables, associated with the first system. Regardless of whether it is a national standard channel or a non-national standard channel, the channel information is synchronized from the first system to the second system and stored in the second-level channel table (for example, the wvp_device_channel table). In this way, non-national standard devices can be cascaded into the second system in the form of non-national standard channels and be identified and accessed by the second system. The second system does not need to distinguish between national standard channels and non-national standard channels, that is, the second system accesses non-national standard channels in the same way as national standard channels without making any changes.

[0061] like Figure 5 As shown, in addition to non-national standard devices, the non-national standard cascade system 100 can also directly obtain data streams from other platforms (for example, other systems except the first system 110 and the second system 120), and push them to the second system 120 or provide access to the second system 120. These data streams may include data streams actively pulled by the first system from other platforms (stored in the wvp_stream_proxy table) (for example, Figure 5 The data stream pulled from other platforms by the "Create Pull Stream" operation (the data stream type is proxy)), the data stream pushed to the first system by other platforms (stored in the wvp_stream_push table) (for example, Figure 5Data streams pushed to the first system by other platforms received through the "Add channel to push list" operation (data stream type is push). Similar to the encoding of the devices in the first system, these data streams have corresponding encoding. Some data streams are transmitted to the first system through the national standard protocol, and they have national standard encoding. Some data streams are transmitted to the first system through non-national standard protocols, and they have non-national standard encoding. Similar to creating national standard encoding for non-national standard devices, the first system can also create national standard encoding for data streams with non-national standard encoding, so as to facilitate access by the second system. For data streams with national standard encoding in the wvp_stream_proxy table and wvp_stream_push table, they can be added to the wvp_gb_stream table and accessed as national standard streams. For data streams with non-national standard encoding in the wvp_stream_proxy table and wvp_stream_push table, national standard encoding can be created for them, and the data stream can be added to the wvp_gb_stream table, and can also be accessed as national standard streams. National standard streams refer to data streams transmitted between the first system and the second system through national standard protocols. For the data stream in the wvp_stream_push table, the first system will determine whether the data stream is a national standard stream (that is, whether it has a national standard code). For the national standard stream (that is, the data stream with a national standard code), the first system can identify it normally. For non-national standard streams, the first system can add the national standard code to it through the "add "national standard code" to a record in the push list item" operation, and add the data stream with the national standard code added to the wvp_gb_stream table. In addition, since the channels in the wvp_platform_gb_channel table and the wvp_platform_gb_stream table have national standard codes, the corresponding data streams are also national standard streams and are added to the wvp_gb_stream table.

[0062] In the above manner, the non-national standard channel (or data stream) is cascaded into the system through the national standard protocol, so that the non-national standard cascade system 100 can support the cascade of other non-national standard channels (or data streams) in addition to the national standard channel (or data stream). In addition, any type of data stream can be added to the national standard stream, so that the non-national standard cascade system 100 can support the scheduling and push of various types of data streams (such as video streams).

[0063] like Figure 6As shown, for the national standard channel, in order to synchronize its status from the first system to the second system, the national standard device in the first system can inform the first system (i.e., the lower-level platform) of its registration online / heartbeat expiration and deregistration offline status (i.e., online / offline status) through the national standard protocol (e.g., SIP protocol), and the lower-level platform can modify the channel status corresponding to the national standard device according to the online / offline status of the national standard device. The lower-level platform can also determine whether the national standard device is cascaded to other platforms. If it is determined that the channel status has changed and / or the national standard device is cascaded to other platforms, the second system (i.e., the upper-level platform) is notified (through the national standard protocol (e.g., SIP protocol)) to synchronize the channel status. After receiving the notification, the upper-level platform sends a channel synchronization command to the lower-level platform (through the national standard protocol (e.g., SIP protocol)). After receiving the command (e.g., channel query command), the lower-level platform will query the status of all cascaded channels bound to the lower-level platform, and send the status of these channels to the upper-level platform (through the national standard protocol (e.g., SIP protocol)). After receiving the channel status, the upper-level platform updates the channel status it stores (for example, updates the status according to the channel ID).

[0064] like Figure 7 As shown, for a non-national standard channel (such as a mesh channel, i.e., a channel corresponding to a mesh device), in order to synchronize its state from the first system to the second system, the non-national standard device (such as a mesh device) in the first system can inform the first system (i.e., the lower-level platform) of its online / heartbeat expiration offline state (i.e., online / offline state) through a non-national standard protocol (such as a websocket protocol), and the lower-level platform can modify the channel state or data stream state (e.g., live stream state) corresponding to the non-national standard device according to the online / offline state of the non-national standard device. The lower-level platform can also determine whether the data stream of the non-national standard device is cascaded to another platform. If it is determined that the channel state or data stream state has changed and / or the data stream of the non-national standard device has been cascaded to another platform, the second system (i.e., the upper-level platform) is notified (through a national standard protocol (e.g., a SIP protocol)) to synchronize the channel state. After receiving the notification, the upper-level platform sends a channel synchronization command to the lower-level platform (through a national standard protocol (e.g., a SIP protocol)). After receiving a command (e.g., a channel query command), the lower-level platform will query the status of all cascaded channels or data streams bound to the lower-level platform, and send the status of these channels or data streams to the upper-level platform (via a national standard protocol (e.g., SIP protocol)). After receiving the status of the channel or data stream, the upper-level platform will update the channel or data stream status it stores (e.g., update its status according to the channel ID).

[0065] Through the above method, no matter it is a national standard channel (or data stream) or a non-national standard channel (or data stream), when its status changes, the lower-level platform can synchronize its status to the upper-level platform in time, ensuring the accuracy of the data stream accessed by the upper-level platform.

[0066] Step 370 , the second system acquires the data stream of the channel. Step 370 may be executed by the streaming module 240 .

[0067] In some embodiments, before the first system receives the access instruction to the channel from the second system, the second system may determine in the service interface whether there is a data stream of the accessed channel in the cache. If there is a data stream of the accessed channel in the cache, the second system directly obtains the data stream of the accessed channel in the cache. If there is no data stream of the accessed channel in the cache, the second system sends an access instruction to the channel to the first system through the national standard protocol. In some embodiments, after the first system receives the access instruction to the channel from the second system, the data stream of the channel is pushed from the first system to the second system. For more descriptions on the second system obtaining the data stream, see Figure 4 , Figure 8 , Fig. 9 .

[0068] It should be noted that the description of process 300 is provided for illustrative purposes only and is not intended to limit the scope of this specification. For those of ordinary skill in the art, various changes and modifications can be made according to the description of this specification. However, these changes and modifications do not depart from the scope of this specification. In some embodiments, the above process may include one or more additional operations, or one or more operations may be omitted. For example, step 360 may be omitted.

[0069] Figure 4 It is an exemplary flow chart for obtaining channel data flow according to some embodiments of this specification. In some embodiments, process 400 can be executed by non-national standard cascade system 100 or non-national standard cascade system 200. For example, process 400 can be stored in a storage device in the form of a program or instruction, and when the non-national standard cascade system executes the instruction, process 400 can be implemented. Process 400 can be executed by streaming module 240. The operational diagram of process 400 presented below is illustrative. In some embodiments, the process can be completed using one or more additional operations not described and / or one or more operations not discussed. In addition, Figure 4 The order in which the operations of process 400 are shown and described below is not limiting. Figure 4 As shown, process 400 may include one or more of the following steps.

[0070] Step 410: The second system initiates an access instruction to a channel (or a data stream). If the accessed data stream (or the data stream in the accessed channel) is a video stream, then the access to the video stream may also be referred to as on-demand.

[0071] In some embodiments, the user of the second system can operate through the user interface to select the channel (or data stream) to be accessed. In response to the user's operation, the second system can initiate an access instruction to the channel (or data stream).

[0072] In step 420, the second system determines in the service interface whether there is a data stream of the accessed channel in the cache. In some cases, the data stream of the accessed channel may already exist in the cache of the second system. For example, other users of the second system are accessing the data stream of the channel, and the data stream exists in the cache. If the data stream of the accessed channel exists in the cache, then in step 430, the second system directly obtains the data stream of the accessed channel in the cache. If the data stream of the accessed channel does not exist in the cache, then in step 440, the second system sends an access instruction to the channel to the first system through a national standard protocol (such as a SIP protocol).

[0073] In some embodiments, in order to push the data stream of a channel from a first system to a second system, the first system may, based on the type of the channel being accessed, adopt a protocol corresponding to the type of the channel, and the first system may obtain the data stream of the channel from a device corresponding to the channel; and then, through the national standard protocol, the first system may push the data stream of the channel to the second system.

[0074] Step 450: The first system determines whether the accessed channel is a national standard channel. In some embodiments, after receiving the access instruction from the second system, the first system may query in the second channel table (e.g., wvp_platform_gb_stream table). If the national standard code of the accessed channel appears in the table, it indicates that the accessed channel is a non-national standard channel; if the national standard code of the accessed channel does not appear in the table, it indicates that the accessed channel is a national standard channel.

[0075] If it is determined that the type of the accessed channel is a national standard channel, then in step 460, the operation server of the first system initiates an access instruction to the national standard device corresponding to the channel through a national standard protocol (such as the SIP protocol); and then the media server of the first system receives the data stream transmitted by the national standard device (through the national standard protocol (such as the SIP protocol)). If it is determined that the type of the accessed channel is a non-national standard channel, then in step 470, the operation server of the first system initiates an access instruction to the non-national standard device corresponding to the channel through a non-national standard protocol (such as the websocket protocol); and then the media server of the first system receives the data stream transmitted by the non-national standard device (through the non-national standard protocol (such as the webrtc protocol)).

[0076] Step 480, the first system pushes the data stream of the channel to the second system through the national standard protocol. Specifically, the operation server of the first system (through the national standard protocol (such as the SIP protocol)) can send a push stream command to the media server of the first system; in response to the push stream command, the media server of the first system (through the national standard protocol (such as the SIP protocol)) sends the data stream to the media server of the second system to complete the push of the data stream from the first system to the second system. Furthermore, the operation server of the second system can obtain the data stream from the media server of the second system and display it in the user interface. If the device corresponding to the accessed channel is a camera and the data stream is a video stream, the above method can be used to realize the on-demand video stream captured by the camera in the second system.

[0077] It should be noted that the description of process 400 is provided only for the purpose of illustration and is not intended to limit the scope of this specification. For those of ordinary skill in the art, various changes and modifications can be made according to the description of this specification. However, these changes and modifications do not depart from the scope of this specification. In some embodiments, the above process may include one or more additional operations, or one or more operations may be omitted.

[0078] An exemplary channel on-demand diagram is shown in FIG. Figure 8 , Fig. 9 shown. Figure 8 It is a schematic diagram of obtaining the data flow of the national standard channel according to some embodiments of this specification. Fig. 9 It is a schematic diagram of obtaining the data stream of a non-national standard channel according to some embodiments of this specification. Figure 8 , Fig. 9 The video stream is taken as an example for description, but the scope of this specification is not limited thereto.

[0079] like Figure 8As shown, if the upper-level platform (i.e., the second system) plays a national standard channel on demand, the running server (i.e., the lower-level server) of the lower-level platform (i.e., the lower-level server) (through the national standard protocol (e.g., SIP protocol)) initiates a play-on-demand to the national standard device corresponding to the national standard channel. After receiving the play-on-demand instruction, the national standard device pushes the video stream generated by the national standard device (through the national standard protocol (e.g., SIP protocol)) to the media server (e.g., ZLM (ZhangLin Media Server)) of the lower-level platform. After the lower-level server monitors the event of video stream registration, it notifies the lower-level ZLM to push the video stream to the upper-level ZLM. After receiving the notification, the lower-level ZLM pushes the video stream to the upper-level ZLM (through the national standard protocol (e.g., SIP protocol)), thereby completing the push of the video stream of the national standard channel from the first system to the second system. After the upper-level server monitors that the stream is registered to the upper-level ZLM, it can return the address of the video stream to the user interaction interface to play the video stream, thereby realizing cascaded play-on-demand.

[0080] like Fig. 9 As shown, if the upper-level platform (i.e., the second system) orders a non-national standard channel (e.g., a mesh channel), the running server (i.e., the lower-level server) of the lower-level platform (i.e., the lower-level server) initiates a video on demand to the non-national standard device (e.g., a mesh device) corresponding to the non-national standard channel (e.g., a websocket protocol)). After receiving the video on demand instruction, the non-national standard device pushes the video stream generated by the non-national standard device to the lower-level ZLM (through a non-national standard protocol (e.g., the webrtc protocol)). After the lower-level server monitors the event of video stream registration, it notifies the lower-level ZLM to push the video stream to the upper-level ZLM. After receiving the notification, the lower-level ZLM pushes the video stream to the upper-level ZLM (through the national standard protocol (e.g., the SIP protocol)), thereby completing the push of the video stream of the non-national standard channel from the first system to the second system. After the upper-level server monitors that the stream is registered to the upper-level ZLM, it can return the address of the video stream to the user interaction interface to play the video stream, thereby realizing cascaded video on demand.

[0081] Some embodiments of the present specification also provide a computer program product, including computer instructions or computer codes. When at least part of the computer instructions or the computer codes are executed by a processor, the non-national standard cascading method described in some embodiments of the present specification can be implemented.

[0082] Specifically, in some embodiments of the present specification, a computer program product may only involve computer instructions or computer codes, which may be carried by a storage medium or a processing device; while in other embodiments of the present specification, a computer program product may also be a storage medium or a processing device containing the aforementioned computer instructions or computer codes, wherein the processing device may include one or more processors, and a storage medium.

[0083] In some embodiments of the present specification, the processor may be a combination of one or more of the following processors: a central processing unit (CPU), an application specific integrated circuit (ASIC), an application specific instruction set processor (ASIP), a graphics processing unit (GPU), a physical processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a programmable logic controller (PLC), a reduced instruction set computer (RISC), and a microprocessor.

[0084] In some embodiments of the present specification, the above-mentioned storage medium may include one or more combinations of the following: mass storage, removable storage, volatile read-write memory, read-only memory (ROM). Exemplary mass storage may include magnetic disks, optical disks, solid-state hard disks, etc. Exemplary removable storage may include flash disks, floppy disks, optical disks, memory cards, compressed hard disks, magnetic tapes, etc. Exemplary volatile read-write memory may include random access memory (RAM). Exemplary random access memory may include dynamic random access memory (DRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), static random access memory (SRAM), thyristor random access memory (T-RAM) and zero capacitance memory (Z-RAM), etc. Exemplary read-only memory may include masked read-only memory (MROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), compact disk read-only memory (CD-ROM) and digital multifunction hard disk read-only memory, etc.

[0085] The beneficial effects that may be brought about by the embodiments of this specification include but are not limited to: (1) by creating national standard codes for non-national standard devices, non-national standard devices can be cascaded into the system, and the national standard communication is adopted between the lower-level system and the upper-level system. The upper-level system can successfully identify and access the data stream of the non-national standard channel corresponding to the non-national standard device without making any changes, thereby expanding the application scope of non-national standard devices; (2) any type of data stream (national standard data stream, non-national standard data stream, etc.) can be connected to the upper-level system through the non-national standard cascading method of this specification, and can be accessed by the upper-level system as a national standard stream, thereby increasing the diversity of data streams accessed by the upper-level system. , expanding the flexibility of the entire system; (3) In some special scenarios (such as firefighting, disaster relief and rescue), the network communication quality is poor, and non-national standard protocol communication may have better communication quality than national standard protocol communication. The next-level system and the acquisition device still maintain non-national standard protocol communication, which can ensure that the data stream received by the next-level system from the acquisition device is of high quality, so that the data stream on demand by the upper-level system is also of high quality, which is conducive to ensuring the smooth progress of firefighting, disaster relief and rescue; (4) The next-level system can synchronize the channel status changes to the upper-level system in a timely manner, ensuring the accuracy of the data stream on demand by the upper-level system. It should be noted that different embodiments may produce different beneficial effects. In different embodiments, the beneficial effects that may be produced may be any one or a combination of the above, or any other beneficial effects that may be obtained.

[0086] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0087] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0088] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0089] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0090] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A non-national standard cascading method, characterized in that: The method comprises: Based on the information of the second system to be cascaded, create a national standard cascade between the first system and the second system; Identify the type of the device in the first system, in response to the type of the device in the first system being a non-national standard device, create a national standard code for the non-national standard device, in response to the type of the device in the first system being a national standard device, identify the national standard code of the national standard device; wherein the device corresponds to the national standard code; Allocating a channel for the device in the first system, wherein the channel corresponds to the national standard code; In response to the first system receiving an access instruction from the second system to the channel, the data stream of the channel is pushed from the first system to the second system.

2. The method according to claim 1, characterized in that The method further comprises: maintaining the channel, The maintaining of the channel comprises: According to the type of the channel, storing the information of the channel in a corresponding first-level channel table, wherein the first-level channel table is associated with the first system; Through the national standard protocol, the information of the channel is synchronized from the first system to the second system and stored in a second-level channel table, and the second-level channel table is associated with the second system.

3. The method according to claim 2, characterized in that: The types of channels include national standard channels and non-national standard channels; The first-level channel table includes a first channel table and a second channel table; According to the type of the channel, storing the information of the channel in the corresponding first-level channel table includes: In response to the type of the channel being a national standard channel, storing information of the channel in the first channel table, In response to the type of the channel being a non-national standard channel, the information of the channel is stored in the second channel table.

4. The method according to claim 1, characterized in that The method further comprises: maintaining the channel, The maintaining of the channel includes synchronizing the state of the channel from the first system to the second system, including: For the national standard equipment, receiving the equipment status information transmitted by the national standard equipment through the national standard protocol; for the non-national standard equipment, receiving the equipment status information transmitted by the non-national standard equipment through the non-national standard protocol; According to the device status information, the first system updates the status of the channel corresponding to the device; In response to a change in the state of the channel, the first system synchronizes the state of the channel to the second system through a national standard protocol, so that the state of the channel stored in the second system is updated.

5. The method according to claim 1, characterized in that The method further includes, before the first system receives an instruction from the second system to access the channel: The second system determines, in the service interface, whether there is a data stream of the accessed channel in the cache; In response to the data stream of the accessed channel existing in the cache, the second system acquires the data stream of the accessed channel existing in the cache; In response to the absence of the data stream of the accessed channel in the cache, the second system sends an access instruction to the channel to the first system through the national standard protocol.

6. The method according to claim 1, characterized in that The step of pushing the data stream of the channel from the first system to the second system comprises: According to the type of the accessed channel, the first system acquires the data stream of the channel from the device corresponding to the channel by adopting a protocol corresponding to the type of the channel; The first system pushes the data stream of the channel to the second system through the national standard protocol.

7. The method according to claim 6, characterized in that The first system obtains the data stream of the channel from the device corresponding to the channel by using a protocol corresponding to the type of the channel according to the type of the accessed channel, including: In response to the type of the accessed channel being a national standard channel, the operation server of the first system initiates an access instruction to the national standard device corresponding to the channel through the national standard protocol, and the media server of the first system receives the data stream transmitted by the national standard device; In response to the type of the accessed channel being a non-national standard channel, the operating server of the first system initiates an access instruction to the non-national standard device corresponding to the channel through a non-national standard protocol, and the media server of the first system receives the data stream transmitted by the non-national standard device.

8. The method according to claim 6, wherein the first system pushes the data stream of the channel to the second system through the national standard protocol, comprising: The operation server of the first system sends a streaming command to the media server of the first system; In response to the streaming command, the media server of the first system sends the data stream to the media server of the second system.

9. A non-national standard cascade system, characterized in that: The system comprises: A cascading module, used for creating a national standard cascade between a first system and the second system to be cascaded based on information of the second system to be cascaded; a national standard code creation module, configured to identify the type of equipment in the first system, create a national standard code for the non-national standard equipment in response to the type of equipment in the first system being a national standard equipment, and identify the national standard code of the national standard equipment in response to the type of equipment in the first system being a national standard equipment; wherein the equipment corresponds to the national standard code; A channel allocation module, used for allocating channels to the devices in the first system, wherein the channels correspond to the national standard codes; The streaming module is used for pushing the data stream of the channel from the first system to the second system in response to the first system receiving an access instruction to the channel from the second system.

10. A computer program product, characterized in that It comprises computer instructions or computer programs, and when at least part of the computer instructions or the computer programs are executed by a processor, it can implement the non-national standard cascading method as described in any one of claims 1 to 8.

Images