Streaming media data management system, method, device and medium

Through the collaborative work of cloud servers and transit servers, user terminals in different networks can obtain streaming media data, solving the problem of remote monitoring in networks without intranet dedicated lines and saving resources.

CN115695861BActive Publication Date: 2025-09-09BEIJING FEIXUN DIGITAL TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202211357317.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-01
Publication Date
2025-09-09
Estimated Expiration
2042-11-01

AI Technical Summary

Technical Problem

Enterprise users cannot remotely view monitoring content and manage image acquisition devices without an intranet dedicated line.

Method used

A streaming media data management system is provided. Through the collaborative work of cloud servers and relay servers, user terminals are allowed to obtain streaming media data under different networks, establish communication connections with cloud servers using relay servers, and pull streaming media data from image acquisition devices through target relay servers and feed it back to user terminals.

Benefits of technology

It enables user terminals in different networks to obtain streaming media data, solving the problem that users without an intranet dedicated line cannot remotely view monitoring content. At the same time, it saves resources and does not require the deployment of external network IP for image acquisition equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115695861B_ABST
    Figure CN115695861B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention discloses a streaming media data management system, method, device and medium. The system includes: a cloud server, and at least one relay server, each relay server is respectively connected to at least one image acquisition device deployed on the same local area network; each image acquisition device, when in working state, collects environmental image information of the environment in which it is located and forms corresponding streaming media data; each relay server, when meeting the connection initiation conditions, sends a communication connection request to the cloud server to establish a communication connection; after receiving the on-demand request from the user terminal, the cloud server determines the associated target relay server and pulls the target streaming media data from its associated target image acquisition device, and feeds it back to the user terminal. Utilizing this system, there is no need to deploy an external network IP for the image acquisition device, which saves resources, provides a channel for users in different networks to obtain streaming media data, and solves the problem that users without an internal network cannot view it.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of embedded technology, and in particular to a streaming media data management system, method, device and medium. Background Art

[0002] Businesses often install image acquisition equipment at various locations to monitor conditions, forming a surveillance system. In most cases, these devices are deployed within a local area network (LAN). Enterprise users can only view surveillance content and manage the devices within this LAN.

[0003] However, in actual applications, there is also a need to remotely manage image acquisition devices or view monitoring content. Existing implementation of this requirement often requires the use of dedicated line networking. Enterprise users who do not have the ability to build an intranet dedicated line network cannot remotely view monitoring content. Summary of the Invention

[0004] The embodiments of the present invention provide a streaming media data management system, method, device and medium, so as to enable user terminals in different networks to obtain streaming media data.

[0005] In a first aspect, an embodiment of the present invention provides a streaming media data management system, comprising: a cloud server, and at least one transfer server, each of the transfer servers being connected to at least one image acquisition device deployed on the same local area network;

[0006] Each of the image acquisition devices is used to acquire environmental image information of the environment in which it is located and generate corresponding streaming media data when in working state;

[0007] Each of the relay servers is configured to send a communication connection request to the cloud server when a connection initiation condition is met, so as to establish a communication connection with the cloud service;

[0008] The cloud server is used to determine the target relay server associated with the on-demand request after receiving the on-demand request from the user terminal, pull the target streaming media data from the associated target image acquisition device through the target relay server and feed it back to the user terminal.

[0009] In a second aspect, an embodiment of the present invention further provides a streaming media data management method, which is executed by a cloud server in the streaming media data management system according to any embodiment of the present invention, wherein the system further comprises at least one transit server, each transit server being connected to at least one image acquisition device deployed on the same local area network;

[0010] Wherein, each of the image acquisition devices, when in working state, collects environmental image information of the environment in which it is located and forms corresponding streaming media data; each of the relay servers, when meeting the connection initiation conditions, sends a communication connection request to the cloud server to establish a communication connection with the cloud service;

[0011] The method comprises:

[0012] After receiving a video-on-demand request from a user terminal, determining a target relay server associated with the video-on-demand request;

[0013] The target transfer server pulls the target streaming media data from the associated target image acquisition device and feeds it back to the user terminal.

[0014] In a third aspect, an embodiment of the present invention further provides an electronic device, which serves as a cloud server in the streaming media data management system according to any embodiment of the present invention, and includes:

[0015] one or more processors;

[0016] a storage device for storing one or more programs;

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the streaming media data management method as described in any embodiment of the present invention.

[0018] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the streaming media data management method as described in any embodiment of the present invention.

[0019] Embodiments of the present invention provide a streaming media data management system, method, device, and medium. The system includes: a cloud server and at least one relay server, each relay server being connected to at least one image acquisition device deployed on the same local area network. Each image acquisition device, when in operation, is configured to acquire environmental image information of its environment and generate corresponding streaming media data. Each relay server is configured to send a communication connection request to the cloud server to establish a communication connection when connection initiation conditions are met. The cloud server, upon receiving a video-on-demand request from a user terminal, determines the associated target relay server and pulls the target streaming media data from the associated target image acquisition device, feeding it back to the user terminal. This system eliminates the need to deploy an external IP address for the image acquisition device, saving resources and providing users on different networks with access to streaming media data, resolving the issue of users without an internal network being unable to access streaming media data. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1This is a structural block diagram of a streaming media data management system provided according to the first embodiment of the present invention;

[0021] Figure 2 This is a flow chart of a streaming media data management method provided according to the second embodiment of the present invention;

[0022] Figure 2a This is an example flow chart of device status management in a streaming media data management method provided according to the second embodiment of the present invention;

[0023] Figure 2b This is an example flow chart of a streaming media data management method provided in accordance with the second embodiment of the present invention when the user terminal is on the Internet;

[0024] Figure 2c This is an example flow chart of a streaming media data management method provided in accordance with the second embodiment of the present invention when the user terminal is in a local area network;

[0025] Figure 3 It is a structural diagram of an electronic device for implementing the streaming media data management system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] Example 1

[0029] Figure 1A structural block diagram of a streaming media data management system provided by the first embodiment of the present invention is given. The system is suitable for situations where user terminals can obtain streaming media data in a local area network or on the Internet. Figure 1 As shown, the streaming media data management system includes: a cloud server 11, and at least one transit server 12, each transit server 12 is connected to at least one image acquisition device 13 deployed in the same local area network. Different local area networks can be deployed in different venues or scenes, so that each venue or scene corresponds to a local area network.

[0030] Each image acquisition device 13 is used to acquire environmental image information of the environment and generate corresponding streaming media data when in working state.

[0031] In this embodiment, the image acquisition device 13 can be understood as a device that captures a target in the form of an image, such as a camera. The environment can be understood as the capture range set by the image acquisition device 13. The environmental image information can be understood as environmental image information in the form of an image captured by the image acquisition device 13. Streaming media data can be understood as data in a specific transmission format formed by compressing the data in the environmental image information.

[0032] Specifically, after the image acquisition devices 13 are powered on and started, each image acquisition device 13 is in a working state. Each image acquisition device 13 can acquire environmental image information of the environment in which it is located. The processor can compress the acquired environmental image information in a set manner to form corresponding streaming media data.

[0033] Exemplarily, the image acquisition device 13 can be a monitoring device. If the user terminal 14 needs to use multiple monitoring devices, these monitoring devices can be powered on and started. Each monitoring device collects environmental image information of a pre-set monitoring environment and compresses the data in each environmental image information to form corresponding streaming media data.

[0034] Each transit server 12 is configured to send a communication connection request to the cloud server 11 when a connection initiation condition is met, so as to establish a communication connection with the cloud service.

[0035] In this embodiment, the connection initiation condition can be understood as the relay server 12 not establishing a communication connection with the cloud server 11. For example, after the relay server 12 is powered on or detects that a communication connection with the cloud server 11 has not been established within a set period, the communication connection request can include information corresponding to the relay server 12.

[0036] It should be noted that before the transit server 12 establishes a communication connection with the cloud server 11, it is necessary to obtain the configuration file set by the user on the user terminal 14, and determine which transit server 12 to establish a communication connection with the cloud server 11 based on the configuration file. Access to the cloud platform can be achieved by providing a corresponding cloud platform website or cloud platform terminal. The user can be guided to set up a configuration file on the user terminal 14, and the cloud server 11 can obtain the corresponding configuration file. The user can log in to the cloud platform by opening the cloud platform website page or the cloud platform terminal interface, first entering the corresponding operation and maintenance personnel account and password. When logging in for the first time, the associated server can be configured first. The page prompts to add a transit server 12. The user can enter the information of the transit server 12 to be added in the corresponding text edit box and click the "Finish" control to complete the addition of the transit server 12 information. When the user clicks the "Finish" control, the cloud server 11 can automatically assign the corresponding transit server 12 ID number to the transit server 12 and associate and record its corresponding website address, local area network address, and other information. After adding the transit server 12, the user can be prompted to add the image acquisition device 13 associated with the transit server 12. The page prompts you to add the image acquisition device 13. The user can enter the information of the image acquisition device 13 to be added in the corresponding text edit box and click the "Finish" control to complete the addition of the image acquisition device 13 information. When the user clicks the "Finish" control, the cloud server 11 can automatically assign the corresponding image acquisition device 13 ID number to the image acquisition device 13, and associate and record its corresponding website address, local area network address and other information, and establish an association with the corresponding transit server 12. A configuration file corresponding to the user terminal 14 is generated based on each transit server 12 added by the user and its corresponding image acquisition device 13. In subsequent use, the configuration file can be directly obtained, and the user can also add or delete the content in the configuration file.

[0037] Specifically, when user terminal 14 successfully logs in with an account and password, it can retrieve the user-defined configuration file. Based on the user-defined configuration file, cloud server 11 can determine the relay server 12 with which to establish a communication connection. It can then power on the corresponding relay server 12. After powering on and starting up, relay server 12 defaults to not having established a communication connection with cloud server 11, thus satisfying the connection initiation condition. The powered-on relay server 12 can periodically check whether it has established a communication connection with cloud server 11. If a communication connection has not been established with cloud server 11, the connection initiation condition is satisfied. A communication connection can be established between relay server 12 and cloud server 11 via a router. The unconnected relay server 12 can send a communication connection request to cloud server 11. Cloud server 11, based on the relay server 12 information in the communication connection request, determines whether the relay server 12 is the one included in the configuration file. If so, a communication connection is established, allowing relay server 12 to establish a communication connection with cloud server 11 via the router. If not, no communication connection is established.

[0038] The cloud server 11 is used to determine the target relay server 12 associated with the on-demand request after receiving the on-demand request from the user terminal 14, pull the target streaming media data from the associated target image acquisition device 13 through the target relay server 12 and feed it back to the user terminal 14.

[0039] In this embodiment, the user terminal 14 can be understood as the terminal of the cloud platform corresponding to the cloud server 11 for the user to log in. The user terminal 14 can be in the local area network corresponding to the relay server 12 and the image acquisition device 13, or it can be outside the local area network (such as the Internet). The on-demand request can be understood as a request for the content captured by the image acquisition device 13 that the user wants to view, which may include the image acquisition device 13 information and the user terminal network address, etc. The target relay server 12 can be understood as the relay server 12 associated with the image acquisition device 13 that the user wants to view. The target acquisition device can be understood as the image acquisition device 13 that the user wants to view. The target streaming data can be understood as the streaming data in the target acquisition device.

[0040] Specifically, a user can log in to the cloud platform corresponding to the cloud server 11 via a web page or application software terminal on the user terminal 14. After configuring the configuration file, the user can directly select the image acquisition device 13 they want to view on the cloud platform interface, such as by clicking the corresponding image acquisition device 13 icon. The cloud server 11 can obtain the network address of the user terminal 14 and automatically generate a video-on-demand request based on the network address of the user terminal 14 and the information about the image acquisition device 13. Based on the image acquisition device information, the cloud server 11 can search the configuration file for the relay server 12 associated with the image acquisition device 13 as the target relay server 12. It is possible to determine whether the user terminal 14 is in the local area network corresponding to the relay server 12 and the image acquisition device 13 based on the network address of the user terminal 14. The cloud server 11 sets different sending methods for sending the target streaming media data to the user terminal 14 based on the judgment result, and sends the on-demand request to the target relay server 12 according to the corresponding method. After receiving the on-demand request, the target relay server 12 searches for the target image acquisition device 13 corresponding to the on-demand request. The target relay server 12 can pull the target streaming media data in the target image acquisition device 13 and feed it back to the cloud server 11. The cloud server 11 sends the target streaming media data to the user terminal 14 according to the corresponding sending method.

[0041] This embodiment provides a streaming media data management system, comprising: a cloud server 11 and at least one relay server 12, each relay server 12 being connected to at least one image acquisition device 13 deployed on the same local area network; each image acquisition device 13, when in operation, being configured to acquire environmental image information of its environment and generate corresponding streaming media data; each relay server 12 being configured to send a communication connection request to the cloud server 11 to establish a communication connection when connection initiation conditions are met; and the cloud server 11 being configured to, upon receiving a video-on-demand request from a user terminal 14, determine the associated target relay server 12, pull the target streaming media data from the associated target image acquisition device, and feed it back to the user terminal 14. This system eliminates the need to deploy an external IP address for the image acquisition device, saving resources and providing users on different networks with access to streaming media data, resolving the issue of users without an internal network being unable to access streaming media data.

[0042] Furthermore, the cloud server 11 is also used to:

[0043] a1. After receiving a video-on-demand request from a user terminal 14, a target image acquisition device 13 and a target transfer server 12 associated with the video-on-demand request are determined.

[0044] Specifically, after receiving the on-demand request from the user terminal 14, the cloud server 11 can obtain the image acquisition device 13 information included in the on-demand request, set the image acquisition device 13 as the target image acquisition device, and search the configuration file based on the target image acquisition device information to find the relay server 12 associated with the target image acquisition device 13, and set the relay server 12 as the target relay server 12. The target image acquisition device 13 and the target relay server 12 associated with the on-demand request are determined.

[0045] For example, a user can log in to the cloud platform corresponding to cloud server 11 via a web page or application software terminal on user terminal 14. The user can select the image acquisition device 13 they want to view by clicking on the icon of the image acquisition device they want to view. A video-on-demand request is automatically generated based on the information of image acquisition device 13. For example, the video-on-demand request may include the ID number B1 set by cloud server 11 for image acquisition device 13. A search is performed in the configuration file based on ID number B1. If the ID number of relay server 12 associated with B1 is determined to be Z1, B1 is selected as the target image acquisition device 13, and Z1 is selected as the target relay server 12.

[0046] b1. Determine whether the user terminal 14 and the target image acquisition device 13 are in the same local area network according to the user terminal network address in the on-demand request, and obtain a determination result.

[0047] In this embodiment, the network address of the user terminal 14 can be understood as the address corresponding to the user terminal 14 in the network. The determination result can be understood as indicating whether they are in the same local area network.

[0048] Specifically, the user terminal network address in the on-demand request can be obtained, the URL information corresponding to the target image acquisition device 13 can be obtained from the configuration file, and the field representing the local area network information in the user terminal network address can be compared with the field representing the local area network information in the device URL information to determine whether the user terminal 14 and the target image acquisition device 13 are in the same local area network. If they are the same, they are in the same local area network, and the determination result is that they are in the same local area network; if they are different, they are not in the same local area network, and the determination result is that they are not in the same local area network.

[0049] c1. Using the streaming media data forwarding mode corresponding to the determination result, the target streaming media data of the target image acquisition device 13 is pulled through the target transfer server 12 and fed back to the user terminal 14 .

[0050] In this embodiment, the streaming media data forwarding form can be understood as a method of forwarding the streaming media data to the user terminal 14 .

[0051] Specifically, cloud server 11 can obtain the determination result and pre-establish corresponding streaming media data forwarding methods based on whether the two devices are in the same local area network or not. The corresponding streaming media data forwarding method can be determined based on the determination result. If the two devices are not in the same local area network, the target transit server 12 is required to first forward the pulled streaming media data to cloud server 11, which then feeds it back to user terminal 14. If the two devices are in the same local area network, the cloud server can notify transit server 12 to pull the streaming media data, and after pulling the target streaming media data, it will directly feed it back to user terminal 14.

[0052] Furthermore, the cloud server 11 is also used to:

[0053] a2. When the judgment result is that they are not in the same local area network, a first pull signaling including the first receiving port information is sent to the target relay server 12, so that after receiving the first pull signaling, the target relay server 12 pulls the first target streaming media data based on the real-time streaming transmission address of the target image acquisition device 13.

[0054] In this embodiment, the first pull signaling instruction can be understood as an instruction for notifying the streaming media service to open a receiving port. The first receiving port information can be understood as port information corresponding to a port for receiving streaming media information.

[0055] In this embodiment, the first target streaming media data can be understood as the target streaming media data collected by the target image acquisition device 13. The real-time streaming address can be understood as the address corresponding to the target image acquisition device 13 for real-time streaming protocol (RTSP).

[0056] It should be noted that signaling control services, streaming media services, and business management services are created in the cloud server 11 to perform information interaction through the created services.

[0057] The specific steps may include:

[0058] a21. The signaling control service sends a port information pull signaling to the streaming service, requiring the streaming service to open a port for receiving streaming information. After the streaming service receives the port information pull signaling from the signaling control service, it opens a receiving port for receiving streaming data and forms a first receiving port information. The streaming service feeds back the first receiving port information to the signaling control service; a22. The signaling control service receives the first receiving port information fed back by the streaming service, and sends a first pull signaling instruction containing the first receiving port information to the target relay server 12, so that the target relay server 12 pulls the first target streaming data based on the real-time streaming transmission address of the target image acquisition device 13 after receiving the second pull signaling instruction.

[0059] b2. Receive the first target streaming media data pushed by the target relay server 12 , and feed back the determined first sending port information to the user terminal 14 .

[0060] In this embodiment, the first sending port information can be understood as a port used to send the first target streaming media data to the user terminal 14 .

[0061] The specific steps may include:

[0062] b21. After detecting that the target transit server 12 pushes the first target streaming media data to the streaming media service according to the first receiving port information, it sends a receiving port pull signaling to the streaming media service, requesting the streaming media service to open the port for outward transmission; b22. Receive the first sending port information fed back by the streaming media service according to the receiving port pull signaling, and feed back the first sending port information to the user terminal 14.

[0063] Specifically, after the target relay server 12 pulls the first target streaming media data, it can push the first target streaming media data to the first receiving port of the streaming media service according to the first receiving port information. After the signaling control service detects that the target relay server 12 has pushed the first target streaming media data to the streaming media service, the signaling control service sends a receiving port pull signaling to the streaming media service, requesting the streaming media service to open an outbound port. The streaming media service can then form corresponding first sending port information, receive the first target streaming media data pulled by the target relay server 12 from the target image acquisition device 13, and send the first sending port information to the user terminal 14, informing the user terminal 14 that the first target streaming media data will be sent via the first sending port.

[0064] c2. After receiving the first response message from the user terminal relative to the first sending port information, forward the first target streaming media data from the first receiving port to the first sending port.

[0065] In this embodiment, the first response message can be understood as information generated to indicate that the user terminal 14 can receive the first target streaming media data.

[0066] Specifically, when the user terminal 14 receives the first sending port information sent by the signaling control service, the user terminal 14 determines that it can receive and form a first response message, and feeds the first response message back to the signaling control service. After the signaling control service receives the first response message fed back by the user terminal 14, it notifies the streaming media service to forward the first target streaming media data from the first receiving port to the first sending port.

[0067] d2. Push to the user terminal 14 through the first sending port.

[0068] Specifically, the first target streaming media data may be pushed to the user terminal 14 by the first sending port.

[0069] Furthermore, the cloud server 11 is also used to:

[0070] a3. When the judgment result is that they are in the same local area network, a second pull signaling including the second receiving port information is sent to the target relay server 12, so that after receiving the second pull signaling, the target relay server 12 pulls the second target streaming media data based on the real-time streaming transmission address of the target image acquisition device 13.

[0071] In this embodiment, the second pull signaling instruction can be understood as an instruction for instructing the target transit server 12 to pull the stream.

[0072] Specifically, when the network address of the target image acquisition device 13 is the same as the network address of the user terminal, and the target image acquisition device 13 and the user terminal 14 are in the same local area network, the signaling control service and business management service created by the cloud server 11 can be combined to send a second pull signaling containing the second receiving port information to the target relay server 12, so that after receiving the second pull signaling, the target relay server 12 pulls the second target streaming media data based on the real-time streaming transmission address of the target image acquisition device 13.

[0073] b3. Feedback the determined second sending port information to the user terminal 14.

[0074] In this embodiment, the second sending port information can be understood as a port used to send the second target streaming media data to the user terminal 14 .

[0075] Specifically, the target transit server 12 opens the second sending port and generates the second sending port information. The target transit server 12 feeds back the second sending port information to the signaling control service in the cloud server 11. The signaling control service feeds back the second sending port information to the user terminal 14, informing the user terminal 14 that the second target streaming media data will be sent through the second sending port.

[0076] d3. After receiving the second response message from the user terminal 14 relative to the second sending port information, forward the second target streaming media data from the second receiving port to the second sending port.

[0077] In this embodiment, the second response message can be understood as information generated to indicate that the user terminal 14 can receive the second target streaming media data.

[0078] Specifically, when the user terminal 14 receives the second sending port information sent by the signaling control service, the user terminal 14 determines that it can receive and form a second response message, and feeds back the second response message to the signaling control service. After the signaling control service receives the second response message fed back by the user terminal 14, it notifies the target transit server 12 to forward the second target streaming media data from the second receiving port to the second sending port.

[0079] e3. Push the data to the user terminal 14 through the second sending port.

[0080] Specifically, the second target streaming media data may be pushed to the user terminal 14 by the second sending port.

[0081] Furthermore, the target transfer server 12 is further configured to:

[0082] a4. After receiving the pull signaling, send an address query request for the target image acquisition device to the cloud server.

[0083] In this embodiment, the address query request can be understood as a request for querying the real-time streaming address of the target image acquisition device 13 .

[0084] Specifically, the pull signaling may include a first pull signaling and a second pull signaling. After receiving the first pull signaling or the second pull signaling instruction sent by the signaling control service in the cloud server 11, the target transit server 12 may send an address query request of the target image acquisition device 13 to the service management service of the cloud server 11.

[0085] b4. Obtain the real-time streaming transmission address of the relative address query request feedback.

[0086] Specifically, after receiving the address query request, the service management service queries the real-time streaming address in the configuration file of the target image acquisition device 13 and feeds the real-time streaming address back to the relay server 12 in the form of a real-time streaming address. The relay server 12 receives the real-time streaming address fed back by the service management service relative to the address query request.

[0087] c4. Access the real-time streaming address, pull the target streaming data of the target image acquisition device 13, and receive the target streaming data through the receiving port.

[0088] Specifically, the receiving port may include a first receiving port and a second receiving port. After receiving the real-time streaming address, the transit server 12 may access the real-time streaming address, pull the target streaming data corresponding to the target image acquisition device 13 under the real-time streaming address, and receive the target streaming data through the receiving port.

[0089] Furthermore, the transfer server 12 is further configured to:

[0090] After power-on startup, or when it is detected that a communication connection with the cloud server 11 is not established in a set period, a communication connection request is sent to the cloud server 11 to establish a communication connection with the cloud server 11.

[0091] In this embodiment, the set period can be understood as performing detection at a certain frequency.

[0092] Specifically, when user terminal 14 successfully logs in with an account and password, it can retrieve the user-defined configuration file. Based on the user-defined configuration file, cloud server 11 can determine the relay server 12 with which to establish a communication connection. It can then power on the corresponding relay server 12. After powering on, relay server 12 defaults to not having a communication connection with cloud server 11. Alternatively, a periodic check can be set to automatically detect whether a communication connection has been established between relay server 12 and cloud server 11. In order to receive instructions from cloud server 11, a communication connection with cloud server 11 must be established. A communication connection can be established between relay server 12 and cloud server 11 via a router. An unconnected relay server 12 can send a communication connection request to cloud server 11. Upon receiving the communication connection request, cloud server 11 determines whether the relay server 12 is the one specified in the configuration file based on the information about the relay server 12 included in the communication connection request. If so, a communication connection is established, allowing relay server 12 to establish a communication connection with cloud server 11 via the router. If not, no communication connection is established.

[0093] Furthermore, the cloud server 11 is also used for:

[0094] After establishing a communication connection with any relay server 12, the device status of each image acquisition device 13 associated with the relay server 12 is detected, and when a status check request from the user terminal 14 is received, the status detection result of the corresponding image acquisition device 13 is sent to the user terminal 14.

[0095] In this embodiment, the status check request may include information about the image acquisition device 13 to be checked. The status detection result may be understood as indicating whether the image acquisition device 13 to be checked is started.

[0096] Specifically, after establishing a communication connection with any relay server 12, the cloud server 11 can obtain the image acquisition devices 13 associated with the relay server 12 through a configuration file, perform device status detection on each image acquisition device 13, and determine in real time whether each image acquisition device 13 is connected to the network. The user terminal 14 can click on the "View Image Capture Device 13 Status" control on the corresponding webpage or client interface to send a status check request containing the image acquisition device information to be checked to the cloud server 11. Upon receiving the status check request from the user terminal 14, the cloud server 11 searches for the current status of the corresponding image acquisition device 13 based on the image acquisition device information in the status check request, generates a status detection result based on the current status, and sends the status detection result of the corresponding image acquisition device 13 to the user terminal 14. If the current status is "operating," the status detection result may indicate that the device is connected to the network and operating; if the current status is "offline," the status detection result may indicate that the device is off the network. Alternatively, the cloud server 11 can automatically send the status detection result of the corresponding image acquisition device 13 to the user terminal 14 upon successful login.

[0097] Furthermore, the cloud server 11 is specifically used for:

[0098] a5. When it is determined according to the received communication connection request that the associated transit server 12 is successfully registered and is in an online state, it is determined to establish a communication connection with the associated transit server 12 .

[0099] In this embodiment, the online state can be understood as the transit server 12 associated with the user terminal 14 has been started.

[0100] Specifically, the following steps may be included:

[0101] a51. A signaling control service established on a cloud server is further configured to, upon determining, based on a received communication connection request, that the associated relay server has successfully registered, provide an online status as a connection detection result and feedback to the service management service. a52. A service management service established on the cloud server is configured to determine the associated relay server corresponding to the received connection detection result, and, when the connection detection result indicates an online status, determine to establish a communication connection with the associated relay server.

[0102] Specifically, after the user terminal 14 successfully logs in with the account and password, it can obtain the configuration file set by the user. The cloud server 11 can determine the transit server 12 to establish a communication connection with the cloud server 11 based on the configuration file set by the user, and then determine whether the transit server 12 is in the startup state. If the transit server 12 is in the startup state, it corresponds to a successful registration. The transit server 12 is associated with the online state, and the online state is used as a connection detection result. The online state can be fed back to the business management service through the signaling control service created on the cloud server 11. When the business management service created on the cloud server 11 receives the connection detection result sent by the signaling control service, the transit server associated with the connection detection result can be determined. When the connection detection result is the online state, it corresponds to that the transit server 12 has been started and can establish a communication connection with the cloud server 11. The business management service then establishes a communication connection with the associated transit server 12.

[0103] b5. Send the determined associated device information to the association transfer server 12.

[0104] In this embodiment, the associated device information can be understood as device information, website address, and other information of the image acquisition device 13 .

[0105] Specifically, the business management service in the cloud server 11 can search in the configuration file according to the associated relay server 12, find the image acquisition device information corresponding to the associated relay server 12, and send the image acquisition device information as the associated device information to the associated relay server 12.

[0106] c5. Receive the device status determined by the association transfer server 12 relative to each associated image acquisition device based on the associated device information.

[0107] Specifically, the associated transfer server 12 may obtain the device status of each associated image acquisition device 13 according to the associated device information, and feed the device status back to the business management service in the cloud server 11 .

[0108] d5. Upon receiving a status check request from the user terminal, the device status of the image acquisition device corresponding to the status check request is fed back to the user terminal.

[0109] Specifically, when the business management service receives a status viewing request from the user terminal 14 or detects that the user terminal 14 is online, it can feedback the device status of the image acquisition device 13 corresponding to the status viewing request to the user terminal 14, or it can send device status feedback of all image acquisition devices 13 associated with the user terminal 14 to the user terminal 14 when the user terminal 14 is online.

[0110] Furthermore, the cloud server 11 is also specifically used for:

[0111] a6. Receive a communication connection request initiated by at least one transit server 12.

[0112] Specifically, the signaling control service in the cloud server 11 can receive a communication connection request including the relay server information initiated by at least one relay server 12 .

[0113] b6. Match the connection information in each communication connection request with the registration configuration information in the set configuration file.

[0114] In this embodiment, the connection information can be understood as the device information and website information of the relay server 12, which can identify the relay server 12. The registration configuration information can be understood as the information generated by the image acquisition device 13 based on the relay server information input by the user.

[0115] Specifically, the connection information in each communication connection request is compared with the registration configuration information in the set configuration file to determine whether the transit server 12 sending the communication connection request belongs to the configuration file corresponding to the user terminal 14 .

[0116] For example, the connection information in the communication connection request is the relay server device information A, B, and C, and the registration configuration information includes the relay server device information A and B. Then, the relay servers A and B belong to the relay servers corresponding to the user terminal 14, and the relay server C does not belong to the relay server corresponding to the user terminal 14.

[0117] c6. For the relay server 12 whose information matches, it is determined that the relay server 12 is successfully registered and is in an online state.

[0118] Specifically, the signaling control service can compare the connection information in each communication connection request with the registration configuration information in the set configuration file, and can determine the relay server 12 with matching information, that is, the relay server 12 belonging to the user terminal 14. For the relay server 12 with matching information, it can be considered that the relay server is successfully registered, and the online status is used as the connection detection result of the relay server 12, and the connection detection result is fed back to the business management server.

[0119] d6. For the relay server 12 whose information does not match, it is determined that the current registration of the relay server 12 has failed, and the relay server 12 is waiting for a communication connection request to be resent.

[0120] Specifically, the signaling control service can compare the connection information in each communication connection request with the registration configuration information in the configured configuration file. If the relay server 12 has mismatched information, that is, the relay server 12 does not belong to the user terminal 14, the relay server 12 is not allowed to establish a communication connection with the cloud server 11, and the current registration of the relay server 12 is determined to have failed. The relay server 12 waits for the user terminal 14 to come online and then resends the communication connection request.

[0121] Furthermore, the transfer server 12 is further configured to:

[0122] a7. Determine the associated image acquisition device 13 according to the received associated device information.

[0123] In this embodiment, the associated device information can be understood as information of the image acquisition device 13 associated with the transit server 12 .

[0124] Specifically, the business management service may send the associated device information to the transfer server 12 , and the transfer server 12 may search all image acquisition devices 13 in the local area network according to the associated device information to find the associated image acquisition device 13 in the associated device information.

[0125] b7. Perform a network status detection on each associated image acquisition device, and determine the device status of the corresponding image acquisition device based on the network status detection result.

[0126] In this embodiment, the network status detection result can be understood as a result indicating whether the network status is normal.

[0127] Specifically, the relay server 12 may perform a network status check on each associated image acquisition device 13 to check whether each image acquisition device 13 is connected to the same local area network as the relay server 12 and whether it can transmit and receive messages normally. The network status check result is obtained, and the device status of the corresponding image acquisition device 13 is determined based on the network status check result. If the network status check result indicates that the image acquisition device 13 is connected to the same local area network as the relay server 12 and can transmit and receive messages normally, the device status of the image acquisition device 13 may be set to enabled and normal.

[0128] c7. Feedback the device status of each associated image acquisition device to the cloud server 11.

[0129] Specifically, after the transit server 12 determines the device status of each associated image acquisition device 13 , it can associate the device status with the corresponding image acquisition device 13 and send the associated device status to the business management service in the cloud server 11 .

[0130] A streaming media data management system provided by an embodiment of the present invention has signaling control services, streaming media services, and business management services created under a cloud server 11. The signaling control service determines whether the user terminal 14 is in the same local area network as the target image acquisition device 13, and selects the corresponding data forwarding form according to the network status of the user terminal 14. This realizes automatic identification of the network of the user terminal 14 and automatic selection of the data forwarding form. When the user terminal 14 is in a local area network, the target streaming media data is sent to the user terminal 14 through the signaling control service and business management service under the transit server 12, the image acquisition device 13, and the cloud server 11. The target streaming media data is transmitted based on the local area network, saving network bandwidth. When the user terminal 14 is not in a local area network, the target streaming media data is sent to the user terminal 14 through the signaling control service and business management service under the transit server 12, the image acquisition device 12, and the cloud server 11. This solves the problem that users without an internal network cannot view image content, and there is no need to deploy an external network IP for the image acquisition device, saving resources.

[0131] Example 2

[0132] Figure 2 A flowchart of a streaming media data management method provided in the second embodiment of the present invention is given. The method is applicable to situations where the user terminal can obtain streaming media data whether it is in a local area network or on the Internet. Specifically, it can be applied to a streaming media data management system provided in the above embodiment of the present invention. The streaming media data management system can be integrated on an electronic device, and the electronic device can serve as a cloud server. The method is executed by the cloud server in the streaming media data management system provided in the above embodiment. The system also includes at least one transit server, and each transit server is connected to at least one image acquisition device deployed in the same local area network. Wherein, when each image acquisition device is in working state, it collects environmental image information of the environment in which it is located and forms corresponding streaming media data; when each transit server meets the connection initiation conditions, it sends a communication connection request to the cloud server to establish a communication connection with the cloud service.

[0133] like Figure 2 As shown, the method includes:

[0134] S110 : After receiving the on-demand request from the user terminal, determine a target relay server associated with the on-demand request.

[0135] S120 , pulling target streaming media data from the associated target image acquisition device through the target transfer server and feeding it back to the user terminal.

[0136] This second embodiment provides a streaming media data management method, comprising: upon receiving a video-on-demand request from a user terminal, determining a target relay server associated with the video-on-demand request; and, via the target relay server, pulling target streaming media data from the associated target image acquisition device and feeding it back to the user terminal. This method eliminates the need to deploy an external IP address for the image acquisition device, conserving resources, and provides access to streaming media data for users on different networks, resolving the issue of users without an internal network being unable to access the data.

[0137] Figure 2a A flow chart illustrating device status management in a streaming media data management method according to a second embodiment of the present invention is provided. Figure 2a As shown, the provided application scenario includes: user terminal 21, cloud server 22, service management service 221 and signaling control service 222 under cloud server 22, relay server 23, and image acquisition device 24. Here, only one user terminal 21, one relay server 23, and one image acquisition device 24 are used as an example; in practice, there may be multiple such devices.

[0138] Specifically, the entire application scenario can be described as:

[0139] S1. The business management service 221 assigns a registration ID to the transit server 23;

[0140] S2. The transit server 23 initiates a communication connection request with the cloud server 22;

[0141] S3. The signaling control service 222 matches the connection information in the communication connection request with the registration configuration information in the configured configuration file and notifies the transit server 23 that the registration is successful.

[0142] S4. The signaling control service 222 notifies the service management service 221 that the successfully registered transit server 23 is online.

[0143] S5. The business management service 221 sends its corresponding associated device information to the transit server 23;

[0144] S6. The transfer server 23 performs a network status detection on the associated image acquisition device 24 and determines the device status of the corresponding image acquisition device;

[0145] S7. The transfer server 23 sends the device status of the associated image acquisition device 24 to the business management service 221;

[0146] S8. The business management service 221 sends the device status of the associated image acquisition device 24 to the user terminal 21.

[0147] It should be noted that Figure 2aIt is only an example diagram of the execution steps of each functional module in a system. The step numbers given in the figure and the order of the steps in the figure do not directly indicate the order of the steps. For some steps, they may be in a parallel relationship.

[0148] Figure 2b A flow chart illustrating an example of a method for managing streaming media data according to a second embodiment of the present invention when the user terminal is on the Internet is provided. Figure 2b As shown, the provided application scenario includes: a user terminal 21, a cloud server 22, a service management service 221, a signaling control service 222, and a streaming service 223 under the cloud server 22, a relay server 23, and an image acquisition device 24. Here, only one user terminal 21, one relay server 23, and one image acquisition device 24 are used as an example; in practice, there may be multiple such devices. The first, second, third, fourth, and fifth pull signaling are all different pull signaling.

[0149] Specifically, the entire application scenario can be described as:

[0150] S1. The user terminal 21 sends a video-on-demand request to the signaling control service 222.

[0151] S2. The signaling control service 222 initiates a first signaling pull instruction to the streaming media service 223.

[0152] S3, the streaming service 223 responds to the first receiving port to the signaling control service 222;

[0153] S4. The signaling control service 222 sends a second pull signaling instruction to the transit server 23;

[0154] S5. The transit server 23 sends an RTSP address query request of the image acquisition device to the service management service 221.

[0155] S6. The service management service 221 sends the real-time streaming transmission address of the image acquisition device to the transfer server 23;

[0156] S7, the transfer server 23 pulls the target streaming media data based on the real-time streaming address of the image acquisition device 24;

[0157] S8. The transit server 23 pushes the target streaming media data to the streaming media service 223 according to the first receiving port information;

[0158] S9, the transfer server 23 responds that the target streaming media data has been sent;

[0159] S10. The signaling control service 222 sends a third pull signaling to the streaming service 223.

[0160] S11, the streaming service 223 responds with the first sending port information to the signaling control service 221;

[0161] S12, the signaling control service 222 feeds back the first sending port information to the user terminal 21;

[0162] S13, the user terminal 21 feeds back a first response message to the signaling control service 221;

[0163] S14. The signaling control service 222 notifies the streaming service 223 to forward the target streaming data from the first receiving port to the first sending port.

[0164] S15 , the streaming media service 223 forwards the target streaming media data from the first receiving port to the first sending port, and pushes the target streaming media data to the user terminal 21 through the first sending port.

[0165] It should be noted that Figure 2b It is only an example diagram of the execution steps of each functional module in a system. The step numbers given in the figure and the order of the steps in the figure do not directly indicate the order of the steps. For some steps, they may be in a parallel relationship.

[0166] Figure 2c A flow chart illustrating an example of a method for managing streaming media data according to a second embodiment of the present invention is provided when the user terminal is in a local area network. Figure 2c As shown, the provided application scenario includes: user terminal 21, cloud server 22, service management service 221 and signaling control service 222 under cloud server 22, relay server 23, and image acquisition device 24. Here, only one user terminal 21, one relay server 23, and one image acquisition device 24 are used as an example; in practice, there may be multiple such devices.

[0167] Specifically, the entire application scenario can be described as:

[0168] S1. The user terminal 21 sends a video-on-demand request to the signaling control service 222.

[0169] S2. The signaling control service 222 initiates a fourth pull signaling to the transit server 23.

[0170] S3, the transit server 23 responds to the second receiving port to the signaling control service 222;

[0171] S4. The transit server 23 sends an RTSP address query request of the image acquisition device to the service management service 221.

[0172] S5. The service management service 221 sends the real-time streaming transmission address of the image acquisition device to the transfer server 23;

[0173] S6. The transfer server 23 receives the target streaming media data through the second receiving port based on the real-time streaming transmission address of the image acquisition device 24;

[0174] S7. The signaling control service 222 sends a fifth pull signaling to the transit server 23.

[0175] S8. The transit server 23 responds with the second sending port information to the signaling control service 222.

[0176] S9. The signaling control service 222 feeds back the second sending port information to the user terminal 21.

[0177] S10, the user terminal 21 feeds back a second response message to the signaling control service 222;

[0178] S11, the signaling control service 222 notifies the transit server 23 to forward the target streaming media data from the second receiving port to the second sending port;

[0179] S12 , the transfer server 23 forwards the target streaming media data from the first receiving port to the first sending port, and sends the target streaming media data to the user terminal 21 through the second sending port information.

[0180] It should be noted that Figure 2c It is only an example diagram of the execution steps of each functional module in a system. The step numbers given in the figure and the order of the steps in the figure do not directly indicate the order of the steps. For some steps, they may be in a parallel relationship.

[0181] Example 3

[0182] Figure 3 A structural schematic diagram of an electronic device 20 that can be used to implement an embodiment of the present invention is shown. The streaming media data management method provided in the above-mentioned embodiment 1 is run on the electronic device. The electronic device can serve as the cloud server provided in the above-mentioned embodiment. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The computer device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0183] like Figure 3As shown, the electronic device 20 includes at least one processor 21 and a memory, such as a read-only memory (ROM) 22, a random access memory (RAM) 23, etc., which is communicatively connected to the at least one processor 21. The memory stores a computer program that can be executed by the at least one processor. The processor 21 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 22 or the computer program loaded from the storage unit 28 into the random access memory (RAM) 23. Various programs and data required for the operation of the electronic device 20 can also be stored in the RAM 23. The processor 21, ROM 22, and RAM 23 are connected to each other via a bus 24. An input / output (I / O) interface 25 is also connected to the bus 24.

[0184] Multiple components in the electronic device 20 are connected to the I / O interface 25, including an input unit 26, such as a keyboard, a mouse, etc.; an output unit 27, such as various types of displays, speakers, etc.; a storage unit 28, such as a magnetic disk, an optical disk, etc.; and a communication unit 29, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 29 allows the electronic device 20 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0185] The processor 21 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 21 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors that run machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 21 executes the various methods and processes described above, such as the streaming media data management method.

[0186] In some embodiments, the streaming media data management method can be implemented as a computer program that is tangibly contained in a computer-readable storage medium, such as storage unit 28. In some embodiments, part or all of the computer program can be loaded and / or installed on computer device 20 via ROM 12 and / or communication unit 29. When the computer program is loaded into RAM 23 and executed by processor 21, one or more steps of the streaming media data management method described above can be performed. Alternatively, in other embodiments, processor 21 can be configured to perform the streaming media data management method in any other suitable manner (e.g., via firmware).

[0187] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0188] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0189] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0190] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0191] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0192] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0193] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0194] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A streaming media data management system, characterized in that: include: A cloud server, and at least one transfer server, each of the transfer servers being connected to at least one image acquisition device deployed on the same local area network; Each of the image acquisition devices is used to acquire environmental image information of the environment in which it is located and generate corresponding streaming media data when in working state; Each of the relay servers is configured to send a communication connection request to the cloud server when a connection initiation condition is met, so as to establish a communication connection with the cloud service; The cloud server is used to: After receiving the on-demand request from the user terminal, determining the target image acquisition device and the target transfer server associated with the on-demand request; Determining, based on the network address of the user terminal in the on-demand request, whether the user terminal and the target image acquisition device are in the same local area network, and obtaining a determination result; Using a streaming media data forwarding form corresponding to the determination result, the target streaming media data of the target image acquisition device is pulled through the target transfer server and fed back to the user terminal; When the result of the determination is that the two devices are not in the same local area network, a first pull signaling including first receiving port information is sent to the target relay server, so that the target relay server pulls the first target streaming media data based on the real-time streaming transmission address of the target image acquisition device after receiving the first pull signaling; wherein the first pull signaling is an instruction for notifying the streaming media service to open a receiving port; receiving the first target streaming media data pushed by the target relay server, and feeding back the determined first sending port information to the user terminal; After receiving a first response message from the user terminal relative to the first sending port information, forwarding the first target streaming media data from the first receiving port to the first sending port; Pushed to the user terminal by the first sending port.

2. The system according to claim 1, wherein: The cloud server is also used for: When the result of the determination is that the two devices are in the same local area network, a second pull signaling including second receiving port information is sent to the target relay server, so that the target relay server pulls the second target streaming media data based on the real-time streaming transmission address of the target image acquisition device after receiving the second pull signaling; Feedback the determined second sending port information to the user terminal; After receiving a second response message from the user terminal relative to the second sending port information, forwarding the second target streaming media data from the second receiving port to the second sending port; The second sending port pushes the data to the user terminal.

3. The system according to claim 1 or 2, characterized in that The target relay server is further configured to: After receiving the pull signaling, sending an address query request of the target image acquisition device to the cloud server; Obtaining a real-time streaming address corresponding to the address query request feedback; The real-time streaming address is accessed to pull the target streaming data of the target image acquisition device, and the target streaming data is received through a receiving port.

4. The system according to claim 1, wherein: The transfer server is further used to: After power-on startup, or when it is detected in a set period that a communication connection is not established with the cloud server, a communication connection request is sent to the cloud server to establish a communication connection with the cloud server.

5. The system according to claim 4, characterized in that The cloud server is also used for: After establishing a communication connection with any relay server, the device status detection is performed on each image acquisition device associated with the relay server, and when a status viewing request from a user terminal is received, the status detection result of the corresponding image acquisition device is sent to the user terminal.

6. The system according to claim 5, characterized in that The cloud server is specifically used for: When it is determined according to the received communication connection request that the associated transit server is successfully registered and is in an online state, determining to establish a communication connection with the associated transit server; Sending the determined associated device information to the associated transfer server; receiving a device status determined by the association transfer server relative to each associated image acquisition device according to the associated device information; When a status viewing request from a user terminal is received, the device status of the image acquisition device corresponding to the status viewing request is fed back to the user terminal.

7. The system according to claim 6, characterized in that The cloud server is further specifically used for: receiving a communication connection request initiated by at least one relay server; Matching the connection information in each communication connection request with the registration configuration information in the set configuration file; For the relay server whose information matches, it is determined that the relay server is successfully registered and is in an online state; For the relay server whose information does not match, it is determined that the current registration of the relay server has failed, and the communication connection request re-sent by the relay server is waited for.

8. The system according to claim 6, wherein: The transfer server is further used to: Determining an associated image acquisition device based on the received associated device information; Performing a network status test on each associated image acquisition device, and determining the device status of the corresponding image acquisition device based on the network status test result; Feedback the device status of each associated image acquisition device to the cloud server.

9. A streaming media data management method, characterized in that: The method is executed by the cloud server in the system according to any one of claims 1 to 8, wherein the system further comprises at least one relay server, each of the relay servers being connected to at least one image acquisition device deployed in the same local area network; Wherein, each of the image acquisition devices, when in working state, collects environmental image information of the environment in which it is located and forms corresponding streaming media data; each of the relay servers, when meeting the connection initiation conditions, sends a communication connection request to the cloud server to establish a communication connection with the cloud service; The method comprises: After receiving the on-demand request from the user terminal, determining the target image acquisition device and the target transfer server associated with the on-demand request; Determining, based on the network address of the user terminal in the on-demand request, whether the user terminal and the target image acquisition device are in the same local area network, and obtaining a determination result; Using a streaming media data forwarding form corresponding to the determination result, the target streaming media data of the target image acquisition device is pulled through the target transfer server and fed back to the user terminal; When the result of the determination is that the two devices are not in the same local area network, a first pull signaling including first receiving port information is sent to the target relay server, so that the target relay server pulls the first target streaming media data based on the real-time streaming transmission address of the target image acquisition device after receiving the first pull signaling; wherein the first pull signaling is an instruction for notifying the streaming media service to open a receiving port; receiving the first target streaming media data pushed by the target relay server, and feeding back the determined first sending port information to the user terminal; After receiving a first response message from the user terminal relative to the first sending port information, forwarding the first target streaming media data from the first receiving port to the first sending port; Pushed to the user terminal by the first sending port.

10. An electronic device, characterized in that: As the cloud server in the system according to any one of claims 1 to 8, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the streaming media data management method described in claim 9.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, a streaming media data management method as claimed in claim 9 is implemented.

Citation Information

Patent Citations

  • An access request processing method and apparatus in a video monitoring system

    CN103595736A

  • Monitoring detection method and device

    CN110519554A

  • Video monitoring data transmission method and device, equipment and storage medium

    CN113301311A