Methods, equipment, systems and media for multi-channel video playback in property monitoring
By displaying the monitoring list and operation items in the browser and playing multiple video streams directly in a floating window, the problem of browsers being unable to play concurrently is solved, server costs and resource consumption are reduced, and video playback quality and management efficiency are improved.
Patent Information
- Application Number
- CN202310389815.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-03
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-04-03
AI Technical Summary
In the field of property monitoring, browsers cannot play multiple video streams simultaneously, and different browsers have inconsistent support for plugins, resulting in limited video playback quality and excessive hardware costs and server resource consumption.
Displays a monitoring list and operation items in the browser, receives user commands to obtain audio and video information, and plays it directly in a floating window. It supports streaming media with multiple protocols without background transcoding.
It enables concurrent playback of multiple video streams on the browser, reducing server costs and resource consumption, and improving video playback quality and management efficiency.
Smart Images

Figure CN116405725B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of smart property management, and in particular to a method, device, system, and medium for multi-channel video playback in property monitoring. Background Technology
[0002] Intelligent video surveillance systems are the foundational business systems of smart park projects, comprising a monitoring center and numerous monitoring devices, such as cameras at parking lot entrances and exits. As the source, the cameras provide video streams using streaming media control protocols such as RTSP. After receiving this video stream, the monitoring center displays and plays it on its monitoring client via a browser for property management personnel to monitor and manage. However, browsers have limited support for video playback; many streaming media cannot be played directly and require browser plugins or background transcoding.
[0003] The inventors discovered that in the field of property monitoring, browsers need to play multiple video streams simultaneously. Furthermore, due to the diverse types of monitoring devices connected, the types of streaming media are also numerous. Therefore, existing technical solutions suffer from at least the following problems: Firstly, different browsers strictly control plugins, preventing some streaming media that rely on plugins from playing in browsers. Secondly, implementing protocol conversion for streaming media through backend transcoding incurs hardware costs and consumes significant server resources. Especially in the property monitoring field, the playback quality of video in browsers is severely affected by high concurrency and bandwidth limitations. Therefore, a solution is urgently needed to address the problem of concurrent playback of multiple monitoring videos in the property monitoring field. Summary of the Invention
[0004] This invention provides a method, device, and medium for playing multiple video streams in property monitoring, aiming to solve the problem mentioned above that multiple monitoring videos cannot be played concurrently in the browser of the monitoring center in the field of property monitoring.
[0005] The technical solution is as follows:
[0006] On the one hand, a method for multi-channel video playback for property monitoring is provided, including the following steps:
[0007] The browser displays the first interactive interface, which includes a monitoring list, device status, and corresponding operation items.
[0008] Receive a first instruction from a first user to select an operation item from a monitoring list, the first instruction including the selected monitoring device and the operation item including playback;
[0009] In response to the first instruction, a second interactive interface with a playback window is displayed in the browser, and an internal playback instruction is sent so that the playback control unit can obtain the audio and video information of the selected monitoring device, decode the audio and video information and cache it as cached audio and video information. According to the preset number and size of playback windows, a floating window is superimposed on the corresponding position of the playback window in the second interactive interface, and the cached audio and video information is played in the floating window.
[0010] Furthermore, the monitoring list is divided according to the scene where the monitoring equipment is located. The scenes include parking lots, office buildings, warehouses and residential areas. When you click on the operation item corresponding to a scene in the monitoring list, the audio and video information of all monitoring equipment in the scene will be obtained and played.
[0011] Furthermore, the monitoring list for each scenario also includes a list of monitoring devices. When an operation item corresponding to a single monitoring device in the monitoring device list is clicked, the audio and video information of that single monitoring device is acquired and played.
[0012] Furthermore, the list of monitored devices also includes device status, which includes online and offline. The audio and video information of the monitored devices includes historical audio and video information and real-time audio and video information. The historical audio and video information is the audio and video information saved before the device went offline, and the real-time audio and video information is the audio and video information acquired in real time.
[0013] If the device is online, the audio and video information corresponds to real-time audio and video information; if the device is offline, the audio and video information corresponds to historical audio and video information.
[0014] Furthermore, the second interactive interface also includes corresponding operation items for audio and video information, and receives a second instruction from the first user to operate on the corresponding operation items of audio and video information by setting playback settings for the audio and video information.
[0015] In response to the second command, control the playback process of audio and video information on the second interactive interface.
[0016] Furthermore, the corresponding operation items for audio and video information include: changing the number of playback windows.
[0017] Furthermore, the corresponding operation items for audio and video information include: taking a screenshot of the video in the playback window.
[0018] On the other hand, a computer device is provided, comprising:
[0019] The processor, memory, and communication circuitry are connected to the memory and communication circuitry, respectively.
[0020] The communication circuit is used for communication connection, the memory is used to store computer programs, and the processor is used to execute the computer programs to implement any of the above methods.
[0021] On the other hand, a property monitoring system is provided, including the aforementioned computer equipment.
[0022] On the other hand, a computer-readable storage medium is provided, storing a computer program that can be executed by a processor to implement any of the methods described above.
[0023] The beneficial effects of this invention are as follows: Using the solution of this invention, a first interactive interface displaying a monitoring list is shown in the browser. User selections and operation instructions are received, and a second interactive interface is generated and displayed in the browser based on the operation instructions. Corresponding audio and video information is obtained based on the monitoring device selected by the user. Finally, the audio and video information is controlled to play in the corresponding window based on the size and number of playback windows generated in the second interactive interface. This method of the invention allows for the concurrent playback of streaming media with multiple protocols directly on the monitoring client without requiring transcoding by the backend server, effectively reducing the cost and pressure on the backend server. Attached Figure Description
[0024] Figure 1 This is an architecture diagram of a multi-channel video playback system for property monitoring according to an embodiment of the present invention;
[0025] Figure 2 This is a schematic flowchart of a multi-channel video playback method for property monitoring according to an embodiment of the present invention;
[0026] Figure 3 This is a schematic diagram of the first interactive interface according to an embodiment of the present invention;
[0027] Figure 4 This is a schematic diagram of the second interactive interface according to an embodiment of the present invention;
[0028] Figure 5 This is a schematic diagram of the entire process of a multi-channel video playback method for property monitoring according to an embodiment of the present invention;
[0029] Figure 6 This is a schematic diagram of the hardware structure of an embodiment of the present invention. Detailed Implementation
[0030] To facilitate understanding of the present invention, a more detailed description is provided below with reference to the accompanying drawings and specific embodiments. Preferred embodiments of the invention are shown in the drawings. However, the invention can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided to provide a thorough and complete understanding of the disclosure of the invention.
[0031] It should be noted that, unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention.
[0032] like Figure 1 As shown, this invention provides a multi-channel video playback system for property monitoring. It comprises a three-layer structure: a monitoring client for viewing surveillance video, a video monitoring management platform, and monitoring equipment deployed in various property locations.
[0033] The video surveillance management platform is typically located in the computer room of the monitoring center, where a large number of servers process data.
[0034] Surveillance equipment is typically a network-enabled camera that can automatically transmit the captured video back to the video surveillance management platform in real time.
[0035] The client application can be located in the monitoring center or other locations for the convenience of property management personnel. Client formats include, but are not limited to: PC clients, large-screen clients, and mobile clients.
[0036] The client includes a computer program that implements the multi-channel video playback method for property monitoring provided by this invention. This program enables concurrent playback of multiple video streams in the client's browser without requiring a decoding service to be set up in the video monitoring management platform, thus eliminating computational and network bottlenecks associated with centralized decoding service setup.
[0037] like Figure 2-4 As shown, the present invention provides a method for multi-channel video playback for property monitoring, including the following steps:
[0038] S10: Display the first interactive interface in the browser. The first interactive interface has a monitoring list, device status and corresponding operation items.
[0039] S20: Receive a first instruction from the first user to select an operation item from the monitoring list and perform an operation on the operation item. The first instruction includes the selected monitoring device and the operation item includes playback.
[0040] S30: In response to the first instruction, a second interactive interface with a playback window is displayed in the browser, and an internal playback instruction is sent so that the playback control unit can obtain the audio and video information of the selected monitoring device, decode the audio and video information and cache it as cached audio and video information, and according to the preset number and size of the playback windows, a floating window is superimposed on the corresponding position of the playback window in the second interactive interface, and the cached audio and video information is played in the floating window.
[0041] In step S30, when the number of windows is greater than or equal to the number of monitoring devices, the cached audio and video information is displayed sequentially. When the number of windows is less than the number of monitoring devices, the cached audio and video information is displayed sequentially, and a prompt appears, such as suggesting that the number of windows can be increased. The option to increase the number of windows is displayed in the playback settings subpage at the bottom of the playback window.
[0042] Further, refer to Figure 4 A monitoring list subpage is also provided on one side of the playback window, which makes it convenient for users to switch monitoring scenes without having to return to the first interactive interface.
[0043] Further, refer to Figure 3 The monitoring list is divided according to the scene where the monitoring equipment is located. Scenes include parking lots, office buildings, warehouses and residential areas. When you click on the operation item corresponding to a scene in the monitoring list, the audio and video information of all monitoring equipment in the scene will be obtained and played.
[0044] Furthermore, the monitoring list for each scenario also includes a list of monitoring devices. When an operation item corresponding to a single monitoring device in the monitoring device list is clicked, the audio and video information of that single monitoring device is acquired and played.
[0045] Furthermore, the list of monitored devices also includes device status, which includes online and offline. The audio and video information of the monitored devices includes historical audio and video information and real-time audio and video information. The historical audio and video information is the audio and video information saved before the device went offline, and the real-time audio and video information is the audio and video information acquired in real time.
[0046] If the device is online, the audio and video information corresponds to real-time audio and video information; if the device is offline, the audio and video information corresponds to historical audio and video information.
[0047] Furthermore, if the device is offline, you can choose not to play historical audio and video information.
[0048] The above methods provide multi-dimensional monitoring scenarios and audio / video monitoring management for monitoring equipment, which can adapt to different needs.
[0049] Furthermore, the second interactive interface also includes corresponding operation items for audio and video information, and the method includes: receiving a second instruction from the first user to perform playback settings on the audio and video information and operate on the corresponding operation items of the audio and video information; responding to the second instruction, controlling the playback process of the audio and video information on the second interactive interface.
[0050] Furthermore, the corresponding operation items for audio and video information include: changing the number of playback windows.
[0051] Furthermore, the corresponding operation items for audio and video information include: taking a screenshot of the video in the playback window.
[0052] Furthermore, the corresponding operation items for audio and video information include: dynamically hiding the playback window.
[0053] Furthermore, the corresponding operation items for audio and video information also include: adjusting the position and size of the playback window, stopping playback, pausing playback, switching playback, hiding the playback window, switching to auto-play, playing historical videos, and playing live videos.
[0054] Furthermore, switching to autonomous playback includes: the playback control unit does not play the decoded cached audio and video information in a window, but instead converts it into HTTP streaming media audio and video information, which is then played autonomously by the browser.
[0055] Further, refer to Figure 4 The corresponding operation items for audio and video information are displayed in the playback settings sub-interface at the bottom of the playback window.
[0056] Specifically, refer to Figure 5 This provides a complete implementation example.
[0057] The playback system includes the aforementioned playback control unit.
[0058] 1. The local program of the playback system starts a long-connection server (such as WebSocket, including but not limited to), and the browser starts a long-connection client. The browser actively connects to the playback system when playback is needed.
[0059] 2. The browser sends a message through the script engine to notify the local program to initialize and display the playback window and multiple child windows in an appropriate location;
[0060] 3. The browser notifies the playback system to play the video from the specified media stream address at a specific location in the playback window. For example, the media stream address can be the address of the selected monitoring device mentioned above.
[0061] 4. The local program encapsulates a playback instance for each child window;
[0062] 5. Local program playback example: Receive streaming media from a specified streaming media address in the browser;
[0063] 6. The local program's playback instance separates the received streaming media into video and audio streams, and places the video and audio streams into their respective decoding buffers;
[0064] 7. The local program's playback instance decodes the video and audio streams in the decoding buffer and places them into the corresponding playback buffer;
[0065] 8. The local program's playback instance renders and outputs the video and audio streams from the playback buffer in the playback window;
[0066] 9. After receiving user input, the browser generates the following instructions to control the playback system to fully control the playback window and playback source.
[0067] 1) Initialize a playback window at the corresponding location on the browser page. You can set its size, position, and the number of child windows per screen: {"req
[0068] ":"Player_Init","rid":"","params":{"left":0,"top":0,"width":320,"height":240,"showType":"1*1"}}
[0069] Where req is the request type; Player_Init is the playback initialization, and rid is the specified window number;
[0070] showType: The number of windows for the x and y coordinates;
[0071] 2) Play the specified streaming media in a specified sub-window of the display window:
[0072] {"req":"Player_Change_Play","rid":"","params":{"playList":[{"id":0,"uri":"","type":":rtsp-tcp"}]}}
[0073] Player_Change_Play indicates the start of playback. playList is the playlist. uri is the playback path.
[0074] The type parameter specifies the video stream format.
[0075] 3) Dynamically adjust the position and size of the playback window:
[0076] {"req":"Player_Resize","rid":"","params":{"left":0,"top":0,"width":320,"heig ht":240}}
[0077] 4) Dynamically change the number of child windows displayed in the playback window:
[0078] {"req":"Player_Change_ShowType","rid":"","params":{"showType":"1*1"}}
[0079] 5) Dynamically stop displaying the playback content of a specified child window of the playback window:
[0080] {"req":"Player_Stop","rid":"","params":{"id":0}}
[0081] 6) Take a screenshot of a child window that is currently playing content from the displayed playback window:
[0082] {"req":"Player_Snapshot","rid":"","params":{"id":0}}
[0083] 7) Dynamically hide the entire display playback window:
[0084] {"req":"Player_Hide","rid":""},"Player_Show":{"req":"Player_Show","rid":""}
[0085] 8) Dynamically hide or show portions of the playback window to avoid obscuring certain parts of the browser page:
[0086] {"req":"Player_Cover","rid":"","params":{"left":30,"top":30,"right":30,"bott om":30}}
[0087] 10. When the browser needs to directly control the streaming media, it notifies the playback system to convert the specified streaming media for output through the following message. The playback instance uses a converter to convert the video and audio streams in the decoding buffer into streaming media formats supported by the browser, such as Ogg and Webm. The browser then plays the converted stream on its own without needing to go through a playback window.
[0088] 1) Dynamically converting a streaming media into the required format is as follows:
[0089] {"req":"Media_Codec","rid":"","params":{"uri":"","option":":rtsp-tcp"}}
[0090] Furthermore, when the browser plays the converted streaming media, it detects the difference between the latest converted time frame and the currently playing time frame. A threshold is preset; when the difference exceeds the threshold, playback is sped up to reduce latency.
[0091] Furthermore, the playback system includes a long link unit and a playback control unit.
[0092] The long-connection unit is responsible for establishing a long-connection communication with the browser, while the playback control unit is responsible for communicating with the browser, enabling bidirectional control of audio and video on the monitoring equipment.
[0093] Furthermore, the playback control unit includes a control module, an audio / video decoding module, an HTTP streaming media conversion module, and an audio / video output module.
[0094] The control module controls other modules to complete the reception, decoding, conversion, and output of audio and video based on instructions from the browser.
[0095] The audio and video decoding module decodes and caches the received surveillance video.
[0096] The audio and video output module will play the decoded and buffered audio and video in a window.
[0097] The HTTP streaming conversion module further transcodes the decoded and cached audio and video for direct playback by the browser.
[0098] Furthermore, the multi-channel video playback method embodiment for property monitoring of this application can run on the client's device system. The client can be client software running on a desktop computer, mobile terminal, or tablet. When the client software runs, it generates a human-computer interaction interface in a browser, and the user can operate on the human-computer interaction interface using devices such as touch screens, mice, and keyboards. In this embodiment, the client software serves as the execution entity for running the multi-channel video playback method for property monitoring of this application.
[0099] Before step S10 is executed, the user starts the client software through the human-machine interface. After starting the client software, the first interactive interface for human-machine interaction can be automatically generated, which makes it convenient for the user to issue commands through the interface.
[0100] Furthermore, before displaying the first interactive interface, the following is included:
[0101] Receive the third command from the first user's login;
[0102] The first user is verified in response to the third instruction;
[0103] The first interactive interface includes:
[0104] Upon successful verification of the first user, a monitoring list matching the first user's permissions and its corresponding operation items are displayed on the first interactive interface.
[0105] Specifically, the operations that different types of users can perform after entering the first interactive interface may differ. Please refer to the following steps for details:
[0106] In response to successful user verification, the first interactive interface displays content matching the user's permissions and their corresponding operation items.
[0107] The server verifies user login. Once verification is successful, the user can access the interactive interface and set permissions for content so that only designated personnel can operate on it.
[0108] On the other hand, the present invention provides a computer device, comprising:
[0109] The processor, memory, and communication circuitry are connected to the memory and communication circuitry, respectively.
[0110] The communication circuit is used for communication connection, the memory is used to store computer programs, and the processor is used to execute the computer programs to implement any of the above methods.
[0111] In another aspect, the present invention provides a readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the methods in the above embodiments.
[0112] For details, please refer to the following: Figure 6 In practical applications, Figure 6 This is a schematic diagram of the hardware operating environment involved in the various methods of the present invention.
[0113] like Figure 6 As shown, the hardware operating environment may include: a processor 1001, such as a CPU; a communication bus 1002; a user interface 1003; a network interface 1004; and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen or an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or stable non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0114] Those skilled in the art will understand that Figure 6The hardware structures shown for each method are not intended to limit the devices on which the methods operate. They may include more or fewer components than shown, or combinations of certain components, or different arrangements of components.
[0115] like Figure 6 As shown, the memory 1005, which serves as a readable storage medium, may include an operating system, a network communication module, a user interface module, and computer programs. The operating system is a management and control program that supports the operation of the network communication module, the user interface module, the computer programs, and other programs or software. The network communication module manages and controls the network interface 1004, and the user interface module manages and controls the user interface 1003.
[0116] exist Figure 6 In the hardware structure shown, the network interface 1004 is mainly used to connect to the backend server and communicate with the backend server; the user interface 1003 is mainly used to connect to the client (user terminal) and communicate with the client; the processor 1001 can call the computer program stored in the memory 1005 and execute the methods described above.
[0117] In summary, this application has the following beneficial effects:
[0118] By displaying a first interactive interface with a monitoring list in the browser, the system receives user selections and operation commands. Based on these commands, a second interactive interface is generated and displayed in the browser. This interface retrieves corresponding audio and video information based on the user-selected monitoring devices. Finally, the system controls the playback of the audio and video information in the corresponding windows based on the size and number of playback windows in the generated second interactive interface. This method allows for the direct concurrent playback of streaming media using multiple protocols on the monitoring client, eliminating the need for transcoding by a backend server and effectively reducing the cost and load on the backend server.
[0119] Furthermore, the browser provides a human-computer interaction interface for property monitoring that is differentiated by scene type, making it convenient for users to view monitoring videos of different scenes in real time, simplifying user operation, and improving property management efficiency.
[0120] Furthermore, by providing information on the online and offline status of devices, users can choose different ways to play surveillance videos, thus meeting the needs of more users.
[0121] Furthermore, by setting up a cache for the decoded audio and video information, playback can be performed from the audio and video data stored in the audio and video playback cache, thereby reducing latency and stuttering caused by poor network conditions.
[0122] Furthermore, subsequent operations such as stopping, pausing, switching, and taking screenshots of the streaming media can be completed through the browser. Users do not need to be aware of the existence of the local program or perform any other operations; they only need to operate on the browser.
[0123] Furthermore, users can choose to play streaming media automatically on the browser side. This streaming media is an HTTP streaming media obtained by converting decoded audio and video information, in order to meet the playback needs of more browsers.
[0124] Furthermore, by managing user roles, the interface content can be differentiated according to permissions, thereby enabling the operation management of personnel with different identities.
Claims
1. A method for multi-channel video playback in property monitoring, characterized in that, Including the following steps: The browser displays a first interactive interface, which includes a monitoring list, device status, and corresponding operation items. The system receives a first instruction from a first user to select an operation item from the monitoring list and perform an operation on the operation item. The first instruction includes the selected monitoring device, and the operation item includes playback. In response to the first instruction, a second interactive interface with a playback window is displayed in the browser, and an internal playback instruction is sent to the playback control unit to obtain the audio and video information of the selected monitoring device, decode and cache the audio and video information as cached audio and video information, and overlay a floating window at the corresponding position of the playback window in the second interactive interface according to the preset number and size of the playback windows, and play the cached audio and video information in the floating window; the playback control unit includes a control module, an audio and video decoding module, an HTTP streaming media conversion module, and an audio and video output module. The control module controls other modules to complete the reception, decoding, conversion, and output of audio and video according to the instruction from the browser. The audio and video decoding module decodes and caches the received monitoring video; the audio and video output module plays the decoded and cached audio and video in a window; the HTTP streaming media conversion module further transcodes the decoded and cached audio and video for direct playback by the browser; wherein, when switching to autonomous playback, the playback control unit does not play the decoded cached audio and video information in a window, but converts the cached audio and video information into HTTP streaming media audio and video information, which is then played autonomously by the browser.
2. The multi-channel video playback method for property monitoring according to claim 1, characterized in that, The monitoring list is divided according to the scene where the monitoring equipment is located. The scenes include parking lots, office buildings, warehouses and residential areas. When an operation item corresponding to a scene in the monitoring list is clicked, the audio and video information of all monitoring equipment in that scene is acquired and played.
3. The multi-channel video playback method for property monitoring according to claim 2, characterized in that, The monitoring list for each scenario also includes a list of monitoring devices. When an operation item corresponding to a single monitoring device in the monitoring device list is clicked, the audio and video information of the single monitoring device is acquired and played.
4. The multi-channel video playback method for property monitoring according to claim 3, characterized in that, The monitoring device list also includes device status, which includes online and offline. The audio and video information of the monitoring device includes historical audio and video information and real-time audio and video information. The historical audio and video information is the audio and video information saved before the device went offline, and the real-time audio and video information is the audio and video information acquired in real time. If the device is online, the audio and video information corresponds to the real-time audio and video information; if the device is offline, the audio and video information corresponds to the historical audio and video information.
5. The multi-channel video playback method for property monitoring according to claim 4, characterized in that, The second interactive interface also includes corresponding operation items for the audio and video information, and receives a second instruction from the first user to perform playback settings on the audio and video information and operate on the corresponding operation items of the audio and video information. In response to the second instruction, control the playback process of the audio and video information on the second interactive interface.
6. The multi-channel video playback method for property monitoring according to claim 5, characterized in that, The corresponding operation items for the audio and video information include: changing the number of playback windows.
7. The multi-channel video playback method for property monitoring according to claim 6, characterized in that, The corresponding operation items for the audio and video information include: taking a screenshot of the video in the playback window.
8. A computer device, characterized in that, include: The processor, memory, and communication circuitry are respectively connected to the memory and the communication circuitry. The communication circuit is used for communication connection, the memory is used to store computer programs, and the processor is used to execute the computer programs to implement the method as described in any one of claims 1-7.
9. A property monitoring system, characterized in that, Includes the computer device as described in claim 8.
10. A computer-readable storage medium, characterized in that, The device contains a computer program that can be executed by a processor to implement the method as described in any one of claims 1-7.
Citation Information
Patent Citations
Monitoring and checking method and device based on articulated naturality web
CN110191315A
Monitoring video display control method and device
CN112449159A
Data playing method and device, storage medium and electronic equipment
CN115600024A
