Live broadcast processing method and device, server, live broadcast processing system and storage medium

Abstract

The embodiment of the invention discloses a live broadcast processing method and device, a server, a live broadcast processing system and a storage medium, and relates to the technical field of computer vision, and the method comprises the steps: receiving a live broadcast request from a video collection device, and enabling the live broadcast request to be sent when the video collection device detects that a moving target exists in a target region; the live broadcast request is used for requesting live broadcast of a first video collected by the video collection device, the target area comprises an area set by the video collection device, and the first video comprises a video triggered and collected during a period when a moving target exists in the target area, and instructing a target display device in the display device to live broadcast the first video in response to the live broadcast request. According to the embodiment of the invention, when the moving target exists in the target area, the activity of the moving target in the target area can be live broadcast through the display device, so that the real-time performance of observing the moving target can be improved.

Description

Technical Field

[0001] The present application relates to the field of computer vision technology, and more specifically, to a live broadcast processing method, device, server, live broadcast processing system and storage medium. Background Art

[0002] As the number of urban parks increases, citizens have a growing need to observe animals and plants. Currently, you can use camera equipment to set up in places where animals and birds often appear, or set up a feeding point, set up the camera equipment, and use the camera equipment to take photos or videos of animals and birds.

[0003] In the related art, after taking a photo or recording a video, the shooting device stores the photo or video obtained in a Secure Digital Memory Card (SD) card or uploads it to a server, and then waits for the staff to play the photo or video stored in the SD card or server.

[0004] However, this kind of observation of moving targets such as animals and birds is not very real-time. Summary of the Invention

[0005] In view of the above problems, the present application proposes a live broadcast processing method, device, server, live broadcast processing system and storage medium, which can improve the real-time observation of moving targets.

[0006] In a first aspect, an embodiment of the present application provides a live broadcast processing method, comprising:

[0007] A live broadcast request is received from a video acquisition device, wherein the live broadcast request is sent by the video acquisition device when an active target is detected in a target area, and is used to request a live broadcast of a first video acquired by the video acquisition device, wherein the target area includes an area set by the video acquisition device, and the first video includes a video triggered and acquired during the period when the active target exists in the target area; in response to the live broadcast request, a target display device in a display device is instructed to live broadcast the first video.

[0008] In one possible implementation, before the target display device in the indicated display device broadcasts the first video live, the method further includes: obtaining the working status of each display device in the M display devices, where M is an integer not less than 1; based on the working status of each display device, determining the display device that meets the preset conditions as the target display device, the preset conditions including that the working status is an idle state, the number of second videos in the working status that are currently broadcast live is less than a quantity threshold, or the second video in the working status that is currently broadcast live is consistent with the video currently broadcast live by other display devices; the target display device in the indicated display device broadcasts the first video live, including: if the preset conditions include that the working status is an idle state or the second video currently broadcast live is consistent with the video currently broadcast live by other display devices, then instructing the target display device to broadcast the first video live; if the preset conditions include that the number of videos in the working status that are currently broadcast live is less than a quantity threshold, then instructing the target display device to broadcast the first video and the second video in split-screen.

[0009] In one possible implementation, the preset condition includes that the working state is an idle state or the second video currently being broadcast is consistent with the video currently being broadcast by other display devices. If there are multiple display devices that meet the preset condition, determining the display device that meets the preset condition as the target display device includes one of the following: determining the display device closest to the server that executes the live broadcast processing method among the multiple display devices that meet the preset condition as the target display device; or, determining the display device closest to the video acquisition device among the multiple display devices that meet the preset condition as the target display device; or, determining the display device with the largest surrounding traffic among the multiple display devices that meet the preset condition as the target display device.

[0010] In one possible implementation, the preset condition includes that the number of second videos currently being broadcast live in the working state is less than a quantity threshold. If there are multiple display devices that meet the preset condition, determining the display device that meets the preset condition as the target display device includes: determining the video attributes of the second video broadcast live by each display device among the multiple display devices that meet the preset condition, and determining the video attributes of the first video; and determining the display device whose video attributes of the second video broadcast live are consistent with the video attributes of the first video as the target display device.

[0011] In one possible implementation, the method further includes: if any display device does not meet the preset condition, caching the first video; when one of the display devices switches from not meeting the preset condition to meeting the preset condition, instructing one of the display devices to play the first video.

[0012] In a possible implementation, there are multiple cached first videos, and the multiple cached first videos come from different video acquisition devices. Instructing one of the display devices to play the first video includes: instructing one of the display devices to play the first video with the earliest acquisition time among the multiple cached first videos.

[0013] In one possible implementation, in response to the live broadcast request, instructing a target display device among the display devices to live broadcast the first video, including: in response to the live broadcast request, determining a target display device among M display devices, where M is an integer not less than 1; receiving a video signal of the first video captured by the video capture device, and sending the video signal of the first video to the target display device, so that the target display device live broadcasts the first video based on the video signal of the first video.

[0014] In one possible implementation, after determining the target display device among the M display devices, the method further includes: sending a target indication to the target display device, so that the target display device plays a third video stored in the target display device based on the target indication, and the third video is used to prompt that the video captured by the video capture device will be broadcast live.

[0015] In a second aspect, an embodiment of the present application provides a live broadcast processing device, comprising: a receiving module for receiving a live broadcast request from a video acquisition device, wherein the live broadcast request is sent by the video acquisition device when an active target is detected in a target area, and is used to request the live broadcast of a first video captured by the video acquisition device, wherein the target area includes an area set by the video acquisition device, and the first video includes a video triggered and captured during the period when the active target exists in the target area; a live broadcast response module for responding to the live broadcast request and instructing a target display device in the display device to broadcast the first video.

[0016] In a third aspect, an embodiment of the present application provides a server comprising one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the above-mentioned method.

[0017] In a fourth aspect, an embodiment of the present application provides a live broadcast processing system, comprising a video acquisition device, a server and a display device; the video acquisition device is used to send a live broadcast request to the server when an active target is detected in a target area, the live broadcast request being used to request the live broadcast of a first video captured by the video acquisition device, the target area including the area set by the video acquisition device, and the first video including the video triggered and captured during the period when the active target exists in the target area; the server is used to instruct the target display device in the display device to broadcast the first video in response to the live broadcast request.

[0018] In a fifth aspect, the present application provides a computer-readable storage medium, in which program code is stored, wherein the above method is executed when the program code is run.

[0019] The embodiments of the present application provide a live broadcast processing method, device, server, live broadcast processing system and storage medium, which receive a live broadcast request from a video acquisition device, wherein the live broadcast request is sent by the video acquisition device when an active target is detected in a target area, and is used to request the live broadcast of a first video acquired by the video acquisition device, wherein the target area includes an area set by the video acquisition device, and the first video includes a video triggered and acquired during the period when the active target exists in the target area, and in response to the live broadcast request, instructs a target display device in a display device to live broadcast the first video. In this way, when an active target exists in the target area, the activities performed by the active target in the target area can be live broadcasted through the display device, thereby improving the real-time observation of the active target. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0022] Figure 2 This is a schematic diagram of the overall framework of a live broadcast processing method according to an embodiment of the present application;

[0023] Figure 3 A flowchart of a live broadcast processing method provided in an embodiment of the present application;

[0024] Figure 4A schematic structural diagram of a live broadcast processing device provided in an embodiment of the present application;

[0025] Figure 5 A block diagram of the server architecture provided in an embodiment of the present application;

[0026] Figure 6 It is a storage unit for storing or carrying program codes for implementing the audio data output method according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0028] As the number of urban parks increases, citizens have a growing need to observe animals and plants. Currently, you can use camera equipment to set up in places where animals and birds often appear, or set up a feeding point, set up the camera equipment, and use the camera equipment to take photos or videos of animals and birds.

[0029] In the related art, after taking a photo or recording a video, the shooting device stores the photo or video obtained in a Secure Digital Memory Card (SD) card or uploads it to a server, and then waits for the staff to play the photo or video stored in the SD card or server.

[0030] However, when the staff plays the pictures or videos stored in the SD card or server, it is often a long time before the stored pictures or videos are played. In this way, the played pictures or videos are not the scenes when they were shot. In this way, the real-time observation of moving targets such as animals and birds is not high.

[0031] In view of this, the present application proposes a live broadcast processing method, device, server, live broadcast processing system and storage medium, which can improve the real-time observation of active targets and enhance user experience.

[0032] For ease of understanding, the following embodiment is exemplified by one application scenario of the live broadcast processing method.

[0033] See also Figure 1 , Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1 The application scenario shown includes a shooting device 110 , a central server 120 and a display device 130 .

[0034] The camera 110 is used to capture moving objects, such as animals and birds, in its designated area. The camera 110 may be, for example, a passive infrared (PIR) device. A PIR device may be a device that uses passive infrared technology to detect the activity of moving objects. The central server 120 may be referred to simply as the server.

[0035] In this embodiment, when the camera device 110 detects an active target in its corresponding detection area, it sends a live broadcast request to the central server 120. The server then queries whether there are idle display devices 130. If there are, it sends an instruction for the camera device 110 to send a live broadcast signal to the central server 120. The central server 120 then sends the live broadcast signal to an idle display device 130, so that the display device 130 can broadcast the live broadcast signal based on the received live broadcast signal, providing real-time video of the active target's activities. If there are no idle display devices 130, the live broadcast signal is first converted into a video recording. For example, set the recording time to 1 minute. After 1 minute of recording, this video recording is uploaded to the central server 120. When the display device 130 is idle, the video recording is sent to the display device 130 for playback.

[0036] In another possible implementation, the central server 120 may not be required. When the shooting module of the shooting device 110 detects the presence of an active target in its corresponding detection area, it sends a live broadcast request to the processor in the shooting device 110. The processor then queries whether there is an idle display device 130. If there is, the live broadcast signal is sent to the idle display device 130 through the signal transceiver module of the shooting device 110, so that the display device 130 can broadcast the live broadcast signal received to provide real-time video of the activities of the active target. If there is no idle display device 130, the live broadcast signal is first converted into a video recording. For example, the recording time is set to 1 minute. After 1 minute of recording, the video recording is stored in the memory of the shooting device 110. When the display device 130 is idle, the video recording is sent to the display device 130 through the signal transceiver module for playback.

[0037] In this embodiment, there may be one or more shooting devices 110. There may also be one or more display devices 130, which are not limited here. Multiple means no less than two.

[0038] It should be noted that the shooting device 110 of this embodiment may be, for example, a shooting device 110 installed with a specific client.

[0039] It can be understood that this embodiment can provide an intuitive and effective observation method for relevant animal researchers, parks, etc.

[0040] The following describes the overall framework of a live broadcast processing method provided by an embodiment of the present application. Figure 2 , Figure 2 This is a schematic diagram of the overall framework of a live broadcast processing method according to an embodiment of the present application.

[0041] In general, PIR-triggered shooting devices (such as hunting cameras, bird-watching cameras) and display devices can be used to implement triggered live broadcast observation of animal behavior. Exemplarily, multiple shooting devices can be set up as sampling units to send request instructions (also called live broadcast requests). And one or more screens are set up as display devices, which are used to receive live broadcast signals (hereinafter referred to as signals) and display pictures corresponding to live broadcast signals. Multiple display devices can, for example, include display device 1, ..., display device n, etc., where n is an integer not less than 2. In addition, a central server can be set up to receive the request instructions sent by the sampling unit, and perform corresponding processing and distribute them to the display device.

[0042] This processing can be set in multiple modes: Example 1: Receive a single signal, and some or all display devices will display that signal. Example 2: Receive multiple signals, and all display devices will play the sampling unit signal one-to-one. Example 3: Receive multiple signals, and some display devices will play the signal collected by a specific sampling unit, while other display devices will play the signal collected by other sampling units, and so on.

[0043] When the PIR of one or more cameras is triggered, meaning one or more cameras detect animal activity, they begin collecting video signals and sending live broadcast requests to the central processing server. If multiple cameras are triggered within a short period of time, live broadcast signals are sent to the display devices in the order in which the live broadcast requests were sent. If there are no idle display devices to display the corresponding screen of the live broadcast signal, the recorded video corresponding to the undisplayed live broadcast signal is stored on the camera device's SD card or the central server so that it can be played on the idle display device when the display device is idle.

[0044] Specifically, the playback relationship between the live broadcast signal and the display device includes but is not limited to the following:

[0045] Playback relationship 1: When there is only one live signal (also called a trigger signal), some or all display devices display the live signal.

[0046] Playback Relationship 2: When there are multiple live broadcast signals and the number of display devices is less than the number of live broadcast signals, the multiple live broadcast signals are played sequentially. Optionally, the multiple live broadcast signals can be played through the display devices in order of their acquisition time, for example, the live broadcast signal with an earlier acquisition time is played before the live broadcast signal with a later acquisition time.

[0047] Playback relationship 3: When there are multiple live broadcast signals and the number of display devices is not less than the number of live broadcast signals, each display device plays the video corresponding to one live broadcast signal.

[0048] It should be noted that the multiple shooting devices in this embodiment can be multiple shooting devices set up in the same area to shoot the area at different angles, or multiple devices set up in different areas to shoot different areas. They can be set as needed and are not limited here.

[0049] The following is an exemplary description of the process of a live broadcast processing method provided in an embodiment of the present application. Figure 3 , Figure 3 This is a flow chart of a live broadcast processing method provided in an embodiment of the present application. Figure 3 The method shown can be executed by a server. Figure 3 The method shown may include:

[0050] S310. Receive a live broadcast request from a video acquisition device, wherein the live broadcast request is sent by the video acquisition device when an active target is detected in a target area, and is used to request a live broadcast of a first video acquired by the video acquisition device, wherein the target area includes an area set by the video acquisition device, and the first video includes a video triggered and acquired during the period when the active target exists in the target area.

[0051] Among them, the video acquisition device can be a device for capturing video. In this embodiment, the video acquisition device can be, for example, a shooting device. The video acquisition device can refer to the relevant instructions of the shooting device and will not be described in detail here. The active target can be a target with the ability to move. For example, the active target can be, for example, a person, or an animal such as a bird or a tiger, which is not limited here. The first video includes the video triggered and captured during the period when the active target exists in the target area, that is, the start of the first video can be the detection of the active target entering the target area, and the end of the first video can be the detection of the active target leaving the target area. The target area can be, for example, a place where animals and birds often appear or a feeding point, etc., which is not limited here.

[0052] In this embodiment, each video acquisition device in one or more video acquisition devices detects active targets in the target area it detects, and when there are active targets in its corresponding target area, it sends a live broadcast request to the server, thereby requesting the first video captured by the live video acquisition device.

[0053] S320: In response to the live broadcast request, instruct a target display device among the display devices to live broadcast the first video.

[0054] In this embodiment, the display device may be one or more. The display device may be, for example, a display device. The display device may refer to the description of the display device and will not be described in detail here.

[0055] It should be noted that, in this embodiment, instructing the target display device to broadcast the first video live can be that the video acquisition device sends the video signal of the first video (also called a live broadcast signal) to the server, and then the server forwards the video signal to the display device, so that the display device starts broadcasting the first video live. In addition, the server can also notify the target display device of the video acquisition device identifier of the video acquisition device, and then the target display device plays the first video based on the video signal when receiving the video signal from the video acquisition device corresponding to the video acquisition device identifier. In addition, the server can also notify the video acquisition device of the target display device identifier of the target display device, and the video acquisition device can directionally send the video signal to the target display identifier corresponding to the target display device identifier.

[0056] In this embodiment, by receiving a live broadcast request from a video acquisition device, the live broadcast request is sent by the video acquisition device when it detects the presence of an active target in a target area, and is used to request the live broadcast of the first video captured by the video acquisition device, the target area includes the area set by the video acquisition device, and the first video includes the video triggered and captured during the period when the active target exists in the target area, and in response to the live broadcast request, the target display device in the display device is instructed to live broadcast the first video. In this way, when there is an active target in the target area, the activities performed by the active target in the target area can be live broadcasted through the display device, thereby improving the real-time observation of the active target. In addition, the live broadcast of the target area can be stopped after the active target leaves the target area, which can reduce the resources required for video playback. When the number of video acquisition devices is greater than the number of display devices, it is also beneficial to the timely playback of the activities performed by the active targets in each target area.

[0057] In a possible implementation, before the target display device in the instructing display device broadcasts the first video live, the method further includes:

[0058] Obtain the working status of each display device among M display devices, where M is an integer not less than 1; based on the working status of each display device, determine a display device that meets preset conditions as a target display device, and the preset conditions include that the working status is an idle state, the number of second videos currently being broadcast in the working status is less than a quantity threshold, or the second video currently being broadcast in the working status is consistent with videos currently being broadcast by other display devices.

[0059] In this embodiment, if the working state of the display device is idle, it means that the display device in idle state is not playing any video, and the display device can be used as the target display device. In addition, if the working state of the display device is that the number of the second video currently being broadcast is less than the quantity threshold, it means that the display device can continue to play the video in split screen, that is, the second video currently being played and the first video are displayed simultaneously through split screen. Among them, the size of the quantity threshold can be set as needed, such as 2, 3 or 4, etc., and can be set as needed, and is not limited here. It can be understood that the quantity threshold can represent the maximum number of videos played in split screen by the display device. It should be noted that the quantity threshold can be a default value or a value entered by the user, and is not limited here. The second video currently being broadcast in the working state is consistent with the video currently being broadcast by other display devices, that is, multiple display devices are broadcasting a second video at the same time. Therefore, some of the multiple display devices that are broadcasting a second video at the same time can be used to broadcast the first video. The target display device may refer to a display device that has the conditions for broadcasting the first video.

[0060] Correspondingly, the instructing a target display device in the display device to broadcast the first video live includes:

[0061] If the preset conditions include that the working status is idle or the second video currently being broadcast is consistent with the video currently being broadcast by other display devices, the target display device is instructed to broadcast the first video; if the preset conditions include that the working status is that the number of videos currently being broadcast is less than a quantity threshold, the target display device is instructed to broadcast the first video and the second video in split-screen.

[0062] In this embodiment, the preset conditions include the following: if the working state is idle or the second video currently being broadcast is consistent with a video currently being broadcast by another display device, it indicates that the display device has remaining resources to display the first video, and the target display device is instructed to broadcast the first video. If the preset conditions include the working state indicating that the number of videos currently being broadcast is less than a threshold, the target display device is instructed to broadcast the first and second videos in split-screen mode, so that the target display device can broadcast the first video while continuing to broadcast the second video.

[0063] In this embodiment, the working status of each display device among M display devices is obtained, where M is an integer not less than 1; based on the working status of each display device, a display device that meets preset conditions is determined as a target display device, and the preset conditions include that the working status is an idle state, the number of second videos currently being broadcast in the working status is less than a quantity threshold, or the second video currently being broadcast in the working status is consistent with videos currently being broadcast by other display devices. If the preset conditions include that the working status is an idle state or the second video currently being broadcast is consistent with videos currently being broadcast by other display devices, the target display device is instructed to broadcast the first video; if the preset conditions include that the number of videos currently being broadcast in the working status is less than a quantity threshold, the target display device is instructed to broadcast the first video and the second video in split-screen. In this way, the first video can be broadcast as much as possible, thereby improving the real-time observation of the active target.

[0064] It should be noted that, in this embodiment, the correspondence between the video acquisition device and the display device may be fixed, that is, the video acquired by a video acquisition device is broadcast live through several fixed display devices; in addition, the correspondence between the video acquisition device and the display device may be not fixed, and as long as the display device meets the preset conditions, the first video can be broadcast live through the display device that meets the preset conditions.

[0065] In this embodiment, the preset conditions may have priorities. For example, the priority of the working state being idle is the highest, and the priority of the second video currently being broadcast being consistent with the video currently being broadcast by other display devices is lower. The priority of the working state being that the number of second videos currently being broadcast is less than the quantity threshold is the lowest. That is to say, if there is a display device whose working state is idle, the video will be broadcast live through the display device whose working state is idle; if there is no display device whose working state is idle and there is a display device whose second video currently being broadcast is consistent with the video currently being broadcast by other display devices, the video will be broadcast live through the display device whose second video currently being broadcast is consistent with the video currently being broadcast by other display devices; otherwise, the video will be broadcast live through the display device whose working state is that the number of second videos currently being broadcast is less than the quantity threshold.

[0066] In the above embodiments, several situations of preset conditions are mentioned. Below, a situation where there are multiple display devices that meet the preset conditions is described.

[0067] In one possible implementation, the preset condition includes that the working state is an idle state or the second video currently being broadcast is consistent with a video currently being broadcast by another display device. If there are multiple display devices that meet the preset condition, determining the display device that meets the preset condition as the target display device includes one of the following:

[0068] A display device that is closest to the server executing the live broadcast processing method among multiple display devices that meet the preset conditions is determined as the target display device; or, a display device that is closest to the video acquisition device among multiple display devices that meet the preset conditions is determined as the target display device; or, a display device with the largest surrounding traffic among multiple display devices that meet the preset conditions is determined as the target display device.

[0069] In this embodiment, the display device closest to the server executing the live broadcast processing method among multiple display devices that meet the preset conditions is determined as the target display device. In this way, the distance between the server and the target display device can be shortened, which can improve the timeliness of the first video live broadcast and reduce the transmission resources of the video signal.

[0070] A display device that is closest to the video acquisition device among multiple display devices that meet preset conditions is determined as a target display device. In this way, when the video acquisition device sends the video signal directly to the target display device, the distance between the video acquisition device and the target display device can be minimized, which can improve the timeliness of the first video live broadcast and reduce the transmission resources of the video signal.

[0071] By determining the display device with the largest number of people around it among multiple display devices that meet the preset conditions as the target display device, the first video of the live broadcast can be seen by more viewers, thereby improving the effective live broadcast of the video and enhancing the viewer experience. It should be noted that a thermal imaging camera can be set up in the target area to identify the number of people in each target area through the thermal imaging camera, and then the display device with the largest number of people around it among the multiple display devices that meet the preset conditions can be determined as the target display device, so that the video can be live broadcasted to the target display device with the largest number of people around it.

[0072] In another possible implementation, the preset condition includes that the number of second videos in the working state of being currently live broadcast is less than a quantity threshold, and if there are multiple display devices that meet the preset condition, determining the display device that meets the preset condition as the target display device includes:

[0073] Determine the video attributes of the second video broadcast live by each display device among multiple display devices that meet preset conditions, and determine the video attributes of the first video; and determine the display device whose video attributes of the second video broadcast live are consistent with the video attributes of the first video as the target display device.

[0074] Among them, video attributes may refer to attributes related to the video. In this embodiment, the video attributes may be, for example, at least one of technical attributes, content attributes, or playback attributes. Among them, technical attributes may be, for example, video format (MP4, AVI, etc.), encoding standard (H.264, ProRes, etc.), resolution, frame rate, bit rate, audio encoding, etc. Content attributes may represent the content of the video, such as the type of active object, which may be, for example, mammals or non-mammals; or flying, reptiles, etc. The type of active objects can be divided as needed, and there is no restriction here. Playback attributes may be, for example, support for streaming media playback, whether a specific player is required, etc.

[0075] For example, assuming that the display device in a working state in which the number of second videos currently being broadcast is less than a threshold number includes display device 1 and display device 2. The video being broadcast by display device 1 is a video of a bird's movement, and the video being broadcast by display device 2 is a video of an elephant's movement. When the first video is a video of a bat's movement, it can be determined that both the bat and the bird are flying animals. In this case, the first video is broadcast live on display device 1, and display device 1 can play the video of the bird's movement and the video of the bat's movement in split screens.

[0076] In this embodiment, the video attributes of the second video being broadcast live by each of multiple display devices that meet preset conditions are determined, as well as the video attributes of the first video. The display device whose video attributes of the second video being broadcast live match those of the first video is then identified as the target display device. This allows multiple videos with the same video attributes to be broadcast live on the same display device, thereby improving the viewer's split-screen viewing experience.

[0077] In another possible implementation, if there is only one display device, the video is directly broadcast live through the display device.

[0078] In a possible implementation, the method further includes:

[0079] If any display device does not meet the preset condition, the first video is cached; when one of the display devices switches from not meeting the preset condition to meeting the preset condition, the one of the display devices is instructed to play the first video.

[0080] In this embodiment, if any display device does not meet the preset conditions, it means that the first video cannot be broadcast live at this time, and the first video can be cached. In this way, when one of the display devices switches from not meeting the preset conditions to meeting the preset conditions, that is, when one of the display devices switches from not meeting the conditions for live broadcast to meeting the conditions for live broadcast, the first video can be played through the display device that meets the conditions for live broadcast.

[0081] It should be noted that in this embodiment, the first video may be cached in the video capture device. When the server determines that one of the display devices switches from not meeting the preset condition to meeting the preset condition, the server notifies the video capture device to send the cached first video via the server to the display device that has switched to meeting the preset condition, or the video capture device directly sends the cached first video to the display device that has switched to meeting the preset condition. Alternatively, the video capture device sends the video signal of the first video to the server, thereby caching it in the server. Then, when one of the display devices on the server switches from not meeting the preset condition to meeting the preset condition, the server sends the video signal to the display device, thereby playing the first video through the display device.

[0082] In this embodiment, if any display device does not meet the preset condition, the first video is cached; when one of the display devices switches from not meeting the preset condition to meeting the preset condition, one of the display devices is instructed to play the first video. In this way, the video that failed to be broadcast live can continue to be played and displayed to the audience later, which can improve the effective collection of the video.

[0083] In a possible implementation, there are multiple cached first videos, and the multiple cached first videos come from different video acquisition devices. The instructing one of the display devices to play the first video includes:

[0084] Instruct one of the display devices to play the first video with the earliest acquisition time among the multiple cached first videos.

[0085] In this embodiment, if there are multiple cached first videos, one of the display devices may be instructed to play the first video with the earliest capture time among the multiple cached first videos. Specifically, based on the time of the first frame of each of the multiple cached first videos, the first video with the earliest first frame time may be determined as the first video with the earliest capture time among the multiple cached first videos.

[0086] In this embodiment, the first video captured earlier can be played first, and the first video captured later can be played later, which is beneficial to taking into account the timeliness of playing multiple cached first videos.

[0087] In a possible implementation, in response to the live broadcast request, instructing a target display device among the display devices to live broadcast the first video includes:

[0088] In response to the live broadcast request, determine a target display device among M display devices, where M is an integer not less than 1; receive a video signal of the first video captured by the video capture device, and send the video signal of the first video to the target display device, so that the target display device broadcasts the first video based on the video signal of the first video.

[0089] In this embodiment, how to determine the target display device among the M display devices can refer to the description of the above embodiment, which is not repeated here. In this embodiment, using the server as a transfer of the video signal is conducive to unified management of the video signal.

[0090] In a possible implementation, after determining the target display device among the M display devices, the method further includes:

[0091] A target indication is sent to the target display device so that the target display device plays a third video stored in the target display device based on the target indication, where the third video is used to prompt that the video captured by the video capture device will be broadcast live.

[0092] In this embodiment, the third video is a video stored in the target display device and is used to preview the upcoming live video. Optionally, the third video can prompt the live broadcast of the video captured by the video capture device, or can also prompt relevant content of the upcoming live video, such as prompting that a video of birds will be broadcast live. Optionally, after obtaining the first video frame of the first video, the server can extract the video content from the first video frame and send the content identifier to the target display device. The target display device can then prompt relevant content of the upcoming live video based on the content identifier.

[0093] In this embodiment, since it takes a certain amount of time for the first video to be transmitted to the target display device for display, before that, the server can send a target indication to the target display device, so that the target display device plays the third video stored in the target display device based on the target indication. The third video is used to prompt the video captured by the video acquisition device that will be broadcast live, which can prompt the audience, and then when the video signal arrives, the first video is broadcast live based on the video signal, thereby improving the audience experience.

[0094] In another possible implementation, it is not necessary to play the third video. That is, the target display device plays the first video after receiving the first video. In this way, the resources required for the display device to play the video can be reduced.

[0095] The following is an exemplary description of the device embodiment of this embodiment.

[0096] See also Figure 4 , Figure 4 This is a structural diagram of a live broadcast processing device provided in an embodiment of the present application. Figure 4 The device shown can be applied to a server, and the device may include a receiving module 410 and a live broadcast response module 420, wherein:

[0097] The receiving module 410 is used to receive a live broadcast request from the video acquisition device, where the live broadcast request is sent by the video acquisition device when an active target is detected in a target area, and is used to request a live broadcast of the first video captured by the video acquisition device, where the target area includes an area set by the video acquisition device, and the first video includes a video triggered and captured during the period when the active target exists in the target area; the live broadcast response module 420 is used to respond to the live broadcast request and instruct the target display device in the display device to broadcast the first video live.

[0098] In a possible implementation, the live broadcast response module 420 is further configured to:

[0099] Obtaining the operating status of each display device among M display devices, where M is an integer not less than 1; determining, based on the operating status of each display device, a display device that meets preset conditions as a target display device, the preset conditions including that the operating status is an idle state, the number of second videos currently being broadcast in the operating status is less than a threshold, or the second video currently being broadcast in the operating status is consistent with videos currently being broadcast by other display devices; when instructing the target display device among the display devices to broadcast the first video, the live broadcast response module 420 may be configured to:

[0100] If the preset conditions include that the working status is idle or the second video currently being broadcast is consistent with the video currently being broadcast by other display devices, the target display device is instructed to broadcast the first video; if the preset conditions include that the working status is that the number of videos currently being broadcast is less than a quantity threshold, the target display device is instructed to broadcast the first video and the second video in split-screen.

[0101] In one possible implementation, the preset condition includes that the working state is an idle state or the second video currently being broadcast is consistent with a video currently being broadcast by another display device. If there are multiple display devices that meet the preset condition, the live broadcast response module 420 may use one of the following when determining the display device that meets the preset condition as the target display device:

[0102] A display device that is closest to the server executing the live broadcast processing method among multiple display devices that meet the preset conditions is determined as the target display device; or, a display device that is closest to the video acquisition device among multiple display devices that meet the preset conditions is determined as the target display device; or, a display device with the largest surrounding traffic among multiple display devices that meet the preset conditions is determined as the target display device.

[0103] In one possible implementation, the preset condition includes that the number of second videos in the working state of being currently live broadcast is less than a quantity threshold. If there are multiple display devices that meet the preset condition, the live broadcast response module 420, when determining the display device that meets the preset condition as the target display device, may be configured to:

[0104] Determine the video attributes of the second video broadcast live by each display device among multiple display devices that meet preset conditions, and determine the video attributes of the first video; and determine the display device whose video attributes of the second video broadcast live are consistent with the video attributes of the first video as the target display device.

[0105] In a possible implementation, the live broadcast response module 420 is further configured to:

[0106] If any display device does not meet the preset condition, the first video is cached; when one of the display devices switches from not meeting the preset condition to meeting the preset condition, the one of the display devices is instructed to play the first video.

[0107] In a possible implementation, there are multiple cached first videos, and the multiple cached first videos come from different video acquisition devices. When the live broadcast response module 420 instructs one of the display devices to play the first video, it can be used to:

[0108] Instruct one of the display devices to play the first video with the earliest acquisition time among the multiple cached first videos.

[0109] In a possible implementation, when the live broadcast response module 420 instructs a target display device among the display devices to broadcast the first video in response to the live broadcast request, it may be configured to:

[0110] In response to the live broadcast request, determine a target display device among M display devices, where M is an integer not less than 1; receive a video signal of the first video captured by the video capture device, and send the video signal of the first video to the target display device, so that the target display device broadcasts the first video based on the video signal of the first video.

[0111] In a possible implementation, after determining the target display device among the M display devices, the live broadcast response module 420 is further configured to:

[0112] A target indication is sent to the target display device so that the target display device plays a third video stored in the target display device based on the target indication, where the third video is used to prompt that the video captured by the video capture device will be broadcast live.

[0113] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the devices and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. In the several embodiments provided in the present application, the coupling between modules can be electrical. In addition, the various functional modules in the various embodiments of the present application can be integrated into a processing module, or each module can exist physically alone, or two or more modules can be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules.

[0114] The following will be combined Figure 5 The architecture of a server provided in this application is described.

[0115] In an optional embodiment, a server is provided, such as Figure 5 As shown, Figure 5 The server 500 shown includes a processor 501 and a memory 503. The processor 501 and the memory 503 are connected, for example, via a bus 502. Optionally, the server 500 may also include a transceiver 504, which can be used for data exchange between the server and other servers, such as sending and / or receiving data. It should be noted that in actual applications, the number of transceivers 504 is not limited to one, and the structure of the server 500 does not constitute a limitation on the embodiments of the present application.

[0116] The processor 501 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor 501 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0117] The bus 502 may include a path for transmitting information between the above components. The bus 502 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0118] The memory 503 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium that can be used to carry or store computer programs and can be read by a computer, without limitation here.

[0119] The memory 503 is used to store the computer program for executing the embodiments of the present application, and the execution is controlled by the processor 501. The processor 501 is used to execute the computer program stored in the memory 503 to implement the steps shown in the above method embodiments.

[0120] An embodiment of the present application also provides a live broadcast processing system, including a video acquisition device, a server and a display device.

[0121] Among them, the video acquisition device is used to send a live broadcast request to the server when an active target is detected in the target area, and the live broadcast request is used to request the live broadcast of the first video captured by the video acquisition device, the target area includes the area set by the video acquisition device, and the first video includes the video triggered and captured during the period when the active target exists in the target area; the server is used to respond to the live broadcast request and instruct the target display device in the display device to live broadcast the first video.

[0122] The method steps executed by the video acquisition device, the server and the display device can refer to the description of the above embodiment and will not be described in detail here.

[0123] Please refer to Figure 6 , which shows a block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 600 stores program code, which can be called by a processor to execute the method described in the above method embodiment.

[0124] The computer-readable storage medium 600 can be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 600 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 600 has storage space for program code 610 for executing any of the method steps described above. These program codes can be read from or written to one or more computer program products. The program code 610 can be compressed, for example, in a suitable form.

[0125] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A live broadcast processing method, characterized in that: include: receiving a live broadcast request from a video acquisition device, the live broadcast request being sent by the video acquisition device when an active target is detected in a target area, and requesting live broadcast of a first video captured by the video acquisition device, the target area including an area set by the video acquisition device, and the first video including a video captured during a period when the active target is present in the target area; In response to the live broadcast request, a target display device among the display devices is instructed to live broadcast the first video.

2. The method according to claim 1, characterized in that Before the target display device in the indicating display device broadcasts the first video live, the method further includes: Obtaining the operating status of each display device among M display devices, where M is an integer not less than 1; Based on the working status of each display device, a display device that meets preset conditions is determined as a target display device, the preset conditions including that the working status is an idle state, the number of second videos currently being broadcast in the working status is less than a quantity threshold, or the second video currently being broadcast in the working status is consistent with videos currently being broadcast by other display devices; The instructing a target display device in the display device to broadcast the first video live, including: If the preset condition includes that the working state is an idle state or the second video currently being broadcast is consistent with the video currently being broadcast by another display device, instructing the target display device to broadcast the first video; If the preset condition includes that the number of videos in the working state of being currently live is less than a quantity threshold, the target display device is instructed to broadcast the first video and the second video in split-screen mode.

3. The method according to claim 2, characterized in that The preset condition includes that the working state is an idle state or the second video currently being broadcast is consistent with the video currently being broadcast by another display device. If there are multiple display devices that meet the preset condition, determining the display device that meets the preset condition as the target display device includes one of the following: Determine a display device closest to the server executing the live broadcast processing method among multiple display devices that meet preset conditions as a target display device; or, Determine a display device closest to the video acquisition device among multiple display devices that meet preset conditions as a target display device; or, The display device with the largest surrounding traffic volume among the multiple display devices that meet the preset conditions is determined as the target display device.

4. The method according to claim 2, characterized in that The preset condition includes that the number of second videos in the working state of being currently live broadcast is less than a quantity threshold, and if there are multiple display devices that meet the preset condition, determining the display device that meets the preset condition as the target display device includes: Determining video attributes of a second video broadcast live by each display device among a plurality of display devices that meet preset conditions, and determining video attributes of the first video; A display device whose video attributes of the second video being broadcast live are consistent with the video attributes of the first video is determined as a target display device.

5. The method according to claim 2, characterized in that The method further comprises: If any display device does not meet the preset condition, buffering the first video; When one of the display devices switches from not satisfying the preset condition to satisfying the preset condition, instructing the one of the display devices to play the first video.

6. The method according to claim 5, characterized in that There are multiple cached first videos, and the multiple cached first videos come from different video acquisition devices. The instructing one of the display devices to play the first video includes: Instruct one of the display devices to play the first video with the earliest acquisition time among the multiple cached first videos.

7. The method according to claim 1, characterized in that In response to the live broadcast request, instructing a target display device among the display devices to live broadcast the first video, including: In response to the live broadcast request, determining a target display device among M display devices, where M is an integer not less than 1; A video signal of the first video captured by the video capture device is received, and the video signal of the first video is sent to the target display device, so that the target display device broadcasts the first video based on the video signal of the first video.

8. The method according to claim 7, characterized in that After determining the target display device among the M display devices, the method further includes: A target indication is sent to the target display device so that the target display device plays a third video stored in the target display device based on the target indication, where the third video is used to prompt that the video captured by the video capture device will be broadcast live.

9. A live broadcast processing device, characterized in that: include: a receiving module, configured to receive a live broadcast request from a video acquisition device, wherein the live broadcast request is sent by the video acquisition device when an active target is detected in a target area, and is configured to request live broadcast of a first video captured by the video acquisition device, wherein the target area includes an area set by the video acquisition device, and the first video includes a video captured during a period when the active target is present in the target area; A live broadcast response module is used to respond to the live broadcast request and instruct a target display device among the display devices to live broadcast the first video.

10. A server, characterized in that: including one or more processors and memory; One or more programs are stored in the memory and configured to be executed by the one or more processors, wherein the one or more programs are configured to execute the method according to any one of claims 1 to 8.

11. A live broadcast processing system, characterized in that: It includes a video acquisition device, a server and a display device; The video acquisition device is used to send a live broadcast request to the server when detecting the presence of an active target in the target area, the live broadcast request being used to request live broadcast of a first video acquired by the video acquisition device, the target area including an area set by the video acquisition device, and the first video including a video triggered and acquired during the period when the active target exists in the target area; The server is configured to instruct a target display device among the display devices to broadcast the first video in response to the live broadcast request.

12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores program code, wherein when the program code is executed by a processor, the method according to any one of claims 1 to 8 is executed.

Images