An audio and video stream pushing method and device, electronic equipment and readable storage medium

Abstract

The application provides an audio and video stream pushing method and device, electronic equipment and a readable storage medium. The method is applied to a picture transmission scheduling client of a picture transmission management system of a vision network. The method comprises the following steps: in response to a creation operation on a target pushing template, displaying a first identifier, a second identifier and an initial pushing template in a first page; in response to a dragging operation on the first identifier, establishing a corresponding relationship between the first identifier and a video preview area, and determining corresponding to-be-displayed content in the video preview area; in response to a selection operation on the second identifier, establishing a corresponding relationship between the second identifier and the to-be-displayed content, and generating the target pushing template; and in response to an execution operation on the target pushing template, uploading the target pushing template to a picture transmission scheduling server, so that the picture transmission scheduling server executes a target pushing task based on the target pushing template. In this way, the target pushing task is executed by configuring the target pushing template, the labor cost is reduced, and the audio and video stream pushing efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of video network technology, and in particular to an audio and video streaming method, apparatus, electronic device and readable storage medium. Background Technology

[0002] Because Video Internet (Vnet) technology can achieve real-time transmission of high-definition video across the entire network, a function that is currently impossible on the Internet, it is pushing many Internet applications toward high-definition video and face-to-face communication. Therefore, Vnet technology is being increasingly applied to technical fields such as video conferencing and surveillance video transmission.

[0003] When conducting video conferencing using visual networking technology, in order to present multiple pieces of information to the participants, the host often needs to push the audio and video streams from at least one signal source of their participating terminal, such as computer screen images, webcam images, and speech transcripts, to at least one audio and video player on each participant's participating terminal in real time.

[0004] Existing audio and video stream push methods require meeting administrators to manually push the audio and video streams from each signal source of the meeting to the corresponding audio and video player on each participant's terminal. This results in high manual labor costs and low audio and video stream push efficiency. Summary of the Invention

[0005] In view of this, embodiments of this application provide at least one audio / video stream push method, apparatus, electronic device, and readable storage medium, which executes target push tasks by configuring target push templates, thereby reducing manual labor costs and improving audio / video stream push efficiency.

[0006] This application mainly includes the following aspects:

[0007] In a first aspect, embodiments of this application provide an audio / video stream push method, applied to an image transmission scheduling client of a video network image transmission management system, the method comprising:

[0008] In response to a user's creation of a target push template for at least one target push task in the task push management interface, the first page of the task push management interface displays a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template. The target push task is a task that pushes the audio and video streams of at least one signal source of any sending terminal to at least one audio and video player of at least one receiving terminal for playback in a preset display mode. The first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area. The push template configuration area displays at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in the preset display mode.

[0009] For any of the target push tasks, in response to the user's operation of dragging the first identifier of the signal source of any of the sending terminals to any of the video preview areas, a first correspondence between the first identifier and the video preview area is established in the push template configuration area, and the content to be displayed in the at least one video preview area is determined;

[0010] In response to a user's selection of a second identifier for any of the receiving terminals, a second correspondence is established between the second identifier and the content to be displayed, and the target push template is generated.

[0011] In response to a user's execution operation on the target push template of the at least one target push task, the target push template is uploaded to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template.

[0012] Secondly, embodiments of this application also provide an audio / video stream pushing device, applied to the image transmission scheduling client of a video network image transmission management system, the audio / video stream pushing device comprising:

[0013] The display module is used to respond to a user's creation operation of a target push template for at least one target push task in the task push management interface. On the first page of the task push management interface, it displays a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template. The target push task is a task that pushes the audio and video streams of at least one signal source from any sending terminal to at least one audio and video player on at least one receiving terminal for playback in a preset display mode. The first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area. The push template configuration area displays at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in the preset display mode.

[0014] The determination module is configured to, for any of the target push tasks, in response to an operation by a user dragging a first identifier of the signal source of any of the sending terminals to any of the video preview areas, establish a first correspondence between the first identifier and the video preview areas in the push template configuration area, and determine the content to be displayed corresponding to the at least one video preview area;

[0015] The generation module is configured to, in response to a user's selection operation of a second identifier for any of the receiving terminals, establish a second correspondence between the second identifier and the content to be displayed, and generate the target push template;

[0016] An execution module is configured to, in response to a user's execution operation on the target push template of the at least one target push task, upload the target push template to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template.

[0017] Thirdly, embodiments of this application also provide an electronic device, including: a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory communicate through the bus. The machine-readable instructions are executed by the processor to perform the steps of the audio and video stream push method described in the first aspect or any possible implementation of the first aspect.

[0018] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the audio / video stream push method described in the first aspect or any possible implementation of the first aspect.

[0019] This application provides an audio / video stream push method, apparatus, electronic device, and readable storage medium. The method is applied to a video transmission scheduling client of a video network image transmission management system, and includes: responding to a user's creation operation of a target push template for at least one target push task in a task push management interface, displaying a first identifier of a signal source from at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template on a first page of the task push management interface; the target push task is a task to push the audio / video stream of at least one signal source from any sending terminal to at least one audio / video player on at least one receiving terminal for playback in a preset display manner; the first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area; the push template configuration area... The domain display has at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in a preset display mode. For any target push task, in response to the user's operation of dragging the first identifier of the signal source of any sending terminal to any video preview area, a first correspondence between the first identifier and the video preview area is established in the push template configuration area, and the content to be displayed in at least one video preview area is determined. In response to the user's operation of selecting the second identifier of any receiving terminal, a second correspondence between the second identifier and the content to be displayed is established, and a target push template is generated. In response to the user's operation of executing the target push template of at least one target push task, the target push template is uploaded to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template. In this way, by configuring the target push template to execute the target push task, the manual labor cost is reduced and the efficiency of audio and video stream push is improved.

[0020] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This illustration shows a structural diagram of a video network image transmission management system provided in an embodiment of this application;

[0023] Figure 2 A flowchart of an audio / video stream push method provided in an embodiment of this application is shown;

[0024] Figure 3 A schematic diagram of the first page in an embodiment of this application is shown;

[0025] Figure 4 A schematic diagram of the second page in an embodiment of this application is shown;

[0026] Figure 5 A schematic diagram of the third page in an embodiment of this application is shown;

[0027] Figure 6 This illustration shows one of the functional block diagrams of an audio / video stream push device provided in an embodiment of this application;

[0028] Figure 7 This illustration shows a second functional block diagram of an audio / video stream push device provided in an embodiment of this application;

[0029] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown.

[0030] Explanation of key component symbols:

[0031] In the diagram: 100 - Video Network Image Transmission Management System; 101 - Image Transmission Scheduling Client; 102 - Image Transmission Scheduling Server; 103 - Sending Terminal; 104 - Receiving Terminal; 600 - Audio / Video Stream Push Device; 610 - Display Module; 620 - Determining Module; 630 - Generating Module; 640 - Execution Module; 650 - Query Module; 660 - Judgment Module; 670 - Second Query Module; 680 - End Push Module; 800 - Electronic Device; 810 - Processor; 820 - Memory; 830 - Bus. Detailed Implementation

[0032] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0033] To enable those skilled in the art to utilize the content of this application, and in conjunction with the specific application scenario of "visual network technology," the following implementation methods are provided. Those skilled in the art can apply the general principles defined herein to other embodiments and application scenarios without departing from the spirit and scope of this application. Although this application is primarily described within the "visual network technology field," it should be understood that this is merely an exemplary embodiment.

[0034] It is worth noting that prior to this application, existing audio and video stream push methods required meeting administrators to manually push the audio and video streams of each signal source of the meeting party to the audio and video player corresponding to the meeting terminal of each participant. This resulted in high manual labor costs and low audio and video stream push efficiency.

[0035] Based on this, embodiments of this application provide an audio / video stream push method, apparatus, electronic device, and readable storage medium. By configuring a target push template to execute a target push task, the manual labor cost is reduced and the audio / video stream push efficiency is improved.

[0036] The following will combine Figure 1 The implementation methods of the embodiments of this application are described in detail; the audio and video stream push method provided in the embodiments of this application is applied to the image transmission scheduling client of the video network image transmission management system.

[0037] Please see Figure 1 , Figure 1 This is a schematic diagram of a video network image transmission management system provided in an embodiment of this application. The audio and video stream push method provided in this embodiment can be applied to... Figure 1 The video network image transmission management system 100 shown includes an image transmission dispatch client 101, an image transmission dispatch server 102, at least one sending terminal 103, and at least one receiving terminal 104. The image transmission dispatch client 101 is communicatively connected to the image transmission dispatch server 102, and at least one sending terminal 103 and at least one receiving terminal 104 are respectively communicatively connected to the image transmission dispatch server 102.

[0038] The image transmission dispatch server 102 is used to receive the target push template sent by the image transmission dispatch client 101, and execute the target push task based on the target push template, pushing the audio and video streams of at least one signal source of any sending terminal 103 to at least one audio and video player of at least one receiving terminal 104 for playback in a preset display mode in the target push task.

[0039] The image transmission dispatch server 102 is also used to send information about the signal source of the sending terminal 103 and the receiving terminal 104 that can be called by the currently logged-in user of the image transmission dispatch client 101 after the user logs in, so that the image transmission dispatch client 101 responds to the user's creation operation of the target push template by sending the first identifier of the signal source of at least one sending terminal 103 and the second identifier of at least one receiving terminal 104 to the image transmission dispatch client 101 for display.

[0040] At least one sending terminal 103 is used to push audio and video streams from at least one signal source to at least one receiving terminal 104 in a preset display mode in the target push task.

[0041] At least one receiving terminal 104 is used to receive audio and video streams from at least one signal source pushed by any sending terminal 103 in a preset display mode in the target push task.

[0042] At least one sending terminal 103 and at least one receiving terminal 104 can be divided into three categories from a functional perspective:

[0043] The first type is the encoder terminal, which mainly includes functions such as image resource acquisition, transmission, and transmission of keyboard and mouse data to the computer.

[0044] The second category is decoder terminals, which mainly include functions such as device login, image resource scheduling, real-time image viewing, image push, and reverse control.

[0045] The third type is the same-encoder and same-decoder terminal, which mainly includes the function of supporting the same-encoder and same-decoder of at least one audio and video stream with a resolution of 1080P 60Hz or lower.

[0046] The following is a detailed description of an audio and video stream push method provided in the embodiments of this application. This audio and video stream push method can be applied to the image transmission scheduling client 101 of the above-mentioned video network image transmission management system 100.

[0047] Please see Figure 2 , Figure 2 This is a flowchart illustrating an audio / video stream push method provided in an embodiment of this application. Figure 2 As shown, the audio / video stream push method provided in this application embodiment includes the following steps:

[0048] S201, in response to the user's creation operation of a target push template for at least one target push task in the task push management interface, the first page of the task push management interface displays a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template; the target push task is a task to push the audio and video streams of at least one signal source of any sending terminal to at least one audio and video player of at least one receiving terminal for playback in a preset display mode; the first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area; the push template configuration area displays at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in a preset display mode.

[0049] In this embodiment, after receiving the target push task sent by the conference initiator, the management user of the video conferencing system creates a target push template for the target push task in the task push management interface of the image transmission scheduling client 101. Here, the management user can receive the target push task by obtaining the target push task uploaded by the conference initiator through the sending terminal 103 from the image transmission scheduling server 102, or by directly obtaining the target push task from the conference initiator; no specific limitation is made here.

[0050] Here, the target push task is to push the audio and video streams from at least one signal source of any sending terminal 103 to at least one audio and video player of at least one receiving terminal 104 for playback in a preset display mode. The preset display mode is the display mode required in the target push task. For example, a video network conference includes a host and three participants. The host's sending terminal 103 includes three signal sources: the host's computer screen, the host's camera, and the host's mobile phone screen. Then, the target push task could be to push the three audio and video streams from the host's sending terminal 103—the host's computer screen, the host's camera, and the host's mobile phone screen—to the audio and video players of the three participants' receiving terminals 104 for playback in a left-to-right display order. Here, displaying the three audio and video streams from the three signal sources in a left-to-right display order is the preset display mode.

[0051] After responding to the user's action to create the target push template, the first page will open in the task push management interface. Please refer to [link / reference]. Figure 3 , Figure 3 This is a schematic diagram of the first page of an embodiment of this application, as shown below. Figure 3As shown, the first page includes three areas: a first display area, a second display area, and a push template configuration area. The first display area displays the first identifier of the signal source of at least one sending terminal 103; the second display area displays the second identifier of at least one receiving terminal 104; and the push template configuration area displays at least one video preview area to establish the correspondence between the first identifier and the video preview area. After opening the first page, the first display area displays the first identifier of the signal source of at least one sending terminal 103 that can be accessed within the management permissions of the managing user; the second display area displays the second identifier of at least one receiving terminal 104 that can be accessed within the management permissions of the managing user; and the push template configuration area displays at least one blank video preview area corresponding to the initial push template. The at least one blank video preview area corresponding to the initial push template is arranged according to a preset display method corresponding to the target push task. For example, the initial push template includes three blank video preview areas arranged sequentially from left to right.

[0052] In this embodiment, before receiving the target push task, the management user of the video conferencing needs to log in to the image transmission dispatch client 101. Specifically, a login request is sent to the image transmission dispatch server 102 via the SDK 1.0 protocol. After the login request is approved, the image transmission dispatch server 102 returns information about the signal sources of at least one sending terminal 103 that is pre-bound to the currently logged-in management user and can be called within the management user's management permissions, as well as information about at least one receiving terminal 104 that can be called within the management user's management permissions. After completing all push tasks, a logout request can also be sent to the image transmission dispatch server 102 via the SDK 1.0 protocol to perform a logout operation.

[0053] In this embodiment of the application, for each target push task in the created target push template, a different first page will be generated for display, wherein the receiving terminal in the different target push tasks is different.

[0054] Specifically, in a video conferencing system, since the same receiving terminal 104 can only participate in one video conferencing system at a time, that is, it can only receive the audio and video stream pushed by one sending terminal 103, the receiving terminal 104 is different in different target push tasks.

[0055] S202, for any target push task, in response to the user's operation of dragging the first identifier of the signal source of any sending terminal to any video preview area, a first correspondence between the first identifier and the video preview area is established in the push template configuration area, and at least one corresponding content to be displayed in the video preview area is determined.

[0056] In this embodiment, a correspondence between a first identifier and a video preview area is established in the push template configuration area. For any target push task corresponding to a first page, in response to a user's operation of dragging the first identifier of the signal source of any sending terminal to any video preview area on the first page, a first correspondence between the first identifier and the video preview area is established in the push template configuration area, and the content to be displayed in at least one video preview area is determined. Specifically, the audio and video stream content of the signal source corresponding to the first identifier can be previewed in the corresponding video preview area after dragging. Taking the example in S201, the user drags the identifier of the signal source of the host's computer screen in the first display area to the left video preview area, drags the identifier of the signal source of the host's camera in the first display area to the middle video preview area, and drags the identifier of the signal source of the host's mobile phone screen in the first display area to the right video preview area. A correspondence between the three signal source identifiers and the three video preview areas is established in the push template configuration area as the first correspondence, and the content to be displayed in the three video preview areas is determined.

[0057] S203, in response to the user's selection operation of the second identifier of any receiving terminal, establishes a second correspondence between the second identifier and the content to be displayed, and generates a target push template.

[0058] In this step, after determining the content to be displayed in at least one video preview area, in response to the user's selection of the second identifier of the receiving terminal 104 to which the target push task needs to be pushed in the second display area, a second correspondence is established between the second identifier and the content to be displayed, generating a target push template. Taking the example in S201, the second identifiers of the receiving terminals 104 of three participants are selected in the second display area, and the second identifiers of the receiving terminals 104 of the three participants are checked, so that the second identifiers of the receiving terminals 104 of the three participants are established with the content to be displayed established in S202, generating a target push template.

[0059] S204, in response to the user's execution operation on the target push template of at least one target push task, the target push template is uploaded to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template.

[0060] Specifically, after configuring the target push template, the management user of the video conferencing network clicks or touches the button for executing the push on the first page to upload the established target push template to the image transmission scheduling server 102. After receiving the uploaded target push template, the image transmission scheduling server 102 automatically executes the target push task according to the first and second correspondences in the template, and pushes the audio and video streams of each signal source of each sending terminal 103 to the corresponding audio and video player of the receiving terminal 104 for playback in a preset display mode.

[0061] Furthermore, after S103 responding to the user's selection operation of the second identifier of any receiving terminal, and before establishing a second correspondence between the second identifier and the content to be displayed, the method further includes:

[0062] Step a1: Determine the first number of audio and video players configured on the receiving terminal.

[0063] In this embodiment of the application, in the application scenario of video conferencing, the decoding capability of the receiving terminal 104 of the conference participants may not meet the decoding requirements of the audio and video streams from multiple signal sources pushed by the sending terminal 103 of the conference initiator. Specifically, the number of audio and video players configured on the receiving terminal 104 is less than the number of audio and video streams pushed by the signal sources of the sending terminal 103. For example, the sending terminal 103 wants to push three audio and video streams from three signal sources to three audio and video players on the receiving terminal 104 for display according to a preset display method, but the receiving terminal 104 only has one audio and video player available for playback. In this case, it cannot be played on the receiving terminal according to the preset display method, resulting in a push failure. Therefore, in order to prevent the above situation, after responding to the user's selection operation of the second identifier of any receiving terminal 104, and before establishing the second correspondence between the second identifier and the content to be displayed, it is necessary to judge the decoding capability of the selected receiving terminal 104. First, determine the first number of audio and video players configured on the selected receiving terminal 104.

[0064] Step a2: Determine whether the first number of receiving terminals is greater than or equal to the second number; the second number is the number of first identifiers of the signal sources of the sending terminals that have a first correspondence with at least one video preview area.

[0065] In this step, the first number of audio and video players configured on the receiving terminal 104 is compared with the second number of the first identifiers of the signal source of the sending terminal 103 to determine whether the receiving terminal 104 is capable of receiving the audio and video stream pushed by the signal source of the sending terminal 103.

[0066] Step a3: If yes, establish a second correspondence between the second identifier and the content to be displayed.

[0067] In this step, if the first quantity of the receiving terminal 104 is greater than or equal to the second quantity, it means that the receiving terminal 104 is capable of receiving the push from the sending terminal 103, and the second identifier can be directly established as a second correspondence with the content to be displayed.

[0068] Step a4: If not, generate a prompt message to inform the user that the receiving terminal cannot play the audio and video streams in the target push task according to the preset display method.

[0069] In this step, if the first number of receiving terminals 104 is less than the second number, it indicates that the receiving terminal 104 is unable to receive the push notification from the sending terminal 103. A prompt message needs to be generated to remind the user that the receiving terminal 104 cannot play the audio and video streams in the target push task according to the preset display method. Specifically, the prompt message can be generated by displaying a pop-up window.

[0070] Furthermore, after generating the prompt message, the method further includes:

[0071] Step b1: Change the preset display method according to the preset filtering display rules to obtain the changed preset display method; the changed preset display method is adapted to the first quantity.

[0072] In this embodiment, since the application scenario is a video conferencing network, to ensure the normal operation of the meeting, for the receiving terminal 104 that cannot play the audio and video streams in the target push task according to the preset display method, the preset display method can be changed according to the preset filtering display rules to obtain a modified preset display method that matches the first number of audio and video players configured on the receiving terminal 104. The preset filtering display rules are based on the preset importance of the audio and video streams of each signal source of the sending terminal, and the preset display method is changed to a preset display method for the number of signal sources that matches the first number of audio and video players configured on the receiving terminal 104, according to the order of the importance of the audio and video streams of the signal sources from high to low. Taking the example in S201 as an example, if one of the three participants' receiving terminal 104 is only configured with two audio and video players, and the importance of the audio and video streams of the signal source of the sending terminal 103, from high to low, is the host's computer screen, the host's camera, and the host's mobile phone screen, then the preset display method after being changed according to the preset filtering display rules is to display the audio and video streams of the signal source corresponding to the host's computer screen and the audio and video streams of the signal source corresponding to the host's camera in the two audio and video players of the receiving terminal 104 in a display order from left to right.

[0073] Step b2: Establish a second correspondence between the second identifier and the content to be displayed corresponding to the modified preset display method, and generate the target push template.

[0074] In this step, according to the configuration method of S203, a second correspondence is established between the second identifier of the receiving terminal 104 that cannot play the audio and video stream in the target push task according to the preset display method and the content to be displayed corresponding to the modified preset display method in step b2, and a target push template is generated.

[0075] Furthermore, prior to responding to a user's creation operation for a push template of at least one target push task, the method further includes:

[0076] Step c1: In response to the user's query operation for historical push tasks in the task push management interface, the historical push list is displayed on the second page of the task push management interface. The historical push list includes template information for at least one historical push template.

[0077] Step c2: If a historical push template that matches the target push task exists in the historical push list, then the historical push template is determined as the target push template for the target push task.

[0078] Step c3: If there is no historical push template that matches the target push task in the historical push list, then wait for the user to create the target push template for the target push task.

[0079] In this embodiment of the application, before creating the target push template for the target push task, it is also possible to view the historical push templates used by historical push tasks. Specifically, in response to the user's query operation for historical push tasks in the task push management interface, a list of historical pushes is displayed on the second page of the task push management interface. Please refer to [link to relevant documentation]. Figure 4 , Figure 4 This is a schematic diagram of the second page in an embodiment of this application, as shown below. Figure 4 As shown, the second page displays a list of historical push notifications, including recipient information, push time, push duration, push template information, and the content to be displayed in the video preview area of ​​the push template. Users can search for historical push templates matching the target push task on the second page. If a matching historical push template exists in the list, it is designated as the target push template for the target task. If no matching historical push template exists in the list, a target push template is created for that task in the task push management interface.

[0080] Further, step c2 specifically includes:

[0081] Step d1: If a historical push template that matches the target push task exists in the historical push list, then in response to the user's download operation of the historical push template that matches the target push task on the second page, the user will be redirected to the first page.

[0082] Step d2: Display the historical push templates on the first page and set the historical push templates as the target push templates for the target push task.

[0083] In this step, if a historical push template that matches the target push task exists in the historical push list, such as... Figure 4 As shown, users can click the download button for the historical push task corresponding to the historical push template to directly jump to the first page. The historical push template is then displayed on the first page. In response to the user's operation on the target push template, the historical push template can be directly uploaded as the target push template to the image transmission scheduling server of the video network image transmission management system, further reducing the workload of manual work and thus improving the user experience.

[0084] Furthermore, after S204, the method further includes:

[0085] Step e1: In response to the user's trigger operation on the push management control in the task push management interface, the user is redirected from the first page to the third page; the third page displays the progress information of each ongoing push task.

[0086] Step e2 is in response to the user's action to end at least one ongoing push task on the third page, instructing the image transmission scheduling server to end the push of at least one push task.

[0087] In this step, after uploading the target push template to the image transmission scheduling server of the video network image transmission management system, it can also respond to user trigger operations on the push management controls in the task push management interface, redirecting from the first page to the third page. Please refer to [link to relevant documentation]. Figure 5 , Figure 5 This is a schematic diagram of the third page in an embodiment of this application, as shown below. Figure 5 As shown, the third page displays the progress information of each ongoing push task, including the recipient information, push time information, push status information, push template information, and the content displayed in the video preview area.

[0088] If, after the video conferencing session ends, it is necessary to stop the sending terminal 103 from pushing audio and video streams to the receiving terminal 104, the system responds to the user's end operation on the third page for at least one ongoing push task, instructing the image transmission scheduling server 102 to end the push of at least one push task. Specifically, as follows... Figure 5 As shown, on the third page, you can select at least one ongoing push task that you want to end, and then click the "Batch End" button to generate a batch end command, which is sent to the image transmission scheduling server 102 to instruct the server to end the push of the selected push task according to the batch end command. Alternatively, you can directly click the end button of an ongoing push task that you want to end, generate an end command, and send it to the image transmission scheduling server 102 to instruct the server to end the ongoing push task according to the end command.

[0089] This application provides an audio / video stream push method, applied to the image transmission scheduling client of a video network image transmission management system. The method includes: responding to a user's creation operation of a target push template for at least one target push task in a task push management interface, displaying a first identifier of a signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template on a first page of the task push management interface; the target push task is a task to push the audio / video stream of at least one signal source of any sending terminal to at least one audio / video player of at least one receiving terminal for playback in a preset display mode; the first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area; the push template configuration area displays the initial push template. The system includes at least one video preview area corresponding to the board, arranged in a preset display mode. For any target push task, in response to a user dragging a first identifier of the signal source of any sending terminal to any video preview area, a first correspondence between the first identifier and the video preview area is established in the push template configuration area, determining the content to be displayed in at least one video preview area. In response to a user selecting a second identifier of any receiving terminal, a second correspondence is established between the second identifier and the content to be displayed, generating a target push template. In response to a user executing the target push template for at least one target push task, the target push template is uploaded to the image transmission scheduling server of the video network image transmission management system, enabling the image transmission scheduling server to execute the target push task based on the target push template. This method of executing target push tasks by configuring target push templates reduces manual labor costs and improves the efficiency of audio and video stream push.

[0090] Based on the same application concept, this application also provides an audio and video stream push device corresponding to the audio and video stream push method provided in the above embodiments. Since the principle of the device in this application to solve the problem is similar to the audio and video stream push method in the above embodiments of this application, the implementation of the audio and video stream push device can refer to the implementation of the method, and the repeated parts will not be described again.

[0091] Please see Figure 6 , Figure 6 This is one of the functional block diagrams of an audio / video stream push device provided in an embodiment of this application, such as... Figure 6 As shown, the audio / video stream pushing device 600 includes:

[0092] The display module 610 is used to respond to a user's creation operation of a target push template for at least one target push task in the task push management interface. The first page of the task push management interface displays a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template. The target push task is a task that pushes the audio and video streams of at least one signal source from any sending terminal to at least one audio and video player on at least one receiving terminal for playback in a preset display mode. The first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area. The push template configuration area displays at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in a preset display mode.

[0093] The determination module 620 is used to, for any target push task, in response to the user's operation of dragging the first identifier of the signal source of any sending terminal to any video preview area, establish a first correspondence between the first identifier and the video preview area in the push template configuration area, and determine at least one content to be displayed in the corresponding video preview area.

[0094] The generation module 630 is used to respond to the user's selection operation of the second identifier of any receiving terminal, establish a second correspondence between the second identifier and the content to be displayed, and generate a target push template.

[0095] The execution module 640 is used to respond to the user's execution operation on the target push template of at least one target push task, and upload the target push template to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template.

[0096] Furthermore, after responding to the user's selection operation of the second identifier of any receiving terminal, and before establishing a second correspondence between the second identifier and the content to be displayed, the generation module 630 is further configured to:

[0097] Determine the first number of audio and video players configured on the receiving terminal; determine whether the first number of receiving terminals is greater than or equal to a second number; the second number is the number of first identifiers of the signal source of the sending terminal that have a first correspondence with at least one video preview area; if yes, establish a second correspondence between the second identifier and the content to be displayed; if no, generate a prompt message to inform the user that the receiving terminal cannot play the audio and video stream in the target push task according to the preset display method.

[0098] Furthermore, after generating the prompt message, the generation module 630 is also used to:

[0099] The preset display method is changed according to the preset filtering display rules to obtain the modified preset display method; the modified preset display method is adapted to the first quantity; a second correspondence is established between the second identifier and the content to be displayed corresponding to the modified preset display method to generate the target push template.

[0100] Further, please refer to Figure 7 , Figure 7 This is a second functional block diagram of an audio / video stream push device provided in an embodiment of this application, as shown below. Figure 7 As shown, the audio / video stream pushing device 600 also includes:

[0101] The query module 650 is used to respond to the user's query operation for historical push tasks in the task push management interface. It displays the historical push list on the second page of the task push management interface. The historical push list includes template information of at least one historical push template.

[0102] The judgment module 660 is used to determine the historical push template as the target push template for the target push task if a historical push template that matches the target push task exists in the historical push list; otherwise, it waits for the user to create the target push template for the target push task.

[0103] Furthermore, the judgment module 660 is specifically used for:

[0104] If a historical push template that matches the target push task exists in the historical push list, then in response to the user's download operation of the historical push template that matches the target push task on the second page, the user will be redirected to the first page; the historical push template will be displayed on the first page and identified as the target push template for the target push task.

[0105] Furthermore, such as Figure 7 As shown, the audio / video stream pushing device 600 also includes:

[0106] The second query module 670 is used to respond to the user's trigger operation on the push management control in the task push management interface, and jump from the first page to the third page; the third page displays the progress information of each push task that is in progress.

[0107] The push termination module 680 is used to respond to the user's termination operation on the third page for at least one ongoing push task, instructing the image transmission scheduling server to terminate the push of at least one push task.

[0108] The audio / video stream push device provided in this application embodiment is applied to the image transmission scheduling client of the video network image transmission management system. The push device includes: a display module, used to respond to the user's creation operation of the target push template for at least one target push task in the task push management interface, displaying a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template on the first page of the task push management interface; the target push task is a task to push the audio / video stream of at least one signal source of any sending terminal to at least one audio / video player of at least one receiving terminal for playback in a preset display mode; the first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area; the push template configuration area displays at least one [unclear text - possibly related to the initial push template] corresponding to the initial push template. The system includes at least one video preview area, arranged in a preset display mode. A determination module, for any target push task, responds to a user's operation of dragging a first identifier of the signal source of any sending terminal to any video preview area, establishing a first correspondence between the first identifier and the video preview area in the push template configuration area, and determining the content to be displayed in at least one video preview area. A generation module, responding to a user's selection operation of a second identifier of any receiving terminal, establishes a second correspondence between the second identifier and the content to be displayed, generating a target push template. An execution module, responding to a user's execution operation of the target push template for at least one target push task, uploads the target push template to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template. In this way, executing target push tasks by configuring target push templates reduces manual labor costs and improves the efficiency of audio and video stream push.

[0109] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of an electronic device 800 provided in an embodiment of the present application, including: a processor 810, a memory 820 and a bus 830.

[0110] The memory 820 stores machine-readable instructions executable by the processor 810. When the electronic device 800 is running, the processor 810 and the memory 820 communicate through the bus 830. When the machine-readable instructions are executed by the processor 810, the steps of the audio and video stream push method provided in the above embodiment are executed. For specific implementation, please refer to the method embodiment, which will not be repeated here.

[0111] This application also provides a computer-readable storage medium storing a computer program. When the computer program is run by a processor, it executes the steps of the audio and video stream push method provided in the above embodiments. For specific implementation details, please refer to the method embodiments, which will not be repeated here.

[0112] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0113] In the embodiments provided in this application, it should be understood that the disclosed methods and apparatus can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some communication interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0114] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0115] In addition, the functional units in the embodiments provided in this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0116] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0117] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. In addition, the terms "first", "second", "third", etc. are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0118] Finally, it should be noted that the above-described embodiments are merely specific implementations of this application, used to illustrate the technical solutions of this application, and not to limit them. The protection scope of this application is not limited thereto. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this application; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application. All should be covered within the protection scope of this application. Therefore, the protection scope of this application should be determined by the protection scope of the claims.

Claims

1. A method for pushing audio and video streams, characterized in that, A video transmission scheduling client applied to a video network video transmission management system, the method comprising: In response to a user's creation of a target push template for at least one target push task in the task push management interface, the first page of the task push management interface displays a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template. The target push task is a task that pushes the audio and video streams of at least one signal source of any sending terminal to at least one audio and video player of at least one receiving terminal for playback in a preset display mode. The first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area. The push template configuration area displays at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in the preset display mode. For any of the target push tasks, in response to the user's operation of dragging the first identifier of the signal source of any of the sending terminals to any of the video preview areas, a first correspondence between the first identifier and the video preview area is established in the push template configuration area, and the content to be displayed in the at least one video preview area is determined; In response to a user's selection of a second identifier for any of the receiving terminals, a second correspondence is established between the second identifier and the content to be displayed, and the target push template is generated. In response to a user's execution operation on the target push template of the at least one target push task, the target push template is uploaded to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template.

2. The audio / video stream push method according to claim 1, characterized in that, After responding to the user's selection operation of a second identifier for any of the receiving terminals, and before establishing a second correspondence between the second identifier and the content to be displayed, the method further includes: Determine the first number of audio and video players configured on the receiving terminal; Determine whether the first number of the receiving terminals is greater than or equal to the second number; the second number is the number of first identifiers of the signal sources of the sending terminals that have a first correspondence with the at least one video preview area; If so, establish a second correspondence between the second identifier and the content to be displayed; If not, generate a prompt message to inform the user that the receiving terminal cannot play the audio and video stream in the target push task according to the preset display method.

3. The audio / video stream push method according to claim 2, characterized in that, After generating the prompt message, the method further includes: The preset display method is changed according to the preset filtering display rules to obtain the modified preset display method; the modified preset display method is adapted to the first quantity; A second correspondence is established between the second identifier and the content to be displayed corresponding to the modified preset display method, thereby generating the target push template.

4. The audio / video stream push method according to claim 1, characterized in that, The receiving terminals in different target push tasks are different.

5. The audio / video stream push method according to claim 1, characterized in that, Prior to responding to a user's action to create a push template for at least one target push task, the method further includes: In response to a user's query operation for historical push tasks in the task push management interface, a historical push list is displayed on the second page of the task push management interface. The historical push list includes template information for at least one historical push template. If a historical push template that matches the target push task exists in the historical push list, the historical push template is determined as the target push template for the target push task. If no historical push template matching the target push task exists in the historical push list, then the system waits for the user to create a target push template for the target push task.

6. The audio / video stream push method according to claim 5, characterized in that, If a historical push template matching the target push task exists in the historical push list, determining the historical push template as the target push template for the target push task includes: If a historical push template that matches the target push task exists in the historical push list, then in response to the user's download operation of the historical push template that matches the target push task on the second page, the user is redirected to the first page. The historical push template is displayed on the first page, and the historical push template is determined as the target push template for the target push task.

7. The audio / video stream push method according to claim 1, characterized in that, After uploading the target push template to the image transmission scheduling server of the video network image transmission management system, the method further includes: In response to a user's triggering action on the push management control in the task push management interface, the user is redirected from the first page to the third page; wherein, the third page displays the progress information of each ongoing push task; In response to a user's action to end at least one ongoing push task on the third page, the image transmission scheduling server is instructed to end the push of the at least one push task.

8. An audio / video stream pushing device, characterized in that, The audio and video stream pushing device in the image transmission scheduling client applied to the video network image transmission management system includes: The display module is used to respond to a user's creation operation of a target push template for at least one target push task in the task push management interface. On the first page of the task push management interface, it displays a first identifier of the signal source of at least one sending terminal, a second identifier of at least one receiving terminal, and an initial push template. The target push task is a task that pushes the audio and video streams of at least one signal source from any sending terminal to at least one audio and video player on at least one receiving terminal for playback in a preset display mode. The first page includes a first display area for displaying the first identifier, a second display area for displaying the second identifier, and a push template configuration area. The push template configuration area displays at least one video preview area corresponding to the initial push template, and the at least one video preview area is arranged in the preset display mode. The determination module is configured to, for any of the target push tasks, in response to an operation by a user dragging a first identifier of the signal source of any of the sending terminals to any of the video preview areas, establish a first correspondence between the first identifier and the video preview areas in the push template configuration area, and determine the content to be displayed corresponding to the at least one video preview area; The generation module is configured to, in response to a user's selection operation of a second identifier for any of the receiving terminals, establish a second correspondence between the second identifier and the content to be displayed, and generate the target push template; An execution module is configured to, in response to a user's execution operation on the target push template of the at least one target push task, upload the target push template to the image transmission scheduling server of the video network image transmission management system, so that the image transmission scheduling server executes the target push task based on the target push template.

9. An electronic device, characterized in that, include: The device includes a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor communicates with the memory via the bus. The machine-readable instructions are executed by the processor to perform the steps of the audio / video streaming method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, performs the steps of the audio / video stream push method as described in any one of claims 1 to 7.

Images