Layer adjustment and double-picture live broadcast method, device, system, equipment and medium

Abstract

The invention relates to the technical field of live broadcast, and discloses a layer adjustment and double-picture live broadcast method, device and system, equipment and a medium. The layer adjustment method comprises the following steps: acquiring a plug-flow scene of double-picture live broadcast and a scene scaling ratio of a corresponding preview scene; when a dragging operation on a preview target layer in the preview scene is detected, obtaining a target dragging path of the dragging operation; and adjusting the corresponding plug flow target layer in the plug flow scene based on the scene scaling and the target dragging path. According to the method and the device, at least two scenes with inconsistent scaling ratios can be rendered in one picture, and the plug flow target layer in the plug flow scene can be flexibly adjusted according to the plug flow scene and the different scene scaling ratios in the preview scene based on the operation in the preview scene, so that efficient and smooth layer adjustment is realized, and the user experience is improved. The interactivity and controllability of the double-picture live broadcast content are improved, and the performance requirement and the equipment cost of the double-picture live broadcast can be reduced.

Description

Technical Field

[0001] The present invention relates to the field of live broadcast technology, and in particular to a method, device, system, equipment and medium for layer adjustment and dual-screen live broadcast. Background Art

[0002] As a highly interactive video entertainment method, live broadcast has developed rapidly in the Internet field in recent years. In the conventional live broadcast form, the picture is often single, and the anchor shows the required content in a unified scene. However, with the increasing demand for the diversity of live broadcast content from viewers, dual-screen live broadcast has gradually become a new hot demand. The dual-screen live broadcast technology allows two pictures, namely the main picture and the secondary picture, to be displayed simultaneously during the live broadcast, and in the live streaming scenario, the main and secondary pictures are regarded as two scenes, namely the main scene and the secondary scene. Important content is placed in the main scene, and secondary content is placed in the secondary scene, so as to conduct dual-screen live broadcast. Among them, the main and secondary scenes are containers for integrating layers, with width and height attributes. The layer is a unit for packaging different image materials to be presented in the live broadcast process, which are independent of each other and placed in the main scene or the secondary scene, so that the position and size of the layer in the scene can be quantified, and the layer can be finely adjusted through parameters such as position, size, Z-axis coverage and transparency.

[0003] However, in dual-screen live broadcast, the main picture and the secondary picture often have different width-to-height ratios, and these ratios may be disproportionate. Moreover, due to the existence of two independent pictures and scenes, dual-scene judgment and operations are required to manage the layers, which is more complex than single-scene. In addition, before live streaming, it is often necessary to watch the live broadcast content to be broadcast through the preview function to ensure the correctness and controllability of the live broadcast content. And the preview function should also provide a platform for the anchor to modify the live broadcast content, such as adding, deleting layers, dragging positions, etc., so as to timely control the live broadcast content. However, in dual-screen live broadcast, due to the different scaling ratios and display effects of the main and secondary scenes, the problem of inconsistent picture ratios of the two pictures often appears during preview rendering, making it difficult to perform corresponding layer adjustments.

[0004] The problem of inconsistent landscape and portrait screen aspect ratios can be referred to Figure 1 and Figure 2 , Figure 1 which is a schematic diagram of landscape preview implemented by the prior art, Figure 2FIG. 0 is a schematic diagram of vertical screen preview implemented by the prior art, which is described in the case where the content of the horizontal screen preview is consistent with the layout of the live streaming scenario. For example, in a certain streaming scenario, the picture size is 2688*1080, and the size of the main scene is 1920*1080. The aspect ratio is 16:9. The width requirement of the secondary scene is 40% of the main scene, that is, the service limit is 768, and its aspect ratio is 1:1. Then the size of the secondary scene is 768*768, and the main scene is larger than the secondary scene. Among them, in the horizontal screen preview scene, the main scene and the secondary scene can be scaled proportionally to the streaming scene. For example, the size of the preview main scene is 192*108, and the size of the preview secondary scene is 77*77 after rounding. Then the scaling ratio of both, that is, the ratio of the streaming scene and the preview scene corresponding to the main scene and the secondary scene, can be regarded as 10. In the vertical screen preview, if the width of the preview window is 192, the main scene will be arranged first to ensure that the main scene is effectively displayed under this width limit, and the preview main scene with a size of 192*108 is obtained, which is reduced by 10 times. Then the secondary scene is arranged, and the size of the preview secondary scene remains 1:1, which can be 192*192, only reduced by 4 times, and it is larger than the main scene in the preview window. Therefore, there is a situation where the scaling ratios and display effects of the main scene and the secondary scene are different. The traditional method usually cannot consider the change of this scaling ratio, so when performing corresponding layer management through the preview scene, it often lacks fluency and flexibility, and it is difficult to meet the requirements of efficient and accurate control of the live content, resulting in the lack of interactivity and controllability of the live content. SUMMARY OF THE INVENTION

[0005] The main object of the present invention is to provide a layer adjustment and dual-screen live streaming method, device, system, equipment and medium, aiming to solve the technical problem of difficult layer adjustment for dual-screen live streaming.

[0006] The present invention provides a layer adjustment method in the first aspect. The layer adjustment method includes: obtaining the scene scaling ratio of the streaming scene and the corresponding preview scene of the dual-screen live streaming; when detecting a dragging operation on the preview target layer in the preview scene, obtaining the target dragging path of the dragging operation; and adjusting the corresponding streaming target layer in the streaming scene based on the scene scaling ratio and the target dragging path.

[0007] Optionally, in the first implementation manner of the first aspect of the present invention, the streaming scene includes a streaming main scene and a streaming secondary scene, and the preview scene includes a preview main scene corresponding to the streaming main scene and a preview secondary scene corresponding to the streaming secondary scene; the obtaining the scene scaling ratio of the streaming scene and the corresponding preview scene of the dual-screen live streaming includes: obtaining the first scaling ratio of the streaming main scene and the preview main scene; and / or obtaining the second scaling ratio of the streaming secondary scene and the preview secondary scene.

[0008] Optionally, in the second implementation manner of the first aspect of the present invention, the target dragging path includes a starting position and an ending position; after obtaining the target dragging path of the dragging operation when detecting a dragging operation on the preview target layer in the preview scene, the method further includes: obtaining a position change amount from the starting position to the ending position.

[0009] Optionally, in the third implementation manner of the first aspect of the present invention, adjusting the push stream target layer corresponding to the push stream scene based on the scene scaling ratio and the target dragging path includes: determining the starting position as the layer position control point of the preview target layer, and the starting position is in the preview main scene. In the push stream main scene, move the push stream target layer based on the position change amount and the first scaling ratio; determining the starting position as the layer position control point of the preview target layer, and the starting position is in the preview secondary scene. In the push stream secondary scene, move the push stream target layer based on the position change amount and the second scaling ratio.

[0010] Optionally, in the fourth implementation manner of the first aspect of the present invention, adjusting the push stream target layer corresponding to the push stream scene based on the scene scaling ratio and the target dragging path includes: determining the starting position as the layer size control point of the preview target layer, and the starting position is in the preview main scene. In the push stream main scene, scale the push stream target layer based on the position change amount and the first scaling ratio with the diagonal point or opposite side of the corresponding layer size control point of the push stream target layer as a reference; determining the starting position as the layer size control point of the preview target layer, and the starting position is in the preview secondary scene. In the push stream secondary scene, scale the push stream target layer based on the position change amount and the second scaling ratio with the diagonal point or opposite side of the corresponding layer size control point of the push stream target layer as a reference.

[0011] Optionally, in the fifth implementation manner of the first aspect of the present invention, after obtaining the scene scaling ratios of the push stream scene and the corresponding preview scene of the dual-screen live broadcast, the method further includes: obtaining a layer configuration instruction and the position of the corresponding selected target area; determining that the target area position is in the push stream main scene, and obtaining the main layer list of the push stream main scene; determining that the target area position is in the push stream secondary scene, and obtaining the secondary layer list of the push stream secondary scene; configuring the main layer list and / or the secondary layer list based on the layer configuration instruction to update the push stream scene and the corresponding preview scene.

[0012] In a second aspect of the present invention, there is also provided a dual-screen live broadcast method, which includes: constructing a live broadcast scene based on a main live broadcast scene and a secondary live broadcast scene for dual-screen live broadcast; generating a corresponding preview scene based on the live broadcast scene; and based on the layer adjustment method as described above, when a dragging operation on a preview target layer in the preview scene is detected, adjusting the live broadcast target layer in the live broadcast scene.

[0013] In a third aspect of the present invention, there is also provided a layer adjustment device, which includes: an acquisition module for acquiring the scene scaling ratios of the live broadcast scene and the corresponding preview scene of the dual-screen live broadcast; a detection module for, when a dragging operation on a preview target layer in the preview scene is detected, acquiring the target dragging path of the dragging operation; and an adjustment module for adjusting the corresponding live broadcast target layer in the live broadcast scene based on the scene scaling ratio and the target dragging path.

[0014] In a fourth aspect of the present invention, there is also provided a dual-screen live broadcast system, which includes: a live broadcast device for constructing a live broadcast scene based on a main live broadcast scene and a secondary live broadcast scene for dual-screen live broadcast; a preview generation device for generating a corresponding preview scene based on the live broadcast scene; and the layer adjustment device as described above for, when a dragging operation on a preview target layer in the preview scene is detected, adjusting the live broadcast target layer in the live broadcast scene.

[0015] In a fifth aspect of the present invention, there is also provided a computer device, which includes: a memory and at least one processor, with instructions stored in the memory; the at least one processor invoking the instructions in the memory to cause the computer device to execute the layer adjustment method as described above.

[0016] In a sixth aspect of the present invention, there is also provided a computer-readable storage medium, with instructions stored thereon, and when the instructions are executed by a processor, the layer adjustment method as described above is implemented.

[0017] A method, device, system, equipment and medium for layer adjustment and dual-screen live broadcast provided by an embodiment of the present invention first obtain the scene scaling ratio of the push stream scene and the corresponding preview scene of the dual-screen live broadcast, and when detecting a dragging operation on the preview target layer in the preview scene, obtain the target dragging path of the dragging operation, and adjust the corresponding push stream target layer in the push stream scene based on the scene scaling ratio and the target dragging path. By dragging the operation in the preview scene, the present invention can realize the adjustment of the layer in the push stream scene, greatly improving the operation convenience and efficiency during the live broadcast, ensuring that during the live push stream, the position, size and display effect of the layer are consistent with the effect in the preview scene, effectively reducing the complexity of layer adjustment in the dual-screen live broadcast, improving the smoothness and flexibility of layer adjustment, avoiding the problem of inaccurate layer adjustment caused by the change of the scaling ratio in the traditional method, being able to adapt to the scaling ratio for layer adjustment, enabling at least two scenes with inconsistent scaling ratios to be rendered in one screen, and allowing layer adjustment for different scenes, meeting the requirements of efficient and smooth control of the live broadcast content, enhancing the interactivity and controllability of the live broadcast content, and being beneficial to reducing the performance requirements and equipment costs of the dual-screen live broadcast. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a schematic diagram of horizontal screen preview implemented by the prior art;

[0019] Figure 2 is a schematic diagram of vertical screen preview implemented by the prior art;

[0020] Figure 3 is a schematic flowchart of an embodiment of the layer adjustment method in an embodiment of the present invention;

[0021] Figure 4 For the present invention Figure 3 is a schematic flowchart of an embodiment of step 101 in an embodiment;

[0022] Figure 5 For the present invention Figure 3 is a schematic flowchart of an embodiment after step 101 in an embodiment of the present invention;

[0023] Figure 6 For the present invention Figure 3 is a schematic flowchart of an embodiment of step 103 in an embodiment of the present invention;

[0024] Figure 7 For the present invention Figure 6 is a schematic diagram of vertical screen operation in a specific embodiment of an embodiment of the present invention;

[0025] Figure 8 For the present invention Figure 3 is a schematic flowchart of another embodiment of step 103 in an embodiment of the present invention;

[0026] Figure 9 For the present invention Figure 8 Schematic diagram of vertical screen operation of a specific embodiment of Embodiment 1;

[0027] Figure 10 Schematic flow chart of an embodiment of the dual-screen live broadcast method in an embodiment of the present invention;

[0028] Figure 11 Schematic diagram of functional modules of an embodiment of the layer adjustment device in an embodiment of the present invention;

[0029] Figure 12 Schematic diagram of functional modules of an embodiment of the dual-screen live broadcast system in an embodiment of the present invention;

[0030] Figure 13 Schematic diagram of functional modules of an embodiment of a computer device in an embodiment of the present invention. Detailed implementation manners

[0031] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments described herein can be implemented in an order other than those illustrated or described herein. In addition, the term "comprising" or "having" and any deformation thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0032] For ease of understanding, the specific process of the layer adjustment method in an embodiment of the present invention is described below. The layer adjustment method of this embodiment is applied to an electronic device, which can be a terminal, such as a smart phone, a laptop computer, a tablet computer, a desktop computer, etc., or a development board, a chip system, etc. Please refer to Figure 3 , Figure 3 Schematic flow chart of an embodiment of the layer adjustment method in an embodiment of the present invention. In this embodiment, the layer adjustment method includes:

[0033] 101. Obtain the scene scaling ratio of the push stream scene and the corresponding preview scene of the dual-screen live broadcast;

[0034] In this embodiment, the streaming scenario is the scenario visible to the host when going live and to the audience. Specifically, it may include the main streaming scenario and the secondary streaming scenario. Among them, the main streaming scenario is the main content display area during the live broadcast, while the secondary streaming scenario is the area for displaying additional information or auxiliary content. For example, in a game live broadcast, the game live broadcast screen is usually placed in the main streaming scenario, while the host's camera screen can be placed in the secondary streaming scenario. To reflect the primary and secondary nature of the main and secondary streaming scenarios, they usually have different sizes. The main scenario occupies a larger screen area, while the secondary scenario occupies a smaller screen area, avoiding the blurring of the main scenario's screen when both use small screens and also avoiding the high requirements for network performance and display device performance when both use large screens. In the prior art, to adapt to existing mainstream display devices, the main streaming scenario usually uses an aspect ratio of 16:9, such as 1920*1080, 1080*720, etc., while the secondary scenario can flexibly adjust the aspect ratio, usually with a maximum aspect ratio of 16:9 and a minimum aspect ratio of 1:1. For example, when the aspect ratio is 1:1, the size of the secondary scenario is usually 768*768, and when the aspect ratio is 16:9, it is usually 768*432.

[0035] In this embodiment, the preview scenario refers to the scenario corresponding to the streaming scenario that the host or the live broadcast administrator can view through an electronic device before pushing the live broadcast content. This preview scenario can be obtained through screen mirroring technology, through a specific data stream analysis tool, or through the program interface provided by some live broadcast platforms. This application does not make specific limitations on this. By obtaining this preview scenario, it can reflect in real time the live broadcast content that will be presented in the streaming scenario, including the layer content in the main and secondary streaming scenarios, as well as possible layer changes and layer adjustment effects. The host or the live broadcast administrator can observe this preview scenario to perform real-time control of the live broadcast content. The host or the live broadcast administrator can observe this preview scenario to perform real-time control of the live broadcast content, such as adjusting the camera angle, changing the live broadcast background, and configuring layer elements, etc., to ensure the effectiveness and accuracy of the live broadcast content.

[0036] In this embodiment, the preview scene specifically includes a preview main scene corresponding to the main live streaming scene and a preview secondary scene corresponding to the secondary live streaming scene. The preview main scene and the preview secondary scene are respectively used to display the content of the main live streaming scene and the secondary live streaming scene, so that the live streamer or the live broadcast administrator can simultaneously preview the overall effect of the dual-screen live broadcast in one screen. Parameters such as the size, layout, and style of the preview main scene and the preview secondary scene can be consistent with those of the main live streaming scene and the secondary live streaming scene in the live streaming scene, or can be adjusted according to different preview requirements. For example, when previewing, the size of the preview secondary scene can be appropriately reduced to display the content of the preview main scene and the preview secondary scene simultaneously in a smaller screen, improving the convenience of preview. When previewing in landscape and portrait orientations, the layout of the preview main scene and the preview secondary scene can be adapted respectively according to the different preview windows to meet the requirements in different preview scenarios. By obtaining the corresponding preview main scene and preview secondary scene, subsequent preview and layer management can be guided according to the scaling ratio relationship with the corresponding main live streaming scene and secondary live streaming scene.

[0037] In this embodiment, since the screen sizes occupied by the live streaming scene and the preview scene on the display device are different, corresponding scaling processing needs to be performed to ensure the accurate presentation of the live broadcast content and the clarity of the preview effect. There is usually a scaling relationship between the live streaming scene and the preview scene. Therefore, after obtaining the live streaming scene and the corresponding preview scene of the dual-screen live broadcast, the corresponding scene scaling ratio can be further obtained. This scene scaling ratio can be obtained by calculating the differences in parameters such as the aspect ratio and resolution between the live streaming scene and the preview scene, or can be determined based on the preset configuration of the live streamer or the live broadcast administrator. After obtaining this scene scaling ratio, during the subsequent layer adjustment process, the layer adjustment operations in the preview scene can be correspondingly transformed and mapped according to this ratio to achieve the accurate adjustment of the layer content in the live streaming scene.

[0038] Optionally, referring to Figure 4 , in one embodiment, obtaining the scene scaling ratio of the live streaming scene and the corresponding preview scene of the dual-screen live broadcast includes:

[0039] 1011. Obtaining the first scaling ratio between the main live streaming scene and the preview main scene; and / or

[0040] 1012. Obtaining the second scaling ratio between the secondary live streaming scene and the preview secondary scene.

[0041] In this alternative embodiment, in dual-screen live streaming, the main and secondary scenes may have different scaling ratios and display effects, resulting in inconsistent scaling ratios of the preview scenes corresponding to different live streaming scenes during preview rendering, such as the problem of inconsistent aspect ratios of the two screens in landscape and portrait orientations as mentioned above. Therefore, for the main live streaming scene and the secondary live streaming scene, the scaling ratios between them and the corresponding main preview scene and secondary preview scene can be obtained respectively to ensure that during subsequent layer adjustment processes, layers with different scaling ratios can be accurately adjusted and controlled. After obtaining the first scaling ratio and the second scaling ratio, subsequent layer adjustment operations in the preview scene can be correspondingly transformed and mapped based on these ratio relationships, thereby adjusting the corresponding layers in the live streaming scene. By separately obtaining the first scaling ratio between the main live streaming scene and the main preview scene, and the second scaling ratio between the secondary live streaming scene and the secondary preview scene, the embodiments of the present invention can accurately adjust and control layers with different scaling ratios, improving the flexibility and accuracy of layer adjustment in dual-screen live streaming. At the same time, it also avoids the problem of inaccurate layer adjustment caused by changes in scaling ratios in traditional methods, further enhancing the operational convenience and efficiency during the live streaming process.

[0042] Optionally, referring to Figure 5 , in one embodiment, after obtaining the scene scaling ratios of the live streaming scene and the corresponding preview scene in dual-screen live streaming, it further includes:

[0043] 1013. Obtain a layer configuration instruction and the position of the selected target area;

[0044] 1014. Determine that the target area position is in the main live streaming scene, and obtain the main layer list of the main live streaming scene;

[0045] 1015. Determine that the target area position is in the secondary live streaming scene, and obtain the secondary layer list of the secondary live streaming scene;

[0046] 1016. Configure the main layer list and / or the secondary layer list based on the layer configuration instruction to update the live streaming scene and the corresponding preview scene.

[0047] In this alternative embodiment, after obtaining the scene scaling ratios of the push stream scenario and the corresponding preview scenario for dual-screen live streaming, a method for configuring layers in the main push stream scenario and the secondary push stream scenario is also provided. Among them, the selected target area position refers to the area in the push stream scenario specified by the host, administrator, or system that needs to be configured with layers. This target area position can be an area in the main push stream scenario or an area in the secondary push stream scenario, specifically depending on the needs of the live content and the operations performed by the host or live administrator using a mouse, touch screen, or other input devices. The layer configuration instruction is a signaling sent by the host or live administrator when performing configuration operations on the layers, such as adding a new layer, deleting a layer, or modifying a layer. It can be triggered by operating in the scene editor provided by the live streaming platform. For example, the host can trigger the instruction to delete a layer by clicking on a certain layer with the mouse and selecting the delete operation, or trigger the corresponding layer configuration instruction by opening the parameter table of the layer through a command and modifying the parameters, or adding a new layer after selecting the main push stream scenario or the secondary push stream scenario and configuring it into the main layer list or the secondary layer list.

[0048] In this alternative embodiment, taking the example of adding a layer to the scene through a layer configuration instruction, specifically, the layer to be added and the corresponding selected target area position can be obtained first through the layer configuration instruction. When it is determined that the target area position is in the main push stream scenario, the layer to be added is added to the main push stream scenario, or when it is determined that the target area position is in the secondary push stream scenario, the layer to be added is added to the secondary push stream scenario. Among them, the layer to be added refers to the new layer that the host or live administrator needs to add to the push stream scenario. This layer to be added can include materials such as text, pictures, animations, etc., which are used to enrich the live content or provide additional information. This layer to be added can be configured in a specific scene editor of the live streaming platform or introduced through file import. This application does not make any restrictions on this. After obtaining the corresponding layer configuration instruction and the corresponding selected target area position, specifically, the target area position can be selected first and then the layer to be added can be added, or the layer to be added can be imported first and then the target area position can be selected for addition. If it is determined that the target area position is in the main push stream scenario, the layer to be added is added to the main push stream scenario to display additional information or decorative effects of the main content during the live stream. If it is determined that the target area position is in the secondary push stream scenario, the layer to be added is added to the secondary push stream scenario to display additional information or decorative effects of the secondary content during the live stream. In addition, when there is no selected target area position, the layer to be added can be default added to the main push stream scenario or the secondary push stream scenario, and corresponding switching controls can be provided to switch the specific push stream scenario to which it is added. In this way, new layers can be flexibly added to the main push stream scenario and the secondary push stream scenario to meet different live streaming needs and display effects.

[0049] In this alternative embodiment, after determining the position of the target area, a corresponding target layer list can be determined according to the position of the target area. The target layer list can be the main layer list of the live streaming main scene or the secondary layer list of the live streaming secondary scene. The main layer list is a list containing all layer objects in the live streaming main scene, while the secondary layer list is a list containing all layer objects in the live streaming secondary scene. By obtaining the corresponding target layer list, a target layer can be selected therefrom, that is, the layer that the host or the live streaming administrator hopes to operate on. After selecting the target layer, the selected target layer can be configured based on the layer configuration instruction, such as modifying its attributes, deleting or moving, etc. In this way, it can adapt to the multi-scene situation including the live streaming main scene and the live streaming secondary scene in dual-screen live streaming, enabling the host or the live streaming administrator to flexibly control and manage the live streaming content in the scenario of this dual-screen live streaming, realizing real-time control of the live streaming content, and improving the interactivity and controllability of the live streaming content display.

[0050] 102. When a drag operation on the preview target layer in the preview scene is detected, obtain the target drag path of the drag operation;

[0051] In this embodiment, the target drag path is the path formed by the host or the live streaming administrator making a certain layer or a controllable point in the layer move from the starting position to the final position through a drag operation in the preview scene. The target drag path can be operated through a mouse, a touch screen or other input devices and is reflected in the preview scene in real time. The starting position refers to the position of the layer at the start of the drag operation, while the final position refers to the position of the layer at the end of the drag operation. Through the drag operation, the host or the live streaming administrator can flexibly adjust the position and size of the layer in the preview scene to adapt to different live streaming requirements and display effects.

[0052] In this embodiment, the detection of the drag operation can be implemented based on the interfaces provided by the live streaming platform or the computer operating system, or can be monitored through image recognition technology, or can be monitored through sensors on the input device. This application does not make specific limitations in this regard. After detecting the drag operation, the corresponding target drag path can be obtained, so as to perform corresponding operations on the corresponding live streaming target layer in the live streaming scene according to the drag operation on the preview target layer in the preview scene, and realize accurate adjustment of the position and size of the live streaming target layer.

[0053] Optionally, in an embodiment, after obtaining the target drag path of the drag operation when a drag operation on the preview target layer in the preview scene is detected, it further includes: obtaining the position change amount from the starting position to the final position.

[0054] In this alternative embodiment, the amount of position change from the starting position to the final position is the displacement values in the width direction and the height direction of the dragging operation in the preview scene, which can be represented by coordinates. For example, if the coordinates of the starting position in the preview scene are (50, 50) and the coordinates of the final position in the preview scene are (250, 280), then the amount of position change is (200, 230), indicating that it has moved 200 pixels in the positive direction in the width direction and 230 pixels in the positive direction in the height direction. Among them, in a normal display window, the positive direction of the width direction is usually horizontal to the right, and the positive direction of the height direction is usually vertical downward. It can also be other coordinate definition methods, as long as it can reflect the displacement situation of the pushing operation. It can be understood that in a single dragging operation, multiple segments of displacement situations can be subdivided and recorded, that is, recorded as multiple target dragging paths and corresponding multiple sets of starting positions and final positions, so that after the corresponding dragging operation is mapped to the live streaming scene, the process of the dragging operation can be presented more meticulously, thus presenting a more flexible and smooth dragging effect. By calculating the amount of position change from the starting position to the final position, subsequent precise adjustment of the layer position and size can be achieved, improving the accuracy and convenience of layer adjustment in dual-screen live streaming.

[0055] 103. Adjust the live streaming target layer corresponding to the live streaming scene based on the scene scaling ratio and the target dragging path;

[0056] In this embodiment, since there is a scene scaling ratio relationship between the preview scene and the live streaming scene, that is, the scene scaling ratio includes the first scaling ratio of the main live streaming scene and the corresponding preview main scene, and the second scaling ratio of the secondary live streaming scene and the corresponding preview secondary scene. Therefore, when dragging a layer, other layer points except the corresponding controllable points in the layer will be scaled or moved accordingly according to this scene scaling ratio relationship to ensure that the relative position and relative size of the layer in the live streaming scene are consistent with those in the preview scene. In this way, the host or the live streaming administrator can intuitively control the layer effect in the live streaming scene based on the layer dragging effect in the preview scene, improving the management efficiency and accuracy of the live streaming content. Among them, the controllable points refer to the points in the layer that can be dragged by the host or the live streaming administrator, which can be the corner points, midpoints of the edges or other key points of the layer. By dragging these controllable points, attributes such as the position, size or shape of the layer can be changed. During the dragging process, the host or the live streaming administrator can, according to actual needs, make real-time adjustments and optimizations to the layer, such as adjusting the position, size, rotation angle or transparency of the layer to adapt to different live streaming requirements and display effects. After the dragging operation is completed, the corresponding layer adjustment effect can be calculated and applied according to the target dragging path and the scene scaling ratio relationship, and the corresponding adjustment operation can be applied to the live streaming scene, thereby realizing the real-time control and management of the live streaming content.

[0057] Optionally, refer to Figure 6 , in one embodiment, adjusting the push stream target layer corresponding to the push stream scenario based on the scenario scaling ratio and the target drag path includes:

[0058] 1031. Determine that the starting position is the layer position control point of the preview target layer, and the starting position is in the preview main scene. In the push stream main scene, move the push stream target layer based on the position change amount and the first scaling ratio;

[0059] 1032. Determine that the starting position is the layer position control point of the preview target layer, and the starting position is in the preview secondary scene. In the push stream secondary scene, move the push stream target layer based on the position change amount and the second scaling ratio.

[0060] In this optional embodiment, the adjustment method of the layer position is specified. Among them, the layer position control point is the point in the layer used to control the layer position, usually set as the center point of the layer. By dragging the layer position control point, the host or the live broadcast administrator can flexibly adjust the position of the layer in the preview scene. After dragging the layer position control point, the corresponding position change amount can be obtained, which is used to guide the subsequent adjustment operation of the layer in the push stream scene.

[0061] In this optional embodiment, after determining the starting position, the corresponding push stream scene, that is, the push stream main scene or the push stream secondary scene, and the corresponding scene scaling ratio, that is, the first scaling ratio or the second scaling ratio, can be determined according to the preview scene where the starting position is located, that is, the preview main scene or the preview secondary scene. Then, according to the scene scaling ratio and the position change amount, calculate the distance and direction that the push stream target layer in the push stream scene should move, and move the push stream target layer accordingly in the push stream scene. Among them, the preview target layer and the push stream target layer are layer objects with the same identification information to ensure the consistency of the corresponding layers processed in the preview scene and the push stream scene, thereby ensuring the relative position of the layer in the push stream scene is the same as that in the preview scene, improving the management efficiency and accuracy of the live broadcast content. At the same time, since the dragging operation is reflected in the preview scene in real time, the host or the live broadcast administrator can intuitively see the effect of the layer adjustment and make real-time adjustments and optimizations according to the needs of the push stream scene to meet different live broadcast requirements and display effects.

[0062] Specifically, refer to Figure 7 , Figure 7 as an example of the position movement operation of the preview target layer in the preview main scene in the vertical screen preview scene. In Figure 7In the vertical screen preview scenario example, the red frame area is the main preview scene, the blue frame area is the secondary preview scene, the purple frame area is the preview target layer to be adjusted, the red inverted triangle is the layer position control point of a layer in the main preview scene, that is, the starting position of the target dragging path, and the green inverted triangle is the final position of the target dragging path. Therefore, the movement of the layer can be achieved according to the corresponding target dragging path. If the coordinates of the starting position are (50, 50) and the coordinates of the final position are (80, 80), then the corresponding first position change amount is (30, 30), so that each layer point in the preview target layer in the corresponding preview scene moves 30 pixels in the positive direction of the width direction and the positive direction of the height direction respectively. If the size of the main push stream scene is 1920 * 1080 and the size of the secondary push stream scene is 192 * 108, that is, the first scaling ratio is 10, then each layer point in the push stream target layer in the corresponding main push stream scene moves 300 pixels in the positive direction of the width direction and the positive direction of the height direction respectively. For example, if the coordinates of a point in the main push stream scene were originally (0, 0), then the coordinates after the corresponding movement operation are (300, 300).

[0063] Optionally, referring to Figure 8 , in an embodiment, based on the scene scaling ratio and the target dragging path, adjusting the corresponding push stream target layer in the push stream scene further includes:

[0064] 1033. Determine that the starting position is the layer size control point of the preview target layer, and the starting position is in the main preview scene. In the main push stream scene, based on the position change amount and the first scaling ratio, scale the push stream target layer with the diagonal point or opposite side of the corresponding layer size control point of the push stream target layer as the reference.

[0065] 1034. Determine that the starting position is the layer size control point of the preview target layer, and the starting position is in the secondary preview scene. In the secondary push stream scene, based on the position change amount and the second scaling ratio, scale the push stream target layer with the diagonal point or opposite side of the corresponding layer size control point of the push stream target layer as the reference.

[0066] In this alternative embodiment, a method for adjusting the size of a layer is specified. Among them, the layer size control points are corner points or edge points used to control the size of the layer. Specifically, when the layer size control point is a corner point, it is usually used to control the scaling of two dimensions, namely the width and height of the layer. By dragging these layer size control corner points, the host or the live broadcast administrator can flexibly adjust the size of the layer in the preview scene. While dragging, the size change amount of the layer is calculated, that is, the scaling ratio and direction of the layer from the starting size to the current size. This size change amount can be used to guide subsequent adjustment operations of the layer in the live streaming scene. During the process of adjusting the layer size based on the corner points of the layer size control, the diagonal point of the layer size control corner point is used as the base point, that is, the coordinates of this diagonal point remain unchanged to perform the scaling adjustment of the layer size, ensuring the fixed-point position relationship of the layer during the scaling process.

[0067] In this alternative embodiment, after determining that the starting position is a layer size control corner point, the corresponding live streaming scene, that is, the main live streaming scene or the secondary live streaming scene, and the corresponding scene scaling ratio, that is, the first scaling ratio or the second scaling ratio, can be determined according to the preview scene where the starting position is located, that is, the main preview scene or the secondary preview scene. Then, according to this scene scaling ratio and the size change amount, calculate the scaling ratio and direction that the layer should be scaled in the live streaming scene, and correspondingly scale the live streaming target layer in the live streaming scene. In this way, it can be ensured that the relative change size of the layer in the live streaming scene is consistent with that in the preview scene, improving the management efficiency and accuracy of the live broadcast content. At the same time, since the dragging operation is reflected in the preview scene in real time, the host or the live broadcast administrator can intuitively see the effect of the layer adjustment and make real-time adjustments and optimizations as needed.

[0068] In this alternative embodiment, specifically, reference can be made to Figure 9 , Figure 9 as an example of the size scaling operation of the preview target layer in the main preview scene in the vertical screen preview scene. In the Figure 9 vertical screen preview scene example, the red frame area is the main preview scene, the blue frame area is the secondary preview scene, the purple frame area is the preview layer object to be adjusted, the red inverted triangle is the layer size control corner point of a layer in the main preview scene, that is, the starting position of the target dragging path, and the green inverted triangle is the final position of the target dragging path. Therefore, the scaling of the layer can be achieved according to the corresponding target dragging path. If the coordinates of the diagonal point are (0, 0), the coordinates of the starting position are (50, 50), and the coordinates of the final position are (80, 80), that is, the size of the layer object in the preview scene is enlarged from 50 * 50 to 80 * 80. Correspondingly, if the first scaling ratio is 10, the size of the layer object in the main live streaming scene is enlarged from 500 * 500 to 800 * 800.

[0069] In this alternative embodiment, when the layer size control point is an edge point, it is usually used to control the scaling of a single dimension of the layer width or height. For example, when the control point is an edge point on the upper or lower side of the layer reflecting the width, it is usually used to adjust the height of the layer. When the control point is an edge point on the left or right side of the layer reflecting the height, it is used to adjust the width of the layer. By dragging these layer size control edge points, the host or the live broadcast administrator can flexibly adjust the size of the layer in the preview scene. Different from dragging the layer size control corner points, when dragging the layer size control edge points for scaling, the scaling adjustment is based on the opposite side of the layer size control edge point. During the dragging process, the size change amount of the layer is calculated in real time, that is, the scaling ratio and direction of the layer from the starting size to the current size. This size change amount can also be used to guide the subsequent adjustment operations of the layer in the live streaming scene. During this size adjustment process, the layer size scaling adjustment is based on the opposite side of the layer size control edge point to ensure the position relationship of the fixed side of the layer during the scaling process.

[0070] In this alternative embodiment, after determining that the starting position is a layer size control edge point, the corresponding live streaming scene, that is, the main live streaming scene or the secondary live streaming scene, and the corresponding scene scaling ratio, that is, the first scaling ratio or the second scaling ratio, can be determined according to the preview scene where the starting position is located, that is, the main preview scene or the secondary preview scene. Then, according to this scene scaling ratio and the size change amount, calculate the scaling ratio and direction that the layer should be scaled in the live streaming scene, and scale the layer object accordingly in the live streaming scene. In this way, it can also be ensured that the relative change size of the layer in the live streaming scene is consistent with that in the preview scene, improving the management efficiency and accuracy of the live broadcast content. At the same time, since the dragging operation is reflected in the preview scene in real time, the host or the live broadcast administrator can intuitively see the effect of the layer adjustment and make real-time adjustments and optimizations as needed. In this embodiment, the adjustment method of the layer size based on the opposite side of the layer size control edge point is similar to the two-dimensional layer size adjustment method based on the diagonal of the layer size control corner point described above. It is a single-direction dimension size adjustment method, and this application will not elaborate on it here.

[0071] In the above optional embodiments, the scaling ratios of the position movement and size scaling processes are all based on the starting position of the target dragging path. Therefore, the corresponding scaling ratios are all the scaling ratios corresponding to the main scene or sub-scene where the starting position is located. Thus, in the case of cross-scene, for example, when the starting position of the target dragging path is in the preview main scene and the final position of the target dragging path is in the preview sub-scene, a smooth layer transition effect can be achieved. That is, when the host or live broadcast administrator drags a layer in the preview scene from the preview main scene to the preview sub-scene, the layer will smoothly transition from the live streaming main scene to the live streaming sub-scene according to the scene scaling ratio relationship of the live streaming scene corresponding to the starting position, ensuring the continuity and consistency of the position and size of the layer during the transition, and there will be no sudden change in the calculated value. This smooth transition effect enables the host or live broadcast administrator to operate more smoothly when adjusting the layer, without worrying about sudden changes or misalignments that may occur when the layer switches between different scenes. At the same time, this smooth transition effect can also improve the viewing experience of the live broadcast content, avoiding the situation where the content in the preview scene and the live streaming scene is inconsistent, so that the audience can more clearly see the changes and effects of the layer when watching the live broadcast.

[0072] In this embodiment, it should be understood that the present invention mainly aims to solve the problem of inconsistent scaling ratios in dual-screen live broadcasts. In live broadcasts with more screens such as triple-screen live broadcasts, quadruple-screen live broadcasts, and quintuple-screen live broadcasts, a similar idea to this solution can also be adopted. Only need to make corresponding adjustments and optimizations to the layers in each screen according to the scene scaling ratio relationships of each screen. For example, in a triple-screen live broadcast, the host or live broadcast administrator can drag the layer in three different preview scenes respectively, and calculate and apply the corresponding layer adjustment effects according to the scaling ratio relationships between each preview scene and the corresponding live streaming scene, and apply the adjusted layer to the corresponding live streaming scene. In this way, whether in a dual-screen live broadcast or a live broadcast with more screens, smooth transition and consistent display of the layer between different scenes can be achieved, improving the management efficiency and accuracy of the live broadcast content.

[0073] The embodiment of the present invention also provides a dual-screen live broadcast method. Please refer to Figure 10 , Figure 10 which is a schematic flowchart of an embodiment of the dual-screen live broadcast method in the embodiment of the present invention. In this embodiment, the dual-screen live broadcast method includes:

[0074] 201. Construct a live streaming scene based on the live streaming main scene and the live streaming sub-scene for dual-screen live broadcast;

[0075] 202. Generate a corresponding preview scene based on the live streaming scene;

[0076] 203. Based on, for example, Figures 3 to 9The described layer adjustment method adjusts the streaming target layer in the streaming scene when a drag operation on the preview target layer in the preview scene is detected.

[0077] In this embodiment, the push streaming scene constructed based on the push streaming main scene and the push streaming sub-scene is the scene actually used in the live streaming process, that is, the scene where the host starts broadcasting and the audience can see it, which is related to the final live broadcast effect. Therefore, it is necessary to ensure the fluency and controllability of the live content in the push streaming scene. Specifically, the size and layout of the push streaming scene can be determined so that it can accommodate the push streaming main scene and the push streaming sub-scene, and maintain the relative position and size relationship between the two, so as to ensure the clarity and readability of the live content. At the same time, when constructing the push streaming scene, usually for the purpose of interaction or for the description of the live content, a layer is usually arranged in the live streaming scene, that is, the unit for displaying text, pictures, animations and other materials in the broadcast process. For each material to be displayed, a layer is created to package it, and the position, size, Z-axis coverage and transparency and other parameters of the layer in the push streaming scene are configured. The process of building the streaming scene can be implemented by dragging and dropping the main streaming scene and the sub-streaming scene based on the graphical user interface, or by calling a programming interface, or by configuring and filling a preset template, as long as the main streaming scene and the sub-streaming scene can be laid out in the streaming scene.

[0078] In this embodiment, in the process of constructing a push stream scene based on the push stream main scene and the push stream sub-scene, it is usually necessary to crop the original main scene and the original sub-scene and place them in the original push stream scene to obtain the push stream scene. Among them, the original main scene and the original sub-scene both refer to images or video streams directly obtained without additional processing, which can be obtained by screen recording, camera shooting or loading video stream content. The original main scene includes the main live content to be presented by the subsequent push stream main scene, and the original sub-scene includes the secondary live content to be presented by the subsequent push stream sub-scene. For example, in the game live broadcast, the original main scene is usually a screen recording of the game screen and the original sub-scene is the anchor screen obtained by the camera. In sports live broadcasts, the original main scene is usually the video content provided by the broadcast station, and the original sub-scene is the commentator screen taken by the camera. In existing live broadcast platforms, it is usually required that the original main scene, the original sub-scene and the final push stream scene are the same size, such as 2688*1080.

[0079] In this embodiment, by cropping an area of a preset main scene size from the original main scene, a push stream main scene that meets the live broadcast requirements can be obtained. Similarly, by cropping an area of a preset sub-scene size from the original sub-scene, a push stream sub-scene that meets the live broadcast requirements can be obtained. Among them, the preset main scene size and the preset sub-scene size are determined according to conditions such as live broadcast requirements, the performance of the display device, and network bandwidth. Usually, different live broadcast platforms provide different service restrictions, and the cropped areas have specific aspect ratio and resolution limitations. For example, under the existing live broadcast resource conditions, when the aspect ratio of the preset main scene is 16:9 and the resolution is 1920*1080, and the aspect ratio of the preset sub-scene is 1:1 and the size is 768*768, or the aspect ratio of the preset sub-scene is 16:9 and the size is 768*432, it can usually ensure that the push stream main scene and the push stream sub-scene can be clearly presented to the audience during the live broadcast and will not have an adverse impact on the smoothness of the live broadcast.

[0080] In this embodiment, after cropping the push stream main scene and the push stream sub-scene, the cropped push stream main scene and push stream sub-scene can be placed in the original push stream scene to obtain the push stream scene. Among them, the original push stream scene is usually a live broadcast template provided by the live broadcast platform or a custom push stream background image and dynamic effects, and is a container for push stream live broadcast content. When placing the push stream main scene and the push stream sub-scene, the layout and style of the push stream main scene and the push stream sub-scene in the original push stream scene, such as position, constraint, and border, can be adjusted according to needs to meet the needs of the live broadcast content. In this way, a push stream scene that meets the live broadcast requirements can be conveniently constructed, and the size and position of the push stream main scene and the push stream sub-scene can be flexibly adjusted to adapt to different live broadcast requirements and display devices. At the same time, since the cropping process only involves the extraction of some areas of the original scene image, the high-quality content of the original scene image can be retained to ensure the clarity and readability of the live broadcast image.

[0081] In this embodiment, the preview scene can be obtained based on the information of the push stream scene through screen mirroring technology, through a specific data stream analysis tool, or through a program interface provided by some live broadcast platforms. This application does not make specific limitations on this. By obtaining this preview scene, the live broadcast content to be presented in the push stream scene can be reflected in real time, including the images in the push stream main scene and the push stream sub-scene, as well as possible layer changes and layer adjustment effects, to obtain the preview main scene and the preview sub-scene. The anchor or the live broadcast administrator can observe this preview scene to perform real-time control of the live broadcast content, such as adjusting the camera angle, changing the live broadcast background, and configuring layer elements, to ensure the interactivity and controllability of the live broadcast content.

[0082] In this embodiment, after constructing a push stream scenario for dual-screen live broadcast and obtaining the corresponding preview scenario, the layers in the preview scenario can be adjusted in real time based on the foregoing layer adjustment method. The host or the live broadcast administrator can change the size and position of the layer by dragging the layer position control point or the layer size control point in the preview scenario, and this operation will be reflected in the preview scenario in real time. The host or the live broadcast administrator can intuitively see the effect of the layer adjustment. At the same time, the layer adjustment method calculates the scaling ratio and direction that the layer should scale in the push stream scenario according to the coordinate changes between the starting position and the final position, as well as the scene scaling ratio, and adjusts the layer object accordingly in the push stream scenario, so as to ensure that the relative position and size of the layer change in the push stream scenario are consistent with those in the preview scenario. The layer adjustment method not only improves the management efficiency and accuracy of the live broadcast content, but also enables the host or the live broadcast administrator to operate more smoothly, and can effectively improve the interactivity and controllability of the dual-screen live broadcast.

[0083] To execute the corresponding steps in the above method embodiments and all possible implementation manners, the following provides an implementation manner of a layer adjustment device. Please refer to Figure 11 , Figure 11 which is a schematic diagram of the functional modules of an embodiment of the layer adjustment device in the embodiment of the present invention. In this embodiment, the layer adjustment device 300 includes:

[0084] An acquisition module 301, configured to acquire the scene scaling ratio of the push stream scenario and the corresponding preview scenario of the dual-screen live broadcast;

[0085] A detection module 302, configured to obtain the target drag path of the drag operation when detecting a drag operation on the preview target layer in the preview scenario;

[0086] An adjustment module 303, configured to adjust the corresponding push stream target layer in the push stream scenario based on the scene scaling ratio and the target drag path.

[0087] Optionally, in an embodiment, the push stream scenario includes a push stream main scenario and a push stream secondary scenario, and the preview scenario includes a preview main scenario corresponding to the push stream main scenario and a preview secondary scenario corresponding to the push stream secondary scenario; the acquisition module 301 is specifically further configured to: acquire the first scaling ratio between the push stream main scenario and the preview main scenario; and / or acquire the second scaling ratio between the push stream secondary scenario and the preview secondary scenario.

[0088] Optionally, in an embodiment, the target drag path includes a starting position and a final position; the detection module 302 is specifically further configured to: acquire the position change amount from the starting position to the final position.

[0089] Optionally, in one embodiment, the adjustment module 303 is further specifically configured to: determine that the starting position is the layer position control point of the preview target layer, and the starting position is in the preview main scene. In the push stream main scene, move the push stream target layer based on the position change amount and the first scaling ratio; determine that the starting position is the layer position control point of the preview target layer, and the starting position is in the preview secondary scene. In the push stream secondary scene, move the push stream target layer based on the position change amount and the second scaling ratio.

[0090] Optionally, in one embodiment, the adjustment module 303 is further specifically configured to: determine that the starting position is the layer size control point of the preview target layer, and the starting position is in the preview main scene. In the push stream main scene, scale the push stream target layer based on the position change amount and the first scaling ratio with the diagonal point or opposite side of the corresponding layer size control point of the push stream target layer as the reference; determine that the starting position is the layer size control point of the preview target layer, and the starting position is in the preview secondary scene. In the push stream secondary scene, scale the push stream target layer based on the position change amount and the second scaling ratio with the diagonal point or opposite side of the corresponding layer size control point of the push stream target layer as the reference.

[0091] Optionally, in one embodiment, the acquisition module 301 is further specifically configured to: acquire a layer configuration instruction and the corresponding selected target area position; determine that the target area position is in the push stream main scene, and acquire the main layer list of the push stream main scene; determine that the target area position is in the push stream secondary scene, and acquire the secondary layer list of the push stream secondary scene; configure the main layer list and / or the secondary layer list based on the layer configuration instruction to update the push stream scene and the corresponding preview scene.

[0092] Since the embodiments of the device part correspond to the embodiments of the above layer adjustment method, the introduction of the layer adjustment device provided in the embodiments of the present invention refers to the embodiments of the above layer adjustment method, and will not be repeated here. It has the same beneficial effects as the above layer adjustment method.

[0093] To execute the corresponding steps in the above method embodiments and all possible implementation manners, the following provides an implementation manner of a dual-screen live broadcast system. Please refer to Figure 12 , Figure 12 which is a schematic diagram of the function modules of an embodiment of the dual-screen live broadcast system in the embodiments of the present invention. In this embodiment, the dual-screen live broadcast system 400 specifically includes:

[0094] A push stream live broadcast device 401, configured to construct a push stream scene based on the push stream main scene and the push stream secondary scene for dual-screen live broadcast;

[0095] A preview generation device 402, configured to generate a corresponding preview scene based on the push stream scene;

[0096] AsFigure 11 The described layer adjustment device 300 is configured to adjust the pushed target layer in the live streaming scene when a dragging operation on the preview target layer in the preview scene is detected.

[0097] Since the embodiments of the system part correspond to the embodiments of the above dual-screen live streaming method and include the same layer adjustment device 300 as above, the introduction of the layer adjustment device provided in the embodiments of the present invention may refer to the embodiments of the above dual-screen live streaming method and the layer adjustment device embodiments. The embodiments of the present invention will not be elaborated herein, and it has the same beneficial effects as the above dual-screen live streaming method.

[0098] The present invention also provides a computer device, which includes a memory and a processor. When the computer-readable instructions stored in the memory are executed by the processor, the processor is caused to execute the layer adjustment method as described above. Figure 13 It is a schematic diagram of the functional modules of a computer device provided by an embodiment of the present invention. The computer device 500 may vary greatly due to configuration or performance differences, and may include one or more processors (central processing units, CPU) 510 (for example, one or more processors) and a memory 520, and one or more storage media 530 (for example, one or more mass storage devices) for storing application programs 533 or data 532. Among them, the memory 520 and the storage media 530 may be transient storage or persistent storage. The program stored in the storage media 530 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the computer device 500. Further, the processor 510 may be configured to communicate with the storage media 530 and execute a series of instruction operations in the storage media 530 on the computer device 500.

[0099] The computer device 500 may further include one or more power supplies 540, one or more wired or wireless network interfaces 550, one or more input / output interfaces 560, and / or one or more operating systems 531, such as Windows Serve, Mac OS X, Unix, Linux, FreeBSD, and so on. Those skilled in the art can understand that Figure 13 The computer device structure shown does not constitute a limitation on the computer device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0100] The present invention also provides a computer-readable storage medium, which can be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are run on a computer, the computer is made to execute the layer adjustment method as described above.

[0101] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the devices described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein. If the integrated module or unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.

[0102] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments or perform equivalent replacements for some of the technical features. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A layer adjustment method, characterized in that: include: Get the scene zoom ratio of the push scene and the corresponding preview scene of the dual-screen live broadcast; When a drag operation on the preview target layer in the preview scene is detected, a target drag path of the drag operation is obtained; The corresponding streaming target layer in the streaming scene is adjusted based on the scene scaling ratio and the target dragging path.

2. The layer adjustment method according to claim 1, characterized in that: The streaming scene includes a streaming main scene and a streaming sub-scene, and the preview scene includes a preview main scene corresponding to the streaming main scene and a preview sub-scene corresponding to the streaming sub-scene; The obtaining of the scene zoom ratio of the streaming scene and the corresponding preview scene of the dual-screen live broadcast includes: Obtaining a first scaling ratio between the streaming main scene and the preview main scene; and / or A second scaling ratio of the streaming sub-scene to the preview sub-scene is obtained.

3. The layer adjustment method according to claim 2, characterized in that: The target dragging path includes a starting position and a final position; After the step of acquiring the target dragging path of the dragging operation when a dragging operation on the preview target layer in the preview scene is detected, the step further includes: The position change from the starting position to the final position is obtained.

4. The layer adjustment method according to claim 3, characterized in that: The adjusting the corresponding streaming target layer in the streaming scene based on the scene scaling ratio and the target dragging path includes: Determine that the starting position is a layer position control point of the preview target layer, and the starting position is in the preview main scene. In the streaming main scene, move the streaming target layer based on the position change amount and the first scaling ratio; The starting position is determined to be a layer position control point of the preview target layer, and the starting position is in the preview sub-scene. In the streaming sub-scene, the streaming target layer is moved based on the position change amount and the second scaling ratio.

5. The layer adjustment method according to claim 3, characterized in that: The adjusting the corresponding streaming target layer in the streaming scene based on the scene scaling ratio and the target dragging path includes: Determine that the starting position is a layer size control point of the preview target layer, and the starting position is in the preview main scene. In the streaming main scene, the streaming target layer is scaled based on the position change and the first scaling ratio, with the diagonal point or the opposite side of the layer size control point corresponding to the streaming target layer as a reference; Determine that the starting position is the layer size control point of the preview target layer, and the starting position is in the preview sub-scene. In the streaming sub-scene, the streaming target layer is scaled based on the position change and the second scaling ratio, with the diagonal point or the opposite side of the layer size control point corresponding to the streaming target layer as a reference.

6. The layer adjustment method according to claim 2, characterized in that: After obtaining the scene zoom ratio of the push stream scene and the corresponding preview scene of the dual-screen live broadcast, the method further includes: Get the layer configuration instructions and the corresponding selected target area location; Determine that the target area is located in the main streaming scene, and obtain a main layer list of the main streaming scene; Determine that the target area is located in the streaming sub-scene, and obtain a sub-layer list of the streaming sub-scene; The main layer list and / or the sub-layer list are configured based on the layer configuration instruction to update the streaming scene and the corresponding preview scene.

7. A dual-screen live broadcast method, characterized in that: include: Construct a streaming scene based on the main streaming scene and the secondary streaming scene to perform dual-screen live broadcast; Generate a corresponding preview scene based on the streaming scene; Based on the layer adjustment method according to any one of claims 1 to 6, when a drag operation on the preview target layer in the preview scene is detected, the streaming target layer in the streaming scene is adjusted.

8. A layer adjustment device, characterized in that: include: An acquisition module is used to obtain the push streaming scene of the dual-screen live broadcast and the scene scaling ratio of the corresponding preview scene; A detection module, configured to, when a drag operation on a preview target layer in the preview scene is detected, obtain a target drag path of the drag operation; The adjustment module is used to adjust the corresponding streaming target layer in the streaming scene based on the scene scaling ratio and the target dragging path.

9. A dual-screen live broadcast system, characterized in that: include: A live streaming device for streaming, used to construct a streaming scene based on a main streaming scene and a secondary streaming scene to perform dual-screen live streaming; A preview generating device, used to generate a corresponding preview scene based on the streaming scene; The layer adjustment device according to claim 8 is used to adjust the streaming target layer in the streaming scene when a drag operation on the preview target layer in the preview scene is detected.

10. A computer device, characterized in that: The computer device comprises: a memory and at least one processor, wherein instructions are stored in the memory; The at least one processor calls the instructions in the memory to enable the computer device to execute the layer adjustment method according to any one of claims 1 to 6.

11. A computer-readable storage medium having instructions stored thereon, characterized in that: When the instructions are executed by the processor, the layer adjustment method according to any one of claims 1 to 6 is implemented.

Images