Live stream picture display method and apparatus, computer device and storage medium

By obtaining and adjusting the display parameter information in the display window in the display window, the stretching or tailoring problems caused by the changes in the dimensions and position changes in the live broadcast screen realize the trigger of the screen integrity and interactive control.

WO2025021037A1PCT designated stage expired Publication Date: 2025-01-30BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/106443
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-21
Filing Date
2024-07-19
Publication Date
2025-01-30

AI Technical Summary

Technical Problem

In live broadcast scenarios such as video chat and multi-person interaction, the size and position of live broadcast screen elements in the display window change, resulting in the problem of screen stretching or cropping.

Method used

By obtaining the display parameter information in the display window, including the display ratio and location, the original size information of the live broadcast element is adjusted to ensure that it has no stretching or tailor display in the display window.

Benefits of technology

Effectively avoid stretching or tailoring of the live broadcast element in the display window to ensure the triggering of the screen integrity and the interactive control control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024106443_30012025_PF_FP_ABST
    Figure CN2024106443_30012025_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the present disclosure are a live stream picture display method and apparatus, a computer device and a storage medium, the method comprising: according to the current live stream scene, displaying at least one display window matched with the live stream scene; acquiring display parameter information of live stream picture elements in the display window, the live stream picture elements comprising a live stream scene image and / or an interaction control, and the display parameter information being determined on the basis of window size information of the display window and original size information corresponding to the live stream picture elements to be displayed in the display window; and, according to a display proportion indicated by the display parameter information, adjusting the original size information corresponding to the live stream picture elements to be displayed, so as to obtain adjusted target size information and, on the basis of a display position indicated by the display parameter information, displaying in the display window the live stream picture elements of the target size information.
Need to check novelty before this filing date? Find Prior Art

Description

Method, device, computer equipment and storage medium for displaying live images

[0001] This application claims priority to Chinese Patent Application No. 202310906588.6 filed on July 21, 2023. The contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] The embodiments of the present disclosure relate to a method, apparatus, computer equipment, and storage medium for displaying live broadcast images. Background Art

[0003] In live streaming scenarios like video chats and multi-person live broadcasts, multiple people may be displayed on a single screen. Each live broadcast user's display window typically displays elements such as the scene image and interactive controls. However, as the number of people in the live broadcast scene changes, the size and position of the display window also change. Therefore, these elements can easily appear stretched or cropped when displayed together.

[0004] Summary of the Invention

[0005] The embodiments of the present disclosure at least provide a method, apparatus, computer equipment, and storage medium for displaying live broadcast images.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for displaying a live screen, comprising: displaying at least one display window matching the current live scene according to the current live scene; obtaining display parameter information of a live screen element in the display window; the live screen element includes a live scene image and / or an interactive control; the display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live screen element to be displayed in the display window; adjusting the original size information corresponding to the live screen element to be displayed according to the display ratio indicated by the display parameter information to obtain the adjusted target size information, and displaying the live screen element under the target size information in the display window based on the display position indicated by the display parameter information.

[0007] In an optional embodiment, for the live scene image included in the live screen element, the display parameter information includes a display ratio, and the display parameter information of the live scene image in the display window is determined according to the following steps: based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension, the size characteristics of the live scene image in the display window are determined; the size dimension includes a width size dimension and a height size dimension; based on the size characteristics of the live scene image, a target size dimension is determined from the at least one size dimension; the ratio between the size information corresponding to the original size information of the live scene image and the window size information of the display window in the target size dimension is used as the display ratio.

[0008] In an optional embodiment, based on the size information of the original size information of the live scene image and the window size information of the display window in multiple size dimensions, determining the size characteristics of the live scene image in the display window includes: determining the first width information in the width size dimension and the first height information in the height size dimension in the original size information of the live scene image, and determining a first ratio between the first width information and the first height information; and determining the second width information in the width size dimension and the second height information in the height size dimension in the window size information of the display window, and determining a second ratio between the second width information and the second height information; in response to the first ratio being less than or equal to the second ratio, determining that the size feature corresponding to the live screen element is a first size feature; or, in response to the first ratio being greater than the second ratio, determining that the size feature corresponding to the live screen element is a second size feature; based on the size feature of the live scene image, determining a target size dimension from multiple size dimensions, including: in response to determining that the size feature is the first size feature, determining the width size dimension as the target size dimension, or, in response to determining that the size feature is the second size feature, determining the height size dimension as the target size dimension.

[0009] In an optional embodiment, for the live scene image included in the live screen element, the display parameter information includes a display position, and the display parameter information of the live screen element in the display window is determined according to the following steps: determine the center position corresponding to the window display center of the display window, and use the center position as the display position of the live scene image, so that the element boundary of the live scene image adjusted based on the display ratio in the target size dimension coincides with the window boundary of the display window in the target size dimension.

[0010] In an optional embodiment, for the interactive controls included in the live screen elements, the display parameter information includes a display ratio and a display position; the display parameter information of the interactive controls in the display window is determined according to the following steps: based on preset standard window size information and the window size information of the display window, the display ratio of the interactive controls in the display window is determined; and based on the target boundary distance between the interactive controls and the display window under the standard window size information, the display position of the interactive controls in the display window is determined, so that the boundary distance between the interactive controls at the display position and the current display window maintains the target boundary distance.

[0011] In an optional embodiment, the display ratio of the interactive control in the display window is determined based on the standard window size information and the window size information of the display window, including: determining the ratio of the standard window size information and the window size information of the display window under a preset size dimension, and determining the display ratio of the interactive control in the display window based on the ratio under the preset size dimension and the original size information corresponding to the interactive control.

[0012] In an optional embodiment, obtaining display parameter information of the live screen element in the display window includes: determining the display parameter information corresponding to the current display window from candidate display ratios and candidate display positions corresponding to a plurality of pre-set display window sizes.

[0013] In the second aspect, the embodiment of the present disclosure also provides a live screen display device, including: a first display module, used to display at least one display window matching the live broadcast scene according to the current live broadcast scene; an acquisition module, used to obtain display parameter information of the live broadcast screen element in the display window; the live broadcast screen element includes a live broadcast scene image and / or an interactive control; the display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live broadcast screen element to be displayed in the display window; a second display module, used to adjust the original size information corresponding to the live broadcast screen element to be displayed according to the display ratio indicated by the display parameter information, obtain the adjusted target size information, and display the live broadcast screen element under the target size information in the display window based on the display position indicated by the display parameter information.

[0014] In an optional embodiment, for the live scene image included in the live screen element, the display parameter information includes a display ratio, and the acquisition module determines the display parameter information of the live scene image in the display window according to the following steps: based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension, determine the size characteristics of the live scene image in the display window; the size dimension includes a width size dimension and a height size dimension; based on the size characteristics of the live scene image, determine the target size dimension from the at least one size dimension; and use the ratio between the size information corresponding to the original size information of the live scene image and the window size information of the display window in the target size dimension as the display ratio.

[0015] In an optional embodiment, when determining the size characteristics of the live scene image in the display window based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension, the acquisition module is used to: determine the first width information in the width size dimension and the first height information in the height size dimension in the original size information of the live scene image, and determine a first ratio between the first width information and the first height information; and determine the second width information in the width size dimension and the second height information in the height size dimension in the window size information of the display window, and determine Determine a second ratio between the second width information and the second height information; in response to the first ratio being less than or equal to the second ratio, determine that the size feature corresponding to the live screen element is the first size feature; or, in response to the first ratio being greater than the second ratio, determine that the size feature corresponding to the live screen element is the second size feature; when the acquisition module determines the target size dimension from multiple size dimensions based on the size feature of the live scene image, it is used to: in response to determining that the size feature is the first size feature, determine the width size dimension as the target size dimension, or, in response to determining that the size feature is the second size feature, determine the height size dimension as the target size dimension.

[0016] In an optional embodiment, for the live scene image included in the live screen element, the display parameter information includes a display position, and the acquisition module determines the display parameter information of the live screen element in the display window according to the following steps: determining the center position corresponding to the window display center of the display window, and using the center position as the display position of the live scene image, so that the element boundary of the live scene image adjusted based on the display ratio in the target size dimension coincides with the window boundary of the display window in the target size dimension.

[0017] In an optional embodiment, for the interactive control included in the live screen element, the display parameter information includes a display ratio and a display position; the acquisition module determines the display parameter information of the interactive control in the display window according to the following steps: based on the preset standard window size information and the window size information of the display window, determining the display ratio of the interactive control in the display window; and based on the target boundary distance between the interactive control and the display window under the standard window size information, determining the display position of the interactive control in the display window, so that the boundary distance between the interactive control at the display position and the current display window maintains the target boundary distance.

[0018] In an optional embodiment, when the acquisition module determines the display ratio of the interactive control in the display window based on the standard window size information and the window size information of the display window, it is used to: determine the ratio of the standard window size information and the window size information of the display window under a preset size dimension, so as to determine the display ratio of the interactive control in the display window based on the ratio under the preset size dimension and the original size information corresponding to the interactive control.

[0019] In an optional embodiment, when the acquisition module acquires the display parameter information of the live screen element in the display window, it is used to: determine the display parameter information corresponding to the current display window from the candidate display ratios and candidate display positions corresponding to the pre-set multiple display window sizes.

[0020] In a third aspect, an optional implementation of the present disclosure further provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the machine-readable instructions perform the steps of the above-mentioned first aspect, or any possible implementation of the first aspect.

[0021] In a fourth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed, it executes the steps of the above-mentioned first aspect or any possible implementation of the first aspect.

[0022] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments. The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without inventive effort.

[0024] FIG1 shows a schematic diagram of a display window provided by an embodiment of the present disclosure;

[0025] FIG2 shows a flow chart of a method for displaying a live broadcast image provided by an embodiment of the present disclosure;

[0026] FIG3 shows a schematic diagram of comparing size features of a live scene image and a display window provided by an embodiment of the present disclosure;

[0027] FIG4 shows a schematic diagram of a live scene image obtained after the live scene image is processed according to a determined display ratio according to an embodiment of the present disclosure;

[0028] FIG5 shows a schematic diagram of a live scene image obtained after image supplementation is performed on the live scene image according to an embodiment of the present disclosure;

[0029] FIG6 shows a schematic diagram of a live scene image obtained after semantic supplementation is performed on the live scene image according to an embodiment of the present disclosure;

[0030] FIG7 shows a schematic diagram of a standard window provided by an embodiment of the present disclosure;

[0031] FIG8 is a schematic diagram showing a coordinate system determined for a current display window provided by an embodiment of the present disclosure;

[0032] FIG9 shows a schematic diagram of displaying live screen elements in a current display window provided by an embodiment of the present disclosure;

[0033] FIG10 shows a schematic diagram of a device for displaying live images provided by an embodiment of the present disclosure;

[0034] FIG11 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present disclosure.

[0036] Research has found that in live streaming scenarios, each user has a display window on the screen, which can display elements such as scene images and interactive controls. However, as the number of participants changes during the live broadcast, the size and position of the display windows will change to accommodate the corresponding display windows of all users on the screen. This can easily cause these elements to appear stretched or cropped when displayed together.

[0037] For example, in some possible cases, the scene image displayed in the display window is only adapted to the display window displayed in a size ratio of 1:2, that is, this scene image will not be stretched or deformed under the display window with a size ratio of 1:2, and an interactive control is determined to be displayed in the scene image at the center of the upper boundary of the image. For example, referring to the schematic diagram (a) on the left side of Figure 1, the corresponding live broadcast scene has only two users, so the size ratio of display window A is 1:2. Under display window A, the scene image and the interactive control can be displayed without stretching, deformation or shearing. When the number of live broadcasters changes, such as from two users to three users, in order to arrange and display the display windows corresponding to the three users, the size ratio of display window A may change to 1:1. For details, please refer to the schematic diagram (b) on the right side of Figure 1. In some possible cases, when the display window changes in proportion, the scene image will be selected to fill the display window, and the scene image in schematic diagram (b) will be stretched. At the same time, since the scene image is stretched vertically, the associated interactive controls will be cropped due to the smaller display area.

[0038] Based on the above research, the present disclosure provides a method for displaying a live screen, which can determine at least one display window that matches the live scene according to the current live scene, and then determine the display parameter information for the live screen element in the display window. Here, when determining the display parameter information for the live screen element, the window size information of the display window is specifically considered, that is, the size that can be displayed, and the original size information corresponding to the live screen element, that is, the specific image characteristics of the live screen element. In this way, the display parameter information determined for the live screen element can be used to adjust and display the live screen element. While satisfying that it can be fully displayed in the current display window, it can also be displayed according to its image characteristics to reduce the situation of being stretched or cropped.

[0039] The defects in the above solutions are the results obtained by the inventors after practice and careful research. Therefore, the process of discovering the above problems and the solutions proposed by this disclosure for the above problems below should be the contributions made by the inventors to this disclosure during the disclosure process.

[0040] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings.

[0041] To facilitate understanding of this embodiment, a method for displaying a live broadcast screen disclosed in an embodiment of the present disclosure is first introduced in detail. The execution subject of the method for displaying a live broadcast screen provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities, and the computer device includes, for example: a terminal device or a server or other processing device. The terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the method for displaying a live broadcast screen can be implemented by a processor calling computer-readable instructions stored in a memory.

[0042] The following is an explanation of the method for displaying the live broadcast screen provided by the embodiment of the present disclosure. The method for displaying the live broadcast screen provided by the embodiment of the present disclosure can be specifically applied to platforms that can perform live broadcasts, including but not limited to video platforms, shopping platforms, teaching platforms, and conference and office platforms. When performing live broadcasts, one or more users can perform live broadcasts at the same time, and the corresponding number of users performing live broadcasts at the same time can be determined according to the actual number of users limit requirements of different platforms. When displaying the live broadcast screen, it can be specifically displayed in the graphic display interface of the device used by the user. When different users use different devices, the size of the corresponding graphic display interface is also different. For details, please refer to the description in the following embodiments. In addition, for the device using the display method provided by the embodiment of the present disclosure, the corresponding user terminal can be a user terminal that watches the live broadcast, such as an audience user who watches the video with a microphone connected, or it can also be a user terminal that participates in the live broadcast, such as an anchor user.

[0043] 2 is a flowchart of a method for displaying a live broadcast screen according to an embodiment of the present disclosure. The method includes steps S201 to S203, wherein:

[0044] S201: displaying at least one display window matching the current live broadcast scene;

[0045] S202: Acquire display parameter information of a live screen element in the display window; the live screen element includes a live scene image and / or an interactive control; the display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live screen element to be displayed in the display window;

[0046] S203: Adjust the original size information corresponding to the live screen element to be displayed according to the display ratio indicated by the display parameter information to obtain the adjusted target size information, and display the live screen element under the target size information in the display window based on the display position indicated by the display parameter information.

[0047] The above S201 to S203 are described in detail below.

[0048] Regarding S201 above, the live broadcast scenario is first explained. According to the above description, different live broadcast platforms have different types of corresponding live broadcast scenarios, such as the host microphone scene or the conference scene. Secondly, different live broadcast scenarios will affect the display window. For example, in the microphone live broadcast scenario, the maximum number of live broadcast users can be limited to 5, and the display window of each live broadcast user can be presented. The size ratio when arranged can include 1:1, 1:2, 2:1, etc., so as to maximize the tiled display of the display windows corresponding to multiple live broadcast users in the graphical display interface.

[0049] For example, in the schematic diagram of the display window shown in Figure 1, the schematic diagram (a) on the left shows the display windows corresponding to two live broadcast users, which are arranged adjacently and tiled, and the size ratio is 1:2. In the schematic diagram (b) on the right, when the number of live broadcast users changes to 2, the same adjacent tile arrangement is selected. Then, due to the increase in the number of people, the size of the display window corresponding to each live broadcast user is changed. For example, the size ratio of the original display window A changes from 1:2 to 1:1, so as to reserve a display window area for the newly joined live broadcast user.

[0050] In the live broadcast scenarios listed above, the display window corresponding to each user under different live broadcast numbers is determined based on the changes in the number of live broadcasters, and the specific size ratio is used for display. In other possible live broadcast scenarios, the display windows corresponding to different live broadcast users may also be determined based on the identity restrictions of the live broadcast users. For example, in the teaching platforms or conference office platforms listed in the above examples, the live broadcast users can be divided into host users (such as teachers or conference speakers) and audience users (such as students or participants).

[0051] In this case, the graphic display interface used to display the display window in the live broadcast scene can also be divided into different areas corresponding to users with different identities, and then display windows are determined for these users in different areas according to the number of corresponding users. For example, the graphic display interface can be divided into two areas, the upper area displays the display window corresponding to the host user, and the lower area displays the display window corresponding to the audience user, and according to the changes in the number of live broadcast users in each area, the display window corresponding to the live broadcast user is determined in each area. For example, in the upper area, if there is only one main speaker, the size ratio of the corresponding display window is 2:1. If there are two people, the corresponding size ratio changes to 1:1, and the total size of the specific area occupied remains unchanged, which is the size of the upper area of ​​the graphic display interface.

[0052] In this way, for the platform used when displaying the live broadcast screen and the current live broadcast scene determined under the platform, the display window that should be displayed currently can be determined, that is, at least one display window that matches the live broadcast scene in the embodiment of the present disclosure.

[0053] Regarding the above S202, for each determined display window, in a live broadcast scenario, multiple live broadcast screen elements will be displayed through the live broadcast window. Here, the live broadcast screen elements specifically include live broadcast scene images and / or interactive controls.

[0054] Taking the live broadcast and microphone connection scenario as an example, the live broadcast scene image can be a waiting scene image displayed when the user is confirmed to enter the microphone connection scenario but the video screen has not yet been displayed, or it can also be a special effect background image displayed during the live broadcast, such as a beach special effect image or an ocean special effect image. The image here can be a static image or a dynamic special effect animated image, which is not specifically limited in the embodiments of the present disclosure.

[0055] Interactive controls are displayed in the display window as control icons and correspond to different interactive functions. For example, interactive controls include comment controls for likes, chat controls for multi-person voice chats, and special effects controls for adding special effects to the display window.

[0056] When displaying these live screen elements, in order to avoid screen deformation or untriggerable interactive controls due to stretching or cropping during display, in the embodiment of the present disclosure, the window size information of the determined display window and the original size information corresponding to the live screen elements to be displayed are specifically selected to determine the display parameter information of the live screen elements in the display window, so as to adjust the original size information of the live screen elements for effective display.

[0057] Here, the window size information of the display window is first explained. In one possible case, the window size information can be expressed using pixel values, such as the size (expressed in the form of "width × height" in the following examples) is 720px (width) × 1280px (height). The size of the display window will be different for different devices. For example, for a tablet computer with a larger screen size, the size corresponding to the display window under the same display method will be larger than the size corresponding to a mobile phone with a smaller screen size. Therefore, when obtaining the window size information of the display window, it is necessary to determine it based on the size of the device actually used. Specifically, after obtaining user authorization, the specific window size information of the display window can be determined in the current live broadcast scenario.

[0058] The original size information corresponding to the live screen elements can be determined during the design process. For example, when designing the drawing or selecting the image, the corresponding size information can be determined as the original size information.

[0059] Below, taking the live scene image and interactive controls specifically involved in the embodiments of the present disclosure as examples, how to obtain the corresponding display parameter information in the display window is explained.

[0060] First, for the live scene image, the specifically determined display parameter information may include the display ratio. Specifically, since the live scene image will be fully spread in the display window, that is, the entire display window is filled with the live scene image, and the size ratio of the live scene image determined when it is produced is not necessarily exactly the same as the size ratio of the acquired display window, therefore, no matter how the live scene image is scaled proportionally without deformation, it cannot be completely consistent with the size of the display window. If the size of the processed live scene image is made completely consistent with the size of the display window through direct scaling, the image in Figure 1 will be compressed and deformed. For this reason, in the embodiment of the present disclosure, it is selected to allow the live scene image to be edge cropped and proportionally scaled so that the live scene image is fully spread in the display window without deformation.

[0061] Specifically, in one possible case, if the original size information of the live scene image and the window size information of the display window represent that the aspect ratio of the live scene image and the display window is consistent, for example, the original size information of the live scene image is 100px×200px, and the window size information of the display window is 360px×720px, then the reflected aspect ratio is 1:2. Then the live scene image is proportionally enlarged, that is, the width dimension and the height dimension are enlarged at the same ratio, so that the processed live scene image can fill the display window without deformation. The display ratio of the live scene image during enlargement can be determined by the ratio corresponding to the height information under the size information of the live scene image and the display window, that is, 360 / 100, and the display ratio is enlarged to 3.6 times. It can also be determined by the ratio corresponding to the height information under the size information of the live scene image and the display window, that is, 720 / 200, and the display ratio is also enlarged to 3.6 times.

[0062] In other possible cases, the original size information of the live scene image and the window size information of the display window may indicate that the aspect ratios of the live scene image and the display window are inconsistent. This inconsistency will result in the live scene image being inconsistent with the size of the display window after processing, regardless of the enlargement or reduction ratio of the live scene image.

[0063] In this case, the live scene image can be enlarged or reduced so that the processed live scene image can coincide with the corresponding upper and lower boundaries or left and right boundaries of the display window at the upper and lower boundaries or left and right boundaries, and the size of the live scene image can exceed the size of the display window at the other boundary, so that the live scene image can be displayed in the display window as widely as possible, and the remaining excess part can be cropped or directly not displayed due to the limitation of the display window.

[0064] Specifically, it can be implemented in the following manner: based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension, determine the size characteristics of the live scene image in the display window; the size dimension includes a width size dimension and a height size dimension; based on the size characteristics of the live scene image, determine the target size dimension from the at least one size dimension; and use the ratio between the size information corresponding to the original size information of the live scene image and the window size information of the display window in the target size dimension as the display ratio.

[0065] First, let's explain the size characteristics of the live scene image within the display window. This size characteristic is derived by comparing the original size of the live scene image with the display window size. This size characteristic is used to express whether the live scene image is "wide" or "narrow."

[0066] In one possible case, in order to determine the "wider" or "narrower" size characteristics expressed by the live scene image in the display window, the size information in at least one size dimension under the original size information of the live scene image and the window size information of the display window can be selected for determination. For example, the aspect ratio of the live scene image can be determined by the ratio between the width size information corresponding to the width size dimension and the height size information corresponding to the height size dimension under the original size information of the live scene image. Similarly, the aspect ratio of the display window can be determined in the same way using the window size information of the display window. It is easy to understand that the higher the value of the aspect ratio corresponding to the live scene image, the higher the width of the live scene image is than the height, indicating that it is a "wider" image. Conversely, the lower the value of the aspect ratio, the more "narrow" it is.

[0067] For example, see Figure 3, which is a schematic diagram of a comparison of size characteristics between a live scene image and a display window provided by an embodiment of the present disclosure. Specifically, there are two different situations. In the schematic diagram (a) on the left side of Figure 3, the live scene image represented by the dotted-line frame is "narrower" than the display window represented by the solid-line frame, while in the schematic diagram (b) on the right side of Figure 3, the live scene image represented by the dotted-line frame is "wider" than the display window represented by the solid-line frame.

[0068] In implementation, in one possible case, when determining the size characteristics of the live scene image compared to the display window, calculation can be used to determine the size characteristics, thereby obtaining a more accurate size characteristic.

[0069] That is, in a specific implementation, the first width information under the width dimension and the first height information under the height dimension in the original size information of the live scene image can be determined, and the first ratio between the first width information and the first height information can be determined; and the second width information under the width dimension and the second height information under the height dimension in the window size information of the display window can be determined, and the second ratio between the second width information and the second height information can be determined; in response to the first ratio being less than or equal to the second ratio, the size feature corresponding to the live screen element is determined to be the first size feature; or, in response to the first ratio being greater than the second ratio, the size feature corresponding to the live screen element is determined to be the second size feature.

[0070] Here, the first size feature indicates that the live scene image is "narrower" than the display window represented by the solid-line frame; the second size feature indicates that the live scene image is "wider" than the display window represented by the solid-line frame.

[0071] In another possible scenario, the size characteristics of the live scene image can also be directly determined. Specifically, since the size characteristics of the live scene image are mainly used to express the characteristics of the live scene image being "narrower" or "wider" compared to the display window, the live scene image can have these characteristics after it is produced. For example, if the live scene image is set to an image showing a waterfall, that is, the value expressed by the height information in the height dimension is large, such as exceeding the first preset multiple of the height information of the display window, then it can itself express the characteristic of being "narrower" compared to the display window; and if the live scene image is set to a horizontal classical painting, that is, the value expressed by the width information in the width dimension is large, such as exceeding the second preset multiple of the width information of the display window, then it can itself express the characteristic of being "wider" compared to the display window. Therefore, when selecting which live scene image to select, the size characteristics can be determined accordingly based on the value of the selected image in at least one size dimension.

[0072] After determining the size characteristics of the live scene image in the display window, a target size dimension can be determined from the various size dimensions. In a specific implementation, in response to determining that the size characteristic is the first size characteristic, the width dimension can be determined as the target size dimension, or in response to determining that the size characteristic is the second size characteristic, the height dimension can be determined as the target size dimension.

[0073] Specifically, based on the above description of the display method for live scene images, in one possible scenario, if the size feature indicates that the live scene image is "narrow," that is, if the size feature is determined to be the first size feature, the width will be aligned, and therefore the target size dimension selected is the width dimension. When determining the display ratio, the determined target size dimension is used to determine the ratio of the width information under the width dimension under the original size information and the window size information, respectively, as the display ratio.

[0074] For example, see FIG4 , which is a schematic diagram of a live scene image obtained after the live scene image is processed according to a determined display ratio according to an embodiment of the present disclosure. The left schematic diagram (a) in FIG3 corresponds to the left schematic diagram (a) in FIG4 , which shows the processed live scene image represented by the dotted frame and the unchanged display window after the alignment width processing of the live scene image is determined using the above process.

[0075] As shown in the diagram (a) on the left in Figure 4, after processing the live scene image, it is aligned with the width of the display window to ensure that the "narrow" size characteristics of the live scene image are preserved. However, in the height dimension, the processed live scene image may exceed the display window. This excess portion can be cropped or simply not displayed due to the display window size limit.

[0076] Similarly, in another possible scenario, if the size feature indicates that the live scene image is "wider," that is, if the size feature is determined to be the second size feature, the width will be aligned, and the height dimension will be selected as the target size dimension. When determining the display ratio, the ratio of the width information under the height dimension under the original size information and the window size information is determined using the determined target size dimension as the display ratio.

[0077] For example, referring to FIG4 , which corresponds to the schematic diagram (b) on the right side of FIG3 , the schematic diagram (b) on the right side of FIG4 shows a schematic diagram of the live scene image after the height alignment processing is determined by the above process, represented by the dotted box, and the unchanged display window. In this schematic diagram, the live scene image is aligned with the height of the display window to ensure that the "higher" size feature of the live scene image is retained. Similarly, in the case where the processed live scene image exceeds the display window in the width dimension, it can also be processed by cropping or directly not displaying it.

[0078] In the above-described scenario, the live scene image is displayed by enlarging it as much as possible, so that the boundary in one dimension coincides with the window boundary of the display window, and the boundary in another dimension exceeds the window boundary, thereby ensuring that the display is as enlarged as possible. In another possible scenario, the boundary in one dimension can also coincide with the window boundary of the display window, while the size of the live scene image in the other dimension does not exceed the size of the display window, such as directly displaying it in the style shown in the schematic diagram of Figure 3.

[0079] In this case, since the size of the processed live scene image is smaller than the display window, the live scene image can be processed by supplementing the image. For example, when the size feature of the live screen is determined to be the first size feature, the supplementary size dimension when supplementing the live scene image is determined to be the width size dimension, or when the size feature of the live screen is determined to be the second size feature, the supplementary size dimension when supplementing the live scene image is determined to be the height size dimension; then, the live scene image is supplemented under the supplementary size dimension, so that the live scene image after image supplementation has the same aspect ratio as the display window, so that the live scene image after image supplementation can fully cover the display window after being proportionally enlarged or reduced.

[0080] Here, when supplementing the image, a solid color supplement can be performed, for example, based on the overall hue of the live scene image, and / or, a solid color filling image with a similar hue to the edge portion under the corresponding size dimension can be used to supplement the live scene image. Exemplarily, for the example in FIG3 above, a schematic diagram of the live scene image obtained after image supplementation of the live scene image can be obtained as shown in FIG5. Corresponding to the schematic diagram (a) on the left side of FIG3, the schematic diagram (a) on the left side of FIG5 shows a schematic diagram of the live scene image after solid color supplementation with white. White is the overall hue of the live scene image. The live scene image is specifically represented by a dotted frame. After being enlarged or reduced in size, it is consistent with the size of the display window. For ease of representation, the solid frame of the display window is displayed slightly larger in the schematic diagram, but the actual indication is consistent with the size of the live scene image.

[0081] Similarly, corresponding to the diagram (b) on the right side of Figure 3 , the diagram (b) on the right side of Figure 5 shows a schematic diagram of the live scene image after being supplemented with a pure gray color. Gray represents the hue of the live scene image at the edge. Similarly, for ease of illustration, the solid-line frame of the display window in the diagram (b) on the right side of Figure 5 is slightly larger, but the actual size of the display window is consistent with the live scene image.

[0082] For this filling method, even if an image with similar hue is added for filling, obvious splicing marks may appear under the display window due to the filling of solid colors. Based on this, in the embodiment of the present disclosure, a pre-trained neural network can also be used to semantically supplement the live scene image during filling, that is, the filling of solid colors in the above embodiment is changed to supplementing specific images. For example, when determining the supplementary size dimension, it can be determined to semantically supplement the live scene image under the supplementary size dimension, and the area that needs to be further supplemented and the current live scene image can be input into the pre-trained neural network, so that the neural network supplements the image of the area that needs to be further supplemented, thereby outputting a result image that can be fully covered in the display window.

[0083] For example, see Figure 6, which is a schematic diagram of a live scene image obtained after semantic supplementation of the live scene image provided by an embodiment of the present disclosure. In this embodiment, following the corresponding example in Figure 3, corresponding to the left schematic diagram (a) and the right schematic diagram (b) in Figure 3, two different semantically supplemented live scene images under the left schematic diagram (a) and the right schematic diagram (b) in Figure 6 are obtained. The corresponding annotation method is similar to Figure 5 and will not be repeated here. In this way, since the image semantics are specifically supplemented, the picture is more harmonious and rich.

[0084] In the embodiment corresponding to the schematic diagram in FIG4 , the display position of the live scene image in the display window may be further determined. In one possible case, the center position corresponding to the window display center of the display window may be determined, and the center position may be used as the center display position of the live scene image, so that the element boundary of the live scene image adjusted based on the display ratio in the target size dimension coincides with the window boundary of the display window in the target size dimension.

[0085] In this case, the live scene image and the display window can be specifically aligned in the center so that the image centered in the live scene image is displayed in the display window. For example, in the schematic diagram (a) on the left of Figure 4, the live scene image and the display window are selected to be aligned in the center. It can also be seen from the schematic diagram that in the target size dimension, that is, the width size dimension, the element boundary of the live scene image coincides with the boundary of the window corresponding to the display window, that is, the width information changes to be the same.

[0086] In another possible case, it is also possible to determine which area of ​​the live scene image after the scale adjustment expresses richer semantic information, and give priority to adjusting this area to the display window for display. For example, in the schematic diagram (b) on the right side of Figure 4, an image recognition model is manually selected or pre-trained to determine a selected area with richer semantic information than other areas, such as the area showing the flame in the figure. Then, while ensuring that the element boundary of the live scene image coincides with the boundary of the window corresponding to the display window under the corresponding target size dimension, that is, the height size dimension, the center of the processed live scene image can be moved to the right, so that the selected area expressing more semantic information is given priority in the display window.

[0087] Here, for the multiple methods listed above for respectively determining the display positions and display ratios corresponding to the live screen elements, any one of them can be combined if feasible, and no limitation is made here.

[0088] Secondly, for interactive controls, when determining how to display them in the display window, the display parameter information determined may specifically include the display scale and display position. Similarly, when enlarging or reducing interactive controls, proportional size changes are selected to avoid deformation caused by stretching or compressing the width or height dimensions. In addition, because interactive controls can be used to trigger actions, unlike the requirements for displaying live scene images mentioned above, cropping of interactive controls is not allowed when they are displayed.

[0089] Based on the above requirements and in actual application scenarios, to adapt to user habits, the interactive controls will be displayed within the display window, adapting to the display window size and at a relatively fixed position, regardless of how the display window size changes. For example, when the display window is 480px×960px, the chat interactive controls are displayed at the center, 30px from the left window border. When the display window is changed to 960px×960px, the chat interactive controls are enlarged due to the larger display window size, but are still displayed at the center, 30px from the left window border, within the enlarged display window.

[0090] In a specific implementation, the following method can be selected: based on the preset standard window size information and the window size information of the display window, the display ratio of the interactive control in the display window is determined; the standard window size information is used to determine the original size information corresponding to the interactive control; and based on the target boundary distance between the interactive control and the display window under the standard window size information, the display position of the interactive control in the current display window is determined, so that the boundary distance between the interactive control at the display position and the current display window maintains the target boundary distance.

[0091] That is, a standard window can be designed first. The size information of the standard window is specifically determined as the standard window size information in the embodiment of the present disclosure. Within this standard window, the display position and display ratio of the interactive control can be determined. Specifically, when designing the interactive control, in one possible case, in order to design the details of the interactive control, a larger size pattern will be selected. In the standard window, a reduced scale method will be selected to display the appropriate size. Here, the display ratio selected in the standard window can be represented as S0, for example.

[0092] In addition, the specific display position can be set when the display ratio S0 is selected to display the interactive control in the standard window. For example, the interactive control can be set to be displayed at the center position Dis0 from the left window boundary of the standard window. For example, see Figure 7, which is a schematic diagram of a standard window provided in an embodiment of the present disclosure. Specifically, in an embodiment of the present disclosure, the distance between the interactive space and a window boundary under the standard window can be set to remain unchanged. For example, in Figure 7, the distance from the left window boundary of the standard window is kept unchanged at 30px, and the height is set to the center position of the standard window.

[0093] In one possible case, if the display window determined in the current live broadcast scenario is exactly the same size as the standard window, the display ratio and display position determined in the standard window can be directly selected to display the interactive controls.

[0094] In another possible case, if the display window determined in the current live broadcast scenario is inconsistent with the size of the standard window, the ratio of the standard window size information and the window size information of the display window under the preset size dimension can be determined to determine the display ratio of the interactive control in the display window based on the ratio under the preset size dimension and the original size information corresponding to the interactive control.

[0095] Here, the preset size dimension can specifically be a dimension with a fixed relative position. For example, in the above example, if the height dimension is specifically set, and the interactive control is displayed in the center, then the preset size dimension is set as the height dimension. Continuing with this example, under the height dimension, the height information under the preset standard window size information is represented as T H , the height information under the window size information of the current display window is represented as V H , then the determined display ratio S1 is:

[0096] For the current display window, if the distance Dis1 from the left window border is determined to be the same as Dis0, that is, Dis1 = Dis0. To facilitate determining the accurate position, see Figure 8, which is a schematic diagram of a coordinate system determined for the current display window provided by an embodiment of the present disclosure, wherein the origin of the coordinate system is set at the center of the current display window, and the coordinate axes are set according to the height and width directions of the current display window. The width information T of the current display window is marked in the figure. W The distance Dis1 between the interactive control and the left window border of the current display window and the coordinates of the center of the interactive control in the coordinate system UI x1 On this basis, the width information of the interactive space in the width dimension is set to S1×UI W (UI W is the width information corresponding to the designed interactive control), the boundary distance Dis1 can be obtained to satisfy the following formula:

[0097] Similarly, in the standard window, the boundary distance Dis0 satisfies the following formula, where the coordinate change of the center of the interactive control in the standard window coordinate system is expressed as UI x0 , the corresponding display ratio change is expressed as S0:

[0098] Therefore, when maintaining the boundary distance Dis0 under the standard window, the boundary distance Dis0 is used as the target boundary distance. Combining the above formulas (1) and (2), the following coordinates of the center of the interactive control in the current display window in the coordinate system UI can be obtained: x1 :

[0099] That is, when the target display distance is determined in the standard window, the coordinate position of the interactive control in the current display window can be calculated by the above formula (3).

[0100] In this way, through the method provided by the above embodiment, the corresponding display ratio and display position can be determined for the live screen elements according to the currently determined display window.

[0101] Regarding the above S203, when the corresponding display ratio and display position are determined for the live screen element, the original size information of the live screen element can be adjusted according to the display ratio, so that the live screen element with the adjusted target size information can be displayed in the display window based on the determined display position.

[0102] Here, in one possible case, according to the description in the above embodiment, when determining the window size information of the current display window, the display ratio and display position under the current display window can be determined based on the original size information of the live scene image that can be acquired in advance, the standard window size information of the standard window, the original size information of the interactive control, etc. Therefore, if the multiple possible window size information that may appear as the current display window can be determined in advance, the display parameter information corresponding to these possible current display windows can be determined in advance, and then the corresponding data can be called according to the actual selection situation to quickly respond to the display of the live screen elements.

[0103] Specifically, the display parameter information corresponding to the current display window can be determined from candidate display ratios and candidate display positions corresponding to a plurality of pre-set display window sizes. Here, the pre-set plurality of display windows refers to the window that may be displayed as the current display window as described in the above example. For each possible display window, the corresponding display parameter information can be stored in advance, and when determining to display, the current display window selected for display is displayed using the stored display parameter information.

[0104] For example, referring to FIG9 , a schematic diagram of displaying live screen elements in the current display window provided by an embodiment of the present disclosure is provided. In this schematic diagram, the example listed in the left schematic diagram (a) of FIG1 is continued, but the processing situation is different from that in the right schematic diagram (b) of FIG1 . By using the specific method provided above in the embodiment of the present disclosure, the situation displayed in the current display window as shown in FIG9 can be obtained. It is easy to see that compared with the deformation of the live scene image in the right schematic diagram (b) of FIG1 , the image can be displayed normally in the current display window of FIG9 ; compared with the right schematic diagram (b) of FIG1 , the interactive controls cannot be fully displayed. In the current display window of FIG9 , even if the window size becomes smaller, the interactive controls can be fully displayed, and still conform to the user's selection habits, and continue to be displayed in a specific central ceiling position, so it is more convenient for users to select and trigger them.

[0105] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0106] Based on the same inventive concept, the embodiment of the present disclosure also provides a live screen display device corresponding to the live screen display method. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned live screen display method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0107] 10 is a schematic diagram of a device for displaying a live screen according to an embodiment of the present disclosure, the device comprising: a first display module 11, an acquisition module 12, and a second display module 13; wherein,

[0108] A first display module 11 is configured to display at least one display window matching the current live broadcast scene according to the current live broadcast scene;

[0109] An acquisition module 12 is configured to acquire display parameter information of a live screen element in the display window; the live screen element includes a live scene image and / or an interactive control; the display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live screen element to be displayed in the display window;

[0110] The second display module 13 is used to adjust the original size information corresponding to the live screen element to be displayed according to the display ratio indicated by the display parameter information to obtain the adjusted target size information, and display the live screen element under the target size information in the display window based on the display position indicated by the display parameter information.

[0111] In an optional embodiment, for the live scene image included in the live screen element, the display parameter information includes a display ratio, and the acquisition module 12 determines the display parameter information of the live scene image in the display window according to the following steps: based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension, determine the size characteristics of the live scene image in the display window; the size dimension includes a width size dimension and a height size dimension; based on the size characteristics of the live scene image, determine the target size dimension from the at least one size dimension; and use the ratio between the size information corresponding to the original size information of the live scene image and the window size information of the display window in the target size dimension as the display ratio.

[0112] In an optional embodiment, the acquisition module 12 determines the size characteristics of the live scene image in the display window based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension, and is used to: determine the first width information in the width size dimension and the first height information in the height size dimension in the original size information of the live scene image, and determine a first ratio between the first width information and the first height information; and determine the second width information in the width size dimension and the second height information in the height size dimension in the window size information of the display window, and determine Determine a second ratio between the second width information and the second height information; in response to the first ratio being less than or equal to the second ratio, determine that the size feature corresponding to the live screen element is a first size feature; or, in response to the first ratio being greater than the second ratio, determine that the size feature corresponding to the live screen element is a second size feature; when the acquisition module 12 determines the target size dimension from multiple size dimensions based on the size feature of the live scene image, it is used to: in response to determining that the size feature is the first size feature, determine the width size dimension as the target size dimension, or, in response to determining that the size feature is the second size feature, determine the height size dimension as the target size dimension.

[0113] In an optional embodiment, for the live scene image included in the live screen element, the display parameter information includes a display position, and the acquisition module 12 determines the display parameter information of the live screen element in the display window according to the following steps: determining the center position corresponding to the window display center of the display window, and using the center position as the display position of the live scene image, so that the element boundary of the live scene image adjusted based on the display ratio in the target size dimension coincides with the window boundary of the display window in the target size dimension.

[0114] In an optional embodiment, for the interactive control included in the live screen element, the display parameter information includes a display ratio and a display position; the acquisition module 12 determines the display parameter information of the interactive control in the display window according to the following steps: based on the preset standard window size information and the window size information of the display window, determining the display ratio of the interactive control in the display window; and based on the target boundary distance between the interactive control and the display window under the standard window size information, determining the display position of the interactive control in the display window, so that the boundary distance between the interactive control at the display position and the current display window maintains the target boundary distance.

[0115] In an optional embodiment, when the acquisition module 12 determines the display ratio of the interactive control in the display window based on the standard window size information and the window size information of the display window, it is used to: determine the ratio of the standard window size information and the window size information of the display window under a preset size dimension, so as to determine the display ratio of the interactive control in the display window based on the ratio under the preset size dimension and the original size information corresponding to the interactive control.

[0116] In an optional embodiment, when acquiring the display parameter information of the live screen element in the display window, the acquisition module 12 is used to: determine the display parameter information corresponding to the current display window from the candidate display ratios and candidate display positions corresponding to a plurality of pre-set display window sizes.

[0117] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference can be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0118] The present disclosure also provides a computer device, as shown in FIG11 , which is a schematic diagram of the structure of the computer device provided by the present disclosure, including:

[0119] A processor 10 and a memory 20; the memory 20 stores machine-readable instructions executable by the processor 10, and the processor 10 is configured to execute the machine-readable instructions stored in the memory 20. When the machine-readable instructions are executed by the processor 10, the processor 10 performs the following steps:

[0120] According to the current live broadcast scene, at least one display window matching the live broadcast scene is displayed; display parameter information of the live broadcast screen element in the display window is obtained; the live broadcast screen element includes a live broadcast scene image and / or an interactive control; the display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live broadcast screen element to be displayed in the display window; the original size information corresponding to the live broadcast screen element to be displayed is adjusted according to the display ratio indicated by the display parameter information to obtain the adjusted target size information, and based on the display position indicated by the display parameter information, the live broadcast screen element under the target size information is displayed in the display window.

[0121] The above-mentioned memory 20 includes internal memory 210 and external memory 220; the memory 210 here is also called internal memory, which is used to temporarily store the calculation data in the processor 10, as well as the data exchanged with the external memory 220 such as the hard disk. The processor 10 exchanges data with the external memory 220 through the internal memory 210.

[0122] The specific execution process of the above instructions can refer to the steps of the live broadcast screen display method described in the embodiment of the present disclosure, and will not be repeated here.

[0123] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer program executes the steps of the method for displaying live images described in the above method embodiment. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0124] The embodiments of the present disclosure also provide a computer program product, which carries program code. The instructions included in the program code can be used to execute the steps of the live broadcast screen display method described in the above method embodiment. Please refer to the above method embodiment for details, which will not be repeated here.

[0125] The computer program product may be implemented in hardware, software, or a combination thereof. In one embodiment, the computer program product is implemented as a computer storage medium. In another embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0126] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems and devices described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0127] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0128] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0129] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0130] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The scope of protection of the present disclosure is not limited thereto. Although the present disclosure has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed in the present disclosure, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure shall be subject to the scope of protection of the claims.

Claims

1. A method for displaying a live broadcast screen, comprising: According to the current live broadcast scene, display at least one display window matching the current live broadcast scene; Acquire display parameter information of a live screen element in the display window; wherein the live screen element includes a live scene image and / or an interactive control; The display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live screen element to be displayed in the display window; The original size information corresponding to the live screen element to be displayed is adjusted according to the display ratio indicated by the display parameter information to obtain the adjusted target size information, and based on the display position indicated by the display parameter information, the live screen element under the target size information is displayed in the display window.

2. The display method according to claim 1, wherein: For the live scene image included in the live screen element, the display parameter information includes a display ratio, and the display parameter information of the live scene image in the display window is determined according to the following steps: Determine the size feature of the live scene image in the display window based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension; wherein the size dimension includes a width size dimension and a height size dimension; Based on the size feature of the live scene image, determining a target size dimension from the at least one size dimension; The ratio between the size information corresponding to the original size information of the live scene image and the window size information of the display window under the target size dimension is used as the display ratio.

3. The display method according to claim 2, wherein: Determining a size feature of the live scene image in the display window based on the original size information of the live scene image and the size information of the display window in at least one size dimension, including: Determine, in the original size information of the live scene image, first width information under the width dimension and first height information under the height dimension, and determine a first ratio between the first width information and the first height information; and, Determine the second widest point under the width dimension in the window size information of the display window. width information, and second height information under the height dimension, and determining a second ratio between the second width information and the second height information; In response to the first ratio being less than or equal to the second ratio, determining that the size feature corresponding to the live screen element is the first size feature; or, in response to the first ratio being greater than the second ratio, determining that the size feature corresponding to the live screen element is the second size feature; Wherein, based on the size feature of the live scene image, determining the target size dimension from the at least one size dimension includes: In response to determining that the size feature is a first size feature, the width dimension is determined as the target size dimension, or, in response to determining that the size feature is a second size feature, the height dimension is determined as the target size dimension.

4. The display method according to any one of claims 1 to 3, wherein: For the live scene image included in the live screen element, the display parameter information includes a display position, and the display parameter information of the live screen element in the display window is determined according to the following steps: Determine the center position corresponding to the window display center of the display window, and use the center position as the display position of the live scene image, so that the element boundary of the live scene image adjusted based on the display ratio in the target size dimension coincides with the window boundary of the display window in the target size dimension.

5. The display method according to any one of claims 1 to 4, wherein: For the interactive controls included in the live screen element, the display parameter information includes a display ratio and a display position; Determine the display parameter information of the interactive control in the display window according to the following steps: Determining a display ratio of the interactive control in the display window based on preset standard window size information and the window size information of the display window; and, Based on the target boundary distance between the interactive control and the display window under the standard window size information, the display position of the interactive control in the display window is determined so that the boundary distance between the interactive control at the display position and the current display window maintains the target boundary distance.

6. The display method according to claim 5, wherein: The determining, based on the preset standard window size information and the window size information of the display window, a display ratio of the interactive control in the display window includes: Determine the ratio of the standard window size information to the window size information of the display window in a preset size dimension, based on the ratio in the preset size dimension and the interactive control The corresponding original size information is used to determine the display ratio of the interactive control in the display window.

7. The display method according to any one of claims 1 to 6, wherein: The obtaining display parameter information of the live screen element in the display window includes: The display parameter information corresponding to the current display window is determined from the candidate display ratios and candidate display positions respectively corresponding to the plurality of preset display window sizes.

8. A device for displaying live broadcast images, comprising: A first display module, configured to display at least one display window matching the current live broadcast scene according to the current live broadcast scene; An acquisition module configured to acquire display parameter information of a live screen element in the display window; the live screen element includes a live scene image and / or an interactive control; The display parameter information is determined based on the window size information of the display window and the original size information corresponding to the live screen element to be displayed in the display window; The second display module is configured to adjust the original size information corresponding to the live screen element to be displayed according to the display ratio indicated by the display parameter information, obtain the adjusted target size information, and display the live screen element under the target size information in the display window based on the display position indicated by the display parameter information.

9. The display device according to claim 8, wherein: For the live scene image included in the live screen element, the display parameter information includes a display ratio, and the acquisition module determines the display parameter information of the live scene image in the display window according to the following steps: Determine the size feature of the live scene image in the display window based on the size information of the original size information of the live scene image and the window size information of the display window in at least one size dimension; wherein the size dimension includes a width size dimension and a height size dimension; Based on the size feature of the live scene image, determining a target size dimension from the at least one size dimension; The ratio between the size information corresponding to the original size information of the live scene image and the window size information of the display window under the target size dimension is used as the display ratio.

10. The display device according to claim 9, wherein: When the acquisition module determines the size feature of the live scene image in the display window based on the original size information of the live scene image and the size information of the display window in at least one size dimension, the configuration is as follows: Determine, in the original size information of the live scene image, first width information under the width dimension and first height information under the height dimension, and determine a first ratio between the first width information and the first height information; as well as, Determine, in the window size information of the display window, second width information under the width dimension and second height information under the height dimension, and determine a second ratio between the second width information and the second height information; In response to the first ratio being less than or equal to the second ratio, determining that the size feature corresponding to the live screen element is the first size feature; or, in response to the first ratio being greater than the second ratio, determining that the size feature corresponding to the live screen element is the second size feature; When the acquisition module determines the target size dimension from the at least one size dimension based on the size feature of the live scene image, the configuration is as follows: In response to determining that the size feature is a first size feature, the width dimension is determined as the target size dimension, or, in response to determining that the size feature is a second size feature, the height dimension is determined as the target size dimension.

11. The display device according to any one of claims 8 to 10, wherein: For the live scene image included in the live screen element, the display parameter information includes a display position, and the acquisition module determines the display parameter information of the live screen element in the display window according to the following steps: Determine the center position corresponding to the window display center of the display window, and use the center position as the display position of the live scene image, so that the element boundary of the live scene image adjusted based on the display ratio in the target size dimension coincides with the window boundary of the display window in the target size dimension.

12. The display device according to any one of claims 8 to 11, wherein: For the interactive control included in the live screen element, the display parameter information includes a display ratio and a display position; the acquisition module determines the display parameter information of the interactive control in the display window according to the following steps: Determining a display ratio of the interactive control in the display window based on preset standard window size information and the window size information of the display window; and, Based on the standard window size information, the target boundary between the interactive control and the display window distance, determining the display position of the interactive control in the display window so that the interactive control at the display position maintains the target boundary distance with the boundary of the current display window.

13. The display device according to claim 12, wherein: When the acquisition module determines the display ratio of the interactive control in the display window based on the preset standard window size information and the window size information of the display window, the configuration is as follows: Determine the ratio of the standard window size information and the window size information of the display window under a preset size dimension, so as to determine the display ratio of the interactive control in the display window based on the ratio under the preset size dimension and the original size information corresponding to the interactive control.

14. The display device according to any one of claims 8 to 13, wherein: When the acquisition module acquires the display parameter information of the live screen element in the display window, the configuration is as follows: The display parameter information corresponding to the current display window is determined from the candidate display ratios and candidate display positions respectively corresponding to the plurality of preset display window sizes.

15. A computer device comprising: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor executes the steps of the method for displaying a live broadcast image as described in any one of claims 1 to 7.

16. A computer-readable storage medium, wherein: The computer-readable storage medium stores a computer program. When the computer program is executed by a computer device, the computer device executes the steps of the method for displaying a live broadcast image as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Method, apparatus, device and storage medium for network broadcast

    CN109511007A

  • Multi-channel live broadcast display control method and device, equipment and medium

    CN114710681A

  • Live broadcast processing method and device, electronic equipment and storage medium

    CN115174983A

  • Live broadcast picture display method and device, computer equipment and storage medium

    CN117082284A

  • Image processing method and apparatus, device, and medium

    WO2023098576A1