Live picture brightness adjustment method and device for live voice chat, computer device and medium

By adjusting the exposure compensation value on the broadcaster's end to achieve consistency in the brightness of the live stream feed, the problem of inconsistent brightness in live stream feeds was solved, improving the viewing experience and retention rate of viewers.

CN115802064BActive Publication Date: 2025-11-04GUANGZHOU FANGGUI INFORMATION TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211156551.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-22
Publication Date
2025-11-04
Estimated Expiration
2042-09-22

AI Technical Summary

Technical Problem

During live streaming interactions, the different exposure compensation values ​​of each host's video feed result in variations in the brightness of the feed seen by viewers, affecting their viewing experience and reducing the retention rate of the live stream.

Method used

By acquiring the brightness of the video feed from each broadcaster's device, the optimal exposure compensation value for each broadcaster's device is determined and sent to the broadcaster's device to adjust the brightness of the video feed, thus achieving consistent video feed brightness across all broadcasters' devices. The live stream feed is then displayed in the live streaming interface using a mixed-streaming operation.

Benefits of technology

It reduced the brightness deviation of the live stream screen and improved the retention rate of viewers in the live stream room.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115802064B_ABST
    Figure CN115802064B_ABST
Patent Text Reader

Abstract

The application relates to the network live broadcast technical field and proposes a live broadcast microphone connection picture brightness adjustment method and device, computer equipment and a storage medium, the method comprises the following steps: in response to a microphone connection opening request, obtaining a plurality of anchor identifiers, establishing microphone connection session connections between a plurality of anchor identifiers corresponding to anchor terminals; according to the exposure compensation range of the video picture of each anchor terminal, determining the best exposure compensation value of the video picture of each anchor terminal, and downloading the best exposure compensation value to the corresponding anchor terminal; wherein the exposure compensation range is determined according to the brightness of the video picture collected by the anchor terminal; receiving target video picture data collected by each anchor terminal according to the best exposure compensation value; according to the target video picture data sent by each anchor terminal, the microphone connection live broadcast picture is displayed in the respective live broadcast room interface of the client in the live broadcast room, so that the brightness deviation of the microphone connection picture is reduced, and the retention rate of the audience in the live broadcast room is improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the network live broadcast technology field, and particularly relate to a live broadcast call-in picture brightness adjustment method and device, a computer device and a storage medium. BACKGROUND

[0002] Network live broadcast refers to a technology that anchors share live audio and video streams on the network to audiences through a network live broadcast platform. Network live broadcast is a new network industry, which embodies the characteristics of Internet openness and sharing, and enables every ordinary person to have the opportunity to show their talents on the network.

[0003] In the process of performing talents on the network live broadcast, some audiences will send virtual gifts in the live broadcast room to interact and express their affirmation of the live broadcast content, thereby enabling the anchors to create income and enabling the anchors to work at home. Especially for people in remote areas or people with limited mobility, or people who cannot normally go out to work, it has created a more convenient employment path and driven social employment.

[0004] The network live broadcast platform selects more talented anchors or encourages anchors to provide better live broadcast content, and allows two or more anchors to simultaneously live broadcast in the live broadcast room. Anchors with more talent or who can provide better live broadcast content will receive more audience support and recognition.

[0005] Currently, in the process of network live broadcast, anchors can interact in real time through the establishment of a call-in session, so that audiences who join their respective live broadcast rooms can watch the audio and video interaction content between the anchors in the live broadcast room.

[0006] However, when multiple anchors live broadcast call-in, the exposure compensation values of the video pictures of the anchors are different, resulting in a deviation in the call-in picture brightness seen by the audiences, that is, the video picture brightness of each anchor seen by the audiences is different, affecting the audience viewing experience and reducing the retention rate of the live broadcast room audiences. SUMMARY

[0007] Embodiments of the present application provide a live broadcast call-in picture brightness adjustment method, device, computer device and storage medium, which can reduce the deviation of the call-in picture brightness and improve the retention rate of the live broadcast room audiences. The technical solution is as follows:

[0008] In a first aspect, the embodiments of the present application provide a live broadcast call-in picture brightness adjustment method, comprising the steps of:

[0009] In response to a call-in opening request, a plurality of anchor identifiers are obtained, and a call-in session connection between a plurality of anchor terminals corresponding to the anchor identifiers is established;

[0010] determine a best exposure compensation value of a video picture of each of the anchor terminals according to an exposure compensation range of the video picture of each of the anchor terminals, and send the best exposure compensation value to the corresponding anchor terminal; wherein the exposure compensation range is determined according to brightness of the video picture collected by the anchor terminal;

[0011] receive target video picture data collected by each of the anchor terminals according to the best exposure compensation value;

[0012] display a live-mixing live picture in a live room interface of a client in the live room according to the target video picture data sent by each of the anchor terminals.

[0013] In a second aspect, the embodiments of the present application provide a method for adjusting picture brightness in live-mixing, comprising:

[0014] a server acquires a plurality of anchor identifiers in response to a live-mixing start request, and establishes a live-mixing session connection between a plurality of anchor terminals corresponding to the anchor identifiers;

[0015] the server determines a best exposure compensation value of a video picture of each of the anchor terminals according to an exposure compensation range of the video picture of each of the anchor terminals, and sends the best exposure compensation value to the corresponding anchor terminal; wherein the exposure compensation range is determined according to brightness of the video picture collected by the anchor terminal;

[0016] each of the anchor terminals receives the best exposure compensation value, collects target video picture data according to the best exposure compensation value, and sends the respective target video picture data to the server;

[0017] the server displays a live-mixing live picture in a live room interface of a client in the live room according to the target video picture data sent by each of the anchor terminals.

[0018] In a third aspect, the embodiments of the present application provide a device for adjusting picture brightness in live-mixing, comprising:

[0019] a live-mixing establishing module, configured to acquire a plurality of anchor identifiers in response to a live-mixing start request, and establish a live-mixing session connection between a plurality of anchor terminals corresponding to the anchor identifiers;

[0020] an exposure compensation value determining module, configured to determine a best exposure compensation value of a video picture of each of the anchor terminals according to an exposure compensation range of the video picture of each of the anchor terminals, and send the best exposure compensation value to the corresponding anchor terminal; wherein the exposure compensation range is determined according to brightness of the video picture collected by the anchor terminal;

[0021] Picture data receiving module, used for receiving target video picture data collected by each of the anchor ends according to the optimal exposure compensation value;

[0022] Mic picture display module, used for controlling display of a mic live picture in a respective live room interface of a client in the live room according to the target video picture data sent by each of the anchor ends.

[0023] In a fourth aspect, an embodiment of the present application provides a computer device, a processor, a memory, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the method in the first aspect or the second aspect when executing the computer program.

[0024] In a fifth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executable on a processor to implement the steps of the method in the first aspect or the second aspect.

[0025] The embodiment of the present application acquires a plurality of anchor identifiers in response to a mic opening request, establishes a mic session connection between a plurality of anchor terminals corresponding to the anchor identifiers, determines an optimal exposure compensation value of a video picture of each of the anchor terminals according to an exposure compensation range of the video picture of each of the anchor terminals, and sends the optimal exposure compensation value to the corresponding anchor terminal, wherein the exposure compensation range is determined according to the brightness of the video picture collected by the anchor terminal, receives target video picture data collected by each of the anchor terminals according to the optimal exposure compensation value, and controls display of a mic live picture in a respective live room interface of a client in the live room according to the target video picture data sent by each of the anchor terminals, thereby reducing the brightness deviation of the mic picture and improving the retention rate of the live room audience.

[0026] For better understanding and implementation, the technical solutions of the present application are described in detail below with reference to the drawings. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 An application scenario diagram of the picture brightness adjustment method for live mic provided by the embodiment of the present application;

[0028] Figure 2 A flowchart when the picture brightness of the live mic is not adjusted provided by the embodiment of the present application;

[0029] Figure 3 A flowchart of the picture brightness adjustment method for live mic provided by the first embodiment of the present application;

[0030] Figure 4 A flowchart when the picture brightness of the live mic is adjusted provided by the embodiment of the present application;

[0031] Figure 5 A flowchart of S20 in the picture brightness adjustment method for live streaming and microphone connection according to an embodiment of the present application is shown in FIG. 6;

[0032] Figure 6 A flowchart of S20 in the picture brightness adjustment method for live streaming and microphone connection according to another embodiment of the present application is shown in FIG. 7;

[0033] Figure 7 A flowchart of S201 in the picture brightness adjustment method for live streaming and microphone connection according to an embodiment of the present application is shown in FIG. 8;

[0034] Figure 8 A flowchart of the picture brightness adjustment method for live streaming and microphone connection according to a second embodiment of the present application is shown in FIG. 9;

[0035] Figure 9 A structural diagram of the picture brightness adjustment device for live streaming and microphone connection according to a third embodiment of the present application is shown in FIG. 10;

[0036] Figure 10 A structural diagram of the computer device according to a fourth embodiment of the present application is shown in FIG. 11. DETAILED DESCRIPTION

[0037] The exemplary embodiments will be described in detail herein with reference to the attached drawings. In the following description, the same numbers are used to indicate the same or similar components. The following exemplary embodiments are not intended to represent all embodiments in accordance with the present application. Rather, they are merely examples of apparatus and methods in accordance with aspects of the present application as detailed in the appended claims.

[0038] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0039] It should be understood that although the terms first, second, third, etc. can be used herein to describe various information, but these information should not be limited to these terms. These terms are only used to distinguish one type of information from another type of information. For example, without departing from the scope of the present application, the first information can also be called the second information, and similarly, the second information can also be called the first information. Depending on the context, the word "if" / "when" as used herein can be interpreted as "when" or "if" or "in response to determining".

[0040] Those skilled in the art can understand that the "client", "terminal", "terminal device" used in the present application includes not only the device with a wireless signal receiver, but also the device with receiving and transmitting hardware, which can communicate bidirectionally on a bidirectional communication link. Such devices can include cellular or other communication devices with single-line or multiple-line displays, or no display, PCS (Personal Communications Service) that can combine voice, data processing, fax, and / or data communication capabilities, PDA (Personal Digital Assistant) that can include radio frequency receivers, pagers, Internet / Intranet access, web browsers, notepads, calendars, and / or GPS (Global Positioning System) receivers, conventional laptop and / or palmtop computers or other devices with and / or including radio frequency receivers. The "client", "terminal", "terminal device" used herein can be portable, transportable, installed in vehicles (air, sea, and / or land), or suitable and / or configured to run locally, and / or in a distributed form, on earth and / or any other location in space. The "client", "terminal", "terminal device" used herein can also be a communication terminal, an Internet terminal, a music / video playing terminal, such as a PDA, a MID (Mobile Internet Device), and / or a mobile phone with music / video playing function, a smart television, a set-top box, and the like.

[0041] The "server", "client", "service node", and the like referred to in the present application essentially refer to computer devices with personal computer equivalent capabilities, which are hardware devices with necessary components disclosed by the von Neumann principle, such as central processors (including arithmetic units and controllers), memories, input devices, and output devices. Computer programs are stored in the memories, and the central processors call the programs stored in the external memories into the memories to run, execute the instructions in the programs, and interact with the input and output devices, thereby completing specific functions.

[0042] It should be noted that the concept of "server" in the present application can also be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, these servers can be independent of each other but can be called through an interface, or can be integrated into a physical computer or a computer cluster. Those skilled in the art should understand this variation and should not be restricted by the implementation of the network deployment of the present application.

[0043] Please refer to Figure 1 , Figure 1 The application scenario of the picture brightness adjustment method for live streaming and microphone connection provided in the embodiments of the present application is shown in the figure, which includes the host client 101, the server 102 and the audience client 103 provided in the embodiments of the present application. The host client 101 and the audience client 103 interact through the server 102.

[0044] The host client 101 refers to the end of sending a network live streaming video, and is usually the client used by the host (i.e., the live streaming host user) in the network live streaming.

[0045] The audience client 103 refers to the end of receiving and watching a network live streaming video, and is usually the client used by the audience (i.e., the live streaming audience user) watching the video in the network live streaming.

[0046] The hardware pointed to by the host client 101 and the audience client 103 essentially refers to a computer device, specifically, as shown in Figure 1 , it can be a smart phone, a smart interactive tablet and a personal computer, etc. The host client 101 and the audience client 103 can access the Internet through a known network access method and establish a data communication link with the server 102.

[0047] The server 102 is a service server, which can be responsible for further connecting related audio data servers, video stream servers and other servers providing related support, etc., to form a logically associated service cluster, to provide services for related terminal devices, such as the host client 101 and the audience client 103 shown in Figure 1 .

[0048] In the embodiments of the present application, the host client 101 and the audience client 103 can join the same live streaming room (i.e., live streaming channel), and the live streaming room refers to a chat room realized by Internet technology, which usually has audio and video broadcasting functions. The host user performs live streaming in the live streaming room through the host client 101, and the audience of the audience client 103 can log in to the server 102 to enter the live streaming room to watch the live streaming.

[0049] In the live room, the anchor and the audience can interact through voice, video, text and other known online interaction methods. The anchor user usually performs a program in the form of audio and video stream for the audience, and resource interaction behavior can also be generated in the interaction process, such as the audience client 103 sending virtual gifts to the anchor client 101 in the same live room. Of course, the application form of the live room is not limited to online entertainment, but can also be extended to other related scenarios, such as user pairing interaction scenarios, video conference scenarios, online teaching scenarios, product promotion and sales scenarios, and other scenarios that require similar interaction.

[0050] Specifically, the process of the audience watching live streaming is as follows: the audience can click to access the live streaming application installed on the audience client 103, and select to enter any live room, triggering the audience client 103 to load a live room interface for the audience. The live room interface includes a plurality of interaction components, which enable the audience to watch live streaming in the live room and perform various online interactions.

[0051] In the embodiments of the present application, the server 102 can also establish a mic-in session connection between the anchor clients 101 for mic-in live streaming. The mic-in session connection can be established in a random matching mode or a friend mode.

[0052] If the random matching mode is used, the server 102 will establish a mic-in session connection between a plurality of anchor clients 101 that send a mic-in live streaming request according to certain mic-in opening rules. After the mic-in session connection is established, the client in the live room can obtain audio and video stream data corresponding to a plurality of anchor identifiers, and output the audio and video stream data in the live room, so that the users (including the audience and the anchor) in the live room can simultaneously see the real-time live streaming of a plurality of anchors.

[0053] If the friend mode is used, the anchor can specify at least one friend anchor for mic-in. After the server 102 receives the mic-in confirmation information of the anchor client 101 corresponding to the at least one friend anchor, the server 102 will establish a mic-in session connection between the anchor client 101 corresponding to the anchor identifier and the anchor client 101 corresponding to the friend anchor identifier. Similarly, after the mic-in session connection is established, the users (including the audience and the anchor) in the live room can simultaneously see the real-time live streaming of a plurality of anchors.

[0054] However, when multiple anchors perform live streaming mic-in, the exposure compensation values of the video pictures set by the anchors are different, resulting in a deviation in the brightness of the mic-in picture seen by the audience. Please refer to Figure 2 , Figure 2The display schematic diagram when the picture brightness of live streaming and microphone connection is not adjusted is provided for the embodiments of the present application. The video picture brightness of each host is different, resulting in poor viewing experience of the audience and affecting the retention rate of the audience in the live streaming room. Therefore, the embodiments of the present application provide a picture brightness adjustment method for live streaming and microphone connection.

[0055] Please refer to Figure 3 , Figure 3 The flowchart of the picture brightness adjustment method for live streaming and microphone connection is provided for the first embodiment of the present application, and the method comprises the following steps:

[0056] S10: In response to a microphone connection opening request, a plurality of host identifiers are acquired, and a microphone connection session connection between a plurality of host terminals corresponding to the plurality of host identifiers is established.

[0057] Before the microphone interaction is performed, the host needs to open the live streaming first. Specifically, the host can click to access the live streaming application, enter the live streaming interface, interact with the live streaming opening control in the live streaming interface, trigger the host client to send a live streaming opening instruction to the server, the server responds to the live streaming opening instruction, and distributes live streaming room data to the host client. The host client loads the live streaming room interface according to the live streaming room data, and plays the audio stream data collected by the host client in the live streaming room. At this time, the audience can also enter the live streaming room to obtain the voice live streaming of the host.

[0058] At this time, the microphone connection opening component is loaded in the live streaming room interface, and the host can send a microphone connection opening request to the server through the microphone connection opening component to invite the host of the other live streaming room to perform microphone connection. The host can invite the host of the other live streaming room to perform microphone connection in a random matching mode, or invite the host of the other live streaming room to perform microphone connection in a friend mode.

[0059] The server responds to the microphone connection opening request, acquires a plurality of host identifiers, and establishes a microphone connection session connection between a plurality of host terminals corresponding to the plurality of host identifiers.

[0060] S20: According to the exposure compensation range of the video picture of each host terminal, the best exposure compensation value of the video picture of each host terminal is determined, and the best exposure compensation value is distributed to the corresponding host terminal; wherein the exposure compensation range is determined according to the brightness of the video picture collected by the host terminal.

[0061] The exposure compensation is an exposure control method, and by adjusting the exposure compensation value (Exposure Values, EV for short), the exposure amount of the picture can be adjusted, so as to change the brightness of the picture. Specifically, increasing the exposure compensation value, the collected video picture will become brighter. Reducing the exposure compensation value, the collected video picture will become darker. For example, EV is greater than 0, such as EV+1, EV+2.5, etc., which means that the exposure amount is increased than EV0, and the picture brightness is brighter than EV0.

[0062] The exposure compensation range refers to the value range of the exposure compensation value, that is, the interval determined by the minimum exposure compensation value and the maximum exposure compensation value.

[0063] The exposure compensation range is determined according to the brightness of the video picture collected by the anchor end. The brightness of the video picture can be input into the exposure compensation model to obtain the exposure compensation range. Alternatively, the exposure compensation range can be obtained according to a preset mapping relationship between the brightness of the video picture and the exposure compensation range. In the mapping relationship, the brightness of one video picture corresponds to a unique exposure compensation range.

[0064] In the embodiments of the present application, the brightness of the video picture of the anchor collected by each anchor end can be input into the exposure compensation model to obtain the exposure compensation range of the video picture. Alternatively, the brightness of the video picture of the anchor collected by each anchor end can be sent to the server, and the server can input the brightness of the video picture into the exposure compensation model to obtain the exposure compensation range of the video picture.

[0065] The server can take the intersection of the exposure compensation ranges of the video pictures sent by all anchor ends. If the intersection is not an empty set, the average of each exposure compensation value in the intersection is calculated, the average result is rounded, and the calculation result is taken as the optimal exposure compensation value of the video picture of each anchor end.

[0066] Alternatively, the server can take the intersection of the exposure compensation ranges of the video pictures sent by all anchor ends. If the intersection is an empty set, the server can take the union of the exposure compensation ranges of the video pictures sent by all anchor ends, calculate the average of each exposure compensation value in the union, round the average result, and take the calculation result as the optimal exposure compensation value of the video picture of each anchor end.

[0067] S30: receiving target video picture data collected by each anchor end according to the optimal exposure compensation value.

[0068] In the embodiments of the present application, each anchor end receives the optimal exposure compensation value issued by the server, and collects target video picture data according to the optimal exposure compensation value. Specifically, after the current exposure compensation value of the camera of each anchor end is controlled to be the optimal exposure compensation value, the anchor's video picture is collected again to obtain the target video picture data.

[0069] S40: according to the target video picture data sent by each anchor end, controlling the display of the live-mic live picture in the respective live room interface of the client in the live room.

[0070] Please refer to Figure 4 ,Figure 4 The display schematic diagram when the picture brightness of the live streaming co-mic is adjusted is provided in the embodiments of the present application. The co-mic live streaming picture includes the video picture of each anchor participating in the co-mic. Specifically, the target video picture data sent by each anchor end is subjected to the mixing operation to obtain the mixed video picture data, and the mixed video picture data is displayed on the live streaming room interface of each client in the live streaming room, that is, the co-mic live streaming picture is displayed.

[0071] The server can be the execution subject of the mixing operation. Specifically, after the server receives the target video picture data corresponding to each anchor identifier, the target video picture data is subjected to the mixing operation to obtain the mixed video picture data, and then the mixed video picture data is sent to the clients in the live streaming room. The clients in the live streaming room obtain the mixed video picture data and output the mixed video picture data in the live streaming room interface.

[0072] In another optional embodiment, the anchor end is the execution subject of the mixing operation. Specifically, after the server receives the target video picture data sent by each anchor end, the target video picture data corresponding to each anchor identifier is sent to the anchor end. Optionally, the server can send only the target video picture data corresponding to the anchor identifiers of other co-mic anchors to a certain anchor end, thereby reducing the data transmission amount. After the anchor end obtains the target video picture data corresponding to each anchor identifier, the target video picture data is subjected to the mixing operation to obtain the mixed video picture data, and then the mixed video picture data is sent to the clients in the live streaming room by the server. The clients in the live streaming room obtain the mixed video picture data and output the mixed video picture data in the live streaming room interface.

[0073] In other optional embodiments, the anchor end and the audience end are the execution subjects of the mixing operation. Specifically, after the server receives the target video picture data sent by each anchor end, the target video picture data corresponding to each anchor identifier is sent to the clients in the live streaming room (including the anchor end and the audience end). After the clients in the live streaming room obtain the target video picture data corresponding to each anchor identifier, the target video picture data is subjected to the mixing operation to obtain the mixed video picture data, and the mixed video picture data is output in the live streaming room interface.

[0074] In the embodiments of the present application, the execution subject of the mixing operation on the target video picture data corresponding to each anchor identifier is not limited, which can be the server, the anchor end, or the audience end.

[0075] According to the embodiment of the present application, the plurality of anchor identifiers are obtained in response to the request for starting the live-mixing, the live-mixing session connection between the plurality of anchor terminals corresponding to the plurality of anchor identifiers is established, the optimal exposure compensation value of the video picture of each anchor terminal is determined according to the exposure compensation range of the video picture of each anchor terminal, the optimal exposure compensation value is sent to the corresponding anchor terminal, wherein the exposure compensation range is determined according to the brightness of the video picture collected by the anchor terminal, the target video picture data collected by each anchor terminal according to the optimal exposure compensation value is received, and the live-mixing live picture is displayed in the live room interface of each client in the live room according to the target video picture data sent by each anchor terminal, thereby reducing the deviation of the brightness of the live-mixing picture and improving the retention rate of the audience in the live room.

[0076] In an optional embodiment, referring to Figure 5 , the step S20 of determining the optimal exposure compensation value of the video picture of each anchor terminal according to the exposure compensation range includes steps S201-S203, which are as follows:

[0077] S201: performing intersection operation on the exposure compensation range of the video picture of each anchor terminal to obtain an exposure compensation set;

[0078] S202: if the exposure compensation set is not empty, averaging all exposure compensation values in the exposure compensation set to obtain an average exposure compensation value;

[0079] S203: taking the average exposure compensation value as the optimal exposure compensation value of the video picture of each anchor terminal.

[0080] In the embodiment of the present application, each exposure compensation value in the exposure compensation range is spaced by 0.1. Taking the live-mixing between the anchor A and the anchor B as an example, if the exposure compensation range of the video picture of the anchor A is EV+3.0-EV+5.0, including the exposure compensation values EV+3.0, EV+3.1, EV+3.2, …, EV+5.0, and the exposure compensation range of the video picture of the anchor B is EV+4.0-EV+6.0, including the exposure compensation values EV+4.0, EV+4.1, EV+4.2, …, EV+6.0, then the exposure compensation set is {EV+4.0, EV+4.1, EV+4.2, …, EV+5.0}, and the average exposure compensation value is EV+4.5, which is taken as the optimal exposure compensation value of the video picture of the anchor A and the anchor B.

[0081] In an optional embodiment, if the average exposure compensation value has two decimal points, for example, the average exposure compensation value is EV+4.68, the average exposure compensation value can be rounded to keep only one decimal point to obtain EV+4.7.

[0082] By taking the average exposure compensation value as the optimal exposure compensation value of the video picture of each anchor end, the optimal exposure compensation value of the video picture of each anchor end is consistent, so that the brightness of the video picture of each anchor end is the same, which can reduce the deviation of the brightness of the live microphone picture and improve the retention rate of the live audience.

[0083] In an optional embodiment, referring to Figure 6 , the step S20 of determining the optimal exposure compensation value of the video picture of each anchor end according to the exposure compensation range includes steps S204-S207, which are as follows:

[0084] S204: If the exposure compensation set is empty, perform a set union operation on the exposure compensation range of the video picture of each anchor end to obtain a first exposure compensation set;

[0085] S205: Average all exposure compensation values in the first exposure compensation set to obtain a first average result, and perform a rounding operation on the first average result to obtain a first average exposure compensation value;

[0086] S206: Traverse the exposure compensation range of the video picture of each anchor end, and if the first average exposure compensation value is within the exposure compensation range of the video picture of the current anchor end, take the first average exposure compensation value as the optimal exposure compensation value of the video picture of the corresponding anchor end;

[0087] S207: If the first average exposure compensation value is not within the exposure compensation range of the video picture of the current anchor end, obtain the difference between each exposure compensation value in the exposure compensation range of the video picture of the current anchor end and the first average exposure compensation value, and take the exposure compensation value with the smallest difference as the optimal exposure compensation value of the video picture of the corresponding anchor end.

[0088] In the embodiments of the present application, if the exposure compensation range of the video picture of the host A is EV+3.0~EV+4.0, including the exposure compensation values EV+3.0, EV+3.1, EV+3.2, …, EV+4.0, and the exposure compensation range of the video picture of the host B is EV+6.0~EV+7.0, including the exposure compensation values EV+6.0, EV+6.1, EV+6.2, …, EV+7.0, the exposure compensation set is empty, the first exposure compensation set is {EV+3.0, EV+3.1, EV+3.2, …, EV+5.0, EV+6.0, EV+6.1, EV+6.2, …, EV+7.0}, and the first average exposure compensation value is EV+5.0. The first average exposure compensation value is neither in the exposure compensation range EV+3.0~EV+4.0 of the video picture of the host A nor in the exposure compensation range EV+6.0~EV+7.0 of the video picture of the host B, the exposure compensation value EV+4.0 in the exposure compensation range of the host A is closest to the first average exposure compensation value, that is, the difference is smallest, and the exposure compensation value EV+6.0 in the exposure compensation range of the host B is closest to the first average exposure compensation value, that is, the difference is smallest. Therefore, EV+4.0 is taken as the optimal exposure compensation value of the video picture of the host A, and EV+6.0 is taken as the optimal exposure compensation value of the video picture of the host B.

[0089] By judging whether the first average exposure compensation value is in the exposure compensation range of the video picture of the host side, the optimal exposure compensation value of the video picture of each host side is determined, so that the optimal exposure compensation values of the video pictures of each host side are the same or very small, thereby the deviation of the brightness of the mic-in picture can be reduced, and the retention rate of the live room audience can be improved.

[0090] In an optional embodiment, referring to Figure 7 , the step S201 of performing intersection operation on the exposure compensation ranges of the video pictures of each host side to obtain the exposure compensation set includes steps S2011-S2012, and the details are as follows.

[0091] S2011: in response to the mic-in exit request of at least one host side, determining the mic-in host side requesting to exit;

[0092] S2012: performing intersection operation on the exposure compensation ranges of the video pictures of the remaining host sides except the mic-in host side requesting to exit to obtain the exposure compensation set.

[0093] In the embodiment of the present application, if an anchor exits the live streaming during the live streaming, the server no longer considers the exposure compensation range of the video picture of the anchor end that exits the live streaming, and accordingly, the server re-determines the exposure compensation set according to the exposure compensation range of the video picture sent by the remaining live streaming anchor end, so as to subsequently re-determine the optimal exposure compensation value of each anchor end.

[0094] By adjusting the exposure compensation set in real time through the exit of the anchor during the live streaming, the accuracy of the live streaming picture brightness adjustment is improved, the deviation of the live streaming picture brightness can be reduced, and the retention rate of the live streaming room audience is improved.

[0095] In an optional embodiment, after the step S10 of obtaining a plurality of anchor identifiers and establishing the live streaming session connection between the anchor ends corresponding to the plurality of anchor identifiers in response to the live streaming opening request, the method further includes the steps of:

[0096] S101: In response to the joining live streaming request of at least one first anchor end, obtaining a first anchor identifier of the at least one first anchor end, and establishing a live streaming session connection between the first anchor identifier and the anchor ends corresponding to a plurality of anchor identifiers;

[0097] The step S201 of performing intersection operation on the exposure compensation range of the video picture of each anchor end to obtain the exposure compensation set includes the steps of:

[0098] S2013: Performing intersection operation on the exposure compensation range of the video picture of at least one first anchor end and the exposure compensation range of the video picture of a plurality of anchor ends to obtain an exposure compensation set.

[0099] In the embodiment of the present application, during the live streaming established by the existing anchor end, a new anchor end requests to join the live streaming, that is, a first anchor end requests to join the live streaming, and the server needs to update the exposure compensation set according to the exposure compensation range of the video picture of the first anchor end and the exposure compensation range of the video picture of a plurality of anchor ends, so as to subsequently re-determine the optimal exposure compensation value of each anchor end.

[0100] By adjusting the exposure compensation set in real time through the joining live streaming of the first anchor, the accuracy of the live streaming picture brightness adjustment is improved, the deviation of the live streaming picture brightness can be reduced, and the retention rate of the live streaming room audience is improved.

[0101] Please refer to Figure 8 , Figure 8 The flowchart of the picture brightness adjustment method for live streaming provided by the second embodiment of the present application, the method includes the following steps:

[0102] S1: The server obtains a plurality of anchor identifiers in response to a live streaming opening request, and establishes a live streaming session connection between the anchor ends corresponding to the plurality of anchor identifiers.

[0103] S2: The server determines the optimal exposure compensation value of the video picture of each anchor end according to the exposure compensation range of the video picture of each anchor end, and sends the optimal exposure compensation value to the corresponding anchor end; wherein the exposure compensation range is determined according to the brightness of the video picture collected by the anchor end.

[0104] S3: Each anchor end receives the optimal exposure compensation value, collects target video picture data according to the optimal exposure compensation value, and sends the respective target video picture data to the server.

[0105] S4: The server controls the display of the live-mic live picture in the respective live room interface of the client in the live room according to the target video picture data sent by each anchor end.

[0106] In this embodiment, the method for adjusting the brightness of the live-mic picture is described from two execution subjects of the client and the server. The client includes the anchor end and the audience end, and the implementation process is described in detail in the first embodiment, which will not be described here.

[0107] In one embodiment, before the step S2 of determining the optimal exposure compensation value of the video picture of each anchor end according to the exposure compensation range of the video picture of each anchor end, and sending the optimal exposure compensation value to the corresponding anchor end, steps S104-S106 are included, which are as follows:

[0108] S104: Each anchor end collects the video picture of the anchor through an image acquisition device, and obtains the brightness of the video picture.

[0109] S105: Each anchor end inputs the brightness of the video picture into the trained exposure compensation model to obtain the exposure compensation range of the video picture.

[0110] S106: Each anchor end sends the exposure compensation range of the video picture to the server.

[0111] The image acquisition device can be a camera, a video camera, a camera, a mobile phone, and a tablet computer, etc. In the embodiment of the present application, the trained exposure compensation model can be a deep learning network model or a machine learning model. Specifically, a plurality of video picture brightness sample data and corresponding exposure compensation range sample data are obtained, the plurality of video picture brightness sample data are input as input, and the plurality of exposure compensation range sample data are output as output, which are input into the exposure compensation model to be trained, the network weight parameters of the exposure compensation model to be trained are updated, and the trained exposure compensation model is obtained.

[0112] The trained exposure compensation model can be pre-stored in the memory of the host end. The host end controls the camera to collect the video picture of the host, obtains the brightness of the video picture, directly obtains the trained exposure compensation model from the memory, inputs the brightness of the video picture into the trained exposure compensation model, and obtains the exposure compensation range of the video picture.

[0113] In an optional embodiment, the trained exposure compensation model can be pre-stored in the memory of the camera. The host end controls the camera to collect the video picture of the host. The camera obtains the brightness of the video picture, directly obtains the trained exposure compensation model from the memory, inputs the brightness of the video picture into the trained exposure compensation model, and obtains the exposure compensation range of the video picture. The host end obtains the exposure compensation range of the video picture from the camera.

[0114] Through the trained exposure compensation model, the exposure compensation range of the video picture of each host end can be automatically and quickly obtained without human intervention, and the efficiency of outputting the exposure compensation range is improved.

[0115] Please refer to Figure 9 The device can be realized by software, hardware or a combination of both to become all or part of a computer device. The device 5 includes:

[0116] The live-mic establishing module 51 is configured to, in response to a live-mic starting request, obtain a plurality of host identifiers, and establish a live-mic session connection between host ends corresponding to the plurality of host identifiers.

[0117] The exposure compensation value determining module 52 is configured to determine a best exposure compensation value of the video picture of each host end according to the exposure compensation range of the video picture of each host end, and send the best exposure compensation value to the corresponding host end. The exposure compensation range is determined according to the brightness of the video picture collected by the host end.

[0118] The picture data receiving module 53 is configured to receive target video picture data collected by each host end according to the best exposure compensation value.

[0119] The live-mic picture displaying module 54 is configured to display a live-mic live picture in a live-mic interface of each client in the live room according to the target video picture data sent by each host end.

[0120] It should be noted that the live streaming and microphone connection picture brightness adjustment device provided in the above embodiment is used to execute the live streaming and microphone connection picture brightness adjustment method, and only the division of the above functional modules is used as an example. In actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above described functions. In addition, the live streaming and microphone connection picture brightness adjustment device and the live streaming and microphone connection picture brightness adjustment method provided in the above embodiment belong to the same concept, and the implementation process is detailed in the method embodiment. Here, it will not be repeated.

[0121] Please refer to Figure 10 The computer device provided in the fifth embodiment of the present application is shown in the structural schematic diagram. As shown in the figure, Figure 10 The computer device 21 can include a processor 210, a memory 211, and a computer program 212 stored in the memory 211 and executable on the processor 210, such as a live streaming control program for team interaction. The processor 210 executes the computer program 212 to implement the steps in the above embodiments.

[0122] The processor 210 can include one or more processing cores. The processor 210 connects various parts of the computer device 21 through various interfaces and lines, executes instructions, programs, code sets or instruction sets stored in the memory 211, and calls data in the memory 211 to perform various functions and process data of the computer device 21. Optionally, the processor 210 can be realized in at least one of the hardware forms of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programble Logic Array, PLA). The processor 210 can integrate a combination of one or several of central processing unit (Central Processing Unit, CPU), graphics processing unit (Graphics Processing Unit, GPU), and modem. Among them, the CPU mainly processes operating systems, user interfaces, and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the touch display screen; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem can also not be integrated into the processor 210, but can be realized by a separate chip.

[0123] The memory 211 can include a random access memory (RAM) and can also include a read-only memory (ROM). Optionally, the memory 211 includes a non-transitory computer-readable storage medium. The memory 211 can be used to store instructions, programs, codes, code sets, or instruction sets. The memory 211 can include a program storage area and a data storage area, where the program storage area can store instructions for implementing an operating system, instructions for at least one function (such as touch instructions, etc.), instructions for implementing the above various method embodiments, etc.; and the data storage area can store data involved in the above various method embodiments, etc. The memory 211 can also be at least one storage device located away from the aforementioned processor 210.

[0124] The embodiments of the present application also provide a computer storage medium, which can store a plurality of instructions, the instructions being suitable for being loaded and executed by a processor to perform the method steps of the above embodiments. The specific execution process can be referred to the specific description of the above embodiments, and will not be described here.

[0125] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units and modules is taken as an example for illustration. In actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the above described functions. Each functional unit and module in the embodiments can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit. In addition, the specific names of each functional unit and module are only for easy distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the above system can refer to the corresponding process in the above method embodiments, which will not be described here.

[0126] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the related description of other embodiments.

[0127] Those skilled in the art can appreciate that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized in electronic hardware or in a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0128] In the embodiments provided by the present application, it should be understood that the disclosed apparatus / terminal device and method can be implemented in other ways. For example, the apparatus / terminal device embodiments described above are merely schematic. The division of the modules or units is merely logical function division. There can be another division manner in actual implementation, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or in other forms.

[0129] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., they can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0130] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically independently, or two or more units can be integrated into one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0131] If the integrated module / unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, all or part of the flow of the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer readable storage medium. When the processor executes the computer program, the steps of each method embodiment described above can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form.

[0132] The present application is not limited to the above-described embodiments, and various modifications or alterations can be made to the present application without departing from the spirit and scope of the present application, and it is intended that such modifications and alterations be included within the scope of the present application recited in the following claims and their equivalents.

Claims

1. A method for adjusting screen brightness in live streaming multiplayer, characterized in that, The method includes the following steps: In response to a request to initiate a live chat session, several streamer identifiers are obtained, and a live chat session connection is established between the streamer terminals corresponding to the several streamer identifiers. The exposure compensation range of the video frame of each broadcaster is intersected to obtain an exposure compensation set. If the exposure compensation set is empty, the exposure compensation range of the video frame of each broadcaster is unioned to obtain a first exposure compensation set. The first average exposure compensation value is obtained by averaging all the exposure compensation values ​​in the first exposure compensation set. Iterate through the exposure compensation range of the video frame of each broadcaster's terminal. If the first average exposure compensation value is within the exposure compensation range of the current video frame of the broadcaster's terminal, use the first average exposure compensation value as the optimal exposure compensation value for the corresponding video frame of the broadcaster's terminal. If the first average exposure compensation value is not within the exposure compensation range of the current video frame of the broadcaster, obtain the difference between each exposure compensation value in the exposure compensation range of the current video frame of the broadcaster and the first average exposure compensation value, and take the exposure compensation value with the smallest difference as the best exposure compensation value for the corresponding video frame of the broadcaster. The optimal exposure compensation value is sent to the corresponding broadcaster terminal; wherein, the exposure compensation range is determined based on the brightness of the video image captured by the broadcaster terminal; Receive target video frame data collected by each of the broadcasters based on the optimal exposure compensation value; Based on the target video image data sent by each of the broadcaster terminals, the live broadcast image is displayed in the respective live broadcast interface of the client in the live broadcast room.

2. The method for adjusting screen brightness in live streaming interaction according to claim 1, characterized in that, Also includes: If the exposure compensation set is not empty, the average of all exposure compensation values ​​in the exposure compensation set is calculated to obtain the average exposure compensation value. The average exposure compensation value is used as the optimal exposure compensation value for the video frame of each broadcaster.

3. The method for adjusting screen brightness in live streaming interaction according to claim 2, characterized in that: The step of performing an intersection operation on the exposure compensation ranges sent by each of the broadcasters to obtain an exposure compensation set includes: In response to a live stream exit request from at least one of the broadcasters, the broadcaster requesting to exit is identified. An intersection operation is performed on the exposure compensation ranges of the video feeds of the remaining live streamers, excluding the one that requested to leave the live stream, to obtain an exposure compensation set.

4. The method for adjusting screen brightness in live streaming multiplayer according to claim 2, characterized in that: After the steps of responding to the live chat initiation request, obtaining several streamer identifiers, and establishing live chat session connections between the streamer terminals corresponding to several streamer identifiers, the following steps are included: In response to a request to join a live chat from at least one first broadcaster, obtain the first broadcaster identifier of at least one first broadcaster and establish a live chat session connection between the first broadcaster identifier and the broadcasters corresponding to the plurality of broadcaster identifiers. The step of performing an intersection operation on the exposure compensation ranges sent by each of the broadcasters to obtain an exposure compensation set includes: An exposure compensation set is obtained by taking the intersection of the exposure compensation range of at least one video frame from the first broadcaster and the exposure compensation ranges of several video frames from the broadcaster.

5. A method for adjusting screen brightness in live streaming multiplayer, characterized in that, The method includes the following steps: In response to the request to start a live chat session, the server obtains several streamer identifiers and establishes live chat session connections between the streamer terminals corresponding to the several streamer identifiers. The server performs an intersection operation on the exposure compensation range of the video frame of each broadcaster to obtain an exposure compensation set. If the exposure compensation set is an empty set, the server performs a union operation on the exposure compensation range of the video frame of each broadcaster to obtain a first exposure compensation set. The first average exposure compensation value is obtained by averaging all the exposure compensation values ​​in the first exposure compensation set. Iterate through the exposure compensation range of the video frame of each broadcaster's terminal. If the first average exposure compensation value is within the exposure compensation range of the current video frame of the broadcaster's terminal, use the first average exposure compensation value as the optimal exposure compensation value for the corresponding video frame of the broadcaster's terminal. If the first average exposure compensation value is not within the exposure compensation range of the current video frame of the broadcaster, obtain the difference between each exposure compensation value in the exposure compensation range of the current video frame of the broadcaster and the first average exposure compensation value, and take the exposure compensation value with the smallest difference as the best exposure compensation value for the corresponding video frame of the broadcaster. The server sends the optimal exposure compensation value to the corresponding broadcaster terminal; wherein, the exposure compensation range is determined based on the brightness of the video image captured by the broadcaster terminal; Each of the aforementioned broadcasting terminals receives the optimal exposure compensation value and, based on the optimal exposure compensation value, collects target video frame data; Each entity sends its target video frame data to the server. The server controls the display of the live stream feed on the respective live stream interface of each client in the live stream room, based on the target video feed data sent by each of the broadcasters.

6. The method for adjusting screen brightness in live streaming multiplayer according to claim 5, characterized in that: Before the step of the server determining the optimal exposure compensation value for the video frame of each broadcaster and sending the optimal exposure compensation value to the corresponding broadcaster, the following steps are included: Each of the aforementioned broadcasting terminals captures the broadcaster's video feed through an image acquisition device and obtains the brightness of the video feed; Each of the aforementioned broadcasting terminals inputs the brightness of the video image into a trained exposure compensation model to obtain the exposure compensation range of the video image; Each of the aforementioned broadcasting terminals sends the exposure compensation range of the video image to the server.

7. A device for adjusting screen brightness in live streaming multiplayer, characterized in that, include: The live chat creation module is used to respond to a live chat initiation request, obtain several broadcaster identifiers, and establish a live chat session connection between the broadcaster terminals corresponding to the several broadcaster identifiers. The exposure compensation value determination module is used to perform an intersection operation on the exposure compensation range of the video frame of each of the broadcasters to obtain an exposure compensation set. If the exposure compensation set is an empty set, the module performs a union operation on the exposure compensation range of the video frame of each of the broadcasters to obtain a first exposure compensation set. The first average exposure compensation value is obtained by averaging all the exposure compensation values ​​in the first exposure compensation set. Iterate through the exposure compensation range of the video frame of each broadcaster's terminal. If the first average exposure compensation value is within the exposure compensation range of the current video frame of the broadcaster's terminal, use the first average exposure compensation value as the optimal exposure compensation value for the corresponding video frame of the broadcaster's terminal. If the first average exposure compensation value is not within the exposure compensation range of the current video frame of the broadcaster, obtain the difference between each exposure compensation value in the exposure compensation range of the current video frame of the broadcaster and the first average exposure compensation value, and take the exposure compensation value with the smallest difference as the best exposure compensation value for the corresponding video frame of the broadcaster. The optimal exposure compensation value is sent to the corresponding broadcaster terminal; wherein, the exposure compensation range is determined based on the brightness of the video image captured by the broadcaster terminal; The video data receiving module is used to receive target video data collected by each of the broadcasters according to the optimal exposure compensation value. The live stream display module is used to control the display of the live stream screen in the respective live stream interface of the live stream client based on the target video screen data sent by each of the broadcasters.

8. A computer device, comprising: A processor, a memory, and a computer program stored in the memory and executable on the processor, characterized in that the processor, when executing the computer program, implements the steps of the method as claimed in any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Method for adjusting brightness of frame, multipoint control unit (MCU) and terminal

    CN105100545A

  • Systems and methods for determining exposure parameters

    US20200396363A1