Volume control method and device in live broadcast process, equipment and storage medium

Abstract

The invention discloses a volume control method and device in a live broadcast process, equipment and a storage medium, and relates to the technical field of Internet. The method is executed by a terminal device of an anchor in a live broadcast room, and comprises the following steps: collecting a live broadcast picture stream of the anchor; displaying the live broadcast picture stream in a live broadcast interface of the live broadcast room; a live broadcast interface of the live broadcast room has background music; identifying limb actions of an anchor in the live broadcast picture stream; determining a volume adjustment operation corresponding to the limb movement; and adjusting the volume of background music in the live broadcast room based on the volume adjustment operation. The method can simplify the volume adjustment operation of the anchor and improve the live broadcast effect.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of Internet technologies, and in particular, to a method, apparatus, device, and storage medium for volume control during a live broadcast. Background Art

[0002] With the changes in network live broadcast technologies and social demands, the types of network live broadcasts are becoming increasingly rich, and the forms of network live broadcasts are also constantly innovating and developing.

[0003] In the related art, the volume of the background music in the live broadcast room can affect the live broadcast effect. Taking a live broadcast room for talent shows as an example, the host can perform talents such as dancing and singing following the background music. If the volume of the current background music is too high or too low, the host can control the volume by touching the volume button.

[0004] However, during the volume adjustment process in the related art, it is usually necessary for the host to interrupt the talent show, resulting in a poor live broadcast effect. Summary of the Invention

[0005] The embodiments of the present application provide a method, apparatus, device, and storage medium for volume control during a live broadcast. The technical solutions provided by the embodiments of the present application are as follows:

[0006] According to one aspect of the embodiments of the present application, there is provided a method for volume control during a live broadcast, the method including:

[0007] Collecting the live video stream of the host;

[0008] Displaying the live video stream on the live broadcast interface of the live broadcast room; the live broadcast interface of the live broadcast room has background music;

[0009] Identifying the body movements of the host in the live video stream;

[0010] Determining a volume adjustment operation corresponding to the body movement;

[0011] Adjusting the volume of the background music in the live broadcast room based on the volume adjustment operation.

[0012] According to one aspect provided by an embodiment of the present application, there is provided a device for volume control during a live broadcast, the device including:

[0013] A video capture module, configured to collect the live video stream of the host;

[0014] A video display module, configured to display the live video stream on the live broadcast interface of the live broadcast room; the live broadcast interface of the live broadcast room has background music;

[0015] An action recognition module for recognizing the limb actions of the host in the live video stream;

[0016] An operation determination module for determining a volume adjustment operation corresponding to the limb action;

[0017] A volume adjustment module for adjusting the volume of the background music in the live broadcast room based on the volume adjustment operation.

[0018] In some embodiments, the operation determination module is configured to obtain the action frequency of the first limb action of the host;

[0019] The operation determination module is configured to determine a volume adjustment operation corresponding to the limb action based on the action frequency of the first limb action.

[0020] In some embodiments, the operation determination module is configured to obtain the action frequency of the first limb action of the host by performing frame recognition processing on the live video stream; or,

[0021] The operation determination module is configured to obtain the action frequency of the first limb action of the host through the sensor data of a motion sensor in the specified terminal device when the first limb action is an action of shaking the specified terminal device; the host carries the specified terminal device.

[0022] In some embodiments, the operation determination module is configured to determine that the volume adjustment operation is a volume reduction operation when the action frequency of the first limb action satisfies a first frequency range;

[0023] The operation determination module is configured to determine that the volume adjustment operation is a volume increase operation when the action frequency of the first limb action satisfies a second frequency range;

[0024] The volume adjustment module is configured to reduce the volume of the background music in the live broadcast room based on the volume reduction operation; or,

[0025] The volume adjustment module is configured to increase the volume of the background music in the live broadcast room based on the volume increase operation.

[0026] In some embodiments, the action recognition module is configured to control the live broadcast room to start a target mode when a first condition is met;

[0027] The action recognition module is configured to recognize the limb actions of the host in the live video stream when the target mode is in a started state.

[0028] In some embodiments, the first condition includes at least one of the following:

[0029] The host performs a second body movement;

[0030] The volume of the live broadcast room satisfies a specified volume range;

[0031] The user interaction operations in the live broadcast room satisfy specified interaction conditions;

[0032] The playback duration of the live broadcast room satisfies a playback duration threshold.

[0033] In some embodiments, the volume control device during the live broadcast further includes: a first prompt module, configured to display a first prompt element in the live broadcast interface of the live broadcast room when the target mode is in the startup state; the first prompt element is used to indicate that the target mode is started in the live broadcast room.

[0034] In some embodiments, the volume control device during the live broadcast further includes: a mode exit module, configured to control the live broadcast room to exit the target mode when a second condition is satisfied; the second condition includes at least one of the following:

[0035] The host performs a third body movement;

[0036] The duration during which the host does not perform a body movement satisfies a specified duration threshold.

[0037] In some embodiments, the volume control device during the live broadcast further includes: a second prompt module, configured to display a second prompt element in the live broadcast interface of the live broadcast room when the target mode is in the exit state; the second prompt element is used to indicate that the live broadcast room exits the target mode.

[0038] According to one aspect of the embodiments of the present application, there is provided a computer device, which includes a processor and a memory, and a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the above-mentioned volume control method during the live broadcast.

[0039] According to one aspect of the embodiments of the present application, there is provided a computer-readable storage medium, in which a computer program is stored, and the computer program is loaded and executed by a processor to implement the above-mentioned volume control method during the live broadcast.

[0040] According to one aspect of the embodiments of the present application, there is provided a computer program product, which includes a computer program, and the computer program is loaded and executed by a processor to implement the above-mentioned volume control method during the live broadcast.

[0041] The technical solutions provided by the embodiments of the present application at least include the following beneficial effects:

[0042] In a live broadcast room with background music, the host terminal device can recognize the body movements of the host in the live video stream, and then obtain the volume adjustment operation corresponding to the body movement performed by the host according to the pre-stored correspondence between body movements and volume adjustment operations, and further adjust the volume of the background music in the live broadcast room; this solution can respond to the host's body movements and automatically adjust the background music volume accordingly, simplifying the operation of the host to adjust the volume and improving the live broadcast effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for description in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0044] Figure 1 It is a schematic diagram of the solution implementation environment provided by an exemplary embodiment of the present application;

[0045] Figure 2 It is a flowchart of the volume control method during the live broadcast provided by an exemplary embodiment of the present application;

[0046] Figure 3 It is a schematic diagram of the display interface of the viewer client provided by an exemplary embodiment of the present application;

[0047] Figure 4 It is a schematic diagram of the display interface of the host client provided by an exemplary embodiment of the present application;

[0048] Figure 5 It is a schematic diagram of the display interface of the host client provided by an exemplary embodiment of the present application;

[0049] Figure 6 It is a flowchart of the volume control method during the live broadcast provided by an exemplary embodiment of the present application;

[0050] Figure 7 It is a block diagram of the volume control device during the live broadcast provided by an exemplary embodiment of the present application;

[0051] Figure 8 It is a block diagram of the structure of the computer device provided by an exemplary embodiment of the present application.

[0052] The drawings here are incorporated into the specification and constitute a part of this specification, showing the embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0053] To make the objectives, technical solutions, and advantages of this application clearer, the following will further describe the embodiments of this application in detail with reference to the accompanying drawings.

[0054] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. On the contrary, they are merely examples of devices and methods consistent with some aspects of this application as detailed in the appended claims.

[0055] The terms used in this disclosure are for the purpose of describing particular embodiments only and are not intended to limit the disclosure. The singular forms "a", "the", and "that" used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0056] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions. For example, the interactive operations involved in this application are obtained under full authorization.

[0057] It should be understood that although the terms first, second, etc. may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this disclosure, the first limb movement may also be referred to as the second limb movement, and similarly, the second limb movement may also be referred to as the first limb movement. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0058] First, several terms related to this application will be introduced and explained:

[0059] 1) Live streaming room: In online live streaming, a live streaming room refers to the virtual space where the host creates real-time content. In the live streaming room, the host and the audience interact in real time through forms such as video, voice, and text.

[0060] 2) Live video stream: It refers to video stream, audio stream, data stream, etc. during the live broadcast. The video stream includes real-time images of the live scene and supports different resolutions and frame rates; the audio stream includes sound information during the live broadcast and supports multiple sampling rates and bitrates; the auxiliary data stream includes bullet screens, gift special effects, host information, timestamps, geographical locations, etc.

[0061] Please refer to Figure 1 , which shows a schematic diagram of the solution implementation environment provided by an exemplary embodiment of the present application. The solution implementation environment may include: a host terminal device 110, an audience terminal device 120, and a server 130. Among them, the above host terminal device 110 and audience terminal device 120 can communicate with the server 130 through a network.

[0062] The host terminal device 110 and the audience terminal device 120 may include audio and video collection devices and audio and video playback devices. Optionally, the number of the host terminal device 110 and the audience terminal device 120 may be one or multiple. Exemplarily, the host terminal device 110 and the audience terminal device 120 may be electronic devices such as mobile phones, tablets, personal computers (PCs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, in-vehicle devices, etc., and the present application does not make any limitation thereto. The client of the target application program (such as a live broadcast application program) runs in the host terminal device 110 and the audience terminal device 120. Optionally, the target application program is an application program that needs to be downloaded and installed, or an application program in the form of a web page, or a small program, or an application program in other forms, and the embodiments of the present application do not make any limitation thereto. In the embodiments of the present application, the target application program may include, but is not limited to: live broadcast application programs, social application programs, shopping application programs, video playback application programs, remote conference application programs, music playback application programs, game application programs, education application programs, instant messaging application programs, or other types of application programs, and the embodiments of the present application do not make any limitation thereto.

[0063] The server 130 is used to provide background services for the clients of the target application programs running in the host terminal device 110 and the audience terminal device 120. The server 130 may be a single server, or a server cluster composed of multiple servers, or a cloud computing service center. The server 130 may be the background server of the above target application program and is used to provide background services for the clients of the target application program.

[0064] In the embodiments of the present application, the client of the target application running on the host terminal device 110 is the host client, and the user corresponding to the host client is the host; the client of the target application running on the viewer terminal device 120 is the viewer client, and the user corresponding to the viewer client is the viewer.

[0065] When the host conducts a live broadcast through the host client, viewers can enter the host's live broadcast room through the network and watch the content of the host's live broadcast room through the live broadcast interface displayed in the viewer client. Exemplarily, viewers can interact with the host. Exemplarily, the host can also view the content of his own live broadcast room through the live broadcast interface displayed in the host client.

[0066] In some embodiments, the solution implementation environment of the embodiments of the present application can be applied to live broadcast scenarios involving voice live broadcast or video live broadcast. The host client and the viewer client can be two different versions of the client of the target application. These two different versions of the client are respectively for host users and viewer users, that is, the version for hosts has the functions of the above-mentioned host client, and the version for viewer users has the functions of the above-mentioned viewer client; or, it can also be the same version of the client of the target application, and this version of the client has both the functions of the above-mentioned host client and the viewer client. For example, the viewer client can not only watch video live broadcasts, but also conduct video live broadcasts. For another example, the host client can not only conduct video live broadcasts, but also watch video live broadcasts of other hosts. The present application does not make any restrictions on this.

[0067] Exemplarily, taking a live broadcast room for talent shows as an example, the host can show talents such as dancing and singing following the background music to attract the interest of online viewers. The host terminal device 110 captures the live video stream of the host's talent show and displays the live video stream in the live broadcast interface of the live broadcast room. The live broadcast interface of the live broadcast room has background music; then, the host terminal device 110 recognizes the host's body movements in the live video stream and determines the volume adjustment operation corresponding to the body movements, so as to adjust the volume of the background music in the live broadcast room based on the volume adjustment operation.

[0068] Please refer to Figure 2 , which shows a flowchart of a volume control method during a live broadcast provided by an exemplary embodiment of the present application. The execution subject of each step of this method can be the host terminal device; optionally, this host terminal device can be the host terminal device 110 in the solution implementation environment shown above Figure 1 . This method may include steps 210 to 250.

[0069] Step 210: Capture the live video stream of the host.

[0070] In the embodiments of the present application, the host terminal device can collect real-time audio and video data related to the host through audio and video collection devices such as cameras and microphones; then, the host terminal device can perform processing such as watermarking, beauty filtering, and special effects on the collected real-time audio and video data; then, the host terminal device encodes and compresses the processed real-time video data into a live video stream for viewing and network transmission, and sends it to the server, which is then sent to each viewer terminal device.

[0071] Among them, taking the live broadcast room as a talent show live broadcast room as an example, the host can show talents such as dancing and singing following the background music, and the host terminal device collects the live video stream during the host's talent show. Correspondingly, the viewers who enter this live broadcast room can see the host's talent show on the live broadcast interface of the viewer terminal device.

[0072] Step 220: Display the live video stream in the live broadcast interface of the live broadcast room; the live broadcast interface of the live broadcast room has background music.

[0073] Among them, the above-mentioned live broadcast interface refers to the operation interface and viewing interface of the host or viewer user during network live broadcast. When the host opens the live broadcast room, the host terminal device of the host displays the live broadcast interface of the live broadcast room, and the viewer terminal device of the viewer user who enters this live broadcast room displays the live broadcast interface of this live broadcast room. Exemplarily, the host can set, modify, and adjust the viewing interface of the viewer user through specified operations.

[0074] Among them, the host terminal device displays the first live broadcast interface in the live broadcast interface, and the viewer terminal device displays the second live broadcast interface in the live broadcast interface. Exemplarily, the first live broadcast interface can include the second live broadcast interface. That is to say, the host can see the viewing interface of the viewer user.

[0075] Among them, the viewer user can interact with the live broadcast room through interactive operations while watching the live broadcast interface of the live broadcast room. Exemplarily, the above-mentioned interactive operations include at least one of the following: commenting, sending bullet screens, following, liking, forwarding, connecting for a voice or video call, and giving virtual items. Optionally, the above-mentioned interactive operations may also include other methods, which are not limited in this application.

[0076] Exemplarily, in addition to displaying the live video stream of the live broadcast room, the live interface of the viewer terminal device can also display an interaction area, an information display area, etc., and may also include other areas, which are not limited in the embodiments of the present application. Among them, the interaction area is used to display various controls related to interaction operations, and the controls may include, but are not limited to: chat box, send barrage control, follow control, like control, forward control, co-host control, co-video control, emoji control, give virtual item control, tip control, etc., and may also include other controls for interaction, which are not limited in the embodiments of the present application. The information display area is used to display information related to the live broadcast room, and the information may include, but are not limited to: the title of the live broadcast room, the introduction of the live broadcast room, the information of the host user, the number of viewers, etc., and may also include other information, which are not limited in the embodiments of the present application.

[0077] Please refer to Figure 3 , which shows a schematic diagram of the display interface of the viewer client provided by an exemplary embodiment of the present application. As Figure 3 shown, the viewer terminal device can display the live interface 310, the interaction area 320, and the information display area 330 of the live broadcast room. The viewer user can perform the interaction operation of sending a barrage through the send barrage control 320a in the interaction area 320, and can also perform the interaction operation of giving a virtual item through the give virtual item control 320b in the interaction area 320.

[0078] In the design of the live broadcast room, in addition to displaying the live video stream, it is also necessary to integrate the background music function. The background music can be freely selected by the host and played during the live broadcast. Exemplarily, the live broadcast platform can provide a music library for the live broadcast room, and the host can easily add background music from the music library to the live broadcast room.

[0079] Step 230: Identify the body movements of the host in the live video stream.

[0080] Among them, the above-mentioned body movements include the movements of at least one of the following body parts: head, eyes, neck, hands, elbows, arms, hips, legs, feet.

[0081] Optionally, the host terminal device can capture different live video streams in the current live interface at different time nodes, and then identify the body movements of the host in the live video stream through computer vision technology. Exemplarily, the host terminal device uses a deep learning model, such as a body pose estimation model based on a convolutional neural network, to identify the joint positions of body parts, etc., and determines the body movements of the host by analyzing the joint positions.

[0082] Step 240: Determine the volume adjustment operation corresponding to the body movement.

[0083] Among them, the above volume adjustment operations include at least one of the following: volume reduction operation, volume increase operation, and mute operation.

[0084] Optionally, limb movements of different limb parts can correspond to different volume adjustment operations. Exemplarily, when the limb movement of the anchor is a hand movement, the corresponding volume adjustment operation is a volume increase operation; when the limb movement of the anchor is a leg movement, the corresponding volume adjustment operation is a volume reduction operation; when the limb movement of the anchor is a head movement, the corresponding volume adjustment operation is a mute operation.

[0085] Optionally, different limb movements of the same limb part can correspond to different volume adjustment operations. Exemplarily, when the limb movement of the anchor is both hands raised upward, the corresponding volume adjustment operation is a volume increase operation; when the limb movement of the anchor is both hands waved downward, the corresponding volume adjustment operation is a volume reduction operation; when the limb movement of the anchor is waving hands left and right, the corresponding volume adjustment operation is a mute operation.

[0086] In the embodiment of the present application, the anchor terminal device can create a database table or a file structure for storing the correspondence between limb movements and volume adjustment operations. Correspondingly, the anchor terminal device can query the corresponding volume adjustment operation from the above correspondence according to the limb movement.

[0087] Exemplarily, taking the case where limb movements of different limb parts can correspond to different volume adjustment operations as an example, the correspondence between the above limb movements and volume adjustment operations can be a mapping relationship table between limb movements and volume adjustment operations as shown in Table 1.

[0088] Table 1

[0089] Body movement Hand movement Leg movement … Volume adjustment operation Volume increase operation Volume decrease operation …

[0090] Optionally, the correspondence between the above limb movements and volume adjustment operations is set by the anchor in the anchor terminal device in advance; or is set by the live broadcast platform in the server in advance and pushed to the anchor terminal device.

[0091] Optionally, the volume adjustment amount corresponding to each volume adjustment operation can be the same. For example, the volume increase operation corresponding to a hand movement is to increase the total volume by 10%. When the anchor wants to increase to 30% of the total volume, the anchor needs to repeat the hand movement three times. Or, the volume adjustment amount corresponding to each volume adjustment operation can be different. For example, the larger the amplitude of the limb movement, the larger the volume adjustment amount corresponding to each volume adjustment operation; the smaller the amplitude of the limb movement, the smaller the volume adjustment amount corresponding to each volume adjustment operation.

[0092] Step 250: Adjust the volume of the background music in the live broadcast room based on the volume adjustment operation.

[0093] Exemplarily, the host terminal device can adjust the volume attribute of the background music in the live room according to the volume adjustment operation, and then adjust the volume of the background music in the live room.

[0094] That is to say, in the embodiments of the present application, in addition to controlling the volume of the background music by touching the volume button, the host can also control the volume of the background music by completing specified body movements.

[0095] In summary, in the solution provided by the embodiments of the present application, in a live room with background music, the host terminal device can recognize the body movements of the host in the live video stream, and then obtain the volume adjustment operation corresponding to the body movement executed by the host according to the corresponding relationship between the pre-stored body movements and volume adjustment operations, and then adjust the volume of the background music in the live room; this solution can respond to the host's body movements and automatically adjust the background music volume accordingly, simplify the host's operation of adjusting the volume, and improve the live broadcast effect.

[0096] Among them, the corresponding relationship between the body movement and the volume adjustment operation can be customized according to different host habits and scenario requirements, and the flexible volume adjustment mechanism can better meet the diverse live broadcast scenario requirements.

[0097] Based on the above Figure 2 In a possible implementation manner based on the solution in the above-described embodiment, step 240 may be implemented as step 240a and step 240b.

[0098] Step 240a: Obtain the action frequency of the first body movement of the host.

[0099] In the embodiments of the present application, the host terminal device can detect and track the first body movement of the host in the live video stream in real time, and calculate the action frequency of the first body movement. Exemplarily, the host terminal device can calculate the action frequency of the first body movement by analyzing the changes between consecutive frames. For example, if the first body movement repeats 5 times per second, the action frequency is 5 Hz.

[0100] Step 240b: Determine the volume adjustment operation corresponding to the body movement based on the action frequency of the first body movement.

[0101] In the embodiments of the present application, the host terminal device can create a database table or file structure for storing the corresponding relationship between the action frequency of the first body movement and the volume adjustment operation. Correspondingly, the host terminal device can query the corresponding volume adjustment operation from the above corresponding relationship according to the action frequency of the first body movement.

[0102] Optionally, the host can pre-set the definition of the first body movement and the volume adjustment operation corresponding to the movement frequency of the first body movement in the host terminal device; or after the live streaming platform pre-sets the definition of the first body movement and the volume adjustment operation corresponding to the movement frequency of the first body movement in the server, it pushes them to the host terminal device.

[0103] Among them, the first body movement is one of the above-mentioned body movements. For example, the first body movement is a hand movement or a specified gesture movement. Specifically, for example, it is set that the volume adjustment operation corresponding to the movement frequency of the first body movement of 1-2 times per second is a volume reduction operation, and the volume adjustment operation corresponding to the movement frequency of the first body movement exceeding 3 times per second is a volume increase operation.

[0104] In the embodiment of the present application, the host terminal device can determine the corresponding volume adjustment operation through the movement frequency when the host executes the specified body movement, and then reduce or increase the volume of the background music in the live broadcast room according to the volume adjustment operation; this solution extends a solution that can respond to the movement frequency of the host's body movement and automatically adjust the background music volume accordingly. Compared with using manual adjustment devices (such as a mouse and a keyboard) to control the volume, this solution reduces physical contact and can improve the convenience of volume adjustment operations.

[0105] In some embodiments, before the above step 240b, the volume control method in the above live broadcast process further includes: obtaining the movement amplitude of the host's first body movement; the above step 240b can be implemented as: determining the volume adjustment operation corresponding to the body movement based on the movement frequency and the movement amplitude of the first body movement; the movement amplitude of the first body movement is used to indicate the volume adjustment amount corresponding to the volume adjustment operation.

[0106] Optionally, in the process of obtaining the movement amplitude of the host's first body movement, the host terminal device can determine the movement amplitude of the host's first body movement by calculating the distance change amount between the key points of the body parts of the first body movement (such as joint positions). For example, taking the first body movement as a waving hand movement, the joint positions of the waving hand movement include the wrist, elbow, shoulder, etc. The host terminal device can calculate the relative position change of the above joint positions at different time nodes to determine the movement amplitude of the waving hand movement.

[0107] Alternatively, the host terminal device can determine the movement amplitude of the host's first body movement by calculating the change amount of the joint angle of the body part of the first body movement. For example, taking the first body movement as an arm swing, the host terminal device can calculate the angle formed by the forearm and the upper arm with the elbow as the vertex to determine the movement amplitude of the waving hand movement.

[0108] Exemplarily, the host terminal device can create a database table or file structure to store the correspondence between the amplitude of the first body movement and the volume adjustment amount. Correspondingly, the host terminal device can query the corresponding volume adjustment amount from the above correspondence according to the amplitude of the first body movement.

[0109] In the embodiments of the present application, the host terminal device can determine the volume adjustment amount corresponding to the volume adjustment operation according to the amplitude of the first body movement, so that when the host executes the first body movement, the host can increase or decrease the amplitude according to actual needs to achieve precise adjustment of the background music volume.

[0110] Based on the solutions in the above various embodiments of the present application, in a possible implementation, the above step 240a can be implemented as step 240a1 or step 240a2.

[0111] Step 240a1: By performing picture recognition processing on the live video stream, obtain the movement frequency of the host's first body movement.

[0112] Wherein, the above picture recognition processing refers to that the host terminal device detects and tracks the host's first body movement in the live video stream in real time, and calculates the movement frequency of the first body movement by analyzing the changes between consecutive frames.

[0113] Step 240a2: In the case where the first body movement is an action of shaking the specified terminal device, obtain the movement frequency of the host's first body movement through the sensor data of the motion sensor in the specified terminal device; the host carries the specified terminal device.

[0114] Wherein, the above specified terminal device refers to a terminal device including a motion sensor, such as a sports headset, a sports bracelet, a VR helmet, an AR glasses, a motion game controller, etc.

[0115] In the embodiments of the present application, the movement frequency of the host's first body movement can be obtained through the sensor data collected by the specified terminal device worn by the host.

[0116] Exemplarily, the motion sensor in the specified terminal device is an accelerometer or a gyroscope. Taking the accelerometer as an example, the host terminal device performs a fast Fourier transform on the sensor data of the accelerometer to obtain the movement frequency of the host's first body movement.

[0117] Embodiments of this application illustrate two feasible solutions for obtaining the action frequency of the host's first body movement. That is, the host terminal device can obtain the action frequency of the host's first body movement through screen recognition processing or motion sensor data, and then determine the volume adjustment operation according to the action frequency. This solution provides a convenient volume control means for the host, enabling the host to select the corresponding method according to the actual live broadcast requirements.

[0118] Based on the solutions in the above various embodiments of this application, in a possible implementation solution, the above step 240b can be implemented as step 240b1 and step 240b2, and the above step 250 can be implemented as step 250a or step 250b.

[0119] Step 240b1: When the action frequency of the first body movement satisfies the first frequency range, determine that the volume adjustment operation is a volume reduction operation.

[0120] Among them, the above first frequency range is pre-stored in the host terminal device and is used to indicate the action frequency of the first body movement for volume reduction operations. Exemplarily, the first frequency range is a low-frequency range, such as 1 action per second (the specific value can be adjusted according to actual needs).

[0121] Exemplarily, after the host terminal device obtains the action frequency of the host's first body movement, it determines whether the action frequency belongs to the first frequency range. If it belongs to the first frequency range, the host terminal device can determine the volume adjustment operation as a volume reduction operation.

[0122] Step 250a: Based on the volume reduction operation, reduce the volume of the background music in the live broadcast room.

[0123] That is to say, the host terminal device can adjust the volume attribute of the background music in the live broadcast room according to the volume reduction operation, and then reduce the volume of the background music in the live broadcast room. Among them, the host terminal device can smoothly reduce the volume in a gradual manner to ensure a natural transition and not affect the viewer experience.

[0124] Step 240b2: When the action frequency of the first body movement satisfies the second frequency range, determine that the volume adjustment operation is a volume increase operation.

[0125] Among them, the above second frequency range is pre-stored in the host terminal device and is used to indicate the action frequency of the first body movement for volume reduction operations. Exemplarily, the second frequency range is a high-frequency range, such as more than 3 actions per second (the specific value can be adjusted according to actual needs).

[0126] Exemplarily, after the host terminal device obtains the action frequency of the host's first body movement, it determines whether the action frequency belongs to the second frequency range. If it belongs to the second frequency range, the host terminal device may determine the volume adjustment operation as a volume increase operation.

[0127] Step 250b: Based on the volume increase operation, increase the volume of the background music in the live broadcast room.

[0128] That is to say, the host terminal device can adjust the volume attribute of the background music in the live broadcast room according to the volume increase operation, and then increase the volume of the background music in the live broadcast room. Among them, the host terminal device can smoothly increase the volume in a gradual change manner to ensure a natural transition and not affect the viewer experience.

[0129] In some embodiments, when the action frequency of the first body movement meets the third frequency range, the host terminal device may determine the volume adjustment operation as a mute operation; correspondingly, the host terminal device adjusts the volume of the background music in the live broadcast room to mute or pauses the playback of the background music in the live broadcast room based on the mute operation.

[0130] Among them, the above-mentioned third frequency range is pre-stored in the host terminal device and is used to indicate the action frequency of the first body movement for the volume decrease operation. Exemplarily, the third frequency range is a medium frequency range, such as 2 times the number of actions per second (the specific value can be adjusted according to actual needs).

[0131] Exemplarily, after the host terminal device obtains the action frequency of the host's first body movement, it determines whether the action frequency belongs to the third frequency range. If it belongs to the third frequency range, the host terminal device may determine the volume adjustment operation as a mute operation. Correspondingly, the host terminal device adjusts the volume attribute of the background music in the live broadcast room according to the mute operation, and adjusts the volume of the background music in the live broadcast room to mute or pauses the playback of the background music in the live broadcast room.

[0132] In the embodiments of the present application, the host terminal device may pre-store the frequency ranges of the action frequencies of the first body movement corresponding to the volume decrease operation and the volume increase operation respectively, and then determine whether the volume adjustment operation is a volume decrease operation or a volume increase operation according to the obtained action frequency of the first body movement. When the volume adjustment operation is a volume decrease operation, it decreases the volume of the background music in the live broadcast room, and vice versa, it increases the volume of the background music in the live broadcast room. This solution determines whether to decrease or increase the volume of the background music according to the different ranges in which the action frequency of the host's first body movement falls, enabling the host to set specific frequency range thresholds according to personal preferences, further enhancing the flexibility and personalization of the method of controlling the volume by body movements.

[0133] Based on the solutions in the above various embodiments of the present application, in a possible implementation, the above step 230 can be implemented as follows:

[0134] When the first condition is satisfied, control the live broadcast room to start the target mode;

[0135] When the target mode is in the startup state, identify the body movements of the host in the live video stream.

[0136] Among them, the above first condition is a trigger condition based on time, event or user behavior, which is pre-stored in the computer device and is information used to control the live broadcast room to start the target mode. Optionally, the above first condition is set by the host in the host terminal device in advance, or is set by the live broadcast platform in the server in advance and pushed to the host terminal device.

[0137] In the above target mode, the host can control the volume of the background music in the live broadcast room through body movements. Correspondingly, when the target mode is in the startup state, the host terminal device starts to identify the body movements of the host in the live video stream, which can save device resources when the target mode is not in the startup state.

[0138] The embodiments of the present application limit that the method of controlling the volume by body movements is a function in a certain mode. When the live broadcast room needs to meet the corresponding conditions of the mode, the host can control the volume of the background music in the live broadcast room through body movements; by limiting the startup conditions for identifying the body movements of the host in the live video stream in this solution, the host can flexibly set the above first condition to avoid interfering with other live broadcast effects in the live broadcast room.

[0139] Based on the solutions in the above various embodiments of the present application, in a possible implementation, the first condition includes at least one of the following:

[0140] The host executes a second body movement;

[0141] The volume of the live broadcast room does not meet the specified volume range;

[0142] The user interaction operations in the live broadcast room meet the specified interaction conditions;

[0143] The playback duration of the live broadcast room meets the playback duration threshold.

[0144] Among them, the above second body movement is one of the above body movements. For example, the second body movement is a hand movement, a specified gesture movement. Specifically, for example, it is set that the second body movement is shaking the palm left and right for more than 3 seconds.

[0145] Among them, the above-specified volume range refers to the volume range preset by the host or the live streaming platform. When the current volume in the live streaming room is less than the minimum value of the specified volume range or exceeds the maximum value of the specified volume range, the host terminal device can control the live streaming room to start the target mode.

[0146] Among them, the above user interaction operations may include at least one of the following: commenting, sending bullet screens, following, liking, forwarding, co-hosting, co-videoing, giving virtual items, and may also include other interaction operations, which are not limited in this application. The above-specified interaction conditions refer to the interaction conditions preset by the host or the live streaming platform. For example, taking the above user interaction operation of sending a bullet screen containing specified content as an example, the above-specified interaction conditions may be that the number of bullet screens containing the specified content within 30s exceeds 3, and the specified content may be content related to volume such as "can't hear the sound" or "the sound is too loud". That is to say, when the audience feedbacks on volume problems, the host terminal device can control the live streaming room to start the target mode.

[0147] Among them, the playing duration of the above live streaming room refers to the playing duration after the host starts the live streaming room; the above playing duration threshold is preset by the live streaming platform. That is to say, the above target mode can be used as an additional function started according to the broadcast duration.

[0148] The embodiments of this application illustrate various implementable ways of the first condition. The host terminal device can control the live streaming room to start the target mode by combining multiple conditions such as body movements, volume, user interaction, and playing duration; this solution provides diverse trigger conditions for starting the target mode and enriches the live streaming methods in the live streaming room.

[0149] Based on the solutions in the above various embodiments of this application, in a possible implementation solution, the above volume control method during the live streaming process further includes:

[0150] When the target mode is in the startup state, a first prompt element is displayed in the live streaming interface of the live streaming room; the first prompt element is used to indicate that the live streaming room has started the target mode.

[0151] Among them, the above first prompt element may be at least one of the following: a pop-up notification, a fixed icon or banner on the screen, a specified prompt message in the chat area of the live streaming room, a specified background effect or border.

[0152] In the embodiments of this application, if the target mode has been started, the host terminal device can display the corresponding prompt element to inform the host that the volume of the background music of the live streaming room can currently be controlled through body movements.

[0153] Exemplarily, when the above-mentioned first prompt element includes text information such as a pop-up notification and specified prompt information in the live chat area of the live room, the first prompt element also indicates the correspondence between the body movement and the volume adjustment operation. For example, Figure 4 As shown, the host terminal device can display the live interface 410 of the live room and the information prompt area 420. The fixed icon 401 displayed at the top of the information prompt area 420 indicates that the target mode of the current live room is in the startup state. The text information below the fixed icon 401 indicates that the correspondence between the body movement and the volume adjustment operation is as follows: when the host's body movement is shaking the palm left and right 1-2 times per second, the corresponding volume adjustment operation is the volume reduction operation; when the host's body movement is shaking the palm left and right more than 3 times per second, the corresponding volume adjustment operation is the volume increase operation; when the host's body movement is putting the hands together, the corresponding volume adjustment operation is the mute operation. Accordingly, if the volume of the current background music is too high, the host can shake the palm left and right 1-2 times per second to reduce the volume, or put the hands together to turn off the background music.

[0154] In the embodiment of the present application, when the target mode is in the startup state, displaying the first prompt element in the live interface of the live room can clearly show the host the change of the live room state and improve transparency.

[0155] Based on the solutions in the above-mentioned various embodiments of the present application, in a possible implementation, the above-mentioned volume control method during the live broadcast further includes:

[0156] When the second condition is met, controlling the live room to exit the target mode; the second condition includes at least one of the following:

[0157] The host performs a third body movement;

[0158] The duration of the host not performing a body movement meets a specified duration threshold.

[0159] Among them, the above-mentioned second condition is a trigger condition based on time, event or user behavior, which is pre-stored in the host terminal device and is information used to control the live room to exit the target mode. Optionally, the above-mentioned second condition is set by the host in the host terminal device in advance, or is pre-set by the live broadcast platform in the server and pushed to the host terminal device. When the second condition is met, controlling the live room to exit the target mode, and the live terminal device stops identifying the body movement of the host in the live video stream, which can save device resources.

[0160] Among them, the above-mentioned third body movement is one of the above-mentioned body movements. For example, the third body movement is a hand movement or a specified gesture movement. Specifically, for example, it is set that the third body movement is shaking the palm up and down for more than 3 seconds.

[0161] Among them, the duration during which the above-mentioned host does not perform body movements meets the specified duration threshold, which means that the host terminal device does not capture the host performing body movements within a period of time. For example, in the case where the host temporarily leaves the live broadcast room, etc., at this time, the live broadcast room can exit the target mode, and the live broadcast terminal device stops recognizing the body movements of the host in the live broadcast video stream. The above-mentioned specified duration threshold is a duration value pre-stored in the host terminal device. For example, the specified duration threshold is 20s or other duration values, which are not limited in this application.

[0162] In the embodiments of the present application, the host can flexibly set the above-mentioned second condition to control the live broadcast room to exit the target mode, so that the live broadcast terminal device stops recognizing the body movements of the host in the live broadcast video stream, which can save device resources.

[0163] Based on the solutions in the above-mentioned various embodiments of the present application, in a possible implementation solution, the above-mentioned volume control method during the live broadcast process further includes:

[0164] When the target mode is in an exited state, a second prompt element is displayed in the live broadcast interface of the live broadcast room; the second prompt element is used to indicate that the live broadcast room exits the target mode.

[0165] Among them, the above-mentioned second prompt element can be at least one of the following: a pop-up notification, a fixed icon or banner on the screen, a specified prompt message in the chat area of the live broadcast room, a specified background effect or border.

[0166] In the embodiments of the present application, if the target mode has exited, the host terminal device can display the corresponding prompt element to inform the host that the volume of the background music in the live broadcast room cannot be controlled by body movements currently.

[0167] Exemplarily, when the above-mentioned second prompt element includes text information such as a pop-up notification and a specified prompt message in the chat area of the live broadcast room, the corresponding relationship between the body movement and the volume adjustment operation is also indicated in the second prompt element. Based on the above Figure 4 , as Figure 5 shown, the fixed icon 401 at the top of the information prompt area 420 is displayed as a dotted line, indicating that the target mode of the current live broadcast room is in a closed state.

[0168] In the embodiments of the present application, when the target mode is in a startup state, a first prompt element is displayed in the live broadcast interface of the live broadcast room, which can clearly show the host the change of the live broadcast room state and improve transparency.

[0169] Based on the solutions shown in the above-mentioned various embodiments of the present application, please refer to Figure 6 , which shows a flowchart of the volume control method during the live broadcast provided by an exemplary embodiment of the present application. As Figure 6As shown, the implementation environment of the volume control method in the live broadcast process includes the host terminal device 10, the server 20, and the viewer terminal device 30.

[0170] In the host terminal device 10, there is a correspondence relationship 601 between the action frequency of the first body movement and the volume adjustment operation. Among them, when the action frequency of the first body movement satisfies the first frequency range, the volume adjustment operation is a volume reduction operation; when the action frequency of the first body movement satisfies the second frequency range, the volume adjustment operation is a volume increase operation.

[0171] First, the host terminal device 10 captures the live video stream 610 of the host and displays the live video stream 610 in the live interface of the live broadcast room. Among them, the live interface of the live broadcast room has background music (BGM) with the first volume. Correspondingly, the host terminal device 10 sends the live video stream 610 with BGM of the first volume to the server 20, and the server 20 sends it to each viewer terminal device 30, that is, the viewer terminal device 30 displays the live video stream 610 with BGM of the first volume in the live interface 6301 of the live broadcast room.

[0172] After that, when the first condition is met, the host terminal device 10 controls the live broadcast room to start the target mode; when the target mode is in the startup state, the host terminal device 10 obtains the action frequency of the first body movement of the host.

[0173] Optionally, the host terminal device 10 can obtain the action frequency 602 of the first body movement of the host by performing image recognition processing on the live video stream 610; in the correspondence relationship 601 between the action frequency of the first body movement and the volume adjustment operation, find the volume adjustment operation 603 corresponding to the action frequency 602, and based on the volume adjustment operation 603, adjust the BGM with the first volume in the live broadcast room to the BGM with the second volume. Correspondingly, the viewer terminal device 30 displays the live video stream 620 with BGM of the second volume in the live interface 6301 of the live broadcast room.

[0174] Optionally, the host terminal device 10 can obtain the action frequency 604 of the first body movement of the host by specifying the sensor data of the motion sensor in the terminal device; in the correspondence relationship 601 between the action frequency of the first body movement and the volume adjustment operation, find the volume adjustment operation 605 corresponding to the action frequency 604, and based on the volume adjustment operation 605, adjust the BGM with the first volume in the live broadcast room to the BGM with the third volume. Correspondingly, the viewer terminal device 30 displays the live video stream 630 with BGM of the third volume in the live interface 6301 of the live broadcast room.

[0175] Among them, the execution manner of the above steps is the same as that of each of the above embodiments of the present application, and will not be elaborated here.

[0176] Based on the solutions shown in the above embodiments, the present application proposes a solution for controlling the background volume according to the speed of the shaking frequency. This method can improve the interactive experience of live broadcasts and VR. This solution proposes a means of shaking frequency to adjust the background volume. That is to say, when the host is performing a talent show (such as singing or dancing), there is no need to interrupt the performance, no need to rely on computer equipment, and by recognizing the shaking frequency effect of gestures through the video screen, the volume can be randomly switched during the live broadcast to enhance the interactive experience of the process and reduce the device volume.

[0177] Exemplarily, a solution for controlling the background volume according to the speed of the shaking frequency includes the following steps:

[0178] During the live broadcast, the host pre-sets various instructions for controlling the volume of the background music in the live broadcast room through body movements, including: shaking the palm left and right for more than 3 seconds, the instruction to turn on the background volume control; setting the first shaking frequency, shaking the palm 1-2 times per second for about one second in a cycle, corresponding to turning down the sound; setting the second shaking frequency, shaking the palm more than 3 times per second for about one second, corresponding to turning up the volume; ending the instruction 3 seconds after the shaking stops.

[0179] That is to say, this solution realizes the method of adjusting the volume through the speed of the shaking frequency. Users do not need to use physical buttons or virtual buttons to achieve the means of adjusting the volume, and it can also be extended to small terminal devices with motion sensors such as wireless earphones.

[0180] Exemplarily, the host wears wireless earphones. During the live broadcast, the host pre-sets various instructions for controlling the volume of the background music in the live broadcast room through body movements, including: shaking the wireless earphones left and right for more than 3 seconds, the instruction to turn on the background volume control; setting the first shaking frequency, shaking the wireless earphones 1-2 times per second for about one second in a cycle, corresponding to turning down the sound; setting the second shaking frequency, shaking the wireless earphones more than 3 times per second for about one second, corresponding to turning up the volume; ending the instruction 3 seconds after the shaking stops.

[0181] The following is the device embodiment of the present application, which can be used to execute the method embodiment of the present application. For the details not disclosed in the device embodiment of the present application, please refer to the method embodiment of the present application.

[0182] Please refer to Figure 7, which shows a block diagram of a volume control device during a live broadcast provided by an exemplary embodiment of the present application. This device has the functions implemented in the above examples, and these functions can be implemented by hardware or by software executed by the hardware. This device can be the server 130 introduced above or can be set in the server 130. As Figure 7 shown, this device may include:

[0183] A video capture module 701, configured to capture the live video stream of the host;

[0184] A video display module 702, configured to display the live video stream on the live broadcast interface in the live broadcast room; the live broadcast interface in the live broadcast room has background music;

[0185] An action recognition module 703, configured to recognize the body actions of the host in the live video stream;

[0186] An operation determination module 704, configured to determine a volume adjustment operation corresponding to the body action;

[0187] A volume adjustment module 705, configured to adjust the volume of the background music in the live broadcast room based on the volume adjustment operation.

[0188] In some embodiments, the operation determination module 704 is configured to obtain the action frequency of the first body action of the host;

[0189] The operation determination module 704 is configured to determine a volume adjustment operation corresponding to the body action based on the action frequency of the first body action.

[0190] In some embodiments, the operation determination module 704 is configured to obtain the action frequency of the first body action of the host by performing video recognition processing on the live video stream; or,

[0191] The operation determination module 704 is configured to, when the first body action is an action of shaking a specified terminal device, obtain the action frequency of the first body action of the host through the sensor data of a motion sensor in the specified terminal device; the host carries the specified terminal device.

[0192] In some embodiments, the operation determination module 704 is configured to determine that the volume adjustment operation is a volume reduction operation when the action frequency of the first body action satisfies a first frequency range;

[0193] The operation determination module 704 is configured to determine that the volume adjustment operation is a volume increase operation when the action frequency of the first body action satisfies a second frequency range;

[0194] The volume adjustment module 705 is configured to reduce the volume of the background music in the live broadcast room based on the volume reduction operation; or,

[0195] The volume adjustment module 705 is configured to increase the volume of the background music in the live broadcast room based on a volume increase operation.

[0196] In some embodiments, the action recognition module 703 is configured to control the live broadcast room to start a target mode when a first condition is met;

[0197] The action recognition module 703 is configured to recognize the body movements of the host in the live video stream when the target mode is in the startup state.

[0198] In some embodiments, the first condition includes at least one of the following:

[0199] The host performs a second body movement;

[0200] The volume of the live broadcast room meets a specified volume range;

[0201] The user interaction operations in the live broadcast room meet specified interaction conditions;

[0202] The playback duration of the live broadcast room meets a playback duration threshold.

[0203] In some embodiments, the volume control device during the live broadcast further includes: a first prompt module, configured to display a first prompt element in the live broadcast interface of the live broadcast room when the target mode is in the startup state; the first prompt element is used to indicate that the live broadcast room starts the target mode.

[0204] In some embodiments, the volume control device during the live broadcast further includes: a mode exit module, configured to control the live broadcast room to exit the target mode when a second condition is met; the second condition includes at least one of the following:

[0205] The host performs a third body movement;

[0206] The duration during which the host does not perform body movements meets a specified duration threshold.

[0207] In some embodiments, the volume control device during the live broadcast further includes: a second prompt module, configured to display a second prompt element in the live broadcast interface of the live broadcast room when the target mode is in the exit state; the second prompt element is used to indicate that the live broadcast room exits the target mode.

[0208] It should be noted that when the device provided in the above embodiments implements its functions, only the above-mentioned functional module division is used for illustration. In practical applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device provided in the above embodiments and the method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be elaborated here.

[0209] Please refer to Figure 8 which shows a block diagram of a computer device 800 provided by an exemplary embodiment of the present application. The computer device 800 may be Figure 1 the host terminal device 110 in the illustrated implementation environment, or may be Figure 1 the viewer terminal device 120 in the illustrated implementation environment, or may be Figure 1 the server 130 in the illustrated implementation environment, and is used to implement the volume control method in the live broadcast process provided in the above embodiments. Specifically:

[0210] Generally, the computer device 800 includes: a processor 810 and a memory 820.

[0211] The processor 810 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 810 may be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), or programmable logic array (PLA). The processor 810 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the wake state, also known as the central processing unit (CPU); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 810 may be integrated with a graphics processing unit (GPU), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 810 may further include an artificial intelligence (AI) processor, and the AI processor is used to process computing operations related to machine learning.

[0212] The memory 820 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 820 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 820 is used to store a computer program, and the computer program is configured to be executed by one or more processors to implement the volume control method in the live broadcast process described above.

[0213] Those skilled in the art can understand that Figure 8The structure shown does not limit the computer device 800, and may include more or fewer components than shown, or combine certain components, or adopt a different component arrangement.

[0214] In an exemplary embodiment, a computer-readable storage medium is also provided. A computer program is stored in the storage medium. When the computer program is executed by a processor, the volume control method in the above live broadcast process is implemented. Optionally, the computer-readable storage medium may include: Read-Only Memory (ROM), Random Access Memory (RAM), Solid State Drives (SSD), or optical discs, etc. Among them, the random access memory may include Resistance Random Access Memory (ReRAM) and Dynamic Random Access Memory (DRAM).

[0215] In an exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the volume control method in the above live broadcast process.

[0216] It should be understood that the "plurality" mentioned herein refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. In addition, the step numbers described herein only exemplarily show a possible execution sequence between steps. In some other embodiments, the above steps may not be executed in the order of the numbers. For example, two steps with different numbers are executed simultaneously, or two steps with different numbers are executed in the reverse order of the illustration. The embodiments of the present application do not limit this.

[0217] The above are only optional embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for controlling the volume during a live broadcast, characterized in that, The method is executed by the terminal device of the host in the live broadcast room, and the method includes: Collect the live video stream of the host. Display the live video stream in the live broadcast interface of the live broadcast room; the live broadcast interface of the live broadcast room has background music. Identify the body movements of the host in the live video stream. Determine the volume adjustment operation corresponding to the body movement. Based on the volume adjustment operation, adjust the volume of the background music in the live broadcast room.

2. The method according to claim 1, wherein The determining the volume adjustment operation corresponding to the body movement includes: Obtain the action frequency of the first body movement of the host. Based on the action frequency of the first body movement, determine the volume adjustment operation corresponding to the body movement.

3. The method according to claim 2, wherein The obtaining the action frequency of the first body movement of the host includes: Obtain the action frequency of the first body movement of the host by performing picture recognition processing on the live video stream; or, In the case where the first body movement is an action of shaking the specified terminal device, obtain the action frequency of the first body movement of the host through the sensor data of the motion sensor in the specified terminal device; the host carries the specified terminal device.

4. The method according to claim 2 or 3, characterized in that, The determining the volume adjustment operation corresponding to the body movement based on the action frequency of the first body movement includes: In the case where the action frequency of the first body movement satisfies the first frequency range, determine that the volume adjustment operation is a volume reduction operation. In the case where the action frequency of the first body movement satisfies the second frequency range, determine that the volume adjustment operation is a volume increase operation. The adjusting the volume of the background music in the live broadcast room based on the volume adjustment operation includes: Based on the volume reduction operation, reduce the volume of the background music in the live broadcast room; or, Based on the volume increase operation, increase the volume of the background music in the live broadcast room.

5. The method according to claim 1, characterized in that, The identifying the body movements of the host in the live video stream includes: In the case where the first condition is satisfied, control the live broadcast room to start the target mode. In the case where the target mode is in the startup state, identify the body movements of the host in the live video stream.

6. The method according to claim 5, characterized in that The first condition includes at least one of the following: The host performs a second body movement. The volume of the live broadcast room does not satisfy the specified volume range. The user interaction operation in the live broadcast room satisfies the specified interaction condition. The playback duration of the live broadcast room satisfies the playback duration threshold.

7. The method according to claim 5 or 6, characterized in that, The method further includes: In the case where the target mode is in the startup state, display a first prompt element in the live broadcast interface of the live broadcast room; the first prompt element is used to indicate that the live broadcast room starts the target mode.

8. The method according to claim 5 or 6, characterized in that, The method further includes: In the case where the second condition is satisfied, control the live broadcast room to exit the target mode; the second condition includes at least one of the following: The host performs a third body movement. The duration of the host not performing body movements satisfies the specified duration threshold.

9. The method according to claim 8, characterized in that, The method further includes: When the target mode is in the exit state, a second prompt element is displayed in the live broadcast interface of the live broadcast room; the second prompt element is used to indicate that the live broadcast room exits the target mode.

10. A volume control device during a live broadcast, characterized in that, The device includes: A video capture module, configured to capture the live video stream of the host; A video display module, configured to display the live video stream in the live broadcast interface of the live broadcast room; the live broadcast interface of the live broadcast room has background music; An action recognition module, configured to recognize the body movements of the host in the live video stream; An operation determination module, configured to determine a volume adjustment operation corresponding to the body movement; A volume adjustment module, configured to adjust the volume of the background music in the live broadcast room based on the volume adjustment operation.

11. A computer device, characterized in that, The computer device includes a processor and a memory, and a computer program is stored in the memory. The computer program is loaded and executed by the processor to implement the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, A computer program is stored in the storage medium, and the computer program is used to be executed by a processor to implement the method according to any one of claims 1 to 9.

13. A computer program product, characterized in that, The computer program product includes a computer program, and the computer program is loaded and executed by a processor to implement the method according to any one of claims 1 to 9.

Images