Live enhancement method and apparatus, terminal, and storage medium

Abstract

The embodiment of the application discloses a live broadcast enhancement method and device, a terminal and a storage medium, and belongs to the technical field of video processing. The method comprises the following steps: in the case that a local starting event exists in a live broadcast application is identified, a first live broadcast control is displayed, the first live broadcast control comprises at least one live broadcast enhancement option, and a live broadcast enhancement mode indicated by the live broadcast enhancement option refers to a mode of performing enhancement processing on at least one of live broadcast images and live broadcast audio; in response to an option selection operation in the first live broadcast control, live broadcast audio and video data are collected and processed based on the live broadcast enhancement mode indicated by the live broadcast enhancement option; and the live broadcast audio and video data are sent to the live broadcast application, so that the live broadcast application displays live broadcast audio and video based on the live broadcast audio and video data. By adopting the scheme provided in the embodiment of the application, the live broadcast effect can be optimized, and the user live broadcast experience can be improved.

Description

Technical Field

[0001] This application relates to the field of video processing technology, and in particular to a live streaming enhancement method, apparatus, terminal, and storage medium. Background Technology

[0002] With the continuous development of communication technology and the increasing popularity of smart terminals, live video streaming has become a widely adopted technology.

[0003] In related technologies, fixing the terminal to a live streaming platform during live streaming can effectively reduce image shake. Alternatively, wearing external audio recording devices can improve audio reception. Clearly, optimizing live streaming quality relies on external equipment, increasing the complexity of the process. Summary of the Invention

[0004] This application provides a live streaming enhancement method, apparatus, terminal, and storage medium. The technical solution is as follows:

[0005] On one hand, embodiments of this application provide a live streaming enhancement method, the method comprising:

[0006] If a local live streaming event is detected in the live streaming application, a first live streaming control is displayed. The first live streaming control includes at least one live streaming enhancement option. The live streaming enhancement method indicated by the live streaming enhancement option refers to a method of enhancing at least one of the live streaming image and live streaming audio.

[0007] In response to the option selection operation within the first live streaming control, live audio and video data are collected and processed based on the live streaming enhancement method indicated by the live streaming enhancement option;

[0008] The live audio and video data is sent to the live streaming application so that the live streaming application can display the live audio and video based on the live audio and video data.

[0009] On the other hand, embodiments of this application provide a live streaming enhancement device, the device comprising:

[0010] The first control display module is used to display a first live control when a local live broadcast event is detected in the live broadcast application. The first live control includes at least one live broadcast enhancement option. The live broadcast enhancement method indicated by the live broadcast enhancement option refers to a method of enhancing at least one of the live broadcast image and live broadcast audio.

[0011] The data processing module is used to respond to the option selection operation within the first live control, and to collect and process live audio and video data based on the live enhancement method indicated by the live enhancement option;

[0012] The data sending module is used to send the live audio and video data to the live application, so that the live application can display the live audio and video based on the live audio and video data.

[0013] On the other hand, embodiments of this application provide a terminal, the terminal including a processor and a memory, the memory storing at least one computer instruction, the at least one computer instruction being loaded and executed by the processor to implement the live streaming enhancement method as described above.

[0014] On the other hand, embodiments of this application provide a computer-readable storage medium storing at least one computer instruction, which is executed by a processor to implement the live streaming enhancement method as described above.

[0015] On the other hand, embodiments of this application provide a computer program product including computer instructions stored in a computer-readable storage medium; a processor reads the computer instructions from the computer-readable storage medium and executes the computer instructions to implement the live streaming enhancement method as described above.

[0016] This application provides a system-level live streaming enhancement method. Upon detecting a local broadcast event within a live streaming application, it provides the user with at least one live streaming enhancement option by displaying a first live streaming control. Responding to the user's selection of an option within the first live streaming control, it collects and processes live audio and video data according to the enhancement method indicated by the option, and finally sends the live audio and video data to the live streaming application, enabling the application to display live audio and video based on this data. By employing the system-level live streaming enhancement method provided in this application, the live streaming effect can be optimized, and the user's live streaming experience can be improved. Attached Figure Description

[0017] Figure 1 A flowchart illustrating a live streaming enhancement method provided in an exemplary embodiment of this application is shown;

[0018] Figure 2 A schematic diagram of a live streaming enhancement interface provided by an exemplary embodiment of this application is shown;

[0019] Figure 3 A flowchart of a live streaming enhancement method provided by another exemplary embodiment of this application is shown;

[0020] Figure 4 This illustration shows a data transmission flowchart provided by an exemplary embodiment of this application when the first live streaming enhancement method is enabled;

[0021] Figure 5 This illustration shows a data transmission flowchart provided by an exemplary embodiment of this application when the second live streaming enhancement method is enabled;

[0022] Figure 6 This illustration shows a data transmission flowchart provided by an exemplary embodiment of this application when a third live streaming enhancement method is enabled;

[0023] Figure 7 This illustration shows a schematic diagram of the display switching of a live streaming control provided in an exemplary embodiment of this application;

[0024] Figure 8 A schematic diagram showing a configuration interface provided in an exemplary embodiment of this application is illustrated.

[0025] Figure 9 This application illustrates a timing flow diagram of an exemplary embodiment of the application's live streaming enhancement functionality.

[0026] Figure 10 A flowchart illustrating an exemplary embodiment of the application for enhanced live streaming functionality is shown.

[0027] Figure 11 A structural block diagram of a live streaming enhancement device provided in another exemplary embodiment of this application is shown;

[0028] Figure 12 A schematic diagram of the structure of a terminal provided in an exemplary embodiment of this application is shown. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0030] In this article, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0031] Live streaming is a form of communication that uses internet technology to transmit real-time images, sound, text, and other information to viewers.

[0032] In related technologies, fixing the terminal to a live streaming platform during live streaming can effectively reduce image shake. Alternatively, wearing external audio recording devices can improve audio reception. Clearly, optimizing live streaming quality relies on external equipment, increasing the complexity of the process.

[0033] This application provides a system-level live streaming enhancement method. Upon detecting a local broadcast event within a live streaming application, it provides the user with at least one live streaming enhancement option by displaying a first live streaming control. Responding to the user's selection of an option within the first live streaming control, it collects and processes live audio and video data according to the enhancement method indicated by the option, and finally sends the live audio and video data to the live streaming application, enabling the application to display live audio and video based on this data. By employing the system-level live streaming enhancement method provided in this application, the live streaming effect can be optimized, and the user's live streaming experience can be improved.

[0034] The live streaming enhancement method proposed in this application will be described below through specific embodiments.

[0035] Please refer to Figure 1 This document illustrates a flowchart of a live streaming enhancement method provided in an exemplary embodiment of this application. This embodiment uses the method applied to a terminal as an example for illustration, and the method may include the following steps:

[0036] Step 110: If a local live broadcast event is detected in the live broadcast application, a first live broadcast control is displayed. The first live broadcast control includes at least one live broadcast enhancement option. The live broadcast enhancement method indicated by the live broadcast enhancement option refers to a method of enhancing at least one of the live broadcast image and live broadcast audio.

[0037] Optionally, the live streaming application can be a native application on the device or a third-party application. Optionally, a local live streaming event refers to the event where a user opens the live streaming application and starts live streaming through the device. Optionally, a local live streaming event can be an audio live streaming event or a video live streaming event.

[0038] Optionally, the live broadcast content for local broadcast events may originate from the local device, such as gameplay footage from a game application running on the device, ambient footage captured by the device's camera, or local audio captured by the device's microphone.

[0039] Optionally, the terminal can identify whether a local broadcast event exists in the live streaming application through the system interface, or it can determine whether a local broadcast event exists in the live streaming application by recognizing the interface content, or it can use other possible implementation methods, which are not limited in this application embodiment.

[0040] In some embodiments, in order to optimize the user's live streaming effect, when a local live streaming event is detected in the live streaming application, the terminal displays a first live streaming control and displays at least one live streaming enhancement option in the first live streaming control.

[0041] Optionally, the first live streaming control is a control within a system-level application. For example, the first live streaming control is a control within a live streaming assistant application, which is a system-level application. Optionally, the first live streaming control can be displayed on top of the live streaming interface or in the notification bar. Optionally, the control form of the first live streaming control can be any control form that is convenient for user operation; this embodiment of the application does not limit this.

[0042] The different live streaming enhancement options indicate different live streaming enhancement methods. The live streaming enhancement method indicated by the live streaming enhancement option refers to the method of enhancing at least one of the live streaming images and live streaming audio. For example, enhancing the image quality of the live streaming images, enhancing the stability of the live streaming images, and enhancing the audio quality of the live streaming audio.

[0043] Optionally, the first live streaming control may include at least one live streaming enhancement option that can be pre-selected and set by the user before starting the live stream based on their own needs, or it may be set directly by the developer. In one possible implementation, multiple candidate live streaming enhancement options can be provided to the user in advance, so that in response to the user's selection operation, when a local live streaming event is detected in the live streaming application, the terminal displays at least one live streaming enhancement option selected by the user in the first live streaming control.

[0044] Indicative, such as Figure 2 As shown, when a local live streaming event is detected in the live streaming application 201, the terminal displays a first live streaming control 202, which includes three live streaming enhancement options.

[0045] Step 120: In response to the option selection operation within the first live streaming control, collect and process live audio and video data based on the live streaming enhancement method indicated by the live streaming enhancement option.

[0046] In some embodiments, in response to a user's option selection operation within a first live streaming control, the terminal collects and processes live audio and video data according to the live streaming enhancement method indicated by the live streaming enhancement option selected by the user.

[0047] Different live streaming enhancement methods correspond to their respective data collection and processing methods. Optionally, different live streaming enhancement methods can correspond to the same data collection method but different data processing methods, or they can correspond to different data collection and processing methods.

[0048] Optionally, live image enhancement can be performed either during the image acquisition stage or the image processing stage. For example, images can be captured by switching between different cameras during the image acquisition stage, and different image processing methods can be used to process the live images during the image processing stage.

[0049] Optionally, live audio enhancement can be performed either during the audio acquisition stage or the audio processing stage. For example, audio can be acquired using different audio acquisition components during the audio acquisition stage, and different audio processing methods can be used to process the live audio during the audio processing stage.

[0050] Optionally, users can select at least one live streaming enhancement method within the first live streaming control, meaning the terminal can collect and process live audio and video data based on one or more live streaming enhancement methods.

[0051] In one possible implementation, after receiving a user's selection operation within the first live streaming control, the terminal determines the selected live streaming enhancement method and, based on the enhancement method, acquires and processes live audio and video data via a camera and / or microphone. Optionally, the terminal may temporarily store the processed live audio and video data in a memory buffer.

[0052] Indicative, such as Figure 2 As shown, in response to the selection of the live streaming enhancement option 203 "Enable macro mode" within the first live streaming control 202, the terminal collects and processes live audio and video data according to the live streaming enhancement method indicated by the live streaming enhancement option 203.

[0053] Step 130: Send the live audio and video data to the live streaming application so that the live streaming application can display the live audio and video based on the live audio and video data.

[0054] In some embodiments, after collecting and processing live audio and video data based on the live enhancement method, the terminal can send the live audio and video data to the live application through the data transmission interface between the system and the live application, so that the live application can display the live audio and video based on the live audio and video data.

[0055] Optionally, the terminal can also encode the live audio and video data using a video codec component, and then send the encoded live audio and video data to each live viewer.

[0056] In summary, this application provides a system-level live streaming enhancement method. Upon detecting a local broadcast event within the live streaming application, it provides the user with at least one live streaming enhancement option by displaying a first live streaming control. Responding to the user's selection of an option within the first live streaming control, it collects and processes live audio and video data according to the enhancement method indicated by the option, and finally sends the live audio and video data to the live streaming application. This allows the live streaming application to display live audio and video based on the data. By employing the system-level live streaming enhancement method provided in this application, the live streaming effect can be optimized, and the user's live streaming experience can be improved.

[0057] The implementation process of several live streaming enhancement methods proposed in this application will be described below through examples.

[0058] Please refer to Figure 3 This illustration shows a flowchart of a live streaming enhancement method provided in another exemplary embodiment of this application. This embodiment uses the method applied to a terminal as an example for description, and the method may include the following steps:

[0059] Step 110: If a local live broadcast event is detected in the live broadcast application, a first live broadcast control is displayed. The first live broadcast control includes at least one live broadcast enhancement option. The live broadcast enhancement method indicated by the live broadcast enhancement option refers to a method of enhancing at least one of the live broadcast image and live broadcast audio.

[0060] To improve the accuracy of the timing of the first live broadcast control display, it is necessary to ensure that the terminal can accurately identify the local broadcast start event within the live broadcast application.

[0061] In one possible implementation, the terminal can detect the running status of the live streaming component within the live streaming application at the system level. Upon detecting the startup of the live streaming component, the terminal determines that a local broadcast event exists within the live streaming application. For example, the terminal can identify the existence of a local broadcast event within the live streaming application using a multimedia engine.

[0062] In another possible implementation, the terminal can also perform interface recognition on the live streaming application's interface after it is launched, and determine whether a local broadcast event exists based on the interface recognition result. Thus, if the interface recognition result indicates that the current interface is the live streaming initiation interface, the terminal determines that a local broadcast event exists within the live streaming application.

[0063] In another possible implementation, the terminal can also determine whether a local broadcast event exists by detecting user actions on interface controls. For example, the terminal detects user actions on the live stream start control. Therefore, upon receiving a user action on the live stream start control within the live streaming application, the terminal determines that a local broadcast event exists within the live streaming application.

[0064] Optionally, the terminal can determine whether a local broadcast event exists within the live streaming application based on at least one of the three identification methods mentioned above. Optionally, by combining at least two identification methods to determine whether a local broadcast event exists within the live streaming application, the accuracy of identifying local broadcast events can be improved, thereby optimizing the display effect of the first live streaming control.

[0065] Step 121: In response to the option selection operation within the first live streaming control, determine the live streaming enhancement method indicated by the live streaming enhancement option.

[0066] Optionally, the option selection operation can be a click operation on a live stream enhancement option. Optionally, the display effect of the selected live stream enhancement option differs from the display effect of the unselected live stream enhancement option. For example, the display color of the selected live stream enhancement option is different from the display color of the unselected live stream enhancement option.

[0067] In one possible implementation, upon receiving an option selection operation from a user within the first live streaming control, the terminal determines the live streaming enhancement method indicated by the live streaming enhancement option selected by the user.

[0068] Step 122: Based on the live streaming enhancement method, control the camera to collect live streaming image data through the camera hardware abstraction layer, and / or control the microphone to collect live streaming audio data through the audio hardware abstraction layer.

[0069] In one possible implementation, after determining the live streaming enhancement method, the terminal can collect live audio and video data according to the enhancement method. Optionally, collecting live audio and video data includes collecting live image data and / or collecting live audio data.

[0070] For live image data, the terminal can control the camera to capture it through the Camera Hardware Abstraction Layer (Camera HAL); for live audio data, the terminal can control the microphone to capture it through the Audio Hardware Abstraction Layer (Audio HAL).

[0071] The camera hardware abstraction layer (HAL) is a key component in the Android system used to connect the application programming interface (API) within the camera framework with the underlying camera driver and hardware. In one possible implementation, when a local live streaming event occurs, the live streaming application sends a camera operation request to the HAL through the camera interface. The terminal also sends the user-selected live streaming enhancement method to the HAL. Upon receiving the request, the HAL controls the camera to capture live images based on the current enhancement method.

[0072] The Audio Hardware Abstraction Layer (HAL) acts as a bridge between the Android system's audio framework and the underlying audio drivers. Its main function is to provide a unified interface for upper-layer applications, hiding hardware details to enable efficient audio function development and cross-platform compatibility. In one possible implementation, when a local broadcast event occurs, the live streaming application sends an audio capture request to the HAL through the audio interface. The terminal also sends the user-selected live streaming enhancement method to the HAL. Upon receiving the audio capture request, the HAL controls the microphone to capture live audio based on the current enhancement method.

[0073] In this embodiment, the live streaming enhancement method includes at least a first live streaming enhancement method, a second live streaming enhancement method, and a third live streaming enhancement method. The first live streaming enhancement method, also known as hand-held mode or macro mode, is used to display detailed information about objects during live streaming. The second live streaming enhancement method, also known as walking mode or anti-shake mode, is used to reduce the degree of shaking in the live streaming image during walking live streaming. The third live streaming enhancement method, also known as voice enhancement mode or noise reduction mode, is used to reduce audio noise in noisy live streaming scenarios.

[0074] The three methods of enhancing live streaming will be explained below.

[0075] 1. Enhancement of the first live broadcast method

[0076] Considering that in the live streaming scenario of product display, the host needs to show the audience the details of the product, in order to facilitate the host to show the details of the product up close, a first live streaming enhancement mode can be set up, that is, the first live streaming enhancement mode is used to realize the display of product details.

[0077] In one possible implementation, upon receiving a user's selection of a first live streaming enhancement method, the terminal sends a camera switching command to the camera hardware abstraction layer based on the first live streaming enhancement method. This allows the camera hardware abstraction layer to activate the first camera based on the camera switching command and control the first camera to acquire live streaming image data.

[0078] Optionally, in general live streaming scenarios, the terminal controls the main camera to capture live images using a standard focal length through the camera hardware abstraction layer. However, in scenarios where it is necessary to display the details of an item, in order to display the details of the item when the host displays it at close range, the terminal can switch the current camera to a wide-angle camera through the camera hardware abstraction layer based on the camera switching command, such as switching from a "1×" focal length to a "0.9×" focal length, thereby enabling close-up shooting of the displayed item.

[0079] When the first live streaming enhancement mode is enabled, considering that users may also actively adjust the focus within the live streaming application, in order to meet the user's focus adjustment operation, during the live streaming process, in response to the camera switching operation within the live streaming application, the terminal can switch the first camera to the second camera indicated by the camera switching operation, thereby acquiring live streaming image data through the second camera.

[0080] When the first live streaming enhancement mode is enabled, the terminal uses the camera switching operation indicated by the user in the live streaming application to collect live streaming image data.

[0081] For example, when the first camera is turned on to capture a live image at a focal length of "0.9×", in response to the user's selection of a focal length of "1.5×" within the live streaming application, the terminal captures a live image at a focal length of "1.5×".

[0082] 2. Second method of enhancing live streaming

[0083] Considering that in scenarios where the anchor is using a handheld terminal for live streaming, the displacement of the terminal during the anchor's movement can cause the live stream to shake, a second live stream enhancement method can be set to optimize the live stream display effect and reduce the degree of shaking.

[0084] In one possible implementation, upon receiving a user's selection of a second live streaming enhancement method, the terminal sends a video stabilization enable command to the camera hardware abstraction layer based on the second live streaming enhancement method. This enables the camera hardware abstraction layer to activate the stabilization function based on the video stabilization enable command and control the camera to acquire live streaming image data.

[0085] Optionally, after activating the image stabilization function, the terminal needs to perform image stabilization processing on the acquired live image data, which consumes corresponding computing resources. Considering that the live broadcast may be interrupted abnormally, i.e., the terminal fails to send the video stabilization off command to the camera hardware abstraction layer in time, causing the image stabilization function to remain on, the camera hardware abstraction layer will still perform image stabilization processing on the image data when acquiring it, thereby increasing unnecessary computing resource consumption. Therefore, in order to optimize the activation and deactivation process of the image stabilization function, in one possible implementation, the terminal can also obtain the live component name corresponding to the live application through the scene recognition function based on the second live broadcast enhancement method, and send the live component name to the camera hardware abstraction layer at the same time. Then, the camera hardware abstraction layer activates the image stabilization function based on the video stabilization on command and the live component name, and controls the camera to acquire live image data.

[0086] In other words, the camera hardware abstraction layer will only activate the image stabilization function upon receiving a video stabilization enable command and the live streaming component name. Regarding the process of obtaining the live streaming component name, the terminal can obtain the live streaming component name (activity name) of the live streaming application through the scene recognition function in the multimedia engine (MediaTurbo). Then, through the camera management interface OplusCameraManager, the live streaming component name and the video stabilization enable command are sent to the camera hardware abstraction layer via the camera service.

[0087] In one possible implementation, during live streaming, in response to the user's action to turn off the second live streaming enhancement method, the terminal can send a video stabilization off command to the camera hardware abstraction layer, so that the camera hardware abstraction layer can turn off the stabilization function, thereby reducing the computational resource consumption caused by maintaining stabilization processing.

[0088] In another possible implementation, considering that the live streaming application may experience abnormal interruptions, or that the user does not close the second live streaming enhancement mode when the live stream ends, i.e., the camera hardware abstraction layer does not receive the video stabilization shutdown command, in order to shut down the stabilization function in a timely manner, the terminal can identify whether the live stream is closed based on the live streaming component name. In this case, if the live stream is closed based on the live streaming component name, the stabilization function can be shut down through the camera hardware abstraction layer, thereby reducing the computational resource consumption caused by maintaining stabilization processing.

[0089] 3. Third live streaming enhancement method

[0090] Considering that the streamer may also be broadcasting outdoors, where the broadcasting environment may be noisy, a third live broadcast enhancement method can be set up to reduce the noise in the live broadcast audio in order to optimize the audio quality.

[0091] In one possible implementation, upon receiving a user's selection of a third live streaming enhancement method, the terminal sends a voice enhancement activation command to the audio hardware abstraction layer based on the third live streaming enhancement method. This allows the audio hardware abstraction layer to activate the voice enhancement function based on the voice enhancement activation command and control the microphone to collect live audio data.

[0092] Step 123: Enhance at least one of the acquired live image data and live audio data.

[0093] In some embodiments, when live image data and / or live audio data are acquired, the terminal can perform enhancement processing on at least one of the acquired live image data and live audio data to obtain processed live audio and video data.

[0094] When applying the first live streaming enhancement method, optionally, after the terminal controls the first camera to acquire live streaming image data through the camera hardware abstraction layer, it can directly transmit the live streaming image data to the live streaming application without processing it. Alternatively, after the terminal controls the first camera to acquire live streaming image data through the camera hardware abstraction layer, it can also perform digital zoom processing on the live streaming image data to optimize the detail display effect of the live streaming items.

[0095] Indicative, such as Figure 4The diagram illustrates a data transmission flowchart provided by an exemplary embodiment of this application when the first live streaming enhancement method is enabled. Optionally, the first live streaming enhancement method provided in this embodiment can be applied to both the live streaming preview (Preview Surface) event and the live streaming (Recorder Surface) event within the live streaming application 401.

[0096] After the user selects the first live streaming enhancement mode within the first live streaming control 402, the terminal sends a camera switching command `sendOplusExtCamCmd` to the camera management interface `OplusCameraManager`. This command is then transmitted via `OplusCameraManager` to the `CameraServiceExtlmpl` interface in the camera service layer, and finally via `Camera3OutputStream` to the camera hardware abstraction layer `Camera HAL`. The `Camera HAL` then controls the first camera to acquire live image data and sends it to `Camera3OutputStream`. `Camera3OutputStream` processes the acquired live image data and displays it on the local device via `Surface Flinger`. Furthermore, to send the live image data to the viewer, `Camera3OutputStream` also transmits the processed live image data to the `GraphBufferSource` in the codec hardware abstraction layer `Codec HAL`. After being buffered and managed by `GraphBufferSource`, the data is transmitted to `HWEncoder`. Finally, the live image data is encoded by the encoding layer `HW Encoder` and transmitted to `PacketSender` via `MediaCodec`.

[0097] By applying the first live streaming enhancement method during the live stream, it is possible to achieve close-up display of the live stream items, quickly focus without blurring, optimize the display effect of the items, and help improve the conversion rate of the live stream.

[0098] In the application of the second live streaming enhancement method, optionally, after the terminal controls the camera to acquire live streaming image data through the camera hardware abstraction layer, it can process the acquired live streaming image data based on the image stabilization algorithm to obtain processed live streaming image data. The image stabilization algorithm can be implemented based on at least one of electronic image stabilization, digital image stabilization, and artificial intelligence image stabilization; this application embodiment does not limit the specific implementation.

[0099] Indicative, such as Figure 5The diagram illustrates a data transmission flowchart provided by an exemplary embodiment of this application when the second live streaming enhancement method is enabled. Optionally, the second live streaming enhancement method provided in this embodiment can be applied to both the live streaming preview (Preview Surface) event and the live streaming (Recorder Surface) event within the live streaming application 501.

[0100] After the user selects the second live streaming enhancement method within the first live streaming control 502, the terminal sends a video stabilization enable command sendOplusExtCamCmd to the Camera Service layer, which is then transmitted to the Camera Hardware Abstraction Layer (Camera HAL) via CameraServiceExtlmpl. Simultaneously, the multimedia engine Media Turbo receives user data from the live streaming application 501 and the live streaming assistant application to which the first live streaming control 502 belongs, and uses MediaSceneDetection to identify whether the current scene is a live stream based on the user data.

[0101] By applying a second live streaming enhancement method during the live stream, the degree of shaking in the live stream can be reduced and the stability of the live stream can be improved while the stream is being moved around.

[0102] In the application of the third live streaming enhancement method, optionally, after the terminal controls the microphone to collect live audio data through the audio hardware abstraction layer, it can process the collected live audio data based on the voice enhancement algorithm to obtain the processed live audio data. The voice enhancement algorithm can be implemented based on deep learning methods, such as deep denoising autoencoders, convolutional neural networks, diffusion models, etc., and this application embodiment does not limit this implementation.

[0103] Indicative, such as Figure 6 The diagram illustrates a data transmission flowchart with the third live streaming enhancement method enabled, as provided in an exemplary embodiment of this application. Optionally, the third live streaming enhancement method provided in this embodiment is applied to audio recording events within the live streaming application 601.

[0104] After the user selects the third live streaming enhancement method within the first live streaming control 602, the terminal sends a voice enhancement enable command (updateLiveVoiceEnhanceInfo) to the AudioFlinger system, which then transmits it to the Audio Hardware Abstraction Layer (Audio HAL). The Audio HAL then controls the microphone to collect and receive (Streamin) the live audio data, processes it using a voice enhancement algorithm, and sends it to the RecordTrack audio input component in the Audio Flinger system. The RecordTrack then transmits the processed live audio data to the live streaming application 601.

[0105] By applying a third-party live streaming enhancement method during the live stream, the clarity of the live audio can be improved and the live stream effect optimized in outdoor or noisy live streaming scenarios.

[0106] Step 130: Send the live audio and video data to the live streaming application so that the live streaming application can display the live audio and video based on the live audio and video data.

[0107] The implementation method of this step can be referred to the above embodiments, and will not be described in detail here.

[0108] The above embodiments describe the process of terminal collecting and processing live audio and video data when selecting three different live streaming enhancement methods. By responding to the user's selection of at least one live streaming enhancement method, the terminal collects and processes live audio and video data, thereby improving the display effect of live audio and video in the corresponding live streaming scenario. Furthermore, by providing a system-level live streaming enhancement method, cross-platform universal live streaming enhancement can be achieved without the need for third-party application adaptation, thus saving development costs.

[0109] In some embodiments, in order to display selectable live streaming enhancement options to users through the live streaming control without affecting the broadcaster's viewing of the live streaming display, the terminal can also switch to display live streaming controls of different sizes.

[0110] Optionally, the first live streaming control is a real-time activity notification control of the first size.

[0111] In one possible implementation, when a local live streaming event is detected in the live streaming application, the terminal first displays a first live streaming control. Then, in order not to affect the broadcaster's viewing of other content on the screen, if no user trigger operation is received on the first live streaming control within a first period of time, the terminal can switch the first live streaming control to a second live streaming control.

[0112] The second live streaming control is a real-time activity notification control of a second size, which is smaller than the first size. For example, the size of the first live streaming control is 4*2, and the size of the second live streaming control is 2*1.

[0113] Optionally, the first duration can be a fixed duration preset by the developers, or a dynamic value determined based on users' preferences for live streaming enhancement methods. This embodiment of the application does not limit this. For example, the first duration is 1 minute.

[0114] Considering that the live streaming scene may change during the live stream, such as the streamer moving from an indoor scene to an outdoor scene, or the streamer changing from a full-body display to a detailed display, in order to promptly remind users to apply the corresponding live streaming enhancement method, in one possible implementation, the terminal can also identify the live streaming scene in real time, and switch the second live streaming control to the first live streaming control when it detects a change in the live streaming scene and the current live streaming enhancement method is not applicable to the changed live streaming scene.

[0115] Regarding the process of identifying live streaming scenarios, optionally, the terminal can identify live audio or live images to determine whether a live streaming scenario has changed based on the identification results. For example, the terminal can determine whether the current live streaming scenario is a handheld broadcast based on the identification of the live streaming image; or, based on the identification of the live streaming image or the live streaming audio, the terminal can determine whether the current live streaming scenario is an outdoor scene; or, based on the identification of multiple consecutive frames of live streaming images, the terminal can determine whether the current scene is a moving broadcast.

[0116] Optionally, when a live streaming scene switch is detected and the current live streaming enhancement method is not applicable to the switched live streaming scene, the terminal can not only switch the second live streaming control to the first live streaming control, but also display a pop-up window with a prompt about the live streaming enhancement method applicable to the current live streaming scene, so as to improve the efficiency of the user's selection of the live streaming enhancement method.

[0117] Indicative, such as Figure 7 As shown, this illustrates a schematic diagram of the display switching of a live streaming control provided in an exemplary embodiment of this application. When a local live streaming event is detected within the live streaming application 701, the terminal first displays the first live streaming control 702. Then, if no user trigger operation is received on the first live streaming control 702 within a first time period, in order not to affect the display of other content within the live streaming interface, the terminal switches the first live streaming control 702 to the second live streaming control 703.

[0118] In some embodiments, in order to enable the use of live streaming enhancement methods according to the user's own needs, when a local live streaming event is detected in the live streaming application, the terminal may first display a pop-up prompt and / or display a live streaming assistant capsule in the status bar. Then, after receiving the user's trigger operation on the live streaming assistant capsule, the terminal displays the first live streaming control (live streaming assistant panel) on the upper layer of the live streaming interface.

[0119] In the above embodiments, by setting two different sizes of live streaming controls and flexibly switching the display of the corresponding live streaming controls according to user operations and live streaming scenarios, the live streaming experience can be optimized, making it easier for users to use different live streaming enhancement methods for different live streaming scenarios and improving the effectiveness of live streaming enhancement.

[0120] In some embodiments, the terminal also provides a configuration entry for the live streaming enhancement function and the live streaming application, allowing users to set whether to use the live streaming enhancement function or to set up a live streaming application that applies the live streaming enhancement function according to their own needs.

[0121] In one possible implementation, the terminal provides a configuration entry point. When a trigger operation is received on the configuration entry point, the terminal displays a configuration interface, which includes a function on / off button corresponding to the live streaming enhancement function and at least one application option that supports live streaming enhancement processing.

[0122] The configuration entry can be within the settings application or within the first live streaming control; this application embodiment does not limit this.

[0123] Optionally, the live streaming enhancement feature is enabled by default. Users can turn the live streaming enhancement feature off or on again by triggering the on / off button according to their own needs.

[0124] Optionally, in response to a user's selection of at least one application option, the terminal can identify the application indicated by the selection as the target application. Therefore, the terminal will only display the first live streaming control to provide the user with live streaming enhancement options if the live streaming enhancement function is enabled, a local live streaming event is detected within the live streaming application, and the live streaming application is the target application.

[0125] Optionally, if the live streaming enhancement feature is not enabled, the terminal will not identify whether a local live streaming event exists within the live streaming application, in order to reduce computational resource consumption. If the live streaming enhancement feature is enabled, the terminal can first determine whether the currently running live streaming application is the target application. If it is determined that the live streaming application is not the target application, then it will not identify whether a local live streaming event exists within the live streaming application. That is, the terminal will only further identify whether a local live streaming event exists within the live streaming application if the live streaming enhancement feature is enabled and the live streaming application is the target application.

[0126] Indicative, such as Figure 8 The diagram illustrates a configuration interface provided in an exemplary embodiment of this application. Upon detecting a local live streaming event within the live streaming application 801, the terminal displays a first live streaming control 802, which includes a configuration entry point 803. In response to a user's triggering of the configuration entry point 803, the terminal displays a configuration interface 804. Users can then select to enable or disable the live streaming enhancement function within the configuration interface 804 and choose the target application for applying the live streaming enhancement function.

[0127] In some embodiments, considering that during the live broadcast, it is also necessary to send live audio and video data to each live viewer, the terminal can also provide a network bandwidth configuration entry in the configuration interface to improve data transmission efficiency, so that users can allocate the corresponding network bandwidth to the live broadcast application according to their own needs.

[0128] In one possible implementation, the terminal displays a network configuration control in the configuration interface, which is used to configure the available network bandwidth for the target application. In response to the triggering operation of the network configuration control, the terminal displays a network configuration window and determines the available network bandwidth corresponding to the target application in response to the user's network configuration operation in the network configuration window.

[0129] Available network bandwidth refers to the network bandwidth that the target application can use during its operation. For example, a user can set the available network bandwidth of the target application to 75% of the maximum network bandwidth.

[0130] Furthermore, during the live streaming process using the target application, the terminal can transmit live audio and video data to each live stream viewer based on the available network bandwidth corresponding to the target application, thereby optimizing the live streaming synchronization effect for the live stream viewer.

[0131] In the above embodiments, by displaying a configuration interface and providing users with configuration options for live streaming enhancement functions, target applications, and network bandwidth within the configuration interface, the application flexibility of live streaming enhancement functions can be improved and the user experience can be optimized.

[0132] Please refer to Figure 9 It illustrates a timing flow diagram of the application live streaming enhancement function provided in an exemplary embodiment of this application.

[0133] When applying the live streaming enhancement method provided in this application to a live streaming preview event, if a live streaming preview event exists within the live streaming application, the multimedia engine Media Turbo first identifies the presence of the live streaming preview event and then starts the LSS (Live Stream Service). The LSS service pops up a live streaming assistant capsule in the status bar. In response to the user's click on the live streaming assistant capsule, the terminal displays a live streaming assistant panel. This panel includes at least one live streaming enhancement method (manual broadcast / walking broadcast / voice enhancement). Based on the user's selection within the live streaming assistant panel, the terminal collects and processes the live audio and video data during the preview process according to the corresponding live streaming enhancement method and saves the current settings for the live streaming enhancement method. When the user exits the live streaming preview, the multimedia engine Media Turbo identifies the live streaming preview exit event and sends the event to the LSS service, which then closes the live streaming assistant capsule.

[0134] When applying the live streaming enhancement method provided in this application to a local live streaming event, if a local live streaming event exists within the live streaming application, the multimedia engine Media Turbo first identifies the local live streaming event and starts the LSS (Live Stream Service). The LSS service then sends a Toast notification to prompt the user to use live streaming enhancement and displays a live assistant capsule in the status bar. In response to the user's click on the live assistant capsule, the terminal displays a live assistant panel. This panel includes at least one live streaming enhancement method (manual broadcast / walking broadcast / voice enhancement). Based on the user's selection within the live assistant panel, the terminal collects and processes the live audio and video data during the preview process according to the corresponding live streaming enhancement method and saves the current settings for the live streaming enhancement method. When the user exits the live stream, the multimedia engine Media Turbo identifies the live stream exit event and sends it to the LSS service, which then closes the live assistant capsule.

[0135] Please refer to Figure 10 The diagram illustrates a flowchart of an application live streaming enhancement function provided in an exemplary embodiment of this application. Optionally, the live streaming enhancement method provided in this embodiment is applied during live streaming preview and local broadcasting within the live streaming application 1001.

[0136] Optionally, the terminal performs scene recognition through the Media Turbo Service (MTS) in the Media Turbo multimedia engine. When a live preview event or local broadcast event is detected in the live application 1001, the terminal starts the LSS service (Live Stream Service) and uses the LSS service to send a Toast notification to prompt the user to use live enhancement. A live assistant capsule pops up in the status bar. In response to the user's click on the live assistant capsule, the terminal displays the live assistant panel, which includes at least one live enhancement method (hand broadcast / walk broadcast / voice enhancement). Based on the user's selection in the live assistant panel, the terminal collects and processes the live audio and video data during the preview process according to the corresponding live enhancement method.

[0137] Meanwhile, the live streaming assistant panel also provides a configuration entry (Setting - Live Streaming Assistant Entry). In response to the user's click on the configuration entry, the terminal can display the configuration interface, where the user can enable or disable the live streaming enhancement function and select the target application (live streaming application switch) to apply the live streaming enhancement function.

[0138] Please refer to Figure 11 This illustration shows a structural block diagram of a live streaming enhancement device provided in an exemplary embodiment of this application. The device includes:

[0139] The first control display module 1101 is used to display a first live control when a local live broadcast event is detected in the live broadcast application. The first live control includes at least one live broadcast enhancement option. The live broadcast enhancement method indicated by the live broadcast enhancement option refers to a method of enhancing at least one of the live broadcast image and live broadcast audio.

[0140] Data processing module 1102 is used to collect and process live audio and video data in response to the option selection operation in the first live control, based on the live enhancement method indicated by the live enhancement option;

[0141] The data sending module 1103 is used to send the live audio and video data to the live application so that the live application can display the live audio and video based on the live audio and video data.

[0142] Optionally, the data processing module 1102 includes:

[0143] The mode determination unit is configured to determine the live enhancement mode indicated by the live enhancement option in response to the option selection operation within the first live control;

[0144] The data acquisition unit is used to control the camera to acquire live image data through the camera hardware abstraction layer and / or control the microphone to acquire live audio data through the audio hardware abstraction layer, based on the live streaming enhancement method.

[0145] A data processing unit is used to enhance at least one of the acquired live image data and live audio data.

[0146] Optionally, the live streaming enhancement method includes a first live streaming enhancement method, which is used to display the details of the item;

[0147] The data acquisition unit is used for:

[0148] Based on the first live streaming enhancement method, a camera switching command is sent to the camera hardware abstraction layer;

[0149] The camera hardware abstraction layer activates the first camera based on the camera switching command and controls the first camera to acquire the live image data.

[0150] Optionally, the device further includes:

[0151] A camera switching module is used to switch the first camera to the second camera indicated by the camera switching operation in the live streaming application during the live streaming process.

[0152] The data acquisition module is used to acquire the live image data through the second camera.

[0153] Optionally, the live streaming enhancement method includes a second live streaming enhancement method, which is used to reduce the degree of shaking in the live streaming image;

[0154] The data acquisition unit is used for:

[0155] Based on the second live streaming enhancement method, a video stabilization enable command is sent to the camera hardware abstraction layer;

[0156] The camera hardware abstraction layer activates the image stabilization function based on the video stabilization activation command and controls the camera to acquire the live image data.

[0157] The data processing unit is used for:

[0158] The acquired live image data is processed based on the anti-shake algorithm to obtain the processed live image data.

[0159] Optionally, the device further includes:

[0160] The name acquisition module is used to obtain the name of the live streaming component corresponding to the live streaming application through scene recognition function based on the second live streaming enhancement method, and send the name of the live streaming component to the camera hardware abstraction layer.

[0161] The data acquisition unit is used for:

[0162] The camera hardware abstraction layer activates the stabilization function based on the video stabilization activation command and the live streaming component name, and controls the camera to acquire the live streaming image data.

[0163] Optionally, the device further includes:

[0164] The instruction sending module is configured to, in response to the shutdown operation of the second live streaming enhancement method, send a video stabilization shutdown instruction to the camera hardware abstraction layer, so that the camera hardware abstraction layer disables the stabilization function; or,

[0165] The function shutdown module is used to disable the image stabilization function through the camera hardware abstraction layer when the live broadcast is identified as being off based on the live broadcast component name.

[0166] Optionally, the live streaming enhancement method includes a third live streaming enhancement method, which is used to reduce live audio noise;

[0167] The data acquisition unit is used for:

[0168] Based on the third live streaming enhancement method, a voice enhancement enable command is sent to the audio hardware abstraction layer;

[0169] The audio hardware abstraction layer activates the voice enhancement function based on the voice enhancement activation command and controls the microphone to collect the live audio data.

[0170] The data processing unit is used for:

[0171] The collected live audio data is processed using a voice enhancement algorithm to obtain the processed live audio data.

[0172] Optionally, the first live streaming control is a real-time activity notification control of a first size; the device further includes:

[0173] The first control switching module is used to switch the first live control to a second live control if no trigger operation is received for the first live control within a first time period. The second live control is a real-time activity reminder control of a second size, which is smaller than the first size.

[0174] Optionally, the device further includes:

[0175] The second control switching module is used to switch the second live control to the first live control when a live scene switch is detected and the current live enhancement method is not applicable to the switched live scene.

[0176] Optionally, the device further includes:

[0177] The first event determination module is used to determine, upon detecting the startup of a live streaming component within the live streaming application, the local broadcasting event occurring within the live streaming application; or,

[0178] The second event determination module is used to determine the local broadcast start event in the live streaming application when the interface recognition result indicates that the current interface is a live streaming initiation interface; or,

[0179] The third event determination module is used to determine the local broadcast start event in the live streaming application when a trigger operation on the live streaming start control is received within the live streaming application.

[0180] Optionally, the device further includes:

[0181] The interface display module is used to display the configuration interface, which includes a function on / off button corresponding to the live streaming enhancement function and at least one application option that supports live streaming enhancement processing.

[0182] An operation response module is configured to, in response to a selection operation of the at least one application option, identify the application indicated by the selection operation as the target application;

[0183] The first control display module 1101 is used for:

[0184] When the live streaming enhancement function is enabled, and the local live streaming event is detected in the live streaming application, and the live streaming application is the target application, the first live streaming control is displayed.

[0185] Optionally, the device further includes:

[0186] The second control display module is used to display network configuration controls in the configuration interface, the network configuration controls being used to configure available network bandwidth for the target application;

[0187] A window display module is used to display a network configuration window in response to a trigger operation on the network configuration control;

[0188] A bandwidth determination module is used to determine the available network bandwidth corresponding to the target application in response to a network configuration operation in the network configuration window.

[0189] The data transmission module is used to transmit the live audio and video data based on the available network bandwidth corresponding to the target application during the live broadcast.

[0190] In summary, this application provides a system-level live streaming enhancement method. Upon detecting a local broadcast event within the live streaming application, it provides the user with at least one live streaming enhancement option by displaying a first live streaming control. Responding to the user's selection of an option within the first live streaming control, it collects and processes live audio and video data according to the enhancement method indicated by the option, and finally sends the live audio and video data to the live streaming application. This allows the live streaming application to display live audio and video based on the data. By employing the system-level live streaming enhancement method provided in this application, the live streaming effect can be optimized, and the user's live streaming experience can be improved.

[0191] It should be noted that the apparatus provided in the above embodiments is only an example of the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the apparatus can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and their implementation process can be found in the method embodiments, which will not be repeated here.

[0192] It should be noted that this application may display prompt interfaces, pop-ups, or output voice prompts before and during the acquisition of relevant user data. These prompt interfaces, pop-ups, or voice prompts are used to inform the user that their relevant data is being collected. This ensures that the application only begins the steps for acquiring user data after receiving confirmation from the user regarding the prompt interface or pop-up. Otherwise (i.e., without receiving confirmation from the user), the steps for acquiring user data are terminated, meaning no user data is acquired. In other words, all information involved in this application (including but not limited to user device information, user personal information, and corresponding user operation data), data (including but not limited to data used for analysis, stored data, and displayed data), and signals are authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0193] See Figure 12 , Figure 12 This is a schematic diagram of the structure of a terminal provided in an exemplary embodiment of this application. The terminal may also include one or more of the following components: a processor 1210 and a memory 1220.

[0194] Optionally, the processor 1210 connects to various parts of the electronic device using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 1220, and by calling data stored in the memory 1220. Optionally, the processor 1210 can be implemented in at least one hardware form selected from Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA).

[0195] The processor 1210 can integrate one or more of the following: a central processing unit (CPU), a graphics processing unit (GPU), a neural network processing unit (NPU), and a baseband chip. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content displayed on the touchscreen; the NPU implements artificial intelligence (AI) functions; and the baseband chip handles wireless communication. It is understood that the baseband chip can also be implemented as a separate chip without being integrated into the processor 1210.

[0196] The memory 1220 may include random access memory (RAM) or read-only memory (ROM). Optionally, the memory 1220 may include a non-transitory computer-readable storage medium. The memory 1220 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 1220 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the various method embodiments described above, etc.; the data storage area may store data created based on the use of the electronic device, etc.

[0197] In addition, those skilled in the art will understand that the structure of the terminal shown in the above figures does not constitute a limitation on the terminal. The terminal may include more (e.g., power supply components, display components, sensor components) or fewer components than shown, or combine certain components, or have different component arrangements.

[0198] This application provides a computer-readable storage medium storing at least one computer instruction, which is executed by a processor to implement the live streaming enhancement method as described in the above embodiments.

[0199] On the other hand, embodiments of this application provide a computer program product, the computer program product including computer instructions stored in a computer-readable storage medium; a processor reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to implement the live streaming enhancement method as described in the above embodiments.

[0200] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0201] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for enhancing live streaming, characterized in that, The method includes: If a local live streaming event is detected in the live streaming application, a first live streaming control is displayed. The first live streaming control includes at least one live streaming enhancement option. The live streaming enhancement method indicated by the live streaming enhancement option refers to a method of enhancing at least one of the live streaming image and live streaming audio. In response to the option selection operation within the first live streaming control, live audio and video data are collected and processed based on the live streaming enhancement method indicated by the live streaming enhancement option; The live audio and video data is sent to the live streaming application so that the live streaming application can display the live audio and video based on the live audio and video data.

2. The method according to claim 1, characterized in that, In response to an option selection operation within the first live streaming control, the system collects and processes live audio and video data based on the live streaming enhancement method indicated by the live streaming enhancement option, including: In response to an option selection operation within the first live streaming control, the live streaming enhancement method indicated by the live streaming enhancement option is determined; Based on the aforementioned live streaming enhancement method, the camera is controlled to acquire live streaming image data through the camera hardware abstraction layer, and / or the microphone is controlled to acquire live streaming audio data through the audio hardware abstraction layer. At least one of the acquired live image data and live audio data is enhanced.

3. The method according to claim 2, characterized in that, The live streaming enhancement method includes a first live streaming enhancement method, which is used to display the details of the item. The method of controlling the camera to acquire live image data through the camera hardware abstraction layer based on the aforementioned live streaming enhancement method includes: Based on the first live streaming enhancement method, a camera switching command is sent to the camera hardware abstraction layer; The camera hardware abstraction layer activates the first camera based on the camera switching command and controls the first camera to acquire the live image data.

4. The method according to claim 3, characterized in that, The method further includes: During the live stream, in response to a camera switching operation within the live stream application, the first camera is switched to the second camera indicated by the camera switching operation; The live image data is captured by the second camera.

5. The method according to claim 2, characterized in that, The live streaming enhancement method includes a second live streaming enhancement method, which is used to reduce the degree of shaking in the live streaming image; The method of enhancing live streaming by controlling the camera to acquire live image data through the camera hardware abstraction layer includes: Based on the second live streaming enhancement method, a video stabilization enable command is sent to the camera hardware abstraction layer; The camera hardware abstraction layer activates the image stabilization function based on the video stabilization activation command and controls the camera to acquire the live image data. The enhancement processing of the acquired live image data includes: The acquired live image data is processed based on the anti-shake algorithm to obtain the processed live image data.

6. The method according to claim 5, characterized in that, The method further includes: Based on the second live streaming enhancement method, the live streaming component name corresponding to the live streaming application is obtained through the scene recognition function, and the live streaming component name is sent to the camera hardware abstraction layer; The step of activating the image stabilization function based on the video stabilization activation command through the camera hardware abstraction layer and controlling the camera to acquire the live image data includes: The camera hardware abstraction layer activates the stabilization function based on the video stabilization activation command and the live streaming component name, and controls the camera to acquire the live streaming image data.

7. The method according to claim 6, characterized in that, The method further includes: In response to the operation of turning off the second live streaming enhancement method, a video stabilization off command is sent to the camera hardware abstraction layer so that the camera hardware abstraction layer turns off the stabilization function; or, If the live stream is detected to be off based on the live stream component name, the image stabilization function is turned off through the camera hardware abstraction layer.

8. The method according to claim 2, characterized in that, The live streaming enhancement method includes a third live streaming enhancement method, which is used to reduce live audio noise. The method of enhancing live streaming by controlling the microphone to collect live audio data through the audio hardware abstraction layer includes: Based on the third live streaming enhancement method, a voice enhancement enable command is sent to the audio hardware abstraction layer; The audio hardware abstraction layer activates the voice enhancement function based on the voice enhancement activation command and controls the microphone to collect the live audio data. The enhancement processing of the collected live audio data includes: The collected live audio data is processed using a voice enhancement algorithm to obtain the processed live audio data.

9. The method according to any one of claims 1 to 8, characterized in that, The first live streaming control is a real-time activity notification control of a first size; the method further includes: If no trigger operation is received for the first live control within the first time period, the first live control is switched to the second live control, which is a real-time activity reminder control of a second size, which is smaller than the first size.

10. The method according to claim 9, characterized in that, The method further includes: If a live streaming scene switch is detected and the current live streaming enhancement method is not applicable to the switched live streaming scene, the second live streaming control will be switched to the first live streaming control.

11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: If the live streaming component within the live streaming application is detected to be running, it is determined that a local live streaming event occurs within the live streaming application; or, If the interface recognition result indicates that the current interface is a live broadcast initiation interface, it is determined that the live broadcast application contains the local broadcast initiation event; or, Upon receiving a trigger operation on the live streaming start control within the live streaming application, it is determined that the local live streaming event exists within the live streaming application.

12. The method according to any one of claims 1 to 11, characterized in that, The method further includes: The configuration interface includes a function on / off button for the live streaming enhancement function and at least one application option that supports live streaming enhancement processing. In response to a selection operation of the at least one application option, the application indicated by the selection operation is identified as the target application; The step of displaying the first live streaming control upon detecting a local live streaming event within the live streaming application includes: When the live streaming enhancement function is enabled, and the local live streaming event is detected in the live streaming application, and the live streaming application is the target application, the first live streaming control is displayed.

13. The method according to claim 12, characterized in that, The method further includes: The configuration interface displays a network configuration control, which is used to configure available network bandwidth for the target application. In response to a triggering operation on the network configuration control, the network configuration window is displayed; In response to a network configuration operation within the network configuration window, determine the available network bandwidth corresponding to the target application; During the live broadcast, the live audio and video data are transmitted based on the available network bandwidth corresponding to the target application.

14. A live streaming enhancement device, characterized in that, The device includes: The first control display module is used to display a first live control when a local live broadcast event is detected in the live broadcast application. The first live control includes at least one live broadcast enhancement option. The live broadcast enhancement method indicated by the live broadcast enhancement option refers to a method of enhancing at least one of the live broadcast image and live broadcast audio. The data processing module is used to respond to the option selection operation within the first live control, and to collect and process live audio and video data based on the live enhancement method indicated by the live enhancement option; The data sending module is used to send the live audio and video data to the live application, so that the live application can display the live audio and video based on the live audio and video data.

15. A terminal, characterized in that, The terminal includes a processor and a memory; the memory stores at least one computer instruction, which is executed by the processor to implement the live streaming enhancement method as described in any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that, The storage medium stores at least one computer instruction, which is executed by a processor to implement the live streaming enhancement method as described in any one of claims 1 to 13.

17. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium; the processor of the terminal reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the terminal to implement the live streaming enhancement method as described in any one of claims 1 to 13.

Images