Live broadcast method and apparatus, and computing device
After detecting the camera material addition operation during the live broadcast, closing its rendering channel and processing images, the problem of anchor privacy data leakage is solved, and the security of user data and user experience is improved.
Patent Information
- Application Number
- CN202510301724.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-13
- Publication Date
- 2025-06-06
AI Technical Summary
In the prior art, after the anchor adds camera material during the live broadcast, the original image collected by the camera is directly rendered to the push-stream screen, resulting in privacy leakage and reducing the security of user data.
After detecting the material addition operation of the target image acquisition device, close its rendering channel to the push streaming screen, display the material setting page to obtain setting parameters, process the original image and display the corrected image in the preview component. Until the anchor completes the settings confirmation, open the rendering channel to render the corrected image to the push streaming screen.
It avoids the privacy data leakage of anchors when adding image acquisition equipment, ensures the security of user data, and improves the anchor user experience.
Smart Images
Figure CN120111271A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of streaming media technology, and in particular to a live broadcast method, apparatus, computing device, computer storage medium and computer program product. Background Art
[0002] With the rapid development of streaming media technology, the emergence of various live broadcast systems has greatly enriched people's work and life. Among them, the anchor end is the production end of live broadcast content and is an important part of the live broadcast system. When the anchor end produces live broadcast content, the anchor user can flexibly add cameras, windows, web pages and other materials according to needs.
[0003] However, the inventors found that the prior art has the following defects during implementation: after the anchor performs the camera material addition operation during the live broadcast, the original image collected by the camera will be directly rendered into the push stream screen, so as to be displayed to the audience. This live broadcast method in the prior art is prone to privacy leakage when the anchor adds a camera during the live broadcast, reducing the security of user data. Summary of the invention
[0004] In view of the above problems, the present application is proposed to provide a live broadcast method, apparatus, computing device, computer storage medium and computer program product that overcome the above problems or at least partially solve the above problems.
[0005] According to a first aspect of an embodiment of the present application, a live broadcast method is provided, including:
[0006] When a material adding operation is detected for a target image acquisition device during a live broadcast, a rendering channel from the target image acquisition device to a streaming screen is closed;
[0007] Displaying a material setting page corresponding to the target image acquisition device, and obtaining setting parameters of the target image acquisition device from the material setting page, processing the original image acquired by the target image acquisition device using the setting parameters to obtain a corrected image, and displaying the corrected image in a preview component;
[0008] It is detected that the material setting operation for the target image acquisition device is completed, and a rendering channel from the target image acquisition device to the streaming screen is opened to render the corrected image to the streaming screen.
[0009] In an optional implementation, after closing the rendering channel from the target image acquisition device to the streaming screen, the method further includes: rendering a placeholder element of the target image acquisition device to the streaming screen;
[0010] The rendering of the corrected image to the streaming screen includes: replacing the placeholder element with the corrected image.
[0011] In an optional implementation, the placeholder element is located in an independent placeholder layer, and the placeholder layer is hidden from the audience end and visible to the host end.
[0012] In an optional implementation, after detecting a material addition operation on a target image acquisition device during a live broadcast and closing a rendering channel from the target image acquisition device to a streaming screen, the method further includes:
[0013] Determine whether the privacy mode is currently enabled;
[0014] If yes, determine to start the privacy mode, and execute the step of detecting that the material setting operation for the target image acquisition device is completed, and opening the rendering channel of the target image acquisition device to the streaming screen;
[0015] If not, it is determined that the privacy mode is not started, and the rendering channel of the target image acquisition device to the streaming screen is opened.
[0016] In an optional implementation, the determining whether the privacy mode is currently activated includes:
[0017] Acquire the original image captured by the target image acquisition device;
[0018] Determining whether the original image contains risk elements;
[0019] If yes, then confirm to start the privacy mode;
[0020] If not, it is determined that the privacy mode is not activated.
[0021] In an optional implementation, if it is determined to start the privacy mode, the method further includes:
[0022] The risk element is marked in the preview component.
[0023] In an optional implementation, the determining whether the privacy mode is currently activated includes:
[0024] Determining a privacy protection level of the anchor user according to the attribute data of the anchor user;
[0025] If the privacy protection level exceeds the preset level, determining to start the privacy mode;
[0026] If the privacy protection level does not exceed the preset level, it is determined not to start the privacy mode.
[0027] According to a second aspect of an embodiment of the present application, a live broadcast device is provided, including:
[0028] A processing module is used to detect a material adding operation for a target image acquisition device during a live broadcast, and close a rendering channel from the target image acquisition device to a streaming screen; and to detect a material setting completion operation for the target image acquisition device, and open a rendering channel from the target image acquisition device to a streaming screen, so as to render the corrected image to the streaming screen.
[0029] A display module is used to display the material setting page corresponding to the target image acquisition device, and obtain the setting parameters of the target image acquisition device from the material setting page, use the setting parameters to process the original image acquired by the target image acquisition device to obtain a corrected image, and display the corrected image in the preview component.
[0030] In an optional embodiment, the processing module is used to: after closing the rendering channel from the target image acquisition device to the streaming screen, render the placeholder element of the target image acquisition device to the streaming screen; and after opening the rendering channel from the target image acquisition device to the streaming screen, replace the placeholder element with the corrected image.
[0031] In an optional implementation, the placeholder element is located in an independent placeholder layer, and the placeholder layer is hidden from the audience end and visible to the host end.
[0032] In an optional implementation, the processing module is further used to: after detecting the material addition operation for the target image acquisition device during the live broadcast, close the rendering channel from the target image acquisition device to the push stream screen, determine whether the privacy mode is currently started;
[0033] If yes, determine to start the privacy mode, and execute the step of detecting that the material setting operation for the target image acquisition device is completed, and opening the rendering channel of the target image acquisition device to the streaming screen;
[0034] If not, it is determined that the privacy mode is not started, and the rendering channel of the target image acquisition device to the streaming screen is opened.
[0035] In an optional implementation, the processing module is used to: obtain an original image captured by the target image acquisition device;
[0036] Determining whether the original image contains risk elements;
[0037] If yes, then confirm to start the privacy mode;
[0038] If not, it is determined that the privacy mode is not activated.
[0039] In an optional implementation, the display module is used to: if it is determined to start the privacy mode, mark the risk element in the preview component.
[0040] In an optional implementation, the processing module is used to: determine the privacy protection level of the anchor user according to the attribute data of the anchor user;
[0041] If the privacy protection level exceeds the preset level, determining to start the privacy mode;
[0042] If the privacy protection level does not exceed the preset level, it is determined not to start the privacy mode.
[0043] According to a third aspect of an embodiment of the present application, there is provided a computing device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;
[0044] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute operations corresponding to the above-mentioned live broadcast method.
[0045] According to a fourth aspect of an embodiment of the present application, a computer storage medium is provided, wherein at least one executable instruction is stored in the storage medium, and the executable instruction enables a processor to perform operations corresponding to the above-mentioned live broadcast method.
[0046] According to a fifth aspect of an embodiment of the present application, a computer program product is provided, comprising at least one executable instruction, wherein the executable instruction enables a processor to perform operations corresponding to the above-mentioned live broadcast method.
[0047] After executing the material adding operation of the target image acquisition device, the embodiment of the present application first closes the rendering channel from the target image acquisition device to the streaming screen. After the host completes the setting confirmation, the processed image of the target image acquisition device is rendered to the streaming screen, thereby avoiding the leakage of privacy data generated by the host when adding the image acquisition device, ensuring user data security, and improving the host's user experience.
[0048] In the embodiment of the present application, after the target image acquisition device is added and before the host user completes the setting confirmation, a placeholder element is first rendered in the streaming screen. The placeholder element is irrelevant to the captured image of the target image acquisition device, thereby not leaking the privacy of the host user. In addition, the placeholder element in the streaming screen can facilitate the host user to configure the parameters of the target image acquisition device, and after the host user completes the setting confirmation, the placeholder element can be replaced with the corrected image of the target image acquisition device, thereby realizing fast switching from the placeholder element to the corrected image.
[0049] After detecting the material addition operation for the target image acquisition device during the live broadcast, the embodiment of the present application first closes the rendering channel from the target image acquisition device to the streaming screen to prevent the image acquired by the target image acquisition device from flowing into the streaming channel; and if it is determined that the privacy mode is not currently turned on, the rendering channel from the target image acquisition device to the streaming screen is turned on again to achieve delayed rendering from the target image acquisition device to the streaming screen, thereby ensuring the privacy data security of the host end; if it is determined that the privacy mode is currently turned on, the rendering channel from the target image acquisition device to the streaming screen is turned on again after the user confirms that the setting is completed, thereby further ensuring the privacy data security of the host end.
[0050] The placeholder elements in the embodiment of the present application are located in an independent placeholder layer, and differentiated display properties are configured for the placeholder layer, that is, the placeholder layer is visible on the host side, and the placeholder image is invisible on the audience side, so that the audience side cannot view the placeholder elements in the placeholder layer, thereby ensuring the user experience of the audience side; while the host side can view the placeholder elements, which is convenient for the host user to set the size, position and other parameters of the target image acquisition device.
[0051] The embodiment of the present application can automatically start the privacy mode when there are risk elements in the original image, simplify user operations, and further reduce the risk of privacy leakage of the anchor user.
[0052] The embodiment of the present application can automatically determine whether the privacy mode is currently turned on based on the existing data of the anchor user, simplifying the user operation and ensuring the data security of the anchor user. In addition, there is no need to perform complex processing such as image recognition, thereby improving the judgment efficiency.
[0053] In the embodiment of the present application, when risk elements exist in the original image, the risk elements are marked in the preview component, thereby facilitating the host user to process the risk elements, etc.
[0054] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:
[0056] Figure 1 A schematic diagram of an operating environment provided for implementing at least one embodiment of the present application is shown;
[0057] Figure 2 A schematic diagram of a live broadcast method provided in Embodiment 1 of the present application is shown;
[0058] Figure 3 A schematic diagram showing a flow chart of a live broadcast method provided in Embodiment 2 of the present application is shown;
[0059] Figure 4 A schematic diagram of a streaming canvas and a material setting page provided in Embodiment 2 of the present application is shown;
[0060] Figure 5 A schematic diagram of a live broadcast method provided in Embodiment 3 of the present application is shown;
[0061] Figure 6 A schematic diagram of the structure of a live broadcast device provided in Embodiment 4 of the present application is shown;
[0062] Figure 7 A schematic diagram of the structure of a computing device provided in Embodiment 5 of the present application is shown. DETAILED DESCRIPTION
[0063] The exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.
[0064] Figure 1 A schematic diagram of an operating environment provided for implementing at least one embodiment of the present application is shown. The present application can be applied to an application environment including but not limited to a host terminal 2, an audience terminal 4, a server terminal 6, and a network 8. Among them:
[0065] The host terminal 2 is a live broadcast resource producer, which is used to produce live broadcast data such as audio and video, and push the produced live broadcast data to the server. The host terminal 2 can be a computer running Windows, Android (Android TM ) or IOS and other operating systems, such as smart phones, tablet devices, laptops, virtual reality devices, gaming devices, set-top boxes, car terminals, smart TVs. Based on the above operating systems, various applications can be run, such as browsers, live broadcast tools, etc.
[0066] The viewer terminal 4 is a live resource consumer, which is used to obtain live data such as audio and video from the server. The viewer terminal 4 can be a computer running Windows, Android, or TM) or IOS and other operating systems, such as smart phones, tablet devices, laptop computers, virtual reality devices, gaming devices, set-top boxes, car terminals, smart TVs. Based on the above operating systems, various applications can be run.
[0067] The server end 6 is a live data processing end, which is used to receive the live data produced by the anchor end 2, process the live data, and provide the live data to the audience end. The server end 6 can be composed of a single or multiple computing devices or computing clusters. The multiple computing devices may include virtualized computing instances. Virtualized computing instances may include virtual machines, such as simulations of computer systems, operating systems, servers, etc. The computing device can load the virtual machine based on a virtual image and / or other data that defines specific software (e.g., operating systems, dedicated applications, servers) for simulation. As the demand for different types of processing services changes, different virtual machines can be loaded and / or terminated on one or more computing devices. A hypervisor can be implemented to manage the use of different virtual machines on the same computing device.
[0068] The server 6 may be configured to communicate with the anchor 2, the viewer 4, etc. via a network 8. The network 8 includes various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or the like. The network 6 may include physical links, such as coaxial cable links, twisted pair cable links, optical fiber links, combinations thereof, etc., or wireless links, such as cellular links, satellite links, Wi-Fi links, etc.
[0069] Embodiment 1
[0070] Figure 2 The flowchart of a live broadcast method provided in the first embodiment of the present application is shown. The live broadcast method provided in the embodiment of the present application can be executed at the anchor end.
[0071] Specifically, Figure 2 As shown, the method comprises the following steps:
[0072] Step S201: Detecting a material adding operation on a target image acquisition device during a live broadcast, and closing a rendering channel from the target image acquisition device to a streaming screen.
[0073] During the live broadcast, the anchor user can flexibly add, delete, and modify the materials in the corresponding scene according to the needs. The materials include but are not limited to: image acquisition devices, windows, websites, game processes, pictures, texts, etc. The image acquisition devices include cameras, etc.
[0074] After detecting the material adding operation of the image acquisition device, the image acquisition device corresponding to the material adding operation is used as the target image acquisition device. For example, the anchor user can add the material to the target image acquisition device through "add material" → "target image acquisition device".
[0075] When the existing technology detects the addition of materials to the target image acquisition device during the live broadcast, it will immediately open the rendering channel from the target image acquisition device to the push stream screen, so that the real-time image collected by the target image acquisition device will be immediately rendered into the push stream screen, so as to be presented to the audience user. However, in the case where the anchor user is a virtual anchor, this method in the existing technology will lead to the leakage of the anchor user's privacy.
[0076] The present application is different from the prior art in that after detecting the material addition operation for the target image acquisition device during the live broadcast, the present application closes the rendering channel from the target image acquisition device to the streaming screen, thereby isolating the captured image of the target image acquisition device from the streaming screen, so that the image captured by the target image acquisition device will not be immediately rendered into the streaming screen, and the audience user will not view the captured image of the target image acquisition device at this time, thereby protecting the privacy of the anchor user. Among them, the target image acquisition device described in the embodiment of the present application is specifically a real image acquisition device such as a real camera.
[0077] Step S202, display the material setting page corresponding to the target image acquisition device, and obtain the setting parameters of the target image acquisition device from the material setting page, use the setting parameters to process the original image acquired by the target image acquisition device to obtain a corrected image, and display the corrected image in the preview component.
[0078] After detecting the material addition operation for the target image acquisition device, the material setting page corresponding to the target image acquisition device is further displayed on the anchor terminal. The material setting page provides a configuration entry for the setting parameters of the target image acquisition device, and the anchor user can configure the parameters through the configuration entry. The setting parameters may include but are not limited to: basic settings (such as resolution, format, etc.), beauty settings, body settings, filter settings, special effects settings, etc.
[0079] The setting parameters of the current target image acquisition device are obtained from the material setting page in real time, and the original image acquired by the target image acquisition device is processed using the setting parameters to obtain a corrected image after processing.
[0080] A preview component isolated from the streaming screen is set on the anchor side, and the corrected image corresponding to the target image acquisition device is displayed in the preview component, so that the anchor user can view the image display effect of the current target image acquisition device in real time, which is convenient for the anchor user to adjust the relevant parameters of the target image acquisition device according to the image display effect.
[0081] Among them, the rendering channel of the streaming screen is isolated from the rendering channel of the preview component, so that the image corresponding to the target image acquisition device will not flow into the streaming screen before the host user confirms it, so that the audience user will not see the image of the target image acquisition device before confirmation, avoiding the leakage of the host user's privacy data during the camera adding stage.
[0082] In an optional implementation, process isolation can also be performed, that is, different processes are used to handle the rendering of the streaming screen (executed by the first process) and the rendering of the screen in the preview component (executed by the second process), further reducing the probability of images from the target image acquisition device flowing into the streaming screen and ensuring the security of the host user's privacy data.
[0083] In an optional implementation, in addition to isolating the rendering channels, the push-stream screen and the preview component can also be memory isolated, thereby further preventing the image corresponding to the target image acquisition device from flowing into the push-stream screen. Specifically, a push-stream screen memory partition and a preview component memory partition are established respectively, and the push-stream screen memory partition and the preview component memory partition are isolated from each other. The push-stream screen memory partition stores the push-stream screen data, and the preview component memory partition stores the original image and corrected image data associated with the target image acquisition device.
[0084] Step S203 , detecting that the material setting operation for the target image acquisition device is completed, opening the rendering channel of the target image acquisition device to the streaming screen, so as to render the corrected image to the streaming screen.
[0085] After detecting that the material setting operation for the target image acquisition device is completed, indicating that the anchor user has completed the confirmation, the rendering channel from the target image acquisition device to the push stream screen is opened, so that the corrected image corresponding to the target image acquisition device can be rendered into the push stream screen, and the push stream screen is sent to the audience end for display via the server end. In addition, the rendering channel from the target image acquisition device to the preview component can be closed synchronously, and the preview component and the material setting page corresponding to the target image acquisition device can be closed.
[0086] In an optional implementation, in order to enhance the live broadcast experience of the anchor user, after detecting the material addition operation for the target image acquisition device during the live broadcast, a corresponding confirmation prompt message can be displayed to prompt the anchor user that the rendering channel from the target image acquisition device to the streaming screen will be opened only after clicking confirm. This implementation does not limit the specific prompt content. In addition, when multiple prompt messages are currently triggered, the confirmation prompt message is displayed first to protect user privacy. For example, different prompt messages can be added to the prompt message queue, and priorities can be assigned to different prompt messages. When the current prompt triggering condition is met, the triggered prompt message is obtained from the queue, and the priorities of the prompt messages are compared, and prompt messages with high priorities are displayed first.
[0087] It can be seen that in the live broadcast method provided in the embodiment of the present application, after executing the material adding operation of the target image acquisition device, the rendering channel from the target image acquisition device to the streaming screen is first closed. After the anchor completes the setting confirmation, the processed image of the target image acquisition device is rendered to the streaming screen, thereby avoiding the leakage of privacy data generated by the anchor when adding the image acquisition device, ensuring user data security, and improving the anchor user experience.
[0088] Embodiment 2
[0089] Figure 3 The flowchart of a live broadcast method provided in the second embodiment of the present application is shown. The live broadcast method provided in the embodiment of the present application can be executed at the anchor end.
[0090] Specifically, if Figure 3 As shown, the method comprises the following steps:
[0091] Step S301: Detecting a material adding operation for a target image acquisition device during a live broadcast, closing a rendering channel from the target image acquisition device to a streaming screen, and rendering a placeholder element of the target image acquisition device to the streaming screen.
[0092] In this embodiment, a streaming canvas is provided in the anchor terminal, and the streaming screen is rendered in the streaming canvas. After detecting the material addition operation for the target image acquisition device during the live broadcast, the rendering channel from the target image acquisition device to the streaming screen is closed, so that the user can confirm that the captured image of the target image acquisition device will not be leaked to the streaming screen.
[0093] Furthermore, after detecting the material addition operation for the target image acquisition device during the live broadcast, the placeholder element of the target image acquisition device is rendered to the streaming screen. The placeholder element is independent of the captured image of the target image acquisition device, and the placeholder element can be a preset picture, such as a picture with prompt information, a picture with a preset background color, etc. Among them, the size of the placeholder element can be determined according to the resolution parameter of the current target image acquisition device, and the position of the placeholder element can also be determined according to the current position parameter, so that the anchor end can determine the material display area and display size corresponding to the target image acquisition device according to the placeholder element.
[0094] In an optional embodiment, in order to prevent the placeholder elements in the streaming screen from affecting the live viewing experience of the audience users, the placeholder elements in this embodiment are invisible to the audience users. Specifically, the transparency of the placeholder element is a preset transparency, under which the audience users cannot see the placeholder element, for example, the preset transparency can be 100% (i.e., the opacity is 0); and / or, the placeholder element is located in a hidden independent layer, that is, the placeholder element is set in an independent layer, the independent layer only contains the placeholder element, and the layer attribute of the placeholder element is set to hidden, so that the audience users cannot see the placeholder element.
[0095] In an optional embodiment, when the placeholder element is not visible to the audience user, the anchor end cannot quickly and accurately determine the display position of the image of the subsequent target image acquisition device only through the push stream screen in the push stream canvas. To solve this technical problem, the placeholder element in this embodiment is located in an independent layer. For example, an independent placeholder layer can be set in the push stream canvas, in which only the placeholder element is rendered, and the placeholder layer is configured with differentiated display attributes, that is, different display attributes are displayed according to the different types of terminals. Specifically, when the end is the anchor end, the display attribute of the placeholder layer is visible, and when it is the audience end, the display attribute of the placeholder layer is invisible, so that the placeholder layer can be hidden from the audience end, but visible to the anchor end. As a result, the audience end cannot view the placeholder elements in the placeholder layer, which guarantees the user experience of the audience end; while the anchor end can view the placeholder elements, which is convenient for the anchor user to adjust the size, position and other parameters of the target image acquisition device.
[0096] Step S302, display the material setting page corresponding to the target image acquisition device, and obtain the setting parameters of the target image acquisition device from the material setting page, use the setting parameters to process the original image acquired by the target image acquisition device to obtain a corrected image, and display the corrected image in the preview component.
[0097] The preview component can be located in the material setting page, and the preview component is isolated from the streaming canvas. The preview component displays in real time the corrected image obtained by processing the original image acquired by the target image acquisition device with the matching setting parameters.
[0098] by Figure 4 For example, the streaming canvas 41 includes a placeholder element 411, and the material setting page 42 includes a preview component 421 and a parameter configuration area 422. The anchor user can configure parameters in the material setting page 42, such as configuring resolution, beauty parameters, special effect parameters, etc. The preview component 421 displays the corrected image corresponding to the target image acquisition device in real time. And when the anchor user adjusts the resolution and / or display position corresponding to the target image acquisition device in the material setting page 42, the placeholder element 42 in the streaming canvas 41 can be adjusted synchronously. Therefore, the anchor user can intuitively know the display position of the image corresponding to the target image acquisition device through the position and size of the placeholder element 411 in the streaming canvas 41, and can determine the display effect of the image corresponding to the current target image acquisition device in real time through the preview component 421.
[0099] Step S303, detecting that the material setting operation for the target image acquisition device is completed, opening the rendering channel of the target image acquisition device to the streaming screen, replacing the placeholder element with the corrected image to render the corrected image to the streaming screen.
[0100] Detects that the material setting operation for the target image acquisition device has been completed, such as detecting that the anchor user triggers Figure 4 After clicking the "OK" control as shown, the rendering channel from the target image acquisition device to the streaming screen is opened, the original image acquired by the target image acquisition device is obtained in real time, and the original image is processed using the setting parameters of the current target image acquisition device to obtain a corrected image, and then the placeholder element is replaced with the corrected image, so that the corrected image inherits the position, size and other parameters of the placeholder element, thereby improving rendering efficiency.
[0101] It can be seen that in the live broadcast method provided in the embodiment of the present application, after the target image acquisition device is added and before the host user completes the setting confirmation, a placeholder element is first rendered in the streaming screen. The placeholder element is unrelated to the captured image of the target image acquisition device, thereby not leaking the privacy of the host user, and ensuring the security of the host user's data during the target image acquisition device adding process; and the placeholder element in the streaming screen can facilitate the host user to configure the parameters of the target image acquisition device, and after the host user completes the setting confirmation, the placeholder element can be replaced with the corrected image of the target image acquisition device, thereby realizing fast switching from the placeholder element to the corrected image.
[0102] Embodiment 3
[0103] Figure 5The flowchart of a live broadcast method provided in the third embodiment of the present application is shown. The live broadcast method provided in the embodiment of the present application can be executed at the anchor end.
[0104] Specifically, if Figure 5 As shown, the method comprises the following steps:
[0105] Step S501: Detecting a material adding operation on a target image acquisition device during a live broadcast, and closing a rendering channel from the target image acquisition device to a streaming screen.
[0106] Step S502, display the material setting page corresponding to the target image acquisition device, and obtain the setting parameters of the target image acquisition device from the material setting page, use the setting parameters to process the original image acquired by the target image acquisition device to obtain a corrected image, and display the corrected image in the preview component.
[0107] The specific implementation process of step S501 and step S502 can refer to the description in other embodiments and will not be repeated here.
[0108] Step S503, determine whether the privacy mode is currently activated; if so, execute step S504; if not, execute step S505.
[0109] Among them, step S503 and step S502 can be executed sequentially or concurrently.
[0110] In an optional implementation, it can be determined whether the privacy mode is currently activated by combining one or more of the following methods:
[0111] Method 1: Provide the anchor user with a privacy mode configuration entry in advance, and the anchor user can turn on or off the privacy mode through corresponding operations. Therefore, when determining whether the privacy mode is currently activated, the anchor user's configuration data for the privacy mode can be queried. If the anchor user's privacy mode is in the activated state, it is determined that the privacy mode is activated, and step S504 is executed; if the anchor user's privacy mode is in the deactivated state, it is determined that the privacy mode is not activated, and step S505 is executed. In this way, it is possible to determine whether to activate the privacy mode according to the anchor user's user operation, thereby meeting the personalized needs of different anchor users.
[0112] Method 2: Obtain the original image captured by the target image acquisition device, and determine whether the original image contains risk elements; if so, determine to start the privacy mode, and then execute step S504; if not, determine not to start the privacy mode, and then execute step S505. Specifically, perform image recognition on the original image captured by the target image acquisition device to detect risk elements in the original image, and the risk elements include: human elements, and / or private item elements (such as express delivery slips and certificates containing detailed addresses), etc. By adopting this method, the privacy mode can be automatically started when there are risk elements in the original image, simplifying user operations and further reducing the risk of privacy leakage of anchor users.
[0113] Method three: Determine the privacy protection level of the anchor user according to the attribute data of the anchor user; if the privacy protection level exceeds the preset level, determine to start the privacy mode, and execute step S504; if the privacy protection level does not exceed the preset level, determine not to start the privacy mode, and execute step S505. Specifically, the privacy protection level of the anchor user can be determined in advance based on the anchor user's user tag and / or the frequency of privacy overlay effects (such as facial effects, body effects, etc.) used in history. For example, if the user tag is a good-looking anchor, a virtual anchor, etc., a higher privacy protection level is assigned to it; and the privacy protection level is positively correlated with the frequency of privacy overlay effects used by the anchor user in the recent historical period, so that the higher the frequency of privacy overlay effects recently used by the anchor user, the higher its privacy protection level.
[0114] It is also possible to generate the first type of privacy protection score of the anchor user based on the user tag, generate the second type of privacy protection score of the anchor user based on the frequency of the privacy coverage special effects used in history, determine the comprehensive privacy protection score of the anchor user based on the weighted sum of the first type of privacy protection score and the second type of privacy protection score, and then determine the final privacy protection level of the anchor user based on the mapping relationship between the comprehensive privacy protection score and the privacy protection level. Among them, when determining the first type of privacy protection score, a label score list can be generated in advance, and the score corresponding to different user tags can be recorded in the label score list, and the user tag of the anchor user can be obtained. The label score of each user tag of the anchor user is determined according to the label score list, and then the first type of privacy protection score is obtained according to the sum or average of the label score of the anchor user. When determining the second type of privacy protection score, the frequency of use of each privacy coverage special effect is counted respectively, and the second type of privacy protection score is obtained according to the frequency of use of each privacy coverage special effect and the weight of the privacy coverage special effect.
[0115] This method can automatically determine whether the privacy mode is currently turned on based on the existing data of the anchor user, simplifying user operations and ensuring the data security of the anchor user. In addition, there is no need to perform complex processing such as image recognition, which improves judgment efficiency.
[0116] Method 4: Obtain the original image captured by the target image acquisition device. If there are human elements in the original image, obtain the privacy protection score of the anchor user; if the privacy protection score is greater than the score threshold, determine to start the privacy mode, and execute step S504; if the privacy protection score is less than or equal to the score threshold, determine whether the number of human elements exceeds the preset number, if so, determine to start the privacy mode and execute step S504, otherwise determine not to start the privacy mode and execute step S505.
[0117] Among them, the privacy protection score includes the first type of privacy protection score, the second type of privacy protection score and / or the comprehensive privacy protection score. Specifically, if the privacy protection score is greater than the score threshold, it indicates that the anchor user has high privacy requirements, and the privacy mode is directly turned on; if the privacy protection score is less than or equal to the score threshold, it indicates that the anchor user has medium privacy requirements, and then it is determined whether the current character elements exceed the preset number. If it exceeds the preset number, it indicates that there are other people entering the country at present, and the privacy mode is turned on to protect the privacy of other people. If it does not exceed the preset number, it indicates that there are no other people in the camera at present, and the privacy mode is not started.
[0118] By adopting this method, it is possible to accurately determine whether the privacy mode needs to be automatically turned on at present, thereby improving the accuracy of determining the on / off state of the privacy mode.
[0119] It should be noted that the attribute data of the anchor user involved in the embodiments of the present application are all authorized or fully authorized by all parties, and the collection, use and processing of relevant data comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for the anchor user to choose to authorize or refuse.
[0120] Further, if there are risk elements in the original image, the risk elements are marked in the preview component, for example, the risk elements can be marked in the corrected image displayed by the preview component by highlighting, circling, etc., so as to facilitate the anchor user to process the risk elements, such as adjusting the camera position to avoid the risk elements, or moving the risk elements so that they no longer appear in the image. Alternatively, desensitization processing can be automatically added to the risk elements, such as blurring the risk elements, removing the image, etc.
[0121] Step S504 , detecting that the material setting operation for the target image acquisition device is completed, and opening the rendering channel from the target image acquisition device to the streaming screen.
[0122] If the privacy mode is currently started, the rendering channel from the target image acquisition device to the streaming screen will remain closed until it is detected that the material setting operation for the target image acquisition device is completed, and then the rendering channel from the target image acquisition device to the streaming screen will be opened, so that the image of the target image acquisition device will be rendered in the streaming screen.
[0123] Step S505, opening the rendering channel from the target image acquisition device to the streaming screen.
[0124] If the privacy mode is not currently activated, the rendering channel from the target image acquisition device to the streaming screen is closed, so that the image of the target image acquisition device is rendered in the streaming screen.
[0125] It can be seen that in the live broadcast method provided in the embodiment of the present application, after detecting the material addition operation for the target image acquisition device during the live broadcast process, the rendering channel from the target image acquisition device to the streaming screen is first closed to prevent the image captured by the target image acquisition device from flowing into the streaming channel; when it is determined that the privacy mode is not currently turned on, the rendering channel from the target image acquisition device to the streaming screen is opened again to achieve delayed rendering from the target image acquisition device to the streaming screen, thereby ensuring the privacy data security of the host end; when it is determined that the privacy mode is currently turned on, the rendering channel from the target image acquisition device to the streaming screen is opened again after the user confirms that the setting is completed, thereby further ensuring the privacy data security of the host end.
[0126] Embodiment 4
[0127] Figure 6 FIG. 1 shows a schematic diagram of the structure of a live broadcast device provided in Embodiment 4 of the present application. The live broadcast device is located at the host end. Figure 6 As shown, the device 600 includes: a processing module 610 and a display module 620 .
[0128] Processing module 610 is used to detect the material addition operation for the target image acquisition device during the live broadcast process, and close the rendering channel from the target image acquisition device to the push-stream screen; and detect the completion operation of the material setting for the target image acquisition device, and open the rendering channel from the target image acquisition device to the push-stream screen, so as to render the corrected image to the push-stream screen
[0129] The display module 620 is used to display the material setting page corresponding to the target image acquisition device, and obtain the setting parameters of the target image acquisition device from the material setting page, use the setting parameters to process the original image acquired by the target image acquisition device to obtain a corrected image, and display the corrected image in the preview component.
[0130] In an optional embodiment, the processing module 610 is used to: after closing the rendering channel from the target image acquisition device to the streaming screen, render the placeholder element of the target image acquisition device to the streaming screen; and after opening the rendering channel from the target image acquisition device to the streaming screen, replace the placeholder element with the corrected image.
[0131] In an optional implementation, the placeholder element is located in an independent placeholder layer, and the placeholder layer is hidden from the audience end and visible to the host end.
[0132] In an optional implementation, the processing module 610 is further used to: after detecting the material addition operation for the target image acquisition device during the live broadcast, closing the rendering channel from the target image acquisition device to the streaming screen, determine whether the privacy mode is currently started;
[0133] If yes, determine to start the privacy mode, and execute the step of detecting that the material setting operation for the target image acquisition device is completed, and opening the rendering channel of the target image acquisition device to the streaming screen;
[0134] If not, it is determined that the privacy mode is not started, and the rendering channel of the target image acquisition device to the streaming screen is opened.
[0135] In an optional implementation, the processing module 610 is used to: obtain an original image captured by the target image acquisition device;
[0136] Determining whether the original image contains risk elements;
[0137] If yes, then confirm to start the privacy mode;
[0138] If not, it is determined that the privacy mode is not activated.
[0139] In an optional implementation, the display module 620 is used to: if it is determined to start the privacy mode, mark the risk element in the preview component.
[0140] In an optional implementation, the processing module 610 is used to: determine the privacy protection level of the anchor user according to the attribute data of the anchor user;
[0141] If the privacy protection level exceeds the preset level, determining to start the privacy mode;
[0142] If the privacy protection level does not exceed the preset level, it is determined not to start the privacy mode.
[0143] It can be seen that in the live broadcast device provided in the embodiment of the present application, after executing the material adding operation of the target image acquisition device, the rendering channel from the target image acquisition device to the streaming screen is first closed. After the anchor completes the setting confirmation, the processed image of the target image acquisition device is rendered to the streaming screen, thereby avoiding the leakage of privacy data generated by the anchor when adding the image acquisition device, ensuring user data security, and improving the anchor user experience.
[0144] Embodiment 5
[0145] Figure 7 The schematic diagram of the structure of a computing device provided in Embodiment 5 of the present application is shown. The specific embodiments of the present application do not limit the specific implementation of the computing device.
[0146] like Figure 7 As shown, the computing device may include: a processor (processor) 702 , a communications interface (Communications Interface) 704 , a memory (memory) 706 , and a communication bus 708 .
[0147] The processor 702, the communication interface 704, and the memory 706 communicate with each other via the communication bus 708. The communication interface 704 is used to communicate with other devices such as a client or other server network elements. The processor 702 is used to execute the program 710, which can specifically execute the relevant steps in the above-mentioned live broadcast method embodiment for a computing device.
[0148] Specifically, the program 710 may include program codes, which include computer operation instructions.
[0149] The processor 702 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the computing device may be processors of the same type, such as one or more CPUs; or may be processors of different types, such as one or more CPUs and one or more ASICs.
[0150] The memory 706 is used to store the program 710. The memory 706 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. The program 710 may be specifically used to enable the processor 702 to perform the operations in the above method embodiment.
[0151] Embodiment 6
[0152] Embodiment 6 of the present application provides a non-volatile computer storage medium, wherein the computer storage medium stores at least one executable instruction or computer program, and the executable instruction or computer program enables a processor to execute operations corresponding to the live broadcast method in any of the above method embodiments.
[0153] Embodiment 7
[0154] Embodiment 7 of the present application provides a computer program product, which includes at least one executable instruction or computer program, and the executable instruction or computer program can enable a processor to execute operations corresponding to the live broadcast method in any of the above method embodiments.
[0155] To summarize, according to the computing device, computer storage medium and computer program product provided in this embodiment, after executing the material adding operation of the target image acquisition device, the rendering channel from the target image acquisition device to the streaming screen is first closed, and after the host completes the setting confirmation, the processed image of the target image acquisition device is rendered to the streaming screen, thereby avoiding the leakage of privacy data generated by the host when adding the image acquisition device, ensuring user data security, and improving the host user experience.
[0156] The algorithm or display provided here are not inherently related to any specific computer, virtual system or other equipment. Various general systems can also be used together with the teaching based on this. According to the above description, it is obvious to construct the structure required for this type of system. In addition, the present application embodiment is not directed to any specific programming language yet. It should be understood that various programming languages can be utilized to realize the content of the present application described here, and the above description of specific languages is to disclose the best mode of implementation of the present application.
[0157] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.
[0158] Similarly, it should be understood that in order to streamline the present application and help understand one or more of the various inventive aspects, in the above description of the exemplary embodiments of the present application, the various features of the embodiments of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting the following intention: the claimed application requires more features than the features clearly stated in each claim. More specifically, as reflected in the claims below, the inventive aspects are less than all the features of the single embodiment disclosed above. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present application.
[0159] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.
[0160] In addition, those skilled in the art will appreciate that, although some embodiments herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present application and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.
[0161] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components according to the embodiments of the present application. The application can also be implemented as a device or apparatus program (e.g., computer program and computer program product) for executing a part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
[0162] It should be noted that the above embodiments illustrate the present application rather than limit the present application, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be constructed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of multiple such elements. The present application may be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim that lists several devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.
Claims
1. A live broadcast method, characterized in that: include: When a material adding operation is detected for a target image acquisition device during a live broadcast, a rendering channel from the target image acquisition device to a streaming screen is closed; Displaying a material setting page corresponding to the target image acquisition device, and obtaining setting parameters of the target image acquisition device from the material setting page, processing the original image acquired by the target image acquisition device using the setting parameters to obtain a corrected image, and displaying the corrected image in a preview component; It is detected that the material setting operation for the target image acquisition device is completed, and a rendering channel from the target image acquisition device to the streaming screen is opened to render the corrected image to the streaming screen.
2. The method according to claim 1, characterized in that After closing the rendering channel from the target image acquisition device to the streaming screen, the method further includes: rendering a placeholder element of the target image acquisition device to the streaming screen; The rendering of the corrected image to the streaming screen includes: replacing the placeholder element with the corrected image.
3. The method according to claim 2, characterized in that The placeholder element is located in an independent placeholder layer, and the placeholder layer is hidden from the audience end and visible to the host end.
4. The method according to any one of claims 1 to 3, characterized in that After detecting a material adding operation for a target image acquisition device during a live broadcast and closing a rendering channel from the target image acquisition device to a streaming screen, the method further includes: Determine whether the privacy mode is currently enabled; If yes, determine to start the privacy mode, and execute the step of detecting that the material setting operation for the target image acquisition device is completed, and opening the rendering channel of the target image acquisition device to the streaming screen; If not, it is determined that the privacy mode is not started, and the rendering channel of the target image acquisition device to the streaming screen is opened.
5. The method according to claim 4, characterized in that The determining whether the privacy mode is currently activated includes: Acquire the original image captured by the target image acquisition device; Determining whether the original image contains risk elements; If yes, then confirm to start the privacy mode; If not, it is determined that the privacy mode is not activated.
6. The method according to claim 5, characterized in that If it is determined to start the privacy mode, the method further includes: The risk element is marked in the preview component.
7. The method according to claim 4, characterized in that The determining whether the privacy mode is currently activated includes: Determining a privacy protection level of the anchor user according to the attribute data of the anchor user; If the privacy protection level exceeds the preset level, determining to start the privacy mode; If the privacy protection level does not exceed the preset level, it is determined not to start the privacy mode.
8. A live broadcast device, characterized in that: include: A processing module, used for detecting a material adding operation for a target image acquisition device during a live broadcast, and closing a rendering channel from the target image acquisition device to a streaming screen; and detecting that the material setting operation for the target image acquisition device is completed, opening a rendering channel from the target image acquisition device to a streaming screen, so as to render the corrected image to the streaming screen; A display module is used to display the material setting page corresponding to the target image acquisition device, and obtain the setting parameters of the target image acquisition device from the material setting page, use the setting parameters to process the original image acquired by the target image acquisition device to obtain a corrected image, and display the corrected image in the preview component.
9. A computing device, characterized in that include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the live broadcast method as described in any one of claims 1-7.
10. A computer storage medium, characterized in that: The storage medium stores at least one executable instruction, and the executable instruction enables the processor to execute an operation corresponding to the live broadcast method as described in any one of claims 1-7.
11. A computer program product, characterized in that It includes at least one executable instruction, and the executable instruction enables the processor to execute the operation corresponding to the live broadcast method as described in any one of claims 1-7.